Lead Data Engineer Job at HMRC

Lead Data Engineer Job at HMRC – There is an exciting opportunity to join a growing and fast paced delivery team within HMRC’s Data Platform Service Delivery Group as a Lead Data Engineer. 

The Data Platform Services Group is building an engineering capability to help run, maintain, and evolve its strategic Data Analytics platforms and services.

The Lead Data Engineer will take part in managing the Delivery Groups technical platforms, data exploitation tools, and data ingestion and transformation activities.

The Lead Data Engineer will also support Scrum-based cross-functional Data Studio teams delivering data exploitation work packages.

Deep technical expertise, demonstrable desire to stay ahead of technology trends and real teamwork ethos are key aspects we’re looking for in candidates. 

Person specification

As part of the Engineering team, you will be responsible for the running, maintenance and evolution of the Delivery Group’s strategic Data Analytics platforms and services.

• Manage and administer the key components of our analytics platforms, including monitoring, alerting, capacity management, investigation and resolution of technical issues.
• Manage and administer a range of data exploitation tools.
• Build, run, and manage data ingestion and transformation feeds.
• Manage and administer the security components of our analytics platforms, as necessary.
• Support DevOps-enabled project teams delivering data exploitation work
• Implement preventative and corrective maintenance activities on platforms, tools, and data jobs/batches
• Provide batch monitoring and support
• Provide support to self-serve Data Analytics users through Data Clinics, as appropriate.
• This role may require the successful candidate to provide support outside of normal working hours and taking part in On Call rotas.
• Limited travel may also be required as part of this role to work in a geographically distributed Delivery Group as well as engage with customers and suppliers.

Essential Criteria:

Experience of implementing and supporting a range of data analytics solutions and platforms, covering data modelling, ETL/ELT, reporting, dash-boarding, complex analytical models/tool.  In addition, as this is a leadership role, proven experience in leading a team is required.

• A demonstrable background in one or more of the following three areas:

Area 1.

Experience of data management technologies and approaches, including some or all of the following: Hadoop (Cloudera), NoSQL databases, relational databases, data warehousing, marts, universes, cubes, virtualization with Denodo.

Area 2.

Experience of data quality, ingestion, and transformation tools, including some or all of the following: Pentaho DI, Talend Data Fabric, SAP BODS, SAS.

Area 3.

Experience of data exploitation tools, including some or all of the following: Pentaho BA, SAS, SAP BI products, Red Hat BRMS, PowerBI.

• Knowledge of security approaches and tools.
• A clear understanding of Agile and Continuous Integration environments
• Experience communicating and supporting business users 

Desirable Criteria:

• A cloud (AWS/Azure) delivery background.
• Knowledge in the following:  EMR, Lambda, S3, RDS, EC2, EBS, EFS, Neptune,VPC (network layer), APIs, Terraform, Cloudwatch, IAM, KMS