Junior data engineer

Digital, Data and Technology (DDaT) is committed to creating an inclusive working environment. We welcome and encourage applications from candidates who are seeking flexible working arrangements, including part time working, job share or carers and career break returners. We also support blended working, and the hiring manager will be happy to discuss arrangements for this role.

The Commissioner and Management Board have determined that the Met will be a data driven organisation. This means treating our data in the same way we treat our people, methods and technology, as a strategic asset.

The Data Office is the single place of accountability across the Met that:

• owns and drives the data compliance and analytics agenda
• brings together the accountabilities that are currently dispersed across the Met business areas
• consolidates and further develops existing Met data and insight services
• enables data sharing and collaboration to serve the public and external partners

Job purpose

A junior data engineer provides ETL (Extract, Transform and Load) capability on Met data systems to deliver high-quality data, including automation, for onward processing and consumption.

On occasion, junior data engineers may be asked to work overtime at weekends and evenings in support of operational policing.

Key role responsibilities

• Assisting in the design, development, and maintenance of robust, scalable data pipelines to ensure efficient data flow from various sources to our data warehouses and analytics platforms.
• Working on integrating data from multiple internal and external sources, ensuring data quality, consistency, and reliability throughout the process.
• Supporting the administration and optimization of databases, including tasks such as indexing, partitioning, and query optimization to enhance performance.
• Developing and managing ETL (Extract, Transform, Load) processes to prepare data for analysis and reporting, ensuring that data is transformed correctly and loaded into the appropriate systems.
• Continuously improving your technical skills and knowledge by staying updated with the latest industry trends, tools, and technologies, and applying this knowledge to your work.
• Supporting implementing data validation and cleansing procedures to maintain high data quality and adhering to data governance policies and standards.
• Collaborating with data analysts, data scientists, and other stakeholders to understand their data needs and provide the necessary support, including troubleshooting and resolving data-related issues.
• Creating and maintaining detailed documentation of data processes, workflows, and systems, and generating reports to provide insights into data operations and performance.

Vetting

This post requires access to the most sensitive intelligence material on a daily basis. Applicants must hold or be prepared to undergo National Security Vetting (NSV) Security Check (enhanced) (SC(e)) level before taking up the post. You must also have a willingness to undergo Developed Vetting (DV) once in post, if required.

Additionally, this material is of particular sensitivity to the UK and its distribution must be restricted to UK nationals. In approved circumstances dual nationals (of which one element is British) may also be granted access. However, in the event that potential conflicts of interest cannot be managed the post holder will not be able to see the intelligence material and will not be able to perform their duties. For the purpose of safeguarding national security and in line with Cabinet Office Policy, supported by Section 82(2) to (4) of the Police Reform Act (2002), applicants who do not hold or acquire Security Check (enhanced) (SC(e)) OR Developed Vetting (DV) clearance and meet the nationality requirements cannot be offered the post.