Senior Data Engineer
Employment Type: Full time
Contract Type: Permanent
Hours Per Week: 37.5
Salary: Competitive salary plus benefits
Category: Data Science
Closing Date: 20 June 2024
Asda’s Data & Analytics team is at the cutting edge of driving transformative, data-driven decisions across the organisation. We cultivate a high-performance, innovative environment where team members are challenged to push the boundaries of technology and data science. We are developing an industry leading data platform as part of the largest retail data transformation in Europe, which we will use to address some of the most complex data challenges in the industry, developing sophisticated solutions that revolutionize our business operations and elevate customer experiences. We seek the best of the best—professionals who thrive in a fast-paced, dynamic setting and are driven to deliver groundbreaking insights that propel Asda’s strategic initiatives and create lasting impact for Colleagues & Customers
We are looking for an Azure Senior Engineer to join our Data Insights and Analytics team. The role will be responsible for building new data pipelines and optimizing data flows using the Azure cloud stack.
The ideal candidate will be an experienced data pipeline builder and data wrangler who enjoys building data products from scratch. The data engineer will need to support Business Analysts and Data Architects with discovery and best practices. The successful candidate must be self-directed and comfortable supporting the data needs of multiple teams, systems and products.
The ideal candidate will be an experienced data pipeline engineer and data specialist who enjoys building data products from scratch as most of the projects will be Greenfield.
- Proficient with Azure Data Services such as Azure Data Lake Storage, Azure Databricks, Azure Synapse Analytics, and Azure Data Factory for efficient data ingestion, processing, storage, and analytics workflows.
- Experienced in building and optimizing ‘big data' data pipelines, architectures and data sets using PySpark and SparkSQL.
- Experienced in building, deploying, sharing, and maintaining enterprise-grade data solutions with Databricks
- Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis.
- Strong analytic skills related to working with unstructured datasets.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- Experience with Object-oriented/ object function scripting languages: Python preferred.
- Excellent communication skills and the ability to collaborate effectively with cross-functional teams in a fast-paced environment
- Experience of coaching, mentoring and providing technical guidance to junior colleagues.
Work Where it Works
Our hybrid way of working gives you the choice to work where it works. This enables you to chose where you’ll be the most effective. It offers a mix of working from home and in an office environment that works best for you and your team.
You will also get an excellent benefits package including; -
- Discretionary company bonus
- £5,700 company car or car allowance
- Company pension up to 7% matched
- 10% colleague discount, free parking and many additional rewards.
We want all colleagues to be able to bring their best and true selves to work, every day. Simply put, we want our colleagues to be Proud to be Asda and proud to be themselves
We are proud supporters of Women in Data®. Connect, engage and belong to the largest free female data community in the UK – visit: www.womenindata.co.uk to join our community.