Data Engineer - Microsoft Fabric

Simpson Associates transforms raw data into actionable insights that drive positive change.

Our Microsoft data expertise, our specialist sector knowledge, plus our innovative and trusted advice and guidance are just some of the reasons clients choose to work with us.

Our mission is to help purpose-led organisations from within the public and private sectors to harness data as a lever for change and enable them to realise business value more quickly. We provide the full range of services to support organisations on their data transformation journey. From advisory support and data strategy, to developing Data & AI solutions, right through to providing a range of managed services.

We are a Microsoft Solutions Partner, holding Specialisations in AI Platform on Microsoft Azure, Analytics on Microsoft Azure, Data Warehouse Migration to Microsoft Azure and Migrate Enterprise Applications to Microsoft Azure, as well as holding Solutions Partner designations in Data & AI (Azure); Digital & App Innovation (Azure); Infrastructure (Azure) and Security. But it's not just about the badges. We are proud to be recognised as the winner of the 2024 Microsoft Community Response Partner of the Year award, reflecting our dedication to using technology for positive change.

We are also a Databricks partner, and an IBM Gold Partner, specialising in Cognos Analytics and Planning Analytics. With offices in York and Sheffield, and a team based throughout the UK – we champion creativity, innovation and collaboration in the workplace.

Join our UK consulting team as an experienced Data Engineer specialising in Spark based data platforms such as Microsoft Fabric or Databricks.

Role

This remote role offers the opportunity to design and deliver integrated analytics solutions using Microsoft Fabric’s cutting-edge Spark ecosystems, including Lakehouse, Data Pipelines, and Power BI. You’ll collaborate closely with our agile delivery team, contributing to technical backlogs, participating in daily stand-ups, and engaging directly with clients to deliver scalable, high-quality data solutions.

Key Responsibilities

• Build and maintain data pipelines, lakes, and warehouses using Fabric and/or Databricks components.
• Implement ETL/ELT processes, data modelling, and analytics workflows to support BI and AI initiatives.
• Serve as a technical expert in the field of data engineering, recognised by both internal teams and customers.
• Provide advanced support across the business through deep expertise in data engineering practices.
• Act as a go-to resource for complex and modern architectural and implementation challenges.
• Deliver high-quality solutions aligned with the latest data engineering methodologies and technologies.
• Contribute to the design and execution of key data functions that drive business and customer success.
• Collaborate with cross-functional teams to prioritise and execute technical backlog items.
• Participate in agile ceremonies including stand-ups, sprint reviews, and customer demos.
• Troubleshoot data issues, optimise performance, and ensure data accuracy and reliability.
• Document architectures, pipelines, and operational procedures for team knowledge sharing.

Required Skills & Experience

• Expertise in Microsoft Fabric specific features: OneLake, Dataflows, Pipelines, and Power BI integration (inc. DirectLake).
• Or Expertise in Databricks features: Autoloader etc.
• Strong programming skills in PySpark, Python, and SQL.
• Familiarity with Azure cloud services and DevOps tools (Git, CI/CD pipelines).
• Proven experience in agile methodologies and backlog management tools (Jira, Azure DevOps Boards).
• Advanced SQL / SparkSQL skills for querying, modelling, and integration.

Nice to have

• 3+ years in Data Engineering, with at least 12 months of hands-on experience in Microsoft Fabric or Databricks.

Qualifications

• Microsoft certifications such as Fabric Analytics Engineer Associate or Azure Data Engineer Associate (preferred).
• Databricks Certifications
• Reasonable proficiency in English for effective technical and client communication.

Soft Skills

• Strong problem-solving and attention to detail.
• Excellent collaboration and communication abilities.
• Adaptability to fast-paced, agile team environments.
• Proactive mindset with a focus on continuous improvement and value delivery.

The successful candidate will be required to obtain Security Clearance and NPPV Level 3.