Lead Data Engineer

We have an exciting opportunity for a Lead Data Engineer to join our fast-growing team and support us to build the next generation of data infrastructure that will power our growth. As Lead Data Engineer, you will lead the development of data pipelines across NHS Professionals (NHSP) with your extensive experience architecting enterprise data solutions on Azure cloud platform and SSIS. You can demonstrate deep expertise in designing and implementing ETL pipelines using Azure services (Synapse Analytics, Data Factory, Data bricks and SQL Database) and SSIS package development, while having a proven track record of leading teams, migrating legacy systems to cloud, implementing data governance, and optimizing costs.

You have high proficiency in SQL, Python, Spark, and SSIS scripting, along with 6+ years of hands-on data engineering experience. Key responsibilities include architecting Azure-based data solutions, optimizing ETL processes, leading platform modernization initiatives, establishing data governance standards, managing cloud infrastructure costs, and mentoring junior engineers. The role demands strong leadership skills to drive best practices in data modelling, CI/CD implementation, and collaboration with stakeholders on technical requirements.

In this role, you'll regularly interact with senior leadership, requiring both deep technical knowledge and polished communication skills. Your ability to translate complex technical challenges into clear, accessible explanations will be crucial for effective decision-making and stakeholder alignment.

If you know you have the above experience and make an impact, we would love to hear from you!

• Bachelor’s degree in computing science, Mathematics, Engineering or similar subjects, with relevant certification in Azure services.
• Expert-level data development with ability to establish enterprise-scale data integration procedures and standards across an organization.
• Superior capabilities of data modelling including cross-industry standardization and metadata management.
• Advanced data analysis capabilities including complex source system analysis and data synthesis.
• Proficient in programming, testing, and building data engineering solutions using agreed standards and tools (for example, SQL, Python, Azure Synapse Analytics, ADF, Data bricks, Data Lake Storage, Purview, Azure DevOps, Power BI, SSIS, SSRS).
• Demonstrated data innovation experience with focus on identifying and adopting new tools and techniques.
• Thorough understanding of technical concepts with ability to explain how they fit into wider technical landscape.
• Experience in establishing and maintaining data standards while keeping abreast of best practices.
• Strong problem management skills with focus on investigation, resolution and preventive measures.
• Strong stakeholder management with proven ability to communicate effectively between technical and non-technical audiences.
• Proven ability to manage resources and ensure effective enterprise data services delivery.
  
  
  

In return for your commitment, we will offer you some fantastic benefits:

• Generous annual leave allowance - 27 days per year, plus bank holidays
• A commitment to talent management & development
• Star of the Month! - Our star of the month award enables you to recognise colleagues or teams that have gone the extra mile and they could win £100 worth of shopping vouchers
• Pension - We’ll contribute up to 10% towards your pension if you join our stakeholder pension scheme
• Life Assurance
• Group Income Protection
• Wellbeing Programme
• Employee Assistance Programme
• Employee Engagement & discounts platform
  
  
  

About Us:

NHS Professionals (NHSP) run the largest NHS flexible staff bank, placing highly skilled temporary workers in NHS Trusts to meet their short, medium and long-term needs. Uniquely we are owned by the Department of Health and Social Care and we therefore reinvest any surplus we make directly back into the NHS.

We are particularly proud of being the first NHS organisation to gain the accreditation of Top Employer by the Top Employers Institute. This is a huge testament to our ongoing commitment to making NHSP a great place to work for all our corporate employees.