Data Engineer

Application Deadline: 18 October 2024

Department: Digital Services

Location: Derby / London

Description

About us

Our mission is to provide high-quality, digitally-enabled rolling stock solutions that help deliver a safe, efficient and sustainable railway

Since 1996, our investments have totaled over £3bn, including the commissioning of over 2,500 new passenger and freight vehicles. We plan to invest over £1bn into UK rail in the coming years to deliver high quality new and refurbished vehicles for passengers and freight customers

But financing new trains is not the end-game. Our asset stewardship role includes management of assets to ensure performance, safety and long-term suitability over their full economic life

About The Team

The successful candidate will be joining the Fleet function, a small multi-disciplinary team that supports corporate and project governance, risk management and audits of Train Operating Companies, suppliers and internal Porterbrook processes. The team is part of the Operations Directorate reporting to the Chief Operating Officer

Key Responsibilities

Role Purpose

This role will support the delivery and development of the Porterbrook Digital Portfolio. Taking advantage of the Porterbrook unified data platform and working with the team you would have overall responsibility for managing and maintaining existing data pipelines, monitoring of workloads, root cause analysis, data quality monitoring and escalation of technical issues to Product Owner

Responsibilities

• Monitoring and recovery of Azure Data Factory and Databricks jobs
• Proactive monitoring of data quality
• Becoming a subject matter expert on understanding Porterbrook's data sources, ingestion methods and data quality levels
• Assisting in developing and adhering to associated data governance policies and internal processes
• Working closely with the wider team to understand the business needs and improve data quality
• Develop and maintain digital services data quality KPIs
• Maintaining and monitoring of user facing dashboards and other internal Digital products
• Updating and patching of existing Digital software products
• Documenting root cause analysis outputs
  
  

General Requirements

Skills, Knowledge and Expertise

• Microsoft Azure Experience (essential)
• Knowledge of Azure data components such as Azure Data Factory, Azure SQL DB, Azure Data Lake, etc
• Strong Python and SQL skills for manipulating data
• Apache Spark and/or Databricks experience
• Experience using BI visualisation tools, such as Power BI
• Experience in managing end-to-end analytics pipelines (batch and streaming) suitable for data science workload consumption
• Experience in root-cause analysis and post-incident reporting in a production environment
  
  

Knowledge And Qualifications

• A relevant degree in Computer Science, Engineering, and/or relevant certificates including, Azure Data Engineer Associate are desirable
• Knowledge of railway industry rolling stock, organisation and players
• Data ingestion methods for real-time and batch ingestion
• PySpark
• Debugging Apache Spark workloads
• Experience using BI visualisation tools, such as Power BI
  
  

Key Skills

• Interpersonal skills
• Report writing, presentation and record keeping skills
• Excellent communication and stakeholder management
  
  

A great place to work

We are seeking the very best talent to join the team, and offer an excellent salary, along with bonus and benefits

This is a fantastic opportunity to join a great organisation with excellent people and a road map for the future to grow and develop the business. Some of our benefits are listed below:

• Excellent pension scheme
• Financial wellbeing support
• Flexible working
• Enhanced family friendly policies
• Adoption & Shared Parental Leave benefits
• Enhanced Armed Forces policies
• Ongoing support with professional and personal development
• Long service awards
• Porterbrook Star awards
• Life assurance
• Healthcare cash plan
• 25 days' annual leave + Bank Holidays + option to buy and sell up to 5 days' additional leave
• Additional days annual leave for long service
• Season ticket loan
• Cycle to work scheme
• Free parking at our Derby and Long Marston sites
  
  

Should you be suitable for the role, the full benefits package will be discussed in more detail during your screening call

To apply

Please follow the link at the top of this page to send your CV and a covering email with full details of why you would be a great addition to the Porterbrook team, along with details of your current salary and notice period

If you have a disability or need any reasonable adjustments during the application and selection stages, please let us know. We're committed to building an inclusive culture where everyone can develop to their full potential

This vacancy may close at any time once sufficient applications have been received. Early submission of your application is therefore encouraged

Please note we are not accepting approaches from recruitment agencies for this role