Databricks Data Engineer

Posted 01 March 2024
Salary Competitive
Job type Permanent
Discipline Software Engineering
Contact NameTaylor Claxton
Remote working Remote

Job description

Databricks Data Engineer

Skills: Data Engineering, ETL Pipelines, Databricks

My client seeks a Databricks Data Engineer to lead the design, development, and implementation of secure and high-performing data solutions. The position is part of the Data and Analytics team and will play a vital role in building our Data Engineer capability. As a Data Engineer, you will be responsible for developing and implementing a new cloud-based healthcare data platform. This platform will provide a single version of the truth, enabling better decision-making and insights across all business functions. You will work as part of a team of Data & Analytics professionals and manage the consolidation and migration of our legacy data to the new platform.

The ideal candidate should have strong experience in data engineering, specifically with Databricks and building data pipelines on Azure cloud platforms. They should possess in-depth knowledge of data modelling and analysis, be able to explain complex models in clear language to technical and business stakeholders, and have experience in one or more functional areas across Clinical, Finance, Procurement, Operations, HR, Risk, or general NHS/healthcare.

The candidate should also be well-versed in data structures and architecture, have advanced SQL and Python skills, and be familiar with working in CICD, DevOps, and agile delivery environments. Additionally, they should understand the sensitive nature of healthcare data and have knowledge of how to ensure robust security measures are in place to protect patient confidentiality in line with various regulations.

You will ideally have a Pharmaceutical or Healthcare background to understand the technicality and complexity of the data.