Job description
| Senior Data Engineer (Python / Databricks) Start: ASAP Duration: 8-9 months Location: travel into London once per month Job: The Senior Data Engineer will be heavily involved in the technical implementation of a new heath care data eco-system to drive improved decision making and insight. This role is responsible for designing, developing, implementing, and maintaining high performing and secure data solutions for the business. Candidates must have at least 2 years of health care experience (ideally NHS) Essential Experience: - Building data pipelines in Azure - Strong expertise in Spark - Strong experience with managing ETL pipelines on Databricks platform. - Data modelling and data analysis - Knowledge of data structures and architecture - Expert in relational databases and warehousing - Advanced SQL and Python - CI/CD, DevOps, Agile Preferred Experience: - Knowledge of Lakehouse architecture and Delta Lake - Azure data factory, ADLS, Power BI - ERP System experience (SAP S/4) |
