Data Engineer

Posted 03 October 2021
Salary80-90
LocationLondon
Job type Contract
DisciplineSoftware Engineering
Reference47833
Contact NameCallum Gough-Mackay
Remote working Hybrid/Flexible

Job description

If your programming skills are matched by an enthusiasm for problem-solving, and your communication skills are as creative as your coding, there’s a digital revolution underway in the UK that could use your help.

Our Financial Services business unit is looking to add talented Data Engineers with strong Scala programming skills to work on a programme of work with one of our key Investment Banking clients.
From public service transformation to cutting-edge commercial projects, our work has a wide reach, helping make the everyday easier, for everyone. 

Your future duties and responsibilities

You will be joining a team striving for the highest quality architecture, design and code to develop an extremely challenging big data solution in Banking. You will help to build the bank’s surveillance systems, working in a fast-paced, agile environment. Your workload for new deliveries will be high. The team uses, Scala/Spark for services, Hadoop Big Data and SQL for data analysis in an agile setup working with global distributed teams. If successful, senior data engineers will play a key role in developing our advanced analytics practice working on some of the most exciting data analytics projects in the market. 

Required qualifications to be successful in this role

• Senior Software Engineering skills in Scala, Python Or Spark
• Experience working with very large datasets using Spark is essential. Other Big Data technologies such as Impala and Hive are also desirable. 
• A good understanding of Hadoop functioning & infrastructure is desirable
• Experience with integration of data from multiple data sources
• Experience with workflow/orchestration tools (e.g. Oozie, Control-m, UWQ)
• Excellent technical leadership, teamwork and communication skills, and working with local and remote teams. A can do attitude is essential to succeed in this role.
• Desire to write robust, maintainable & re-usable code

Other desirable skills and experience:

• Experience in other programming languages, specifically Python would be helpful but not essential
• Experience with Machine Learning Big Data technologies 
• Working understanding of Cloud deployment & migration
• BDD, particularly experience of how it can be used to define requirements in a collaborative manner, ensure that the team builds the right thing and create a system of living documentation