Job description
Job Title: Data Engineer
Location: London (Hybrid)
Salary: £75,000
About the role:
You will be joining a team striving for the highest quality architecture, design and code to develop an extremely challenging big data solution in Banking. You will help to build the bank’s surveillance systems, working in a fast-paced, agile environment.
Your workload for new deliveries will be high and the team uses, Spark for services, Hadoop Big Data and SQL for data analysis in an agile setup working with global distributed teams. If successful, you will play a key role in developing our advanced analytics practice working on some of the most exciting data analytics projects in the market.
• Strong knowledge of SQL and advanced data analysis
• Desire to write robust, maintainable & re-usable code
• Practical experience of TDD and constant refactoring in continuous integration environment.
• Practical experience of delivering good quality code within enterprise scale development (CI/CD)
• Experience leading an agile team, practicing Scrum, Kanban or XP
Required qualifications to be successful in this role:
• Senior Software Engineering skills in python is essential
• Pyspark is highly desirable!
• Experience working with very large datasets using Spark is essential. Other Big Data technologies such as Impala and Hive are also desirable
• A good understanding of Hadoop functioning & infrastructure is desirable
• Experience with integration of data from multiple data sources
• Experience with workflow/orchestration tools (e.g. Oozie, Control-m, UWQ)
• Excellent technical leadership, teamwork and communication skills, and working with local and remote teams. A can do attitude is essential to succeed in this role.
• Desire to write robust, maintainable & re-usable code
• Practical experience of TDD and constant refactoring in continuous integration environment.
• Practical experience of delivering good quality code within enterprise scale development (CI/CD)
• Experience or working with an Agile environment
Location: London (Hybrid)
Salary: £75,000
About the role:
You will be joining a team striving for the highest quality architecture, design and code to develop an extremely challenging big data solution in Banking. You will help to build the bank’s surveillance systems, working in a fast-paced, agile environment.
Your workload for new deliveries will be high and the team uses, Spark for services, Hadoop Big Data and SQL for data analysis in an agile setup working with global distributed teams. If successful, you will play a key role in developing our advanced analytics practice working on some of the most exciting data analytics projects in the market.
• Strong knowledge of SQL and advanced data analysis
• Desire to write robust, maintainable & re-usable code
• Practical experience of TDD and constant refactoring in continuous integration environment.
• Practical experience of delivering good quality code within enterprise scale development (CI/CD)
• Experience leading an agile team, practicing Scrum, Kanban or XP
Required qualifications to be successful in this role:
• Senior Software Engineering skills in python is essential
• Pyspark is highly desirable!
• Experience working with very large datasets using Spark is essential. Other Big Data technologies such as Impala and Hive are also desirable
• A good understanding of Hadoop functioning & infrastructure is desirable
• Experience with integration of data from multiple data sources
• Experience with workflow/orchestration tools (e.g. Oozie, Control-m, UWQ)
• Excellent technical leadership, teamwork and communication skills, and working with local and remote teams. A can do attitude is essential to succeed in this role.
• Desire to write robust, maintainable & re-usable code
• Practical experience of TDD and constant refactoring in continuous integration environment.
• Practical experience of delivering good quality code within enterprise scale development (CI/CD)
• Experience or working with an Agile environment