Job description
| HADOOP BIG DATA DEVELOPER Start: ASAP Duration: initial 6-months Location: Hybrid, once per week in Windsor Rate: inside IR35, paying up to £425 per day. Responsibilities: - Assess existing big data infrastructure - Design and code Hadoop applications - Create processing frameworks - Extract and isolate data clusters - Test scripts to analyse results Skills required: - Build and maintain data pipelines. Expertise in PySpark, Spark SQL, Hive, Python, Kafka - Data collection, integration, scheduling, data storage and management, ETL processes - Relational and non-relational databases (MySQL, PostgreSQL, MongoDB) |
