Senior Data Engineer - Systems Integrator
1513231
Posted: 23/07/2024
- Day Rate: €600-€800
- City of London
- Contract
- 600
- 800
- Contract
- Infrastructure and Cloud Contract
We are excited to announce an opening for a Senior Data Engineer, offering a fully remote position exclusively within Europe. This is an excellent opportunity to join a dynamic team working on a large-scale infrastructure project for a prestigious EU Institution.
The role offers a long-term contract, initially spanning 6-12 months with the potential for 12-month extensions.
If you are interested in this opportunity,, we encourage you to apply today!
Responsibilities:
- Design, support, and implement scalable data architectures using Lakehouse technologies, relational databases, No-SQL, and streaming scenarios on Kubernetes.
- Establish and contribute to best practices for data management.
- Develop data pipelines and enhance existing Python/Pyspark frameworks.
- Customize tools like Airflow and Spark.
- Provide training and support for business users.
- Extend the data ecosystem with tools like data catalogs and BI tools (e.g., Apache Superset).
- Possible on-call duties.
Skills & Experience:
- Proficiency with Lakehouse technologies (Spark, Python, Apache Iceberg, S3).
- Experience with data management and data modeling in scalable architectures.
- Knowledge of data pipeline orchestration with Apache Airflow.
- Understanding of the software development lifecycle, preferably with GitHub.
- Familiarity with data catalogs and metadata.
- Proficiency in Kubernetes, Docker, and related tooling.
- Excellent English skills.
Salary & Benefits:
- Fully remote position within Europe.
- Long-term contract with the possibility of freelance or permanent roles.
- Day Rate: €600-€800
George McDonnell
Network Consultant (Contract)