Excellent opportunity for an experienced Data Engineer looking for a fully remote role, ideally you will have at least 5 years experience.
You will need to be eligible for SC Clearance for this role
Data Engineer
Location - Fully Remote - occasional site visits to London
Salary - £80,000 - £84,000
Key Skills:
- Data Engineering: ETL pipeline design, implementation, and debugging
- Programming: Python, PySpark, SQL
- Big Data & Workflow: Apache Spark, Airflow
- Cloud Services: AWS (API Gateway, Lambda, Redshift, Glue, CloudWatch)
- Infrastructure as Code: Terraform
- CI/CD: GitHub Actions
Key Experience
- At least 8 years of hands on experience in data engineering projects
- Good hands on experience of designing, implementing, debugging ETL pipeline
- Expertise in Python, pySpark and SQL languages in must
- Expertise with Spark and Airflow
- Experience of designing data pipeline using cloud native services on AWS
- Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue, Cloudwatch, etc.
- Iac experience of deploying AWS resources using terraform