Skills

Python SQL Apache Airflow GitHub CI/CD Decision-making Programming apache AWS Analytics Spark CI/CD Pipelines PySpark Terraform GitHub Actions

Job Specifications

Data Engineer – AWS | PySpark | SQL | Lambda

London / Remote

Contract | £300/day | Outside IR35

About the Role

We are seeking a talented and driven Data Engineer to join a forward-thinking organisation where data sits at the heart of decision-making. You will design and build scalable, high-performance data pipelines that power analytics and business insights across the company.

This is an exciting opportunity to work with modern cloud technologies, contribute to mission-critical systems, and make a real impact in a fast-paced, collaborative environment.

What You’ll Be Doing

Designing and implementing robust ETL pipelines to move and transform data at scale
Building cloud-native solutions on AWS to ensure reliability and performance
Working with PySpark, Python, and SQL to process large datasets efficiently
Orchestrating workflows using Apache Airflow
Leveraging AWS services such as S3, RDS, Redshift, and Lambda
Deploying infrastructure using Terraform and Infrastructure-as-Code best practices
Automating releases through CI/CD pipelines with GitHub Actions
Collaborating closely with engineering and analytics teams to deliver high-quality solutions

Required Skills

Strong experience with PySpark and AWS
Proven background building and maintaining ETL pipelines
Solid programming ability in Python, SQL, and Spark
Hands-on experience with Apache Airflow
Deep understanding of AWS data services
Terraform for cloud deployments
CI/CD workflow experience using GitHub Actions

About the Company

Welcome to Athsai, For Technical and Automotive sector Hiring Our Journey: Athsai emerged from a shared vision to bridge the gap between exceptional tech professionals and companies on the cutting edge of innovation. We recognised that the most ground breaking solutions arise when diverse minds collaborate, and that’s where our journey began. Our Mission: Our mission is simple yet transformative: To propel the tech industry forward by connecting the brightest minds with groundbreaking opportunities. We’re not just matc... Know more