- Company Name
- ALOIS Solutions
- Job Title
- AWS Data engineer
- Job Description
-
Job title: AWS Data Engineer
Role Summary: Design, build, and maintain scalable batch and streaming ETL/ELT pipelines on AWS, ensuring data quality, governance, and performance for analytics and business use.
Expactations: Deliver high‑availability data pipelines, meet performance SLAs, implement security best practices, and continuously evaluate and adopt emerging AWS services to improve data processing efficiency.
Key Responsibilities:
- Design and develop batch and streaming ETL/ELT pipelines using AWS Glue, Lambda, Step Functions, EMR, Kinesis, and related services.
- Implement data ingestion from APIs, databases, and streaming platforms into data lakes and warehouses (S3, Redshift, Athena, Lake Formation).
- Build and optimize data schemas, perform performance tuning, and enforce data governance and security across all data flows.
- Collaborate with data scientists, analysts, and business stakeholders to translate requirements into reliable datasets.
- Monitor, troubleshoot, and enhance data workflows for high availability and performance.
- Maintain CI/CD pipelines and infrastructure-as-code using Terraform or CloudFormation.
- Stay current with AWS innovations and suggest architecture improvements.
Required Skills:
- Proficiency with S3, Glue, Redshift, EMR, Kinesis, Lambda, DynamoDB, RDS, Athena, SNS, SQS.
- Strong SQL, Python, and PySpark programming skills.
- Experience with data modeling, schema design, and query performance tuning.
- Knowledge of CI/CD pipelines, DevOps practices, and IaC tools (Terraform, CloudFormation).
- Understanding of security best practices (IAM, encryption, compliance).
Required Education & Certifications:
- Bachelor’s degree in Computer Science, Information Systems, or a related field.
- AWS certifications (Solutions Architect, Data Analytics, or Developer) preferred.