- Company Name
- Tekgence Inc
- Job Title
- ETL Specialist
- Job Description
-
Job Title: ETL Specialist
Role Summary: Cloud ETL Operations Specialist with deep expertise in AWS services, Python, Spark, Glue, Redshift, EMR, and Airflow. Responsible for designing, developing, deploying, optimizing, and maintaining end‑to‑end ETL/ELT pipelines and data warehouses on the AWS cloud.
Expactations: Deliver scalable and reliable data integration solutions, migrate on‑prem workloads to AWS, monitor and troubleshoot incidents, enforce change and incident management processes, and collaborate with cross‑functional teams to align data capabilities with business needs.
Key Responsibilities:
- Design and implement ETL/ELT workflows using Spark, Python, AWS Glue, Redshift, EMR, and Airflow.
- Build and maintain data lake and data warehouse solutions on AWS, integrating SQL, Netezza, and Hadoop environments.
- Execute cloud migrations of on‑prem data pipelines, ensuring minimal downtime and data integrity.
- Monitor pipeline performance with CloudWatch and Kibana; diagnose and resolve incidents while applying incident, problem, and change management practices.
- Analyze business processes to identify automation opportunities and improve data quality and reliability.
- Communicate status, findings, and recommendations to stakeholders and collaborate with engineering, data, and business teams.
Required Skills:
- Technical: AWS (Glue, Redshift, EMR, CloudWatch, Kibana), Python, Spark, Airflow, SQL, Netezza, Hadoop, ETL/ELT concepts.
- Analytical: Strong problem‑solving, data interpretation, and process optimization abilities.
- Soft: Excellent written and verbal communication, teamwork, organization, and the ability to manage multiple priorities.
Required Education & Certifications:
- Education: Not specified.
- Certifications: AWS certifications (e.g., AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect) preferred but not mandatory.