- Company Name
- TechDoQuest
- Job Title
- Senior Data Engineer
- Job Description
-
**Job Title:** Senior Data Engineer
**Role Summary:**
Design, build, and optimize enterprise data pipelines and architectures. Lead ETL development using Informatica PowerCenter and Snowflake, architect Amazon Web Services solutions (S3, Lambda, Glue, Redshift, CloudWatch), and drive data quality, performance tuning, and scalability.
**Expectations:**
Onsite presence required Monday–Wednesday each week; initial interview conducted virtually with a second customer round in person. Must demonstrate 10+ years of senior data engineering experience, strong leadership, and excellent communication skills.
**Key Responsibilities:**
- Architect and maintain scalable data pipelines using Informatica PowerCenter, Snowflake, and AWS.
- Design and implement Snowflake tables, partitions, and clustering for optimal query performance.
- Develop, deploy, and manage serverless data processing with AWS Lambda and related services.
- Build and maintain S3 data lakes, ensuring proper data lifecycle and security.
- Integrate CI/CD pipelines for data workflows, leveraging DevOps best practices.
- Collaborate in Agile teams, participate in sprint planning, and deliver iterative improvements.
- Ensure data quality, consistency, and compliance across all pipelines.
- Mentor junior engineers and conduct code reviews.
- Monitor and optimize pipeline performance with CloudWatch, Glue, or Redshift metrics.
**Required Skills:**
- 10+ years professional experience in data engineering or related domains.
- Advanced expertise in Informatica PowerCenter (ETL development, administration).
- Proficient in Snowflake (data warehouse design, performance tuning, query optimization).
- Hands‑on AWS: S3, Lambda (mandatory), Glue, Redshift, CloudWatch (preferred).
- SQL development and Python scripting (preferred).
- Strong data modeling, integration, and data quality framework knowledge.
- Experience with Agile methodologies and cross‑functional collaboration.
- Familiarity with CI/CD pipelines, Git, and DevOps practices.
- Excellent problem‑solving, analytical, and communication skills.
**Required Education & Certifications:**
- Bachelor’s degree in Computer Science, Engineering, or related field (master’s preferred).
- Professional certifications such as Informatica, Snowflake, or AWS Certified Data Analytics – Specialty highly desirable.