- Company Name
- Alliance Search Partners
- Job Title
- Senior Data Engineer
- Job Description
-
Job title: Senior Data Engineer
Role Summary: Lead the design, development, and maintenance of scalable data pipelines, ETL processes, and data warehouse solutions for the financial services sector, driving technology modernization and ensuring data quality, compliance, and performance across cloud and on‑prem environments.
Expactations: Deliver high‑performance, reliable data engineering solutions; collaborate with cross‑functional teams; modernize legacy systems; integrate pipelines into CI/CD workflows; maintain enterprise architecture standards; provide accurate effort estimates for development and testing.
Key Responsibilities:
- Design and implement scalable data pipelines using SSIS, Azure Data Factory, or Databricks.
- Develop and optimize ETL/ELT processes and data models (Kimball & Inmon).
- Create and maintain stored procedures in T‑SQL and/or PL/SQL; develop data processing modules in C#, Java, or Python.
- Conduct data profiling, quality audits, and performance tuning for cloud (AWS/Azure) and on‑prem systems.
- Build automated unit‑testing frameworks and integrate with CI/CD pipelines.
- Produce estimates for analysis, design, development, and testing phases.
- Ensure compliance with business, data, and technical requirements and enterprise architecture standards.
Required Skills:
- Strong SQL, T‑SQL, and PL/SQL proficiency.
- Advanced Python for data processing and automation.
- Experience with SSIS, Azure Data Factory, Databricks, and CI/CD tools.
- Cloud platform expertise (AWS or Azure), including data services (e.g., SageMaker, Unified Studio).
- Knowledge of data warehousing, relational & dimensional modeling, and data integration methodologies (ETL, ELT, EAI, EII).
- Familiarity with Power BI or similar analytics tools.
- Understanding of REST‑oriented APIs, continuous integration and delivery principles, and enterprise data management.
- Strong problem‑solving, communication, and collaboration skills; ability to work independently and in teams.
Required Education & Certifications:
- Bachelor’s degree in Computer Science, Engineering, or related field.
- Minimum 5 years of experience in data engineering and ETL development.