Skills

Python Scala SQL Data Warehousing CI/CD DevOps Azure Data Factory Azure DevOps Programming git Azure Snowflake Spark CI/CD Pipelines Databricks PySpark

Job Specifications

Key Responsibilities:

Data Pipelines: Build and optimize ETL/ELT pipelines using Azure Data Factory, Databricks (PySpark, SQL), and ingest data from diverse sources into ADLS and Snowflake.
Databricks Development: Create and tune Spark jobs, leverage Delta Lake, Autoloader, and advanced optimization techniques.
Data Warehousing: Design and manage Snowflake schemas, queries, and performance tuning.
Data Quality & Governance: Implement security, lineage, validation frameworks, and compliance policies.
Programming: Develop in Python, PySpark, Scala, and advanced SQL for data processing and automation.
Collaboration: Partner with data architects and mentor junior engineers.
DevOps: Maintain CI/CD pipelines using Azure DevOps; troubleshoot and optimize performance.

Required Skills:

Expertise in Azure services (ADF, Databricks, ADLS, Key Vault).
Strong Snowflake experience (data modeling, optimization, Snowpipe).
Proficiency in Python, PySpark, Scala, and advanced SQL.
Knowledge of Delta Lake, Autoloader, Z-ordering, partitioning.
Familiarity with CI/CD, Git workflows, and data security best practices.
Experience with JSON, Parquet, CSV formats.

Preferred Qualifications:

Bachelor’s/Master’s in Computer Science or related field.
Azure Data Engineer and Databricks certifications.

About the Company

Yochana: Your Trusted Workforce Partner Across North America & Beyond For over 15 years, Yochana has been a leading talent acquisition firm, connecting businesses with top professionals across industries. Headquartered in Farmington Hills, Michigan, we specialize in temporary workforce solutions, permanent placements, contract-to-hire, and recruitment process outsourcing (RPO) across the USA, Canada, Mexico, and India. At Yochana, we go beyond traditional hiring agencies--our customized recruitment strategies and AI-driven ... Know more