Job Specifications
Job Title: Sr Data engineer
Location: Toronto, ON, Canada (Onsite)
Mode: Contract
Client: HCLTech
About the Role:
Seeking an experienced Senior Data Engineer (6+ years) to design and optimize scalable data solutions on Microsoft Azure.
You will work with Snowflake for data warehousing and Databricks for big data processing within a Lakehouse architecture using medallion principles (Bronze, Silver, Gold).
Key Responsibilities:
Data Pipelines: Build and optimize ETL/ELT pipelines using Azure Data Factory, Databricks (PySpark, SQL), and ingest data from diverse sources into ADLS and Snowflake.
Databricks Development: Create and tune Spark jobs, leverage Delta Lake, Autoloader, and advanced optimization techniques.
Data Warehousing: Design and manage Snowflake schemas, queries, and performance tuning.
Data Quality & Governance: Implement security, lineage, validation frameworks, and compliance policies.
Programming: Develop in Python, PySpark, Scala, and advanced SQL for data processing and automation.
Collaboration: Partner with data architects and mentor junior engineers.
DevOps: Maintain CI/CD pipelines using Azure DevOps; troubleshoot and optimize performance.
Required Skills:
Expertise in Azure services (ADF, Databricks, ADLS, Key Vault).
Strong Snowflake experience (data modeling, optimization, Snowpipe).
Proficiency in Python, PySpark, Scala, and advanced SQL.
Knowledge of Delta Lake, Autoloader, Z-ordering, partitioning.
Familiarity with CI/CD, Git workflows, and data security best practices.
Experience with JSON, Parquet, CSV formats.
Preferred Qualifications:
Bachelor’s/Master’s in Computer Science or related field.
Azure Data Engineer and Databricks certifications.
About the Company
Ktek Resourcing is a global staffing and recruitment firm specializing in IT, engineering, and professional services.
We combine data, AI, and human insight to deliver smarter, faster hiring solutions. Whether you're filling a single role or scaling an entire team, we bring over two decades of recruiting expertise to every engagement. Ktek is proudly headquartered in Houston, TX.
Our reach spans North America, South America, Asia, and EMEA, connecting businesses with top-tier talent. We are committed to creating equitable...
Know more