Job Specifications
Data Engineer Lead
Toronto, ON- 3-4 days a week ONSITE
Long Term Contract(6 Months to start with)
Experience Required: Bring a minimum of 10 years' experience working with large SQL data marts, including at least 3 years in a Tech Lead role.
Skills: Python, Apache Spark, Database Technologies (SQL & NoSQL)
Role Overview
We are seeking a highly experienced Data Engineering Lead with deep expertise in ETL development, large‑scale SQL data marts, advanced analytics, troubleshooting, and cloud‑based data integration. The ideal candidate will have a strong technical background, excellent communication skills, and the ability to manage complex workloads in fast‑paced environments.
Key Responsibilities:
1. ETL Development & Cloud Data Integration
Design and develop end‑to‑end ETL processes using Azure Data Factory, Synapse Pipelines, or Databricks.
Establish and maintain cloud connectivity across systems including ADLS, ADF, Synapse, and Databricks.
Ensure efficient extraction, transformation, loading, and orchestration of large datasets.
2. Advanced Programming & Scripting
Develop and optimize complex T‑SQL queries, stored procedures, and functions.
Write automation and transformation scripts using Python within Azure-based ETL frameworks.
3. Data Mart & Database Management
Troubleshoot, optimize, and support large-scale SQL databases, including performance tuning, indexing, and storage planning.
Perform ETL of large data volumes from multiple systems with strong attention to accuracy and performance.
Identify, report, and manage database security, including access controls and compliance.
4. Data Analysis & Problem Solving
Navigate and analyze massive volumes of data to design effective extraction, load, and reporting solutions.
Demonstrate a strong analytical mindset, excellent attention to detail, and the ability to solve complex technical issues.
Work under tight deadlines while balancing multiple priorities.
5. Data Governance & Operational Support
Support database testing, troubleshooting, and validation activities.
Design backup, archiving, and retention strategies; maintain recovery readiness and capacity planning.
Ensure compliance with enterprise data governance and security standards.
6. Stakeholder Communication & Collaboration
Communicate effectively with stakeholders across all levels—from junior analysts to senior leadership.
Lead discussions related to data solutions, technical decisions, and delivery timelines.
Work independently as well as collaboratively within cross‑functional teams.
Demonstrate proactive behavior, strong organization, and a willingness to learn new tools and technologies.
Nice‑to‑Have / Additional Assets:
Experience in financial institution data mart environments.
Hands-on experience with .NET applications.
Experience designing dashboards in Tableau.
Prior work with large-scale datasets in a regulated environment.
Essential Skills:
Strong experience in database management across both relational and NoSQL platforms.
Familiarity with Hadoop, Spark, Kafka, or other distributed data technologies.
Deep understanding of ETL processes, data flows, and pipeline orchestration.
Knowledge of data modeling principles and best practices.
About the Company
Q1 is a professional organization that delivers quality products and services. Q1 specializes in Software Development, Business Consulting and Technology Integration. We provide end-to-end integrated solutions that include professional services, functional and technical support and ongoing maintenance using our on-site, off-site and off-shore resources. We offer a comprehensive range of managed services for enterprise business and technology solutions with a team of highly experienced professionals. Q1 is also a Value Added...
Know more