Skills

Problem Solving Python Data Warehousing Monitoring Agile methodologies Attention to detail Linux Operating Systems Programming git Agile Snowflake python programming Databricks ETL Processes

Job Specifications

Job Title: Data Engineer

Job Level: FTC

Location: Montreal (Day 1 onboarding onsite / in office presence 3x week)

Duration: 12+ months extendable contract

Role Responsibilities

Collaborating with cross-functional teams to understand data requirements, and design efficient, scalable, and reliable ETL processes using Python and DataBricks
Developing and deploying ETL jobs that extract data from various sources, transforming it to meet business needs.
Taking ownership of the end-to-end engineering lifecycle, including data extraction, cleansing, transformation, and loading, ensuring accuracy and consistency.
Creating and manage data pipelines, ensuring proper error handling, monitoring and performance optimizations
Working in an agile environment, participating in sprint planning, daily stand-ups, and retrospectives.
Conducting code reviews, provide constructive feedback, and enforce coding standards to maintain a high quality.
Developing and maintain tooling and automation scripts to streamline repetitive tasks.
Implementing unit, integration, and other testing methodologies to ensure the reliability of the ETL processes
Utilizing REST APIs and other integration techniques to connect various data sources
Maintaining documentation, including data flow diagrams, technical specifications, and processes.

You have:

Proficiency in Python programming, including experience in writing efficient and maintainable code.
Hands-on experience with cloud services, especially DataBricks, for building and managing scalable data pipelines
Proficiency in working with Snowflake or similar cloud-based data warehousing solutions
Solid understanding of ETL principles, data modelling, data warehousing concepts, and data integration best practices
Familiarity with agile methodologies and the ability to work collaboratively in a fast-paced, dynamic environment.
Experience with code versioning tools (e.g., Git)
Meticulous attention to detail and a passion for problem solving
Knowledge of Linux operating systems-Familiarity with REST APIs and integration techniques

About the Company

Established in 2000, LanceSoft is a pioneer in delivering top-notch Global Workforce Solutions and IT Services to a diverse clientele. As a Certified MBE and Woman-Owned organization, we pride ourselves on fostering global cross-cultural connections that advance both the careers of our employees and the success of our clients' businesses. At LanceSoft, our mission is clear: to leverage our global network to seamlessly connect businesses with the right talent and individuals with the right opportunities, all without bias. We... Know more