Skills

Python SQL Data Warehousing Apache Airflow Kubernetes Azure Data Factory Architecture Programming apache Organization Azure Snowflake python programming Databricks

Job Specifications

Job Title: Solutions Architect

Location: Mississauga - Hybrid - 3 days/week

Term: Long term contract

The Solutions Architect, specializing in Cloud Orchestration, will serve as a trusted advisor within a small team of technologists, delivering technical solutions powered by Apache Airflow on the client platform. This role will focus on designing, engineering, and implementing a wide range of use cases where Airflow acts as the central orchestration tool, with the goal of rapidly building and scaling solutions across the organization.

Key Responsibilities:

Guide a small team of technologists on their Apache Airflow adoption journey, including onboarding new domain teams and identifying additional use cases.
Review, optimize, and fine-tune data ingestion and extraction pipelines orchestrated by Airflow.
Design and document architecture, data flows, and operational diagrams, including both physical and logical layers.
Provide reference implementations for key activities such as building Airflow pipelines, integrating Airflow with third-party solutions, and adopting new Airflow features.
Stay current with the latest features in Airflow to recommend impactful improvements.
Ensure technology teams realize the full value of their investment in Airflow.

Required Skills & Experience:

Proven experience running Apache Airflow in production environments.
Strong background in designing and implementing ETL, Data Warehousing, and ML/AI use cases.
Proficiency in Python programming, Knowledge of Azure cloud-native data architectures.
Experience migrating workflows from legacy schedulers (e.g., Tidal) to Apache Airflow.
Experience integrating Airflow with Azure Data Factory pipelines.
Hands-on experience with Snowflake and Databricks.
Experience working with containers and Kubernetes (on-premises or cloud).
Strong SQL skills, Enterprise data experience in regulated environments.

About the Company

Open Systems Technologies is a tier-one vendor for the world's most competitive financial and technology companies, offering both full-time and contract recruiting services across the country. We offer a positive, entrepreneurial, high performing culture where all employees have the unique opportunity to run a full desk. Our office looks, feels, and operates like a start-up, but with the stability, clientele, and resources that only an industry veteran can provide. At our core, we are structured to be flexible. With over 3... Know more