Skills

Python SQL Big Data Data Warehousing Data Governance Azure Data Factory Programming Organization Azure Spark Databricks

Job Specifications

Senior Data Architect

Key Responsibilities:

Design, develop, and maintain Master Data Management (MDM) solutions to ensure accurate, consistent, and reliable master data across the organization.
Build and optimize scalable data pipelines and workflows using Databricks on Azure cloud platform.
Collaborate with data architects, business analysts, and data stewards to gather requirements and translate them into technical solutions.
Develop and implement data integration processes, data quality rules, and data transformation logic within Databricks environment.
Create and maintain data models, metadata, and documentation for MDM processes.
Apply best practices for data governance, security, and compliance within MDM and Databricks ecosystem.
Perform data profiling, analysis, and troubleshooting to resolve data issues and improve data quality.
Automate routine tasks and implement continuous improvement initiatives.
Mentoring junior team members and providing technical guidance on MDM and Databricks best practices.
Stay updated with emerging trends and technologies in MDM, big data, and cloud-based data platforms.

Required Qualifications:

Bachelor's degree in computer science, Information Technology, or related field; Master's preferred.
Extensive experience in MDM design, development, and implementation.
Proven expertise with Databricks platform, including notebooks, Spark, Delta Lake, and Spark SQL.
Strong programming skills in Python.
Experience with cloud platform such as Azure (Azure Data Factory, Azure Data Lake)
Familiarity with data modeling, data warehousing, and ETL/ELT processes.
Understanding of data governance, data quality, and master data concepts.
Good knowledge of SQL and working with large datasets.

About the Company

Open Systems Technologies is a tier-one vendor for the world's most competitive financial and technology companies, offering both full-time and contract recruiting services across the country. We offer a positive, entrepreneurial, high performing culture where all employees have the unique opportunity to run a full desk. Our office looks, feels, and operates like a start-up, but with the stability, clientele, and resources that only an industry veteran can provide. At our core, we are structured to be flexible. With over 3... Know more