- Company Name
- Hired by Matrix, Inc
- Job Title
- Data and Systems Engineer
- Job Description
-
**Job Title**
Data and Systems Engineer
**Role Summary**
Design, implement and govern scalable data, analytics, and compute platforms for scientific and enterprise functions. Responsible for developing reference architectures, optimizing ETL/ELT pipelines, integrating cloud and analytical services, and ensuring data governance, security, and compliance.
**Expectations**
- Deliver robust, secure, and scalable data infrastructure.
- Translate business and scientific requirements into technical solutions.
- Maintain high standards of data governance, lineage and audit readiness.
**Key Responsibilities**
- Design, build, and govern data, analytics, and compute platforms using Databricks (Unity Catalog, Delta Lake), AWS services, and Posit Workbench.
- Create reference architectures and architectural diagrams (Visio, Draw.io, SqlDBM).
- Model data flows, source‑to‑target mappings, and governance frameworks.
- Develop and optimize ETL/ELT pipelines on Databricks.
- Support AWS infrastructure components: S3, IAM, Lambda, EC2, Glue, EMR, CloudWatch.
- Integrate Databricks with Posit and scientific data platforms.
- Implement CI/CD and IaC workflows via Terraform, GitHub Actions, and AWS‑native tooling.
- Participate in technical reviews, security assessments, and compliance controls.
- Document architectural standards and operational safeguards.
- Train and onboard end‑users, and collaborate with scientists, engineers, and platform teams.
**Required Skills**
- Hands‑on Databricks: Unity Catalog, Delta Lake, clusters, notebooks.
- Posit Workbench/Connect/Package Manager with R/Python.
- AWS services: S3, IAM, Lambda, EC2, Glue, EMR, CloudWatch.
- Automation & scripting in Python, SQL, R, Bash, or PowerShell.
- Understanding of cloud architectures, data engineering patterns, and system integrations.
- Architecture modeling (Visio, Draw.io, SqlDBM).
- Desired: Terraform, CloudFormation, GitHub Actions.
- Familiarity with scientific computing or R&D workflows.
**Required Education & Certifications**
- Bachelor’s or Master’s in Computer Science, Data Engineering, Information Systems, or related discipline.
- Equivalent professional experience acceptable.
- Preferred certifications: AWS Certified Solutions Architect, Databricks Certified Engineer (not mandatory).