- Company Name
- Centraprise
- Job Title
- Azure Cloud Platform Engineer (AZURE AI, Python, Pyspark, ADF, Databrick)
- Job Description
-
Job Title: Azure Cloud Platform Engineer (Azure AI, Python, PySpark, ADF, Databricks)
Role Summary:
Design, deploy, and manage Azure cloud solutions integrating AI, data processing, and orchestration services. Deliver scalable pipelines, manage Databricks environments, and implement AI models within Azure AI Studio.
Expectations:
- Lead end‑to‑end Azure resource provisioning and configuration.
- Build and maintain robust data pipelines using Python, PySpark, and Azure Data Factory.
- Administer Databricks and Azure Functions to support data science and AI workloads.
- Deploy and operationalize OpenAI models in Azure AI Studio.
- Ensure CI/CD practices, version control, and infrastructure-as-code are applied.
Key Responsibilities:
- Create and manage Azure resources (VMs, networks, storage) through Terraform and ARM templates.
- Design and implement ADF pipelines, Spark jobs, and Databricks notebooks for ETL and analytics.
- Configure and administer Azure Databricks workspaces, cluster policies, and access controls.
- Develop and deploy Azure Function Apps and Web Apps for API and UI endpoints.
- Integrate OpenAI models in Azure AI Studio, manage model lifecycle, and monitor performance.
- Build and maintain CI/CD pipelines using Jenkins, Git, and Azure DevOps.
- Optimize data indexing, chunking, and embedding for AI search and RAG patterns.
- Collaborate with data scientists to build chatbot solutions leveraging AI Search Index.
- Monitor and troubleshoot performance, security, and compliance across all services.
Required Skills:
- Azure Cloud Platform administration (resource management, networking, virtual machines).
- Terraform, ARM templates, and infrastructure-as-code.
- Python, PySpark, SQL, Azure Data Factory, Azure Databricks, Azure Functions, Azure Web Apps.
- Databricks admin/developer, Power Platform, and Azure AI Studio.
- OpenAI model deployment on Azure.
- Jenkins CI/CD, Git versioning, Azure DevOps pipelines.
- Experience with AI Search Index, document chunking, embedding, RAG patterns (nice to have).
- Familiarity with ML Ops frameworks, Azure ML, Microsoft Cloud Processors, AI Search (nice to have).
Required Education & Certifications:
- Bachelor’s degree in Computer Science, Information Technology or related field.
- Azure certifications (AZ-104, DP-203, AI-100, or equivalent) preferred.
---