Anyscale

Company Name: Anyscale
Job Title: Software Engineer, Release & Engineering Efficiency
Job Description: **Job Title:** Software Engineer, Release & Engineering Efficiency **Role Summary:** Accelerate engineering productivity across all teams by designing, building, and maintaining CI/CD pipelines, build systems, automated release mechanisms, and core testing infrastructure for Ray and the proprietary Anyscale platform. Bridge the intersection of distributed systems and machine learning to ensure reliable, scalable deployment environments. **Expectations:** - Minimum 2 years of software engineering in large‑scale CI/CD or distributed systems. - Strong ownership of end‑to‑end delivery of developer‑focused tooling. - Ability to collaborate cross‑functionally with infrastructure, platform, and open‑source teams. **Key Responsibilities:** 1. Design and implement developer velocity projects throughout the engineering organization. 2. Define and deliver CI/CD tools, build systems (e.g., Bazel), and automated release workflows that support scalable development. 3. Build and maintain core testing infrastructure to sustain Ray’s high‑performance, distributed runtime. 4. Partner with infrastructure teams to influence cluster management features and evaluate new solutions. 5. Collaborate with the open‑source Ray community to create distributed testing frameworks and applications ensuring cross‑platform correctness. **Required Skills:** - CI/CD, build system design (Bazel) and large‑scale distributed system engineering. - Infrastructure as Code (Terraform, CloudFormation, Pulumi). - AWS cloud operations (EC2, S3, IAM, Docker). - Kubernetes cluster management. - Experience with programming languages, security, or cloud developer productivity tools is a plus. **Required Education & Certifications:** - Bachelor's degree in Computer Science, Engineering, or related field, or equivalent practical experience. ---

San francisco, United states

On site

Junior

30-01-2026

Company Name: Anyscale
Job Title: Software Engineer - Model Serving Infrastructure
Job Description: **Job title:** Software Engineer – Model Serving Infrastructure **Role Summary** Design, build, and maintain high‑availability systems for serving machine learning models at scale. Contribute to the open‑source Ray Serve library and Anyscale’s platform, driving performance, cost‑efficiency, and real‑time latency targets for a mix of single‑ and multi‑model workloads. **Expectations** - Deliver production‑ready, fault‑tolerant model serving services with measurable performance gains. - Collaborate with open‑source community and enterprise customers to guide feature development. - Iterate on autoscaling, latency, and throughput improvements repeatedly based on metrics and user feedback. **Key Responsibilities** - Engineer highly available, scalable model serving pipelines for diverse ML frameworks (PyTorch, TensorFlow, JAX). - Extend Ray Serve and related libraries to simplify end‑to‑end deployment of complex ML applications. - Design and implement autoscaling logic that balances performance with cost savings. - Optimize request routing, caching, and parallelism to reduce latency and increase throughput. - Monitor, troubleshoot, and benchmark production systems; provide root‑cause analysis and post‑mortem reports. - Contribute code, documentation, and tests to open‑source repositories; maintain high code quality and standards. **Required Skills** - Strong grasp of algorithms, data structures, and systems design. - 2+ years of software engineering experience, preferably in ML infrastructure. - Practical experience with distributed systems, Kubernetes/containers, and cloud platforms. - Familiarity with modern ML frameworks (PyTorch, TensorFlow, JAX). - Experience building open‑source libraries and managing public repositories. - Proven ability to build and operate high‑availability serving systems in production. **Required Education & Certifications** - Bachelor’s degree (or equivalent work experience) in Computer Science, Engineering, or related field. - No mandatory certifications; preferred experience with distributed systems or cloud‑native architecture.

San francisco, United states

On site

Junior

30-01-2026

Company Name: Anyscale
Job Title: Lead Security Engineer
Job Description: **Job Title:** Lead Security Engineer **Role Summary:** Architect and build secure products and infrastructure for mission‑critical distributed computing platforms. Drive security best practices, policies, and compliance across the organization while partnering with product and engineering teams to embed security throughout the development lifecycle. **Expectations:** - Provide security guidance, requirements, and guardrails to product and engineering groups. - Own product and cloud infrastructure security, including design, configuration, threat modeling, and incident response. - Lead corporate security programs (endpoint protection, access management, SaaS security). - Support and drive compliance certifications (SOC 2, HIPAA, ISO 27001, etc.). - Communicate security concepts clearly to technical and non‑technical audiences. **Key Responsibilities:** - Design secure architectures for applications and cloud environments (AWS, GCP, Azure). - Conduct threat modeling, risk assessments, and security reviews of code and infrastructure. - Integrate security tooling and processes into CI/CD pipelines. - Develop and maintain security policies, standards, and incident response plans. - Manage endpoint protection, identity & access management, and SaaS security controls. - Coordinate and document evidence for external audits and certifications. - Mentor engineering teams on secure coding practices and security hygiene. **Required Skills:** - Strong product security experience building enterprise‑grade applications. - Deep hands‑on expertise with cloud security (AWS, GCP, and/or Azure). - Software development background (ability to write and review secure code). - Proven ability to design and implement security architectures and controls. - Excellent written and verbal communication; experience delivering security training. - Experience managing corporate security programs (device management, access controls, SaaS security). - Familiarity with compliance frameworks: SOC 2, HIPAA, ISO 27001, FedRAMP, etc. **Required Education & Certifications:** - Bachelor’s degree in Computer Science, Information Security, Engineering, or related field (or equivalent practical experience). - Relevant security certifications preferred (CISSP, CISM, CCSP, AWS/GCP/Azure Security certifications, etc.).

San francisco, United states

Hybrid

Senior

02-02-2026

About the Company

Listed Jobs