- Company Name
- Virtue AI
- Job Title
- Software Engineer (All Levels)
- Job Description
-
Job Title: Software Engineer (All Levels)
Role Summary: Design and implement scalable, secure distributed services and APIs that support AI security products, including inference, guardrails, and red‑team tools, across SaaS and on‑prem environments.
Expectations: Deliver reliable, high‑throughput systems that meet enterprise SLOs; collaborate with ML, security, and product teams; maintain clean abstractions, robust observability, and automated deployment pipelines.
Key Responsibilities:
- Design, develop, and maintain scalable APIs and services for red‑team, guardrail, and agent‑safety products.
- Build multi‑tenant data pipelines and storage layers for real‑time evaluation and analytics.
- Create deployment abstractions for SaaS, customer Kubernetes clusters, and hybrid cloud.
- Integrate inference services (vLLM, Triton, Ray) into production‑grade systems.
- Implement observability, performance tooling, and meet enterprise SLOs.
- Contribute to CI/CD, containerization (Docker, Helm), and infrastructure automation (Terraform).
- Participate in design reviews, code reviews, and documentation for maintainability.
Required Skills:
- Strong programming in Python, Go, or similar.
- Deep knowledge of distributed systems, concurrency, and service‑oriented architecture.
- Experience with SQL/NoSQL databases (Postgres, Redis, MongoDB).
- Proficient with Docker, Kubernetes, and container orchestration.
- Familiarity with GCP, AWS, or Azure and IaC (Terraform).
- Ability to work in fast‑paced, security‑focused environments.
Bonus:
- Experience building SaaS or enterprise software with on‑prem deployment.
- Integration of ML inference frameworks or GPU backends.
Required Education & Certifications:
- Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent practical experience).
San francisco, United states
On site
23-09-2025