cover image
Harrison Clarke

Artificial Intelligence Engineer

Hybrid

San francisco bay, United states

$ 450,000 /year

Full Time

23-02-2026

Share this job:

Skills

Cloud Security CI/CD DevOps Kubernetes Monitoring Networking Architecture Systems Architecture Cost Management CI/CD Pipelines

Job Specifications

AI Infrastructure Engineer

A high-growth AI startup is seeking AI Infrastructure Engineers to design and scale the cloud-native foundation powering its AI platform. This is a highly technical, high-impact role focused on building robust, cost-efficient infrastructure to support large-scale, real-time AI workloads.

The successful candidate will own the end-to-end infrastructure stack - from GPU orchestration and Kubernetes to networking, observability, and distributed systems architecture - establishing the patterns and best practices that will underpin long-term platform growth.

Key Responsibilities

Architect and scale infrastructure for low-latency, high-throughput AI inference.
Orchestrate GPUs and manage multi-tenant workloads using Kubernetes and service mesh technologies.
Build and operate core systems including infrastructure-as-code, observability, distributed storage, and networking.
Implement cross-platform capabilities such as authentication, rate limiting, monitoring, and telemetry.
Define infrastructure roadmap and drive trade-offs across performance, reliability, and cost.
Collaborate closely with ML engineers to productionize and optimize model serving pipelines.

Requirements

Strong background in infrastructure engineering, DevOps, or ML platform engineering.
Deep expertise in Kubernetes at scale, GPU orchestration, and cloud-native automation.
Experience designing highly available, globally distributed systems and traffic routing.
Proficiency with infrastructure-as-code, CI/CD pipelines, and observability tooling.
Solid understanding of distributed systems, performance optimization, and cost management.
Experience with ML inference frameworks (e.g., Triton, ONNX Runtime, vLLM, TensorRT).
Strong grasp of cloud security and data management for production AI workloads.
Entrepreneurial mindset with the ability to operate autonomously in fast-paced environments.

About the Company

Harrison Clarke is the Leading Cloud, Data & AI Staffing & Recruiting Firm! We partner with Tier 1 Venture Capital firms to help portfolio companies from seed round to Fortune 500 build and grow with the top 1% world class engineering talent in this space. Know more