- Company Name
- Innodata Inc.
- Job Title
- Software Engineering Associate (open to US or Canada)
- Job Description
-
**Job Title:** Software Engineering Associate
**Role Summary:**
Build production‑ready GenAI solutions by prototyping LLM pipelines, managing vector databases, and developing FastAPI services for search, recommendation, and memory. Optimize low‑latency APIs, design resilient distributed systems, and collaborate closely with research and product teams.
**Expectations:**
- 1‑3 years hands‑on experience in Python (FastAPI, async/await, Redis, PostgreSQL).
- Proficiency in LLM prompting, Retrieval‑Augmented Generation (RAG), embeddings, and vector search.
- Familiarity with cloud platforms (GCP, AWS, Azure), Docker, Git, and CI/CD pipelines.
- Strong communication, self‑drive, and ability to work in a multicultural, fast‑paced environment.
**Key Responsibilities**
- Prototype LLM + retrieval pipelines with safety and filtering.
- Operate vector databases (Pinecone, Weaviate) and manage embeddings.
- Build FastAPI services for search, recommendation, and memory.
- Design resilient systems with caching, retries, and observability.
- Run large‑scale data pipelines for indexing and embeddings.
- Capture personalization signals from search, chat, and purchase data.
- Optimize APIs for low latency and high throughput.
- Collaborate with research and product teams on evaluation and UX.
**Required Skills**
*Technical*
- Python (FastAPI, async/await, Redis, PostgreSQL)
- LLM prompting, RAG, embeddings, vector search
- APIs, distributed systems, caching, observability
- Cloud services (GCP/AWS/Azure), Docker, Git, CI/CD
*Preferred*
- TypeScript/Node.js (NestJS), React/Next.js
- Recommender systems knowledge
- Embedding model evaluation
*Soft*
- Excellent verbal and written communication
- Strong time‑management and organizational skills
- Self‑starter with customer‑centric mindset
- Team player in multicultural, high‑speed settings
**Required Education & Certifications**
- Bachelor’s degree or higher in Computer Science, Artificial Intelligence, Machine Learning, Linguistics, Localization, or a related field. (No mandatory certifications.)