iMerit Technology

www.imerit.net

1 Job

6,472 Employees

About the Company

iMerit is a leading AI data solutions company providing high-quality data across computer vision, natural language processing, and content services that power machine learning and artificial intelligence applications for large enterprises. iMerit provides end-to-end data labeling technologies and solutions to Fortune 500 companies in a wide array of industries including agricultural AI, autonomous vehicles, commerce, geospatial, government, financial services, medical AI, and technology. iMerit is headquartered in the United States, with large CV and NLP teams in India, US, Bhutan and Europe. iMerit investors are Omidyar Network, Dell.org, Khosla Ventures, and British International Investment. For more information, visit imerit.net.

Listed Jobs

Company Name: iMerit Technology
Job Title: English Language Specialist
Job Description: **Job Title** Multimodal GenAI Evaluation Analyst (English Language Specialist) **Role Summary** Evaluate the quality, accuracy, cultural appropriateness, and safety of outputs generated by large language models (LLMs) and multimodal AI systems across text, image captions, video descriptions, and multimodal prompts. Provide detailed feedback, scoring, and tagging to inform model fine‑tuning and ensure consistent adherence to complex evaluation guidelines. **Expectations** * Deliver precise, consistent evaluations within defined turnaround windows. * Maintain high accuracy and reliability across all modalities. * Adapt quickly to evolving project requirements and quality frameworks. * Communicate findings clearly to project teams and contribute to guideline refinement. **Key Responsibilities** 1. Assess AI outputs against project‑specific criteria (correctness, coherence, completeness, style, cultural fit, safety). 2. Detect and document subtle errors, hallucinations, biases, or inappropriate content. 3. Resolve ambiguous or unclear outputs using domain knowledge and logical reasoning. 4. Provide written feedback, tagging, and scoring to support team consistency. 5. Escalate unclear cases and aid in refining evaluation guidelines. 6. Collaborate with Project Managers and Quality Leads to meet accuracy and turnaround standards. **Required Skills** * Strong critical reading, observational, and evaluative skills across multiple modalities. * Ability to articulate nuanced judgments with precision and clarity. * Excellent English comprehension (CEFR B2 or higher); additional language proficiency is a plus. * Familiarity with LLMs, generative AI, and multimodal systems. * High attention to detail and consistent guideline application. * Awareness of cultural and linguistic biases and potential harms in AI outputs. * Comfort with evolving workflows, rapid feedback cycles, and complex quality frameworks. * Experience with data annotation tools and software platforms. **Required Education & Certifications** * Bachelor’s degree, diploma, or equivalent in a relevant field (e.g., Linguistics, Computer Science, Data Science, or related disciplines). * 1+ years of experience in data annotation, LLM evaluation, content moderation, or related AI/ML domains. * CEFR B2+ English proficiency; additional language certifications welcome. ---