ActiveFence

About the Company

ActiveFence is the leading provider of UGC and AI Safety solutions, delivering the industry's most robust safeguards, to protect the world's leading foundation models and AI-powered applications. Trusted by safety teams of all sizes, we help protect over three billion users from threats such as child abuse, exploitation, hate speech, and more. Our comprehensive solutions integrate deep intelligence research, AI-driven harmful content detection, and a robust moderation platform, enabling global platforms to operate safely and responsibly in over 100 languages.

Listed Jobs

Company Name

ActiveFence

Job Title

GenAI Analyst

Job Description

**Job Title:** Generative AI Analyst (GenAI Analyst) **Role Summary:** Analyze and mitigate content infringement and abuse risks in generative AI systems. Design adversarial prompts, evaluate model vulnerabilities across text, image, and video modalities, and manage multilingual datasets to ensure safe AI deployment. Collaborate with engineering, product, policy, and safety teams to develop proactive risk‑reduction strategies. **Expectations:** - Deliver high‑quality analytical outputs on schedule. - Maintain meticulous attention to detail in data handling and documentation. - Proactively identify emerging abuse tactics and propose mitigation measures. - Foster knowledge sharing and continuous learning within the team. **Key Responsibilities:** - Create and test adversarial and risky prompt strategies to expose model weaknesses. - Lead end‑to‑end project cycles: planning, execution, quality assurance, and delivery. - Manage large, multilingual datasets across various abuse categories with precision. - Conduct ongoing research on techniques that bypass safety controls of foundational models. - Partner with cross‑functional teams (engineering, product, policy) to devise and implement mitigation solutions. - Promote a collaborative culture of knowledge exchange and best‑practice development. **Required Skills:** - Strong background in AI Safety, Responsible AI, or AI Ethics. - Familiarity with recent generative AI models and agents (LLMs, text‑to‑image, text‑to‑video). - Near‑native proficiency in English (written and spoken). - Excellent organizational abilities and multitasking capacity. - High attention to detail and analytical rigor. **Additional Desired Skills:** - Experience with multiple model types (e.g., Text‑to‑Text, Text‑to‑Image). - Knowledge of OSINT (Open Source Intelligence) techniques. - Self‑starter mindset with ability to thrive in fast‑paced, dynamic environments. **Required Education & Certifications:** - Bachelor’s degree in Computer Science, Data Science, Ethics, Law, Social Sciences, or a related field (or equivalent practical experience). - Relevant certifications in AI Ethics, AI Safety, or Responsible AI (optional but advantageous).

London, United kingdom

Hybrid

21-09-2025