Associate Director, Evaluation and Quality Standards
Johnson & Johnson · Barcelona, Spain +1 more
QualityFull-timeCompany career page
The apply link worked recently (not employer-confirmed).
Role summary
Johnson & Johnson seeks an Associate Director to establish evaluation and quality standards for generative AI systems across pharmaceutical R&D. This newly created leadership role owns evaluation frameworks, vendor assessments, and governance for AI solutions in a regulated environment, reporting to the Head of Generative AI.
What they're looking for
- PhD in computational biology, bioinformatics, data science, computer science, AI/ML, or related discipline
- Minimum 8 years post-academic industry experience in pharma or biotech R&D
- Hands-on expertise with LLMs, retrieval-augmented generation, agentic systems, and prompt engineering
- Demonstrated track record designing evaluation frameworks and quality standards for AI/ML
- Strong people leadership experience building technical teams in matrix organizations
- Excellent communication skills for technical and non-technical senior audiences
What you'll be doing
- Design and maintain evaluation frameworks for LLM quality, RAG performance, agent reliability, safety, and scientific accuracy
- Lead vendor assessments and produce evaluation reports with independent benchmarking
- Serve as technical lead for the Evaluation & Standards Board governance body
- Define production-ready standards and evaluation gates for GenAI product development stages
- Build and lead the GenAI Evaluation & Standards team
Privacy & handoff
This role links to Johnson & Johnson's own application system. RoleLantern records your interest and checks the link, but the application happens on the employer's site and status updates may not come back to us. Clicking apply does not mark you as applied automatically.