AI Evaluation Infrastructure & Production Readiness Lead

We have partnered with our client in their search for an AI Evaluation Infrastructure & Production Readiness Lead (Contract position).

Responsibilities

• Lead the development of client's enterprise AI evaluation and production readiness framework, establishing standardized testing, validation, governance, and go/no-go criteria that ensure AI systems are accurate, safe, compliant, and ready for enterprise deployment.
• Design and build scalable AI evaluation infrastructure, including evaluation harnesses, golden datasets, regression testing, hallucination and grounding validation, bias/fairness testing, adversarial testing, drift detection, automated monitoring, and production readiness controls.
• Partner with AI Engineering, Risk, Compliance, Legal, and Model Governance teams to translate regulatory and business requirements into repeatable AI testing methodologies, vendor evaluation standards, and evidence-based reporting for enterprise AI governance.

Skills Required

• 7+ years of experience in AI/ML Engineering, Software Quality Engineering, Data Science, or Machine Learning, with expertise in LLM evaluation, regression testing, statistical analysis, and production validation.
• Hands-on experience building and testing enterprise LLM/ML evaluation frameworks, including hallucination detection, grounding validation, bias/fairness testing, experimental design, AI safety, policy adherence, and production readiness.
• Strong expertise in AI testing methodologies, statistical experimentation, evaluation metrics, and acceptance criteria, with experience partnering across AI Engineering, Risk, Compliance, and Legal to implement enterprise AI governance and quality controls.

Education & Work Experience

• Bachelor's Degree (pref. Computer Science, Engineering, IT, Data Science, or related fields)
• 7+ years of Professional Work Experience

Title: AI Evaluation Infrastructure & Production Readiness Lead

Client Industry: Financial Services

About Korn Ferry

Korn Ferry unleashes potential in people, teams, and organizations. We work with our clients to design optimal organization structures, roles, and responsibilities. We help them hire the right people and advise them on how to reward and motivate their workforce while developing professionals as they navigate and advance their careers. To learn more, please visit Korn Ferry at www.Kornferry.com

Upload Your Resume

Accepted file types are DOC, DOCX, and PDF.

Upload File from Computer Choose File from Drive Choose File from Dropbox

Please upload a resume of type .doc, .docx, or .pdf. Name Email Best Phone Number to Call Mandatory questions are indicated with a *. All other questions are optional.

For each question below, please consult the Korn Ferry Global Privacy Policy, Terms and Cookie Policy. You may withdraw your consent at any time by contacting privacy@kornferry.com. * I acknowledge that my information will be collected, used, and shared as described in the Korn Ferry Global Privacy Policy. I am not a citizen of, ordinarily resident, or physically located in Cuba, Iran, North Korea, or the Russia-occupied regions of Ukraine, nor ordinarily resident in Russia. I agree to receive communications from Korn Ferry via SMS/text regarding career opportunities (message frequency varies; SMS message and data rates may apply; text STOP at any time to opt out). I would like to receive email updates on thought leadership, industry insights and upcoming events from Korn Ferry. Submit Your Resume