OmegaHires

QA AI Lead

Remote · Remote · Posted today

Opens omegahires.applytojob.com

Get a version of your resume written for this job.

Salary
Not listed
Job type
Contract
Work mode
Remote
Source
Jazzhr (employer's hiring system)

Skills mentioned

Generative AI, LLM, CI/CD

About the role

QA AI Lead

Responsibilities:- Define and implement enterprise-wide AI testing and quality assurance strategies.- Establish testing standards, governance, and best practices for AI/ML and Generative AI applications.- Lead QA activities across AI product lifecycle from development through production deployment.- Drive AI-powered quality engineering transformation initiatives.- Validate LLMs, Chatbots, Copilots, and GenAI applications.- Develop test scenarios for prompt validation, hallucination detection, bias and fairness testing, security and privacy testing, performance and scalability testing, and explainability validation.- Define AI model quality metrics and monitoring standards.- Design and implement automated testing frameworks.- Integrate automated testing into CI/CD pipelines.- Establish AI-assisted test generation and test optimization strategies.- Drive shift-left and continuous testing practices.- Lead and mentor QA Engineers, Automation Engineers, and AI Test Specialists.- Collaborate with Product Owners, Architects, Developers, Data Scientists, and Business Analysts.- Manage vendor and offshore QA teams.- Conduct test planning, effort estimation, and release readiness reviews.- Monitor quality KPIs and AI performance metrics.- Present quality status and risk assessments to leadership teams.- Ensure compliance with security, regulatory, and Responsible AI requirements.

Required Skills:- Bachelor's degree in Computer Science, Information Technology, Engineering, or related field; Master's degree preferred.- 10+ years of experience in Software Quality Assurance.- 5+ years of Test Automation experience.- 3+ years of experience testing AI/ML or Generative AI solutions.- Experience leading QA teams and enterprise testing programs.

Job ID jz-omegahires-20261002200053_9qlmdrgvtyqlrr7t · Original posting ↗