Montreal AI Systems Testing QA Lead

Lead AI systems testing as a QA Lead specializing in quality assurance for contract projects in Montreal, QC. Bring expertise in LLM and testing methodologies.
Our team is in search of a seasoned QA Lead to manage AI systems testing for a contract role in Montreal. This position involves strategic leadership in quality assurance focusing on LLM inner workings and prompt engineering. You will be responsible for ensuring the integrity of AI product testing through effective collaboration with interdisciplinary teams to meet quality benchmarks.
Key Responsibilities:
• Direct design and execution of AI testing strategies
• Develop test harnesses for LangChain applications
• Validate RAG framework integrity and accuracy
• Establish generative AI quality metrics and thresholds
• Document findings comprehensively for all stakeholders
Requirements:
• Strong background as a QA leader in AI/ML systems
• In-depth understanding of LLM tokenization and inference
• K...