Senior QA Automation Engineer (AI Systems)

Job Description

Software Mind is building a private, tenant‑isolated AI assistant for the real estate title and settlement industry. The platform is a retrieval‑first (RAG) system that ingests historical email, documents, and structured metadata into a per‑tenant vector index, and serves grounded, cited, expert‑weighted answers through a chat‑style Q&A interface with single sign‑on and full audit logging.

The platform is AWS‑native with a Python/FastAPI backend, Vue.js frontend, OpenSearch/Pinecone vector store, and OpenAI/Anthropic/Bedrock as LLM provider. You will join a senior, cross‑functional LATAM‑based team where hands‑on AI delivery experience—not just familiarity—is the baseline expectation.

You build the validation harness that determines whether the AI system meets accuracy standards; this is your primary deliverable. This is not generic test automation. You need to understand what “correct” means for a RAG‑based retrieval system and design test ...