MixmaxRemote

Staff AI Software Developer in Test

Description

51 - 200 employees

Founded 2022

🤖 Artificial Intelligence

Artificial Intelligence • B2B • SaaS

Wand AI is the only platform for management, execution, and creation of AI agents, integrating them as trusted members of the workforce. It powers dynamic teams of humans and AI agents to deliver scalable outcomes through a complete operating system designed for hybrid workforces. Wand's agents continuously learn and adapt to business operations while providing autonomous capabilities, multi-agent orchestration, and enterprise data connectivity to optimize team performance and collaboration.

Staff AI Software Developer in Test

🔥 9 hours ago

Report problem

51 - 200 employees

Founded 2022

🤖 Artificial Intelligence

Artificial Intelligence • B2B • SaaS

📋 Description

• Design and implement QA foundations and evaluation frameworks for assessing AI agents, their workflows and processes. • Design and run experiments to assess AI-driven QA processes, including prompt strategies, automation workflows, and agent performance. • Benchmark systems across multiple engineering streams to determine accuracy, reliability, cost, and consistency of outputs. • Develop approaches for creating synthetic datasets and structured test data to support reliable evaluation. • Identify gaps in existing testing approaches and design AI-based solutions or agents to address them. • Build proof-of-concepts (POCs) to explore new testing approaches and validate ideas. • Structure and document product knowledge, including user journeys, APIs, and business rules, to support AI-assisted testing systems. • Evaluate the cost, ROI, and effectiveness of different QA approaches and automation strategies. • Collaborate closely with the QA Lead and engineering teams to integrate AI-assisted QA into development workflows. • Ensure AI-driven testing processes produce consistent, reliable, and high-quality results. • Remain hands-on in building tooling, experiments, and testing infrastructure.

🎯 Requirements

• Strong background in SDET, test automation. • Experience building and maintaining automated testing frameworks and QA tooling. • Hands-on experience building proof-of-concepts or experimental systems. • Experience evaluating or working with AI systems, LLMs, or agent-based workflows. • Ability to design structured experiments and evaluation methodologies. • Strong understanding of testing fundamentals, including UI and API automation tools such as Cypress, Playwright, or similar. • Experience analysing systems and identifying opportunities to improve processes through automation or AI. • Ability to work hands-on while also contributing to process design and strategic improvements. • Preferred Experience: • Experience working in AI-focused companies or startups. • Hands-on experience building or experimenting with AI agents or AI-driven automation workflows in Quality Assurance. • Experience deg evaluation frameworks for AI systems.

Skills

Artificial IntelligencePlaywrightAIFirebaseIAMCypressAPI

Want AI to find more roles like this?

Upload your CV once. Get matched to relevant assignments automatically.

Try personalized matching