QA Engineer (AI Applications)

bolttech is an international insurtech with a mission to build the world’s leading, technology-enabled ecosystem for protection and insurance. With a full suite of digital and data-driven capabilities, bolttech powers connections between insurers, distributors, and customers to make it easier and more efficient to buy and sell insurance and protection products.

A part of Pacific Century Group, bolttech serves customers in multiple markets across North America, Asia and Europe.

In this position you will… …be owning and driving quality for AI-powered applications and platforms. You will partner with Product, Engineering, Data/ML and Security to define test strategy, quality gates and acceptance criteria, then design and execute testing across APIs, UI, integrations and LLM components (prompting, RAG and agent workflows). You will validate functional correctness and GenAI-specific risks such as hallucinations, unsafe outputs, data leakage, latency and cost, ensuring releases are reliable, scalable and compliant for enterprise, multi-tenant use.

・Define and maintain end-to-end QA strategy, test plans, test cases and quality metrics for AI applications (web, APIs, services and integrations). ・Partner with Product and Engineering to translate requirements into clear acceptance criteria, including ・GenAI behaviors (grounding, citations, refusal handling, tone and language). ・Execute functional testing (smoke, regression, UAT support) across UI, API and backend services; validate workflows, permissions, and multi-tenant behavior. ・Design and implement test automation for UI/API and service layers; integrate automated checks into CI/CD pipelines and enforce release quality gates. ・Perform risk-based testing eg. hallucination, toxicity, prompt injection, data leakage (PII/PHI), guardrails, redaction, etc. ・Test non-functional requirements: performance/latency, reliability, concurrency, and observability (logs/traces).

・5+ years of QA experience (manual and automation) for web applications, APIs and distributed systems; experience in Agile delivery teams. ・Strong knowledge of test design techniques (risk-based testing, boundary/value analysis, exploratory testing) and defect lifecycle management. ・Hands-on test automation experience with tools such as Playwright/Cypress/Selenium for UI and　Postman or equivalent for API testing is a strong plus. ・Proficiency in at least one programming/scripting language (JavaScript/TypeScript, Python or Java) to build and maintain automation and test utilities is a strong plus. ・Experience testing GenAI/LLM applications, with practical understanding of prompts, tokens, temperature, embeddings, RAG, tool/agent calling, and common failure modes (hallucination, prompt injection). ・Excellent communication skills and ability to collaborate with cross-functional stakeholders (Product, Engineering, Data/ML, Ops).

・Flexible working arrangements, including hybrid/remote work options ・Performance-driven and autonomous work culture ・Flexible scheduling based on team and role requirements ・Statutory annual leave plus additional company-provided leave ・Paid leave for sick days and personal reasons ・Leave for major life events such as marriage, childbirth, and bereavement ・Competitive salary and performance-based incentive programs ・Full support for statutory retirement pension and social insurance contributions ・Reward and recognition programs based on long-term service and performance ・Group accident and medical insurance coverage ・Regular health check-ups and wellness program support ・Employee Assistance Program (EAP) offering psychological counseling and mental health support ・Provision of necessary IT equipment and software for work ・Comfortable office environment and essential workplace amenities ・Horizontal organizational culture that values collaboration and communication ・Trust-based culture built on autonomy and accountability ・Open communication and strong teamwork environment ・Inclusive and diverse g