Senior Quality Assurance Engineer

About SleekFlow

SleekFlow is an AI Suite for Revenue-Driving Conversations. We are trusted by over 2,000 enterprises globally. But we are more than just a SaaS company; we are an AI-native movement redefining the B2C relationship across 70+ countries.

At our core is AgentFlow—an AI GTM workforce that learns, improves, and acts as a self-healing knowledge base for businesses. From first-click conversion to long-term retention, we turn every conversation into a data-backed growth opportunity. Headquartered in Singapore with a global presence in Hong Kong, the UAE, and the US, we are looking for exceptional people to help us build an AI operating system that matters.

Join us and rewrite how the world engages at scale.

Learn more from our blogs for developers: https://sleekflow.io/blog/category/developer-blog

Senior level

Location: Jakarta, Indonesia

About the Role

As a Senior QA Engineer at SleekFlow, you will drive quality across our web applications, omnichannel workflows, and AI-powered conversational tools. You will be responsible for designing robust automation frameworks, assessing risks, and shaping our QA practices around non-deterministic AI features (LLMs, chatbots, and RAG systems).

Responsibilities

End-to-End Quality Ownership: Review user stories and requirements to design comprehensive test strategies across web applications, APIs, and background services.

AI & LLM Quality Assurance:

• Evaluation Frameworks: Design, run, and maintain evaluation frameworks for LLM-based features, covering accuracy, hallucination, relevance, prompt robustness, and consistency under non-deterministic behavior.
• Dataset Ownership: Own the eval datasets—write test cases with golden answers and must/must-not rules, grow them from failure analysis and production incidents, version them, and keep tuning data separate from release-gating data.
• LLM Judge Calibration: Calibrate automated LLM judges against human grading and re-check them when judge models or prompts change.
• Release Gating & Triage: Gate releases on eval results; triage failures to root cause (model, retrieval, prompt, test, or infrastructure) and route to the right owner.
• Guardrails & Security: Design and enforce guardrail tests (prompt injection, data leakage, out-of-scope behavior) with zero tolerance for breaches.

Automation Frameworks: Build, maintain, and expand automated test coverage across unit, integration, and E2E layers (web and API).

Risk & Impact Analysis: Conduct technical impact analysis to identify edge cases, performance bottlenecks, and architectural risks before release.

CI/CD & Environment Health: Partner with DevOps and Engineering to integrate LLM eval suites and automated tests into CI/CD pipelines.

Cross-Team Collaboration: Work closely with Product, AI/LLM Engineers, and Software Engineers to embed quality standards early in the SDLC and troubleshoot production incidents quickly.

Requirement

• Experience: 5+ years of hands-on experience in Software Quality Assurance, test automation, and release management.
• AI / LLM Testing: Hands-on experience testing LLM applications (chatbots, RAG systems, agents) with a deep understanding of non-deterministic behavior, prompt evaluation, and guardrail testing.
• Programming Skills: Proficient in TypeScript / JavaScript (or Python/another high-level language).
• Automation Expertise: Proven experience with modern E2E and API testing frameworks (e.g., Playwright, Cypress, Jest, Supertest, Postman).
• API & System Architecture: Strong experience with RESTful APIs, webhooks, microservices architecture, and API mocking tools.
• CI/CD Processes: Experience working with CI/CD pipelines (e.g., GitHub Actions, GitLab CI) to automate regression and evaluation suites.
• Problem Solving & Mindset: Sharp analytical skills with strict attention to edge cases, data integrity, and system safety.
• Communication: Fluent in English (Mandarin/Cantonese is a plus).

What We Offer

• Attractive compensation package including a 13th-month salary
• Stock options in a rapidly growing startup
• A fun, diverse, and international team culture
• Comprehensive group medical insurance
• Transport allowance
• Examination & education allowance
• Paid birthday leave
• Flexible work-from-home policy
• Work From Anywhere scheme
• Rewarding continuous learning from experienced team leads
• Many more exciting perks and growth opportunities!

Confidence can sometimes hold us back from applying for a job. But we'll let you in on a secret: there's no such thing as a perfect candidate.

SleekFlow is a place where everyone can grow. So however you identify and whatever background you bring with you, please apply if this is a role that would make you excited to come into work every day.