Senior Test Analyst in AI & Automation

NCS Australia
📍 Australia, New South Wales, Australia 💼 full-time 🕒 Posted February 26, 2026

Job Description

Job Description

We are seeking a Senior Test Analyst to design, automate, and execute testing for LLM‑powered applications and agentic systems operating across multiple platforms and services. You will lead Responsible AI testing (safety, guardrails, fairness, explainability), red‑teaming/adversarial evaluation, and multi-system integration testing. You will also coordinate releases across DEV, SIT, UAT, and PROD, producing audit‑ready test evidence for Cyber and Change boards.

You’ll partner closely with AI engineering, platform, SecOps, and Network Operations teams to assure safety, reliability, and compliance of AI capabilities at scale.

As a Senior Test Analyst, you will design and execute comprehensive test strategies for AI‑driven and multi‑system solutions, ensuring quality across integration, API, functional, and Responsible AI domains. You will develop automated test suites using Python or shell scripting, validate LLM behaviour and agent workflows, and...

Ready to Apply?

Submit your application today and join our talented team at NCS Australia.

Submit Application

Job Details

  • Location Australia, New South Wales
  • Job Type full-time
  • Category Computer Occupations
  • Posted Date February 26, 2026
  • Application Deadline April 07, 2026