AI Response Evaluator

Job: AI Response Evaluator

Work setting: On-site in Kebayoran Baru, Jakarta Selatan

We are looking for detail-oriented and analytical contributors to support next-generation AI development through human evaluation and annotation. In this role, you will assess and score AI-generated responses based on a combination of objective and subjective criteria, including accuracy, reasoning quality, clarity, safety, relevance, tone, and overall user experience. Your feedback will directly contribute to improving the performance and alignment of advanced AI models.

Responsibilities

• Evaluate and score AI-generated outputs using provided guidelines
• Compare multiple model responses and identify the strongest answer
• Provide concise justification and qualitative feedback
• Detect factual inaccuracies, hallucinations, bias, or unsafe content
• Support continuous improvement of annotation standards and workflows
• Co...

Ready to Apply?

Submit your application today and join our talented team at Thoth AI.