Data & Evaluation LLM Intern

Office Location: Sequis Tower, SCBD, Jakarta

Work Arrangement: Hybrid (WFO + WFA)

Responsibilities

• Support evaluation workflows for Large Language Models (LLMs) across chat, voice, and task-based use cases.
• Review model outputs for quality, factuality, instruction-following, safety, tone, and user experience.
• Label / annotate datasets based on internal guidelines and maintain high consistency.
• Assist in prompt testing, A/B comparisons, and regression checks after model updates.
• Identify recurring failure patterns and summarize findings to senior team members.
• Prepare reports, trackers, and dashboards for quality metrics and project progress.
• Collaborate with Data, Product, QA, and Operations teams on improvement cycles.
• Help organize datasets for training, fine-tuning, and benchmarking.

Qualifications

• Recent graduate with a Bachelor's degree, or currently a final-year student.
• Fluent in English and Bahasa Indonesia.
• Strong analytical thinking and attention to detail.
• Familiar with AI/ChatGPT/LLM tools and comfortable with spreadsheets (Excel/Google Sheets).
• Able to follow guidelines consistently, handle repetitive tasks accurately, communicate well, and learn fast.
• Nice to have skills: Data labeling/QA/content moderation, prompt engineering, Python/SQL, Jira/Notion, voice bot/call evaluation, or reporting skills.

About AI Rudder

AI Rudder is a conversational AI company on a mission to transform how businesses communicate with their customers — across voice and digital channels that feel genuinely human.

Founded in 2019 and headquartered in Singapore, we're building technologies that bridge languages, enhance understanding, and enable meaningful human–machine communication at scale.

Today, we serve 500+ enterprise clients globally processing 50 million calls daily and having delivered more than 8 billion calls to date.

Most recently, we have raised $50M in a Series B fundraising from leading global investors including Tiger Global, Peak XV Partners, and Cathay Innovation.

How We Work

AI-first: AI isn't a tool we reach for. It's the default we start from. Every team, every workflow: AI-first.

Global Collaboration: We operate globally and work as one team. Distance is a logistics problem, not a cultural one. We build the habits that make distributed teams actually work.

Communication Principle: Simple, Trust, Transparent. We remove unnecessary complexity so people can focus on what matters most.

What We Offer

Learning & Development: Continuous learning through real projects, knowledge sharing session, mentorship, and cross-functional collaboration.

Performance Recognition: Regular performance reviews, feedback, and opportunities for career progression.

Global Exposure: Collaborate with international teams, global rotations, and work with global enterprise customers.

Meaningful Impact: Build AI solutions that create real value for businesses around the world.

Ownership & Autonomy: Freedom to take initiative and drive outcomes.

Team Engagement: Team Building, Local & Global Gatherings & Local Events Celebration.

AI Rudder is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees and applicants.