About The Opportunity
Help our client improve how AI systems personalize responses for multilingual professionals. In this remote contractor assignment, you will review AI-generated answers using authorized professional email history as context. You will judge whether each response is relevant, accurate, helpful, and appropriately personalized across German and English communication. Your careful, objective feedback will help improve the quality and reliability of future AI experiences.
What you will do
- Assess AI-generated responses for relevance, accuracy, helpfulness, and appropriate personalization.
- Compare multiple responses and determine which delivers the stronger overall experience.
- Identify unsupported assumptions, incorrect personalization, irrelevant recommendations, and subtle inconsistencies.
- Evaluate how effectively responses use German and English professional-email context.
- Explain your judgments through clear, detailed, and well-reasoned written feedback.
- Follow evaluation guidelines consistently while protecting privacy and maintaining confidentiality.
What we are looking for
- Strong German proficiency and professional English proficiency, including the ability to evaluate nuanced written content in both languages.
- An active Google Workspace account used regularly for professional communication.
- A Gmail interface or display language set to the target project language.
- A professional inbox in which German and English each represent at least 30% of the email content.
- A well-established professional inbox with approximately 1,000 or more emails and regular account activity.
- Authorization to use the qualifying Google Workspace account's email history for this evaluation project.
- A bachelor's degree or equivalent practical experience in any field.
- At least two years of professional experience.
- Strong analytical judgment, attention to detail, and the ability to work independently in a remote setting.
- Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical area is helpful but not required.
- A desktop or laptop, reliable internet access, and the ability to follow detailed project instructions.
Engagement details
- Remote contractor assignment with an immediate start.
- Expected duration of 12 to 16 weeks.
- At least 4 hours of availability per day, up to 40 hours per week.
- At least 4 hours of working-time overlap with Pacific Time.
Compensation
