Brazil GP - GA i18n project

Project Summary

Join a collaborative initiative at the intersection of clinical expertise and emerging technology. In this project, you will review AI-generated conversations displayed in a Google Sheet, each row containing two separate exchanges (Model A and Model B). You will evaluate every conversation across defined quality dimensions, rating each model individually before completing a final side-by-side comparison.

All conversations will appear in your local language, while your evaluations and written comments will be completed in English. The project is scheduled for delivery by mid-October, with final turnaround expectations to be confirmed. The weekly workload typically ranges from 5 to 10 hours, though it may vary slightly depending on volume.

Project Details

While reviewing both model outputs, you will follow the project’s established evaluation guidelines:

• Add a brief mandatory comment next to each rating dimension.
• Include a Health Literacy assessment for every conversation; request clarification when needed.
• Complete a Summative Quality score for every model.
• Make sure all fields are filled out accurately, with no missing cells.

Responsibilities

Responsibilities

• Examine and assess multi-turn AI conversations produced by Model A and Model B.
• Work in coordination with another rater to complete assigned tabs efficiently.
• Apply clear, consistent, and objective scoring across all quality dimensions.
• Provide concise written comments that explain each rating.
• Evaluate health literacy and summative quality for every model output.
• Identify concerns related to accuracy, completeness, tone, or coherence.
• Ensure full data integrity by completing every required field.
• Raise questions promptly when content or context requires clarification.

Requirements

• Currently practicing physicians in General Practice, Family Medicine, or Primary Care.
• Practicing in Brazil.
• 3+ years of experience. 

Your clinical perspective will help shape how AI supports patient care and professional communication. If you’re interested in contributing to an initiative that elevates the quality and safety of emerging healthcare tools, we welcome your application.