Korea GP - GA i18n project

Project Summary

Join a collaborative initiative designed to strengthen the quality of AI-generated medical conversations. As part of this project, you will review a series of AI outputs presented in a Google Sheet. Each row includes two conversation pairs—Model A and Model B—and you will evaluate both independently before completing a final side-by-side comparison.

Although the conversations appear in your local language, all evaluations and written comments will be completed in English. Final turnaround timelines will be confirmed.

Project Details

Your evaluation will follow structured guidelines:

• Mandatory comments: Every rating must include a short explanation in the adjacent comment field.
• Health literacy: You will provide a health-literacy assessment for each conversation; ask for clarification if context is not evident.
• Summative quality: Both Model A and Model B require a final quality score.
• Data integrity: Each item must be reviewed thoroughly with no omissions.

Responsibilities

Responsibilities

• Review and evaluate multi-turn AI-generated clinical conversations from Model A and Model B.
• Apply consistent, objective ratings across all required dimensions for both models.
• Provide clear, concise explanations for every score, ensuring each rating dimension includes a brief comment.
• Assess health literacy, accuracy, completeness, tone, and coherence.
• Complete summative quality ratings for each conversation.
• Ensure all data fields are fully and accurately filled out—no empty cells.
• Coordinate with another rater to complete assigned tabs smoothly and efficiently.
• Flag unclear context promptly and request clarification when needed.

Requirements

Requirements

• Current-practice General/Family Medicine/Primary Care physician.
• 5-10 hours of weekly commitment