Open role
Korea GP - GA i18n project
Project summary
Join a collaborative initiative designed to strengthen the quality of AI-generated medical conversations. As part of this project, you will review a series of AI outputs presented in a Google Sheet. Each row includes two conversation pairs—Model A and Model B—and you will evaluate both independently before completing a final side-by-side comparison.
Although the conversations appear in your local language, all evaluations and written comments will be completed in English. Final turnaround timelines will be confirmed.
Project details
Your evaluation will follow structured guidelines:
- Mandatory comments: Every rating must include a short explanation in the adjacent comment field.
- Health literacy: You will provide a health-literacy assessment for each conversation; ask for clarification if context is not evident.
- Summative quality: Both Model A and Model B require a final quality score.
- Data integrity: Each item must be reviewed thoroughly with no omissions.
Responsibilities
- Review and evaluate multi-turn AI-generated clinical conversations from Model A and Model B.
- Apply consistent, objective ratings across all required dimensions for both models.
- Provide clear, concise explanations for every score, ensuring each rating dimension includes a brief comment.
- Assess health literacy, accuracy, completeness, tone, and coherence.
- Complete summative quality ratings for each conversation.
- Ensure all data fields are fully and accurately filled out—no empty cells.
- Coordinate with another rater to complete assigned tabs smoothly and efficiently.
- Flag unclear context promptly and request clarification when needed.
Requirements
- Current-practice General/Family Medicine/Primary Care physician.
- 5-10 hours of weekly commitment
Interested in this role? Use Apply now above or email recruiting@medcase.health with questions. Our team will follow up with more information.
Designed for Practising Clinicians
Medcase engagements are built to complement active clinical practice—not replace it.
- Project-based participation aligned with your specialty
- Compensation for professional medical expertise
- Flexible involvement without long-term commitments
- Secure, compliant environments (HIPAA, GDPR)
Held to Clinical Standards
Not every contribution is equal in healthcare—and we treat it that way.
- Credential verification and specialty matching
- Structured review and calibration processes
- Ongoing quality oversight by medical and project leads
- Clear clinical and ethical guidelines
How Clinicians Contribute
Clinicians participate where medical judgment matters most in AI development.
- Reviewing and validating medical data and model outputs
- Providing expert clinical interpretation across modalities (text, imaging, video, waveform, audio)
- Supporting clinician-led data annotation and enrichment
- Advising on clinical accuracy, relevance, and edge cases
- Contributing specialty-specific insight across regulated use cases
Professional Contribution, Fairly Compensated
Clinicians are compensated for their time and professional expertise.
- Compensation details are shared transparently during the application and onboarding process
- Participation is designed to fit alongside active clinical roles
6,000+ Health Care Professionals trust Medcase for flexible, rewarding project opportunities.
Join our network and start your fully remote part-time project today.
Join
Sign up for free, create your profile and verify your credentials.
Apply
Explore our current projects and find the perfect match for your expertise. Start contributing today!
Earn
Complete your tasks to receive monthly transfers to your connected payment method.