Project Summary
You are required to review a set of AI outputs displayed in a google sheet.
Each row contains 2 pairs of conversations (Model A and Model B).
You will be rating each conversation from Model A and for Model B against each dimension. You should rate them separately first and then you will be asked to compare which is preferred in the final SxS rating
The conversations will be in your local languague, but the reviews and comments will be required to be in english.
We expect the work to be ready by mid October. the turnaround time will be set and confirmed shortly.
Project Details
While reviwiwing the Models A and B you must follow these guidelines:
Mandatory Comments: Provide a brief explanation next to every rating dimension (e g., if you rate a conversation as 'inaccurate, describe why in the adjacent column)
Health Literacy: A Health Literacy rating is required. Please ask for clarification if the context is not immediately clear.
Summative Quality: Please be sure to complete the summative quality rating for each coversation, for each model.
Data Integrity: Every item must be rated against every question. Do not leave any cells blank.
Responsibilities
Review and evaluate AI-generated multi-turn conversations (Model A and Model B).
Collaborate with another rater to complete assigned tabs efficiently.
Apply consistent and objective ratings across all required dimensions.
Provide clear, concise written comments explaining each rating.
Assess health literacy and summative quality for each model’s output.
Identify and describe issues in accuracy, completeness, tone, or coherence where applicable.
Ensure all data fields are completed accurately with no missing information.
Communicate promptly regarding ambiguities or unclear content.
Requirements
General/Family medicine/Primary Care physicians in current practice.
Proficiency in your local language (for conversation review).
Strong command of English for written feedback and documentation.
Excellent attention to detail and ability to follow structured evaluation guidelines.
Ability to work collaboratively and meet deadlines.
Background in linguistics, content evaluation, or health communication preferred but not required.
Compensation
Clinician will be fairly compensated for their time and expertise.
If you are interested in this position, please use the button. You may email recruiting@medcase.health with any questions you might have.
Our team will be in contact with you with more information.
If you are interested in this position, please use the button. You may email recruiting@medcase.health with any questions you might have.
Our team will be in contact with you with more information soon.
Endless Benefits
Work When You Want, Wherever You Want
As a 100% remote professional platform, you can work on as many projects as you want from anywhere in the world. All you need is an internet connection and a Medcase account.
Engage Your Mind
Stay updated round the clock, with the latest news from healthcare as well as the chance to test your knowledge.
Boost Your Earnings
Earn more for your effort with a workspace that appreciates and rewards you for all those hours you put in! Start logging tasks to earn points you can redeem for discounts, perks, cashback, freebies and more.
6,000+ Health Care Professionals trust Medcase for flexible, rewarding project opportunities.
Join our network and start your fully remote part-time project today.
Join
Sign up for free, create your profile and verify your credentials.
Apply
Explore our current projects and find the perfect match for your expertise. Start contributing today!
Earn
Complete your tasks to receive monthly transfers to your connected payment method.