In this position, you will utilize your skills to train and evaluate next-generation AI systems, ensuring they learn and reason effectively through real-world input.

Responsibilities

• Assess and score AI-generated responses using established rubrics and metrics across various subjects.
• Annotate and classify data sets to enhance the accuracy and reliability of AI models.
• Review content meticulously for relevance, coherence, and factual correctness.
• Offer clear, actionable feedback on AI performance to guide model improvements.
• Collaborate with the client's team to interpret guidelines and refine rubrics.
• Keep detailed records of annotations and evaluations, documenting your findings.
• Analyze complex subjects, including business, finance, marketing, healthcare, and legal domains.

Requirements

• Strong attention to detail and accuracy in data annotation and content evaluation.
• Excellent critical reading and analytical skills with the ability to apply rubrics effectively.
• Proficient in both written and verbal communication, capable of providing nuanced feedback.
• Bachelor’s degree is mandatory.
• Experience in evaluating or scoring large content volumes against specific criteria.
• Background in AI training, machine learning data annotation, or similar tasks is highly advantageous.
• Ability to work both independently and collaboratively in a remote setting.

Nice to Have

• Experience in business, finance, legal, marketing, healthcare, or research fields.
• Previous involvement in AI training, human-in-the-loop systems, or quality assurance of AI-generated content.
• Familiarity with standard annotation tools or AI evaluation platforms.