We are hiring PhD-level Subject Matter Experts (Librarian Researchers and Corporate Researchers) to evaluate the quality of AI-generated scientific responses for an AI Evaluation Project. This is an excellent remote contracting opportunity for academic librarians, technical librarians, and corporate researchers who want to contribute to improving AI in scholarly communication while maintaining flexibility in their schedules.

The Role

You will review and critically evaluate AI-generated scientific responses within your subject domain, rate these responses using predefined quality metrics, and provide clear, constructive written feedback. You will need to complete evaluations within deadlines, averaging about 60 minutes per query.

Responsibilities

• Review and critically evaluate AI-generated scientific responses across your subject domain.
• Rate the responses using predefined quality metrics and scales.
• Provide clear, constructive written feedback.
• Complete evaluations within deadlines (approx. 60 minutes per query).

Requirements

• PhD mandatory in a relevant subject area.
• Currently working or recently worked as an Academic/Technical Librarian or Corporate Researcher.
• Minimum 2 years of post-PhD work experience.
• Strong domain expertise and ability to assess scientific accuracy, relevance, and scholarly quality.
• Excellent English language proficiency (written).
• Experience with Elsevier tools (Scopus, ScienceDirect, etc.) is a plus but not mandatory.
• Reliable internet connection and ability to work independently.