About the job
Position Overview
We are in search of a seasoned Biology Subject Matter Expert (SME) to join our team on a freelance basis. You will play a pivotal role in AI training data projects for top AI model developers and enterprises. Your responsibilities will involve establishing success metrics, evaluating outputs, and offering specialized guidance to enhance quality and efficiency. Your contributions will directly influence the successful delivery of high-quality, domain-specific annotated datasets that adhere to stringent technical standards. This engagement will be project-based, with well-defined deliverables, milestones, and completion dates.
Key Responsibilities
Quality Assurance, Technical Standardization, and Process Optimization
- Establish quality success metrics tailored to the biology domain.
- Create specific SOPs, QA rubrics, and reference documents aimed at achieving client technical standards.
- Assess project outputs (annotations, classifications, metadata) against established technical standards, identifying and rectifying errors prior to client delivery.
- Conduct systematic QA reviews on a regular basis; promptly identify, track, and resolve defects to meet delivery deadlines.
- Return work to contractors with detailed remediation feedback.
- Advise on tools, workflows, and processes to achieve quality benchmarks.
- Manage specification changes and unique scenarios, such as new nomenclature updates or ambiguous classifications, drafting acceptance criteria or alternative approaches as necessary.
- Develop libraries of exemplary “gold standard” annotated datasets for calibration against reference samples.
Talent Evaluation & Output Enhancement
- Engage in the assessment and selection of technical contractors for specific projects, including reviews of sample annotations and domain-specific knowledge tests.
- Provide precise, actionable feedback on contractors' sample work to enhance output quality.
- Produce focused training or calibration materials, including guidelines for the correct application of nomenclature and data formatting standards.
Support for Project Delivery
- Offer expert insight on technical scoping and requirements during project initiation, including reference data sources and domain-specific quality thresholds.
- Provide guidance on edge cases, technical exceptions, and changes in specifications throughout the project lifecycle.
- Participate in post-project evaluations to document lessons learned and refine future standards.
- Compile and summarize client model observations and insights, such as misclassification trends and knowledge gaps in model outputs.

