About the job
Join Our Team as a PhD-Level Chemistry Expert!
Compensation: $73.29 per hour
We are on the lookout for highly qualified PhD-level Chemistry experts to contribute to an impactful project aimed at enhancing the quality, reliability, and functionality of advanced conversational AI systems. These AI systems play a crucial role in various everyday and professional applications, and their success hinges on their ability to respond clearly, accurately, and helpfully to real-world inquiries.
In chemistry-related contexts, these AI systems must exhibit precise mechanistic reasoning, quantitative accuracy, and a robust understanding of chemical principles across both theoretical and practical spectrums. This position centers on evaluating and improving how AI models reason about, elucidate, and convey chemistry concepts spanning foundational and advanced topics.
Key Responsibilities
- Craft and refine prompts to steer AI model responses in chemistry-related scenarios.
- Assess AI-generated answers to chemistry queries for scientific validity, mechanistic accuracy, and quantitative reasoning.
- Conduct thorough fact-checking utilizing reputable public sources and domain expertise.
- Annotate model responses by pinpointing strengths, weaknesses, and factual or conceptual inaccuracies.
- Evaluate the clarity, structure, and suitability of explanations for various audiences.
- Ensure responses conform to expected conversational standards and established system protocols.
- Implement consistent evaluation metrics using structured taxonomies, benchmarks, and detailed review guidelines.
Who You Are
- You possess a PhD in Chemistry or a closely related field.
- You have extensive expertise in one or more of the following disciplines:
- Organic & Biological Chemistry
- Inorganic & Materials Chemistry
- Physical & Theoretical Chemistry
- Analytical & Instrumental Chemistry
- You are experienced with large language models (LLMs) and possess an understanding of user interactions with these models.
- You demonstrate superior writing and communication abilities, capable of clearly articulating complex chemistry concepts.
- You exhibit keen attention to detail in identifying subtle issues within technical explanations.
- You have a background in reviewing or editing technical or academic material.
Preferred Qualifications
- Experience with RLHF, model evaluation, or data annotation.
- Background in teaching or mentoring chemistry concepts to non-expert audiences.
- Familiarity with evaluation rubrics and methodologies.