Mercor
|Generalist Expert
N/A, N/A, N/A
Summary
Led nuanced quality assessment of AI-generated responses across diverse subject domains, applying LLM evaluation expertise to deliver high-quality human feedback for RLHF pipelines.
Highlights
Evaluated AI-generated responses across diverse subject domains, conducting nuanced quality assessments covering accuracy, helpfulness, reasoning, tone, and safety for leading AI research organizations.
Applied LLM evaluation expertise, prompt interpretation, and structured rationale writing to deliver high-quality human feedback for RLHF pipelines, ensuring model alignment and performance.
Demonstrated broad generalist knowledge across STEM, finance, healthcare, and real estate domains, effectively assessing complex AI model outputs and enhancing evaluation criteria.