AI Evaluation Specialist: Data Science & ML Focus

About Verita AI

Verita AI is building the intelligent infrastructure that powers the next frontier of AI development: generative media systems. Our AI-driven talent marketplace matches vetted creative experts with frontier AI labs building the next generation of image, audio, music, and video models.

Verita AI is a seed-stage company valued at $25 million. We recently raised $6 million led by Kindred Ventures. Our founding team includes alumni of Mercor, Hudson River Trading, Citadel, IDEO, Stanford, and Yale.

Your Role

As an AI Evaluation Specialist (data science & ML focus), you will apply your professional experience as a data scientist or machine learning engineer to help define, execute, and evaluate realistic analytical workflows.

This is a part-time, contract role (~20 hours/week) designed for experienced professionals looking to contribute on a flexible basis.

What You'll Do

• Design and validate structured tasks based on real-world data science and machine learning workflows

• Reason through ambiguous analytical problems, including problem formulation and approach selection

• Interact with data, models, and tools in ways that reflect day-to-day DS / ML practice

• Evaluate model outputs, identify failure modes, and diagnose errors or inconsistencies

• Provide clear, written explanations of analytical decisions, assumptions, and tradeoffs

• Review and validate AI-generated analytical work for correctness, realism, and quality

• Help define standards for what "good" data science and ML reasoning looks like in practice

What We're Looking For

• Data science or machine learning roles in industry or applied research

• Applied analytics, modeling, or quantitative problem-solving roles

• Experience working with machine learning models, analytical pipelines, or complex datasets

Ideal candidates would have:

• A PhD, or a Master's degree in a relevant field with 3+ years of professional experience

• Strong ability to reason through open-ended data and modeling problems

• Experience evaluating model outputs and identifying strengths, weaknesses, and failure modes

• Clear written communication skills and the ability to explain analytical decisions

• A high bar for correctness, realism, and analytical rigor

Why Verita AI?

You'll be joining a team at the intersection of creative expertise and frontier AI research. This is a rare opportunity to build something from the ground up and play a defining role in shaping how Verita AI shows up to the world.

Have questions? Email recruiting@verita-ai.com