AI Research

Contract type
Ongoing
Work mode
Remote · Worldwide
Experience
3 years

Job description

AI Researcher at Vetto who designs datasets, benchmarks, and evaluations to teach models new capabilities and measure whether training interventions worked. The role is evaluation-driven with some fine-tuning and post-training to validate research hypotheses, working directly with top AI labs.

At a glance

Work mode
Remote · Worldwide

What you'll do

  • Design and run experiments to understand model behavior, test new ideas, and determine whether a dataset or training intervention actually works.
  • Use fine-tuning and post-training experiments when useful to validate research hypotheses and measure improvements in the capabilities we care about.
  • Create datasets, benchmarks, agent environments, rubrics, and evaluation methods for problems that are not well measured today.
  • Work directly with AI labs and enterprise partners to turn open-ended model-development goals into concrete research and data projects.
  • Dig into model outputs and trajectories to understand systematic failure modes and separate model limitations from problems in the data, grader, or evaluation setup.
  • Write analysis code and build lightweight tools or prototypes for your own work, with support from engineers when a workflow needs to become reliable infrastructure.
  • Share what you learn through clear technical reports, internal discussions, benchmarks, and research papers.

What we're looking for

  • Experience doing empirical research or similarly open-ended technical work with machine learning systems.
  • Hands-on experience designing and running agentic systems for complex work, such as coding agents and automated research pipelines.
  • Good experimental judgment: you can form a hypothesis, choose useful baselines and metrics, run a careful experiment, and make sense of noisy results.
  • Strong Python and data analysis skills, plus enough software engineering ability to prototype your own research workflows.
  • The independence to take an ambiguous question about a model and turn it into a dataset, benchmark, experiment, or other concrete contribution.
  • Rigorous analytical thinking — you look at the underlying evidence, notice subtle failure modes, and question results that seem too simple or too good to be true.
  • Excellent written and verbal communication with researchers, engineers, customers, and non-specialists.
  • Comfort with ambiguity, fast iteration, changing priorities, and occasional forward-deployed work with partner teams.

Nice to have

  • Research or industry experience in LLM evaluation, post-training, agents, human or synthetic data, alignment, or AI safety.
  • Experience designing datasets or benchmarks, validating annotation quality, or working with large collections of model outputs and trajectories.
  • Published research, technical writing, open-source contributions, or strong independent projects.
  • Experience building or managing human feedback pipelines.
  • A background in cognitive science, linguistics, philosophy, statistics, or another field that helps you think clearly about evaluation.
  • Experience at an AI lab, AI data company, or in a partner-facing research role.

Benefits

  • Competitive compensation and a stock option plan.
  • Global, remote-first work with flexibility and periodic in-person on-sites every few months.
  • Direct collaboration with cutting-edge AI labs on evaluation, data, and post-training challenges.
  • High ownership and fast career growth in a founding-era team.

Apply

About Vetto

Builds the infrastructure for next-generation AI training data

Vetto builds the infrastructure for next-generation AI training data. We partner with the world's top AI labs to push the frontier of what models can do — by designing, collecting, and delivering the highest-quality training data for the hardest problems in AI.

Key facts

  • Partners with the world's top AI labs
  • Global, remote-first work with periodic in-person on-sites every few months
  • Founding-era team

What they value

  • End-to-end ownership
  • Work that gets used
  • Fast, flat team