E
Research Engineer, Index Intelligence
Contract type
Ongoing
Work mode
Remote · Switzerland
Experience
3 years
Job description
Research engineer role at an applied AI lab owning the signals and decisions behind which pages the web crawler indexes, follows, deduplicates and drops. The work aims to improve search by deciding what is worth indexing and retrieving.
At a glance
- Work mode
- Remote · Switzerland
What you'll do
- Own the signals behind indexing decisions and the decisions themselves
- Make parsing work on pages where it currently does not, and prove the improvement rather than assert it
- Teach a model to judge page quality and get everyone to agree on what quality means well enough to supervise it
- Work on credibility and misinformation as a modelling problem: what a page claims, whether it is a reliable source of it, and whether it was written for a reader or for a crawler
- Decide whether two documents are semantically the same or genuinely different, so the web can be deduplicated without collapsing pages a user would want to see separately
What we're looking for
- Comfortable owning a problem with no ground truth, where the first job is defining what the right answer means
- Hands-on ML experience with classifiers, rankers and calibration, plus strong data instincts at web scale
- Think in end-to-end impact: a signal only counts if a decision changes and search gets better
- Like working across teams; crawling, indexing and retrieval all consume what you build
- Care about the problem of finding high quality knowledge and recognize how important this is for the world
Apply
Direct apply at Exa
Opens the job posting at Exa
About Exa
An applied AI lab building a search engine unlike the world has ever seen
Exa is an applied AI lab building a search engine. It builds massive-scale infra to crawl the entire web, trains state-of-the-art embedding models to process it, and designs super high performant vector databases to retrieve over it.
Mission
Build perfect search over all the world's information, far beyond Google
Key facts
- AI / search
- Powers search for Cursor, Cognition, HubSpot, and over 400,000 developers
- Has raised $350m from Lightspeed, Benchmark, and a16z
Partners & customers
CursorCognitionHubSpotLightspeedBenchmarka16z