Senior Software Engineer (Agentic Search) - Web Access Engineer

About Tavily

We're building the infrastructure layer for agentic web interaction at scale. Our API is designed from the ground up to power Retrieval-Augmented Generation (RAG) and real-time reasoning in AI systems. By connecting LLMs to high-quality, trustworthy web content, we help developers build agents that are not only intelligent — but also informed.

We work with some of the most innovative teams in AI — from small startups shaping the ecosystem to the largest enterprises deploying AI at scale. Whether it's powering sales assistants, research copilots, or internal knowledge tools, we're the missing link between LLMs and the real world.

The Role

We are looking for a Senior Software Engineer to build the web access infrastructure behind a novel search engine designed for agentic AI.

In this role, you will investigate how modern websites communicate with browsers and translate that understanding into production systems operating at internet scale. You will build browser infrastructure and tooling that enables reliable, efficient access to web content across a rapidly changing web.

Your responsibilities will include:

• Research and analyse how modern websites communicate with browsers across the complete request lifecycle

• Investigate browser fingerprinting, client verification mechanisms, and modern web technologies to enable reliable web access

• Build tooling for browser instrumentation, debugging, observability, and large-scale experimentation

• Translate technical research into production systems operating at internet scale

Requirements

You have 5+ years of experience as a software engineer working on production backend or infrastructure systems, and are an expert in several of the following areas:

Browser Technologies

• Chromium architecture and browser internals

• Browser lifecycle and navigation

• Chrome DevTools Protocol (CDP)

• Playwright, Puppeteer, Selenium, or similar browser automation frameworks

• Browser instrumentation and debugging

Web Platform

• HTTP/1.1, HTTP/2, HTTP/3 — TLS, DNS, and browser networking

• Cookies, browser storage, caching, redirects, and session management

• JavaScript execution and modern client-side rendering

• Resource loading, page lifecycle, and browser networking

• Browser fingerprinting concepts and browser characteristics

Nice to Have

• Experience working on browser engines or browser infrastructure

• Experience reverse engineering browser or web application behaviour

• Experience building internet-scale distributed systems

• Go, C++, Rust, or Python

• Kubernetes and cloud infrastructure

We conduct coding interviews as part of the process.

Why Tavily ?

• Full ownership — small team, you own the entire infrastructure, not a slice of it

• Real scaling challenges — bursty scraping workloads, cache invalidation, multi-region, millions of daily requests

• AI-native company — your infra directly powers AI agents used by leading companies in the space.

Find Jobs in United Kingdom on Arbeitnow