Staff Site Reliability Engineer - Dev Platform
Level inferred from job title
Job description
Site Reliability Engineer role on Kraken's Dev Platform team, owning the reliability, availability and performance of the company-wide AI Gateway LLM service.
At a glance
- Work mode
- Remote
What you'll do
- Own the reliability, availability and performance of the AI Gateway as a production-critical service used across the company, including SLOs, error budgets and on-call practices
- Design the gateway's resilience: multi-provider routing, failover, retries, rate limiting and graceful degradation when an upstream model provider is slow or unavailable
- Set the technical direction for gateway architecture, capacity planning and scaling as LLM traffic grows and more workloads move onto the gateway
- Build observability for LLM traffic, covering latency, errors, token usage and cost, attributed by team and use case
- Partner with Security, Finance and AI governance stakeholders to put access controls, budgets, audit logging and data-handling requirements into the platform
- Lead incident response and blameless post-incident reviews, and turn what you learn into lasting reliability improvements
- Automate operations through infrastructure as code, safe deployments and progressive rollouts
- Mentor engineers and raise the operating standard across Dev Platform
What we're looking for
- Extensive experience in site reliability, infrastructure or platform engineering, with a track record of owning high-traffic, business-critical services in production
- Deep hands-on experience with Kubernetes, a major cloud provider and infrastructure as code (for example Terraform)
- Strong command of SLOs, observability and incident management, and the judgment to know which reliability work matters most
- Proficiency in a language such as Rust or Python, and comfort reading and contributing to a production service's codebase
- Experience with API gateways, reverse proxies or traffic management: load balancing, rate limiting, failover and caching
- Experience with Consul and Vault for service discovery, configuration and secrets management
- Working knowledge of authentication and authorization mechanisms for internal platforms and APIs, such as OAuth 2.0/OIDC, JWT, mTLS and API keys
Your team
Dev Platform
Builds the internal platform that Kraken's engineers use to build, ship and run software; within it, the AI Gateway is Kraken's company-wide LLM gateway providing a single, governed entry point to leading models from providers such as Anthropic, OpenAI and Google.
Apply
Direct apply at Kraken
Opens the job posting at Kraken
About Kraken
Building the Future of Open Finance
Founded in 2011, Kraken is one of the world's longest-standing crypto platforms, trusted by over 10 million individuals and institutions across the globe. It offers spot trading, margin, futures, staking, and OTC services, with products built for both individual investors and institutional clients. Payward is the parent company behind Kraken, NinjaTrader, Breakout, xStocks, Payward Services and CF Benchmarks.
Mission
Advance an open, global financial system.
Key facts
- 2011
- Crypto / financial infrastructure
- Founded in 2011
- Trusted by over 10 million individuals and institutions across the globe
- Offers spot trading, margin, futures, staking, and OTC services
- Payward is the parent company behind Kraken, NinjaTrader, Breakout, xStocks, Payward Services and CF Benchmarks
- Has spent the last 15 years building one of the most modern and globally accessible financial infrastructure platforms in the industry