Senior Infrastructure Software Engineer
Job description
Senior Infrastructure Software Engineer on Lightning AI's Infrastructure Engineering team, building production software, APIs, tooling and automation to manage large-scale GPU and bare-metal infrastructure across its lifecycle.
At a glance
- Employment
- Full-time · Employee (employment agreement)
- Work mode
- Hybrid · London, United Kingdom
- Pay
- USD 180,000 – 220,000 / year
What you'll do
- Design, build, and operate production services, APIs, tooling, and automation for managing large-scale bare-metal and GPU infrastructure
- Build and extend software systems that support infrastructure provisioning, configuration, monitoring, and lifecycle management
- Develop reliable automation that reduces manual operational work and improves the consistency and scalability of infrastructure management
- Build tools and interfaces that enable engineers and other systems to interact programmatically with physical infrastructure
- Build and extend systems for server discovery, provisioning, configuration, validation, and lifecycle management
- Automate infrastructure bring-up and capacity deployment across large fleets of compute systems
- Integrate software and automation with hardware management and provisioning systems
- Improve tooling and workflows for managing infrastructure throughout its production lifecycle
- Build telemetry, logging, and observability capabilities that provide visibility into the health of our infrastructure
- Develop tools and automation to identify, diagnose, and respond to infrastructure and hardware issues
- Translate recurring operational issues and hardware failure modes into improvements to software, tooling, and automation
- Improve the reliability and scalability of infrastructure operations as the fleet grows
- Partner with Network, Infrastructure Operations, Data Center, Platform Engineering, and other teams to define requirements and build new infrastructure capabilities
- Participate in architectural discussions and help define the technical direction of Lightning AI's infrastructure software
- Make pragmatic design decisions that balance reliability, scalability, simplicity, and speed of execution
- Write clear design documents and technical documentation and contribute to engineering best practices
What we're looking for
- 5+ years of professional software engineering, infrastructure engineering, or related experience
- Strong software engineering fundamentals and experience building production backend systems in Python or similar object-oriented programming languages
- Strong experience with Linux in production environments
- Experience building APIs, tooling, or automation for managing infrastructure at scale
- Familiarity with containerization and orchestration concepts
- Understanding of HPC and bare-metal infrastructure fundamentals, including provisioning and out-of-band management
- Ability to navigate ambiguity and make pragmatic architecture decisions while building for long-term reliability and scale
- Experience working in a startup or other fast-paced environment with a high degree of ownership and autonomy
Nice to have
- Experience with bare-metal hardware troubleshooting and provisioning, including technologies such as PXE/iPXE, BMC, Redfish, or IPMI, particularly with Dell hardware
- Experience with GPU servers, either in bare-metal environments or under virtualization
- Experience with network switches, routers, and firewalls, particularly SONiC switches, Palo Alto firewalls, or Juniper Networks
- Experience with high-performance storage systems, particularly VAST
- Experience supporting AI/ML or HPC infrastructure at scale
Your team
Infrastructure Engineering
Builds the software systems that operate and manage Lightning AI's large-scale GPU and bare-metal infrastructure, developing services, APIs, tooling, and automation that bridge physical infrastructure and customer systems for AI/ML training, inference, and HPC workloads.
Benefits
- Comprehensive Health Coverage: Medical, dental, and vision coverage for employees and eligible dependents
- Meaningful Equity: RSUs that give employees a stake in the company's long-term success
- Retirement Savings: 401(k) matching (U.S.) and pension contributions (U.K.)
- Flexible Time Off: Unlimited PTO, company holidays, and floating holidays to support work-life balance
- Company-Wide Winter Break: Two weeks of company closure each winter to disconnect and recharge
- Paid Parental & Family Leave
- Professional Development: Annual learning and development allowance
- Wellness Benefits: Wellness and work-from-home stipends
- Sabbatical Program: Four weeks of paid sabbatical leave after four years of service
- Flexible Work: Flexible schedules and a hybrid work model for our office-based teams
- In-Office Meals: Complimentary meals at our office hubs
Apply
About Lightning AI
The company behind PyTorch Lightning
Lightning AI builds an end-to-end platform for developing, training, and deploying AI systems—designed to take ideas from research to production with less friction. Through its merger with Voltage Park, a neocloud and AI Factory, Lightning AI combines developer-first software with cost-efficient, large-scale compute, with security, observability, and control built in. It serves solo researchers, startups, and large enterprises.
Key facts
- 2019
- AI platform and compute
- Founded in 2019
- Behind PyTorch Lightning
- Merged with Voltage Park, a neocloud and AI Factory
- Offices in New York City, San Francisco, Seattle, and London
- Operates globally
- Backed by Coatue, Index Ventures, Bain Capital Ventures, and Firstminute
Partners & customers
What they value
- Move with Urgency
- Take Ownership
- Communicate Openly
- Build Great Teams
- Raise the Bar
- Think Long-Term
