Member of Technical Staff (GPU Performance Engineer)
Level inferred from job title
Job description
GPU Performance Engineer at Reka, responsible for improving large-scale model training infrastructure, post-training processes, and model serving efficiency. The role involves designing and implementing performance improvements and contributing to technical decisions on model performance.
At a glance
- Work mode
- Remote
What you'll do
- Design and implement improvements to training infrastructure
- Directly contribute to technical decisions that optimize performance of models
- Work on post-training processes, including reinforcement learning and fine-tuning
- Contribute to improving the efficiency and scalability of model serving infrastructure
What we're looking for
- Strong engineering skills with fluency in Python and PyTorch (or other frameworks)
- Proven experience implementing and training large deep learning models
- Experience writing and debugging low-level GPU code (CUDA, C++)
- Experience scaling up GPU jobs using large-scale compute clusters (e.g., Slurm or Kubernetes)
- Demonstrated ability to analyze and optimize the performance of GPU-accelerated workloads, including profiling, identifying bottlenecks, and implementing performance tuning techniques
Benefits
- Five weeks of paid leave
- Comprehensive healthcare benefits (including vision and dental)
- Additional perks that support well-being
- Visa support, including H1B and OPT transfers, for US employees
Apply
About Reka
A globally distributed foundation model startup
Reka is a globally distributed foundation model startup, headquartered in the San Francisco Bay Area, California. Embracing a remote-first approach, the team brings together top talent from around the world. The founding team, along with many team members, has contributed to numerous breakthroughs in AI over the past decade.
Mission
Reka's mission is to build useful multimodal artificial intelligence and use it to empower organizations and businesses.
Key facts
- San Francisco Bay Area, California
- Globally distributed foundation model startup
- Remote-first approach
- Founding team and many team members have contributed to numerous breakthroughs in AI over the past decade
What they value
- Inclusive and Open Culture