HPC Networking Lead

San Francisco or Remote

Apply for this position

Magic’s mission is to build safe AGI that accelerates humanity’s progress on the world’s most important problems. We believe the most promising path to safe AGI lies in automating research and code generation to improve models and solve alignment more reliably than humans can alone. Our approach combines frontier-scale pre-training, domain-specific RL, ultra-long context, and inference-time compute to achieve this goal.

About the role:

As the HPC networking lead, you will be the lead technical contributor to an internal NCCL-like library, aiming to optimize performance for communication patterns our workloads require.

What you might work on: 

  • Implement and tune custom collective communication algorithms for specific topologies

  • Design and implement networking monitoring systems for our training clusters

  • Implement and benchmark collective communication primitives to achieve low latency and high throughput

  • Contribute to the development of debugging and profiling tools for network communication performance analysis

  • Integrate new communication techniques into the overall system architecture

What we’re looking for: 

  • Deep understanding of sharding techniques used in distributed training (pipeline/tensor/data parallelism) 

  • Experience contributing to a collective communication library such as NCCL or an MPI implementation

  • Expert understanding of RoCE/IB RDMA networks and have written distributed algorithms using RDMA

  • A track record of contributing to open-source projects related to high-performance networking

Magic strives to be the place where high-potential individuals can do their best work. We value quick learning and grit just as much as skill and experience. 

Our culture:

  • Integrity. Words and actions should be aligned

  • Hands-on. At Magic, everyone is building 

  • Teamwork. We move as one team, not N individuals

  • Focus. Safely deploy AGI. Everything else is noise

  • Quality. Magic should feel like magic

Compensation, benefits and perks (US):

  • Annual salary range: $100K - $550K

  • Equity is a significant part of total compensation, in addition to salary

  • 401(k) plan with 6% salary matching

  • Generous health, dental and vision insurance for you and your dependents

  • Unlimited paid time off

  • Visa sponsorship and relocation stipend to bring you to SF, if possible

  • A small, fast-paced, highly focused team