Jobs · empllo
LLM Pre-training - Distributed Engineer (AI Infrastructure)
Halcyon Labs · Boston · Posted 11d ago
About the role
Orchestrate distributed training across 1,000+ GPUs using PyTorch and DeepSpeed.
📋 Description Orchestrate distributed training across 1,000+ GPUs using PyTorch/DeepSpeed/Megatron-LM. Tune InfiniBand/RDMA networking and memory to prevent out-of-memory errors. Automate checkpointing and failure recovery during month-long training runs. 🎯 Requirements 3D parallelism (Data, Tensor, Pipeline). Experience managing SLURM or Kubernetes-based GPU clusters. Strong systems engineering background (C++, CUDA, Python).
Read the full posting on empllo →
FAQ
Is the LLM Pre-training - Distributed Engineer (AI Infrastructure) role at Halcyon Labs remote?+
This LLM Pre-training - Distributed Engineer (AI Infrastructure) position is listed as onsite (Boston).
What is the salary for the LLM Pre-training - Distributed Engineer (AI Infrastructure) role at Halcyon Labs?+
The listing states Estimated 140k-263k USD.
What seniority level is this LLM Pre-training - Distributed Engineer (AI Infrastructure) role?+
This is a senior level position.
How do I apply for the LLM Pre-training - Distributed Engineer (AI Infrastructure) role at Halcyon Labs?+
Use the "Apply on empllo" button to open the original posting on empllo, where you can submit your application directly to Halcyon Labs.