Jobs · empllo
LLM Pre-training & Distributed Engineer (AI Infrastructure)
Nimbus Data Systems · Worldwide · Posted 11d ago
Available in 6 locations
Australia · onsite Apply → China · onsite Apply → Hong Kong · onsite Apply → Oregon · onsite Apply → Singapore · onsite Apply → Worldwide · remote Apply →About the role
Orchestrate distributed training across 1,000+ GPUs using PyTorch and DeepSpeed.
📋 Description Orchestrate distributed training across 1,000+ GPUs using PyTorch, DeepSpeed, or Megatron-LM. Optimize networking (InfiniBand/RDMA) and memory management to prevent OOM. Automate checkpointing and failure recovery during long training runs. 🎯 Requirements Deep expertise in 3D parallelism (Data, Tensor, Pipeline). Experience managing SLURM or Kubernetes-based GPU clusters. Strong systems engineering background (C++, CUDA, Python).
Read the full posting on empllo →
FAQ
Is the LLM Pre-training & Distributed Engineer (AI Infrastructure) role at Nimbus Data Systems remote?+
This LLM Pre-training & Distributed Engineer (AI Infrastructure) position is listed as remote (Worldwide).
What is the salary for the LLM Pre-training & Distributed Engineer (AI Infrastructure) role at Nimbus Data Systems?+
The listing states Estimated 140k-263k USD.
What seniority level is this LLM Pre-training & Distributed Engineer (AI Infrastructure) role?+
This is a senior level position.
How do I apply for the LLM Pre-training & Distributed Engineer (AI Infrastructure) role at Nimbus Data Systems?+
Use the "Apply on empllo" button to open the original posting on empllo, where you can submit your application directly to Nimbus Data Systems.