Note: The job is a remote job and is open to candidates in USA. Nscale is building next-generation AI infrastructure from the ground up, aiming to deliver reliable and scalable network clusters for large-scale AI training and inference. The Senior Systems Engineer will lead the deployment of network clusters, ensuring they are validated and production-ready, while also contributing to automation and process improvement.
Responsibilities
- Execute end-to-end bringup of network nodes and racks from installation to production readiness
- Validate BIOS/BMC/firmware configurations and network health
- Perform rack-level integration including power, cabling, and airflow validation
- Bring up and validate high-speed network fabrics (InfiniBand, RoCE, 100–400G Ethernet)
- Configure and validate leaf/spine network connectivity
- Run cluster-wide burn-in and stress testing
- Validate node-to-node performance (NCCL, RDMA, GPUDirect)
- Troubleshoot hardware, firmware, and fabric-level issues
- Contribute to automation for provisioning and cluster validation
- Improve deployment playbooks and documentation
- Identify reliability issues early and drive corrective actions
- Help turn ad hoc deployments into repeatable systems
- Work closely with networking, systems software, and data center teams
- Coordinate with hardware vendors to resolve bringup issues
- Support rapid capacity expansion as we scale
Skills
- 5–8+ years in infrastructure engineering, hardware deployment, or data center operations
- Hands-on experience deploying network servers (HGX/DGX or similar platforms)
- Experience with high-speed networking (InfiniBand, RoCE, Ethernet fabrics)
- Strong Linux systems knowledge
- Experience troubleshooting distributed systems performance issues
- Comfortable working onsite in data center environments as needed
- Experience in AI/ML infrastructure or HPC environments
- Familiarity with NCCL, CUDA, RDMA
- Automation experience (Python, Ansible, Terraform, Bash)
- Experience in high-density power and cooling environments
Company Overview