❌

Reading view

Validating GPU Platforms with Runtime AI Inventory via the NVIDIA DSX AI Factory

As teams deploy and scale AI workloads using NVIDIA Dynamo, Kubeflow, or Slurm, tracking what actually runs requires visibility beyond the platform...

As teams deploy and scale AI workloads using NVIDIA Dynamo, Kubeflow, or Slurm, tracking what actually runs requires visibility beyond the platform configuration captured in a recipe. Application teams define and update these workloads independently of the platform recipe, so a reproducible deployment bundle alone cannot establish which workload artifacts are running on each node.

Source

  •  

Manage Kubernetes Clusters for GPU Infrastructure with NVIDIA Kubernetes Engine

An illustration of a layered computing stack shows connected AI models above a Kubernetes layer and a processor.NVIDIA is announcing two open source projects for building and operating managed Kubernetes services on GPU infrastructureβ€”NVIDIA Kubernetes Engine (NVKE) and...An illustration of a layered computing stack shows connected AI models above a Kubernetes layer and a processor.

NVIDIA is announcing two open source projects for building and operating managed Kubernetes services on GPU infrastructureβ€”NVIDIA Kubernetes Engine (NVKE) and NVIDIA Kubernetes Recipes (NVKR). Both are new projects available in public preview. AI Factory customers often want to consume GPU capacity through the Kubernetes APIs, tools, and ecosystem they already use, with the factory operating…

Source

  •  

Keep Distributed Training Running with Automated Workload Recovery

As distributed AI training scales, failures across hardware and software dependencies increasingly disrupt training progress, making fast, reliable recovery...

As distributed AI training scales, failures across hardware and software dependencies increasingly disrupt training progress, making fast, reliable recovery essential. A stalled training rank can trigger an NVIDIA Collective Communications Library (NCCL) timeout, a GPU node can stop responding to the scheduler, or a straggler can slow the entire job. Each disruption is manageable on its own…

Source

πŸ’Ύ

  •  

Making Kubernetes AI-Ready for NVIDIA Vera Rubin on Day One

Configuring and optimizing Kubernetes for new GPU hardware such as NVIDIA Vera Rubin is complex and error-prone. Drivers, kernels, runtimes, networking,...

Configuring and optimizing Kubernetes for new GPU hardware such as NVIDIA Vera Rubin is complex and error-prone. Drivers, kernels, runtimes, networking, operators, and schedulers must work together, with settings tuned to the hardware and workload. Small mismatches can prevent workloads from running or limit performance. The NVIDIA AI Cluster Runtime (AICR)β€”part of the NVIDIA DSX AI Factory…

Source

  •  

Support New AI Frameworks Faster Using NVIDIA Workload Map

NVIDIA DSX AI Factory Platform brings together technologies to help the ecosystem design, build, and operate more efficient AI factories, including open source,...

NVIDIA DSX AI Factory Platform brings together technologies to help the ecosystem design, build, and operate more efficient AI factories, including open source, modular software components built to support multi-tenant operations and scaling. Operating an AI factory requires a shared understanding of distributed workloads: their components, pod templates, replica counts, and status.

Source

  •  
❌