❌

Normal view

Reducing Rollout Bottlenecks in Reinforcement Learning with NVIDIA Dynamo

19 November 2026 at 20:28
Reinforcement learning (RL) uses rewards to train models to solve problems and complete tasks more successfully. Inference drives this process. Workers generate...

Reinforcement learning (RL) uses rewards to train models to solve problems and complete tasks more successfully. Inference drives this process. Workers generate rollouts: sequences of model outputs, actions, and environment interactions. The RL framework scores the results, updates model weights, and sends those weights back to the workers for the next round. As RL training scales…

Source

Co-Designing Sparse Attention for Efficient Long-Context Inference

17 November 2026 at 17:30
Agentic workloads, long documents, and large codebases are pushing context lengths from tens of thousands of tokens to hundreds of thousands. At those lengths,...

Agentic workloads, long documents, and large codebases are pushing context lengths from tens of thousands of tokens to hundreds of thousands. At those lengths, attention becomes the most expensive part of a transformer layer. Dense attention scores every query against every key, so its cost per query grows with the context length N, and at 128K tokens it can take most of the prefill time in a…

Source

Integrating QPUs into Supercomputing Centers Using Slurm HRES Plugins

17 November 2026 at 17:00
Quantum processors are being integrated into supercomputing centers worldwide. National programs in North America, Europe, and Asia are driving the installation...

Quantum processors are being integrated into supercomputing centers worldwide. National programs in North America, Europe, and Asia are driving the installation of quantum processing units (QPUs) alongside high-performance computing (HPC) systems. Every supercomputer will eventually be a hybrid quantum-classical device, drawing on quantum processors to expand what’s possible in scientific research.

Source

NVIDIA Vera Rubin NVL72 Leads Agentic Inference Performance on MLPerf Endpoints v1.0

16 November 2026 at 16:00
Two rows of black data center racks with gold-colored server components against a black background.Agentic workloads are demanding more from inference systems. AI agents carry growing conversation histories across turns and generate a mix of reasoning, tool...Two rows of black data center racks with gold-colored server components against a black background.

Agentic workloads are demanding more from inference systems. AI agents carry growing conversation histories across turns and generate a mix of reasoning, tool calls, and responses. Inference systems must support users at scale while remaining responsive. MLPerf Endpoints v1.0 evaluates this balance between serving capacity and responsiveness using coding and enterprise workflows through API…

Source

NVIDIA Vera Rubin NVL72 Achieves up to 2x Blackwell Ultra Performance in MLPerf Training v6.1

16 November 2026 at 16:00
As AI agents tackle increasingly complex workflows, reducing time-to-train is critical for rapidly iterating on both models and the agents they power. MLPerf...

As AI agents tackle increasingly complex workflows, reducing time-to-train is critical for rapidly iterating on both models and the agents they power. MLPerf Training v6.1 marks the debut of the NVIDIA Vera Rubin architecture, and these early results demonstrate that its CUDA software stack is already highly mature. NVIDIA swept all seven benchmarks, with the Vera Rubin NVL72 platform delivering…

Source

Faster Scientific Simulations with New FP64 Algorithms in NVIDIA cuBLAS

13 November 2026 at 22:13
Many scientific simulations, from molecular chemistry to materials science, spend the majority of their execution time computing high-precision dense general...

Many scientific simulations, from molecular chemistry to materials science, spend the majority of their execution time computing high-precision dense general matrix multiplications (GEMM). These operations are called DGEMM for real 64-bit floating-point numbers and ZGEMM for complex 64-bit floating-point numbers. cuBLAS is widely used by HPC and AI applications to accelerate GEMM and other Basic…

Source

Validating GPU Platforms with Runtime AI Inventory via the NVIDIA DSX AI Factory

11 November 2026 at 17:00
As teams deploy and scale AI workloads using NVIDIA Dynamo, Kubeflow, or Slurm, tracking what actually runs requires visibility beyond the platform...

As teams deploy and scale AI workloads using NVIDIA Dynamo, Kubeflow, or Slurm, tracking what actually runs requires visibility beyond the platform configuration captured in a recipe. Application teams define and update these workloads independently of the platform recipe, so a reproducible deployment bundle alone cannot establish which workload artifacts are running on each node.

Source

Agent Substrate: Advancing Kubernetes for Agents at Scale

10 November 2026 at 15:00
AI agents spend most of their time idle, waiting on a human prompt, a tool result or a model response. Kubernetes wasn’t built for that. Running one Pod per...

AI agents spend most of their time idle, waiting on a human prompt, a tool result or a model response. Kubernetes wasn’t built for that. Running one Pod per session holds memory for sessions that aren’t doing anything, and deleting Pods between turns pays a multi-second cold start every time and loses the agent’s state. RL post-training hits the same wall. Agent Substrate, now donated to the…

Source

Start and Restore GPU Workloads in Seconds with NVIDIA Snapshot

10 November 2026 at 15:00
Green cube with a neural-network diagram, surrounded by circular arrows beneath descending data blocks on a purple background.NVIDIA Snapshot, a new open-source component of the NVIDIA DSX AI Factory Platform, makes initialized GPU workloads reusable across inference...Green cube with a neural-network diagram, surrounded by circular arrows beneath descending data blocks on a purple background.

NVIDIA Snapshot, a new open-source component of the NVIDIA DSX AI Factory Platform, makes initialized GPU workloads reusable across inference replicasβ€”speeding startup and recovery. When inference demand spikes or a replica fails, available GPUs don’t translate immediately into serving capacity. Initializing an LLM workloadβ€”a process known as a cold startβ€”can take minutes…

Source

Manage Kubernetes Clusters for GPU Infrastructure with NVIDIA Kubernetes Engine

10 November 2026 at 15:00
An illustration of a layered computing stack shows connected AI models above a Kubernetes layer and a processor.NVIDIA is announcing two open source projects for building and operating managed Kubernetes services on GPU infrastructureβ€”NVIDIA Kubernetes Engine (NVKE) and...An illustration of a layered computing stack shows connected AI models above a Kubernetes layer and a processor.

NVIDIA is announcing two open source projects for building and operating managed Kubernetes services on GPU infrastructureβ€”NVIDIA Kubernetes Engine (NVKE) and NVIDIA Kubernetes Recipes (NVKR). Both are new projects available in public preview. AI Factory customers often want to consume GPU capacity through the Kubernetes APIs, tools, and ecosystem they already use, with the factory operating…

Source

Received β€” 5 November 2026 ⏭ NVIDIA Technical Blog

Configure, Certify, and Operate Kubernetes GPU Clusters with NVIDIA DSX OS

5 November 2026 at 17:00
Glowing green modular cube with gauge, clock, and gear icons on a black background.One underperforming GPU can slow an entire distributed training job. The node may pass basic health checks and show normal utilization, leaving operators to...Glowing green modular cube with gauge, clock, and gear icons on a black background.

One underperforming GPU can slow an entire distributed training job. The node may pass basic health checks and show normal utilization, leaving operators to discover the problem only after the workload is running. These issues can appear at any point in a cluster’s lifecycle. A GPU cluster that passes readiness checks at handover changes as nodes are replaced, drivers are patched…

Source

Five Ways NVIDIA Co-Design Maximizes the Value of Every Byte in the AI Factory

5 November 2026 at 16:00
In an AI factory, high bandwidth memory (HBM)is the fastest, most expensive, and most contested memory tier. Every byte spent on a redundant weight copy, an...

In an AI factory, high bandwidth memory (HBM)is the fastest, most expensive, and most contested memory tier. Every byte spent on a redundant weight copy, an idle session’s KV cache, or a recomputed prefix is a byte that is not being used to produce tokens. The question is no longer how much memory a GPU has, but how much useful work each byte delivers. The generational data in Figure 1 below…

Source

Received β€” 4 November 2026 ⏭ NVIDIA Technical Blog

How NVIDIA Uses AI Agents to Streamline AI Factory Operations

4 November 2026 at 22:00
As GPU clusters scale, operations span compute, network, hardware, and scheduling. Site reliability engineers (SREs) often have to examine multiple dashboards...

As GPU clusters scale, operations span compute, network, hardware, and scheduling. Site reliability engineers (SREs) often have to examine multiple dashboards to identify the cause of training performance drops. What if a team of AI agents could perform that correlation through one interface? NVIDIA developed the AI Factory Operations Agent to streamline its own internal NVIDIA DGX SuperPOD…

Source

Received β€” 3 November 2026 ⏭ NVIDIA Technical Blog

Diagnose Distributed AI Workload Failures with NVIDIA Attribution

2 November 2026 at 23:39
In distributed AI workloads, a single error can produce a cascade of symptoms. A GPU or fabric event may surface as NCCL errors on other ranks, scheduler state...

In distributed AI workloads, a single error can produce a cascade of symptoms. A GPU or fabric event may surface as NCCL errors on other ranks, scheduler state changes, and thousands of downstream messages. The reported exception shows where the workload stopped, not where the failure began. In this post, you’ll learn how to run NVIDIA Attribution on sample workload evidence…

Source

Received β€” 2 November 2026 ⏭ NVIDIA Technical Blog

Keep Distributed Training Running with Automated Workload Recovery

2 November 2026 at 22:43
As distributed AI training scales, failures across hardware and software dependencies increasingly disrupt training progress, making fast, reliable recovery...

As distributed AI training scales, failures across hardware and software dependencies increasingly disrupt training progress, making fast, reliable recovery essential. A stalled training rank can trigger an NVIDIA Collective Communications Library (NCCL) timeout, a GPU node can stop responding to the scheduler, or a straggler can slow the entire job. Each disruption is manageable on its own…

Source

πŸ’Ύ

Making Kubernetes AI-Ready for NVIDIA Vera Rubin on Day One

2 November 2026 at 18:00
Configuring and optimizing Kubernetes for new GPU hardware such as NVIDIA Vera Rubin is complex and error-prone. Drivers, kernels, runtimes, networking,...

Configuring and optimizing Kubernetes for new GPU hardware such as NVIDIA Vera Rubin is complex and error-prone. Drivers, kernels, runtimes, networking, operators, and schedulers must work together, with settings tuned to the hardware and workload. Small mismatches can prevent workloads from running or limit performance. The NVIDIA AI Cluster Runtime (AICR)β€”part of the NVIDIA DSX AI Factory…

Source

Support New AI Frameworks Faster Using NVIDIA Workload Map

2 November 2026 at 16:00
NVIDIA DSX AI Factory Platform brings together technologies to help the ecosystem design, build, and operate more efficient AI factories, including open source,...

NVIDIA DSX AI Factory Platform brings together technologies to help the ecosystem design, build, and operate more efficient AI factories, including open source, modular software components built to support multi-tenant operations and scaling. Operating an AI factory requires a shared understanding of distributed workloads: their components, pod templates, replica counts, and status.

Source

Received β€” 30 October 2026 ⏭ NVIDIA Technical Blog

Build a Validated Kubernetes Runtime for NVIDIA Dynamo

30 October 2026 at 21:35
Glowing green AI network illustration in front of server racks.Teams building AI applications need a repeatable path from a model configuration to a working inference endpoint. NVIDIA Dynamo is a distributed inference...Glowing green AI network illustration in front of server racks.

Teams building AI applications need a repeatable path from a model configuration to a working inference endpoint. NVIDIA Dynamo is a distributed inference framework that coordinates model serving across GPU workers. Deploying it on Kubernetes is only a first step. A successful model deployment requires more: GPU drivers, resource allocation, scheduling, networking, and monitoring must all work…

Source

How to Check and Configure NVIDIA GPUDirect Storage for Your Platform

30 October 2026 at 15:01
Data center server racks with network cables connecting rack-mounted equipment.NVIDIA GPUDirect Storage (GDS) accelerates GPU storage access in on-premises and cloud environments. It provides a robust, portable, and efficient data path...Data center server racks with network cables connecting rack-mounted equipment.

NVIDIA GPUDirect Storage (GDS) accelerates GPU storage access in on-premises and cloud environments. It provides a robust, portable, and efficient data path between NVIDIA GPUs and storage targets to increase bandwidth, minimize latency, and reduce CPU and memory utilization across a broad range of platforms, application frameworks, and workload patterns. Configuring NVIDIA GPUDirect Storage…

Source

Received β€” 27 October 2026 ⏭ NVIDIA Technical Blog

Memory-Enforced GPU Sharing in Kubernetes with NVIDIA CUDA 13.4

27 October 2026 at 20:50
Many AI workloads need only a fraction of a GPU. Giving each one an entire device can leave capacity idle; sharing GPUs lets platform teams serve more workloads...

Many AI workloads need only a fraction of a GPU. Giving each one an entire device can leave capacity idle; sharing GPUs lets platform teams serve more workloads with the infrastructure they already have. NVIDIA GPUs already support several approaches to sharing. Multi-instance GPU (MIG) splits a GPU into hardware-isolated instances that are transparent to the application…

Source

❌