golang wrapper for nccl

Experimental Explicit Communications API for Kokkos

Real multi-node MPI benchmarks for AI infrastructure teams. By NYDUX — nydux.ai

Complete setup guide for a 2-node NVIDIA DGX Spark cluster — distributed training, CUDA inference with EXO, NCCL tuning for Grace Blackwell, NVMe-TCP shared storage, and 200 Gb/s direct fabric networking.

optimize HPC AI/ML workloads over RoCEv2 and Infiniband

Mini Distributed Training Framework using NCCL

EUMaster4HPC student challenge group 7 - EuroHPC Summit 2024 Antwerp

practical guide to multi-node NCCL over switched RoCE fabric on NVIDIA GB10 (DGX Spark class) — documenting the gaps in NVIDIA's official playbooks

NCCue - a lightweight RDMA + GPU inspection toolkit for analyzing NCCL-style communication patterns

Simple quick test to benchmark your pytorch + nccl/ncclx setup

Experiments with low level communication patterns that are useful for distributed training.

Single-node data parallelism in Julia with CUDA

A hybrid testbed for evaluating top open-source LLMs (like gpt-oss-20b and Llama 3.3) on local, cloud GPUs, and AWS Inferentia2/Trainium instances, focusing on vLLM optimization, capacity management, kernel bypass, hardware-software co-design, as well as supporting infrastructure such as NCCL, RDMA, NVMeoF.

Practical AI homelab setup guides for GB10, Mac Studio Ultra, RoCE/RDMA, MikroTik switching, NCCL, and heterogeneous workload experiments.

A practical model (with math + Python) to tell if you’re compute-, memory-, or network-bound—and what to buy next

From-scratch RDMA-based PyTorch backend in C++; trained a char-level GPT on TinyShakespeare via DDP through code I wrote.

Librería de operaciones matemáticas con matrices multi-gpu utilizando Nvidia NCCL.

Infra environment checklist before nccl-test

NCCL communication benchmarking and topology visualization on multi‑node GPU clusters.

Blood Cell Simulation server