jetson-containers Documentation

Machine Learning Containers for NVIDIA Jetson and JetPack-L4T

4,888 stars Jupyter Notebook 57 files · ~125,704 tokens #containers#docker#dockerfiles#jetson#machine-learning#numpy#nvidia#pandas
RAW Doc

Docker & Self-Hosted Deployment Verified OCI

Deploy jetson-containers on any server, homelab, or cloud container platform.

1-Click Terminal Command
bash (docker run)
docker run -d --name jetson-containers -p 8126:8126 --restart always pypiserver/pypiserver:edge
Configured Services & Ports
⚙️ pypi_cu126
image: pypiserver/pypiserver:edge
🔌 Ports: 8126:8080
⚙️ pypi_cu129
image: pypiserver/pypiserver:edge
🔌 Ports: 8129:8080
⚙️ pypi_cu130
image: pypiserver/pypiserver:edge
🔌 Ports: 8130:8080
⚙️ apt-server
image: python:3-slim
🔌 Ports: ${LOCAL_DIST_APT_PORT:-8034}:8080
docker-compose.yml
yaml (docker-compose.yml)
# -----------------------------------------------------------------------------
# Docker Compose Stack: Local PyPI & APT Servers
#
# This stack provides:
#   - Multiple local PyPI servers (cu126, cu129, cu130) for Jetson CUDA variants
#     with a fallback to Jetson Community PyPI Registry (https://pypi.jetson-ai-lab.io)
#   - A local APT server for hosting debian packages (cu126, cu129, cu130)
#     with a dallback to Jetson Community APT Registry (https://apt.jetson-ai-lab.io)
#
# Designed for compatibility with:
#   - jetson-containers
#
# Usage:
#   - Local wheel/distribution packages are stored under /home/${SCP_UPLOAD_USER}/dist/pypi/{jpX,sbsa}/cuXXX
#   - Local debian packages are stored under /home/${SCP_UPLOAD_USER}/dist/apt/{jpX,sbsa}/cuXXX/{22.04,24.04}
#
# Services automatically fallback to the Jetson Community Registry when needed.
# -----------------------------------------------------------------------------

x-common: &common
  restart: unless-stopped
  healthcheck:
    interval: 30s
    timeout: 10s
    start_period: 10s
    retries: 3
    test: ["CMD", "python", "-c", "import urllib.request; urllib.request.urlopen('http://127.0.0.1:8080/').status"]

name: jetson-containers-local
services:
  pypi_cu126: # CUDA 12.6 / Orin (default)
    image: pypiserver/pypiserver:edge
    command: >
      run
      --overwrite
      --verbose
      --authenticate .
      --passwords .
      --hash-algo off
      --fallback-url https://pypi.jetson-ai-lab.io/jp6/cu126
      --server gunicorn
      /data/packages
    <<: *common
    container_name: pypi_cu126
    hostname: pypi_cu126
    volumes:
      - /home/${SCP_UPLOAD_USER}/dist/pypi/jp6/cu126:/data/packages:rw
    ports:
      - "8126:8080"

  pypi_cu129: # CUDA 12.9 / Orin
    image: pypiserver/pypiserver:edge
    command: >
      run
      --overwrite
      --verbose
      --authenticate .
      --passwords .
      --hash-algo off
      --fallback-url https://pypi.jetson-ai-lab.io/jp6/cu129
      --server gunicorn
      /data/packages
    <<: *common
    container_name: pypi_cu129
    hostname: pypi_cu129
    volumes:
      - /home/${SCP_UPLOAD_USER}/dist/pypi/jp6/cu129:/data/packages:rw
    ports:
      - "8129:8080"

  pypi_cu130: # CUDA 13.0 / Thor
    image: pypiserver/pypiserver:edge
    command: >
      run
      --overwrite
      --verbose
      --authenticate .
      --passwords .
      --hash-algo off
      --fallback-url https://pypi.jetson-ai-lab.io/sbsa/cu130
      --server gunicorn
      /data/packages
    <<: *common
    container_name: pypi_cu130
    hostname: pypi_cu130
    volumes:
      - /home/${SCP_UPLOAD_USER}/dist/pypi/sbsa/cu130:/data/packages:rw
    ports:
      - "8130:8080"

  apt-server:
    image: python:3-slim
    <<: *common
    container_name: apt-server
    hostname: apt-server
    command: python -m http.server 8080 --bind 0.0.0.0 --directory /dist/apt
    ports:
      - "${LOCAL_DIST_APT_PORT:-8034}:8080"
    volumes:
      - /home/${SCP_UPLOAD_USER}/dist/apt:/dist/apt:rw

Technical Documentation: dusty-nv/jetson-containers

ℹ️ Provenance: Multi-Tier Ingestion · CodeWiki Reference

Overview (`README.md`)

CUDA Containers for Edge AI & Robotics

Modular container build system that provides the latest AI/ML packages for NVIDIA Jetson :rocket::robot:

ML pytorch tensorflow jax onnxruntime deepstream holoscan CTranslate2 JupyterLab
LLM SGLang vLLM MLC AWQ transformers text-generation-webui text-generation-inference ollama optimum openaigptqmodel llama.cpp llama-factory exllama ktransformers FlashAttention DeepSpeed bitsandbytes xformers xgrammar
VLM llava llama-vision VILA LITA NanoLLM Prismatic xtuner gemma_vlm
VIT NanoOWL NanoSAM Segment Anything (SAM) Track Anything (TAM) clip_trt
RAG llama-index langchain jetson-copilot NanoDB FAISS RAFT
L4T l4t-pytorch l4t-tensorflow l4t-ml l4t-diffusion l4t-text-generation
CUDA cupy cuda-python pycuda cv-cuda opencv:cuda numba
Robotics ROS LeRobot OpenVLA 3D Diffusion Policy Crossformer MimicGen OpenDroneMap ZED openpi
Simulation Isaac Sim Genesis Habitat Sim MimicGen MuJoCo PhysX Protomotions RoboGen RoboMimic RoboSuite Sapien
Graphics 3D Diffusion Policy AI Toolkit ComfyUI Cosmos Diffusers Diffusion Policy FramePack Stable Diffusion WebUI SD.Next nerfstudio meshlab gsplat
Mamba mamba mambavision cobra dimba videomambasuite
KANs pykan kat
xLTSM xltsm mlstm_kernels
Speech whisper whisper_trt faster-whisper espeak whisperx Chatterbox TTS piper riva speech-dispatcher speaches SparkTTS riva-client audiocraft voicecraft voice-pro xtts
Home/IoT homeassistant-core wyoming-whisper wyoming-openwakeword wyoming-piper
3DPrintObjects PartPacker Sparc3D
Agents OpenClaw OpenFang ZeroClaw

See the packages directory for the full list, including pre-built container images for JetPack/L4T.

Using the included tools, you can easily combine packages together for building your own containers. Want to run ROS2 with PyTorch and Transformers? No problem - just do the system setup, and build it on your Jetson:

bash
$ jetson-containers build --name=my_container pytorch transformers ros:humble-desktop

There are shortcuts for running containers too - this will pull or build a l4t-pytorch image that's compatible:

bash
$ jetson-containers run $(autotag l4t-pytorch)

jetson-containers run launches docker run with some added defaults (like --runtime nvidia, mounted /data cache and devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

If you look at any package's readme (like l4t-pytorch), it will have detailed instructions for running it.

Changing CUDA Versions

You can rebuild the container stack for different versions of CUDA by setting the CUDA_VERSION variable:

bash
CUDA_VERSION=12.6 jetson-containers build transformers

It will then go off and either pull or build all the dependencies needed, including PyTorch and other packages that would be time-consuming to compile. There is a Pip server that caches the wheels to accelerate builds. You can also request specific versions of cuDNN, TensorRT, Python, and PyTorch with similar environment variables like here.

Documentation

Check out the tutorials at the Jetson Generative AI Lab!

Getting Started

Refer to the System Setup page for tips about setting up your Docker daemon and memory/storage tuning.

bash
# install the container tools
git clone https://github.com/dusty-nv/jetson-containers
bash jetson-containers/install.sh

# automatically pull & run any container
jetson-containers run $(autotag l4t-pytorch)

To also spin up a local devpi PyPI + APT caching server during install, pass --pypi:

bash
sudo bash jetson-containers/install.sh --pypi

This launches a containerized devpi instance with per-architecture indexes (jp6, jp7, sbsa, amd64) and an nginx-based APT cache, so subsequent builds resolve wheels and packages locally instead of hitting the network.

Or you can manually run a container image of your choice without using the helper scripts above:

bash
sudo docker run --runtime nvidia -it --rm --network=host dustynv/l4t-pytorch:r36.2.0

Looking for the old jetson-containers? See the legacy branch.

Only Tested and supported Jetpack 6.2 (Cuda 12.6) and JetPack 7 (CUDA 13.x).

[!NOTE]
Ubuntu 24.04 containers for JetPack 6 and JetPack 7 are now available (with CUDA support)

     LSB_RELEASE=24.04 jetson-containers build pytorch:2.8
     jetson-containers run dustynv/pytorch:2.8-r36.4-cu128-24.04

ARM SBSA (Server Base System Architecture) is supported for GH200 / GB200.
To install CUDA 13.0 SBSA wheels for Python 3.12 / 24.04:

     uv pip install torch torchvision torchaudio \
            --index-url https://pypi.jetson-ai-lab.io/sbsa/cu129

See the Ubuntu 24.04 section of the docs for details and a list of available containers 🤗
Thanks to all our contributors from Discord and AI community for their support 🤗

[!IMPORTANT]
Jetson Orin now receives ARM SBSA CUDA in CUDA 13.2 — Starting with CUDA 13.2, the same Arm SBSA CUDA Toolkit is supported on Jetson Orin devices, unifying the toolkit across server-class (GH200/GB200) and embedded (Orin) platforms. This requires JetPack 7.2 with CUDA driver R595 minimum.

Code Style

The project uses automated code formatting tools to maintain consistent code style. See Code Style Guide for details on:

  • Setting up formatting tools
  • Adding your package to formatting checks
  • Troubleshooting common issues

Troubleshooting

InvalidDefaultArgInFrom: Default value for ARG ${BASE_IMAGE} results in empty or invalid base image name

This may be caused by corrupted caches. Docker caches both image results and build downloads. Try these simple steps first:

  • Remove non-essential docker images using: *docker image rm --force *
  • Prune resulting docker image cache: docker image prune -f
  • Prune docker build image cache: docker buildx prune -f

Multimodal Voice Chat with LLaVA-1.5 13B on NVIDIA Jetson AGX Orin (container: NanoLLM)

Interactive Voice Chat with Llama-2-70B on NVIDIA Jetson AGX Orin (container: NanoLLM)

Realtime Multimodal VectorDB on NVIDIA Jetson (container: nanodb)

NanoOWL - Open Vocabulary Object Detection ViT (container: nanoowl)

Live Llava on Jetson AGX Orin (container: NanoLLM)

Live Llava 2.0 - VILA + Multimodal NanoDB on Jetson Orin (container: NanoLLM)

Small Language Models (SLM) on Jetson Orin Nano (container: NanoLLM)

Realtime Video Vision/Language Model with VILA1.5-3b (container: NanoLLM)

Citation

Please see CITATION.cff for citation information.


Overview (`packages/README.md`)

Packages

ATTENTION BUILD CODE CUDA CV HW LLM ML MULTIMEDIA NET PHYSICAL AI RAG SMART-HOME SPEECH VECTORDB VIT VLM


Attention

Attention mechanism implementations and optimizations.

Package Path
ParaAttention attention/ParaAttention
block-sparse-attention attention/block-sparse-attention
flash-attention attention/flash-attention
flashinfer attention/flashinfer
flexprefill attention/flexprefill
huggingface_kernels attention/huggingface_kernels
jvp-flash-attention attention/jvp-flash-attention
log-linear-attention attention/log-linear-attention
radial-attention attention/radial-attention
sage-attention attention/sage-attention
sparge-attention attention/sparge-attention
tilelang attention/tilelang
xattention attention/xattention
xformers attention/xformers

Build

Build tools, compilers, and development dependencies.

Package Path
bazel build/bazel
build-essential build/build-essential
cmake:apt build/cmake/cmake_apt
cmake:pip build/cmake/cmake_pip
docker build/docker
go build/go
h5py build/h5py
helm build/helm
llvm build/llvm
ninja build/ninja
nodejs build/nodejs
protobuf:apt build/protobuf/protobuf_apt
protobuf:cpp build/protobuf/protobuf_cpp
pybind11 build/pybind11
python build/python
rust build/rust

Code

Development environments and IDEs.

Package Path
jupyterlab code/jupyterlab
openhands code/openhands
vscode code/vscode

CUDA

CUDA toolkit, libraries, and Python bindings.

Package Path
cuda cuda/cuda
cuda-python cuda/cuda-python
cudastack cuda/cudastack
   cudnn_frontend cuda/cudastack/cudnn_frontend
cutlass cuda/cutlass
pycuda cuda/pycuda

CV

Computer vision, 3D reconstruction, diffusion models, and related packages.

cv/3d/3dobjects

Package Path
partpacker cv/3d/3dobjects/partpacker
sparc3d cv/3d/3dobjects/sparc3d

cv/3d/3dvision

Package Path
glomap cv/3d/3dvision/glomap
hloc cv/3d/3dvision/hloc
kaolin cv/3d/3dvision/kaolin
meshlab cv/3d/3dvision/meshlab
nerfacc cv/3d/3dvision/nerfacc
open3d cv/3d/3dvision/open3d
pixsfm cv/3d/3dvision/pixsfm
polyscope cv/3d/3dvision/polyscope
pyceres cv/3d/3dvision/pyceres
pycolmap cv/3d/3dvision/pycolmap
pymeshlab cv/3d/3dvision/pymeshlab
tinycudann cv/3d/3dvision/tinycudann
usdcore cv/3d/3dvision/usdcore

cv/3d/gaussian_splatting

Package Path
3dgrut cv/3d/gaussian_splatting/3dgrut
4k4d cv/3d/gaussian_splatting/4k4d
easyvolcap cv/3d/gaussian_splatting/easyvolcap
fast_gauss cv/3d/gaussian_splatting/fast_gauss
gsplat cv/3d/gaussian_splatting/gsplat
nerfview cv/3d/gaussian_splatting/nerfview

cv/3d/nerf

Package Path
fruitnerf cv/3d/nerf/fruitnerf
nerfstudio cv/3d/nerf/nerfstudio

cv/diffusion

Package Path
3d_diffusion_policy cv/diffusion/3d_diffusion_policy
ai-toolkit cv/diffusion/ai-toolkit
cache_edit cv/diffusion/cache_edit
comfyui cv/diffusion/comfyui
diffusers cv/diffusion/diffusers
diffusion_cpp cv/diffusion/diffusion_cpp
diffusion_policy cv/diffusion/diffusion_policy
fastgen cv/diffusion/fastgen
framepack cv/diffusion/framepack
sdnext cv/diffusion/sdnext
self-forcing cv/diffusion/self-forcing
stable-diffusion-webui cv/diffusion/stable-diffusion-webui

cv (other)

Package Path
cv-cuda cv/cv-cuda
deepstream cv/deepstream
holoscan cv/holoscan
jetson-inference cv/jetson-inference
opencv cv/opencv
vpi cv/vpi

HW

Hardware interfaces and device drivers.

Package Path
canable hw/canable
canbus hw/canbus
cangaroo hw/cangaroo
jetcam hw/jetcam
jupyter_clickable_image_widget hw/jupyter_clickable_image_widget
librealsense hw/librealsense
oled hw/oled
pl2303 hw/pl2303
zed hw/zed

LLM

Large language model inference, training, quantization, and serving frameworks.

Package Path
awq llm/awq
bitsandbytes llm/bitsandbytes
deepspeed llm/deepspeed
dynamo llm/dynamo/dynamo
   kai-scheduler llm/dynamo/kai-scheduler
   mooncake llm/dynamo/mooncake
   nixl llm/dynamo/nixl
exllama llm/exllama
gptqmodel llm/gptqmodel
huggingface_hub llm/huggingface_hub
hymba llm/hymba
ktransformers llm/ktransformers
litellm llm/litellm
llama-factory llm/llama-factory
llama_cpp llm/llama_cpp
llamaspeak llm/llamaspeak
lobe_chat llm/lobe_chat
local_llm llm/local_llm
minference llm/minference
mistral_common llm/mistral/mistral_common
mistral_rs llm/mistral/mistral_rs
mlc llm/mlc
nano_llm llm/nano_llm
nemo llm/nemo
nvidia-modelopt llm/tensorrt_optimizer/nvidia-modelopt
ollama llm/ollama
open-webui llm/open-webui
openai llm/openai
optimum llm/optimum
sglang llm/sglang
sudonim llm/sudonim
tensorrt_llm llm/tensorrt_optimizer/tensorrt_llm
text-generation-inference llm/text-generation-inference
text-generation-webui llm/text-generation-webui
transformers llm/transformers
unsloth llm/unsloth
vllm llm/vllm
xgrammar llm/xgrammar

ML

Machine learning frameworks, PyTorch ecosystem, numeric libraries, and RAPIDS.

ml/pytorch

Package Path
pytorch ml/pytorch
apex ml/pytorch/apex
torch2trt ml/pytorch/torch2trt
torch3d ml/pytorch/torch3d
torch_tensorrt ml/pytorch/torch_tensorrt
torchao ml/pytorch/torchao
torchaudio ml/pytorch/torchaudio
torchcodec ml/pytorch/torchcodec
torchsaver ml/pytorch/torchsaver
torchsde ml/pytorch/torchsde
torchtext ml/pytorch/torchtext
torchvision ml/pytorch/torchvision

ml/tensorflow

Package Path
tensorflow ml/tensorflow
tensorboard ml/tensorflow/tensorboard

ml/jax

Package Path
jax ml/jax

ml/mamba

Package Path
causalconv1d ml/mamba/causalconv1d
cobra ml/mamba/cobra
dimba ml/mamba/dimba
mamba ml/mamba/mamba
mambavision ml/mamba/mambavision
videomambasuite ml/mamba/videomambasuite
zigma ml/mamba/zigma

ml/numeric

Package Path
arrow ml/numeric/arrow
cupy ml/numeric/cupy
numba ml/numeric/numba
numpy ml/numeric/numpy
warp ml/numeric/warp

ml/rapids

Package Path
cudf ml/rapids/cudf
cuml ml/rapids/cuml
raft ml/rapids/raft

ml/kans

Package Path
kat ml/kans/kat
pykan ml/kans/pykan

ml/xlstm

Package Path
mlstm_kernels ml/xlstm/mlstm_kernels
pltsm ml/xlstm/pltsm
xlstm ml/xlstm/xlstm

ml/apache

Package Path
tvm ml/apache/tvm
tvm-ffi ml/apache/tvm-ffi

ml (other)

Package Path
aim ml/aim
ctranslate2 ml/ctranslate2
dli-nano-ai ml/dli/dli-nano-ai
onnx ml/onnx
onnxruntime ml/onnxruntime
onnxruntime_genai ml/onnxruntime_genai
transformer-engine ml/transformer-engine
triton ml/triton
tritonserver ml/tritonserver

ml/l4t

Package Path
l4t-diffusion ml/l4t/l4t-diffusion
l4t-dynamo ml/l4t/l4t-dynamo
l4t-ml ml/l4t/l4t-ml
l4t-pytorch ml/l4t/l4t-pytorch
l4t-tensorflow ml/l4t/l4t-tensorflow
l4t-text-generation ml/l4t/l4t-text-generation

Multimedia

Media processing, video codecs, and streaming.

Package Path
decord multimedia/decord
ffmpeg multimedia/ffmpeg
gstreamer multimedia/gstreamer
jetson-utils multimedia/jetson-utils
libcom multimedia/libcom
opengl multimedia/opengl
pyav multimedia/pyav
sound-utils multimedia/sound-utils
video-codec-sdk multimedia/video-codec-sdk
vulkan multimedia/vulkan

Net

Networking, proxies, and self-hosted infrastructure.

Package Path
devpi net/devpi
https-portal net/https-portal
mkdocs net/mkdocs
nginx_proxy_manager net/nginx_proxy_manager
portainer net/portainer
pypi.dev net/pypi.dev
tailscale net/tailscale
yacht net/yacht

PhysicalAI

Robotics, simulation, embodied AI, and vision-language-action models.

physicalAI/sim

Package Path
genesis physicalAI/sim/genesis
   quadrants physicalAI/sim/genesis/quadrants
   splashSurf physicalAI/sim/genesis/splashSurf
   vtk physicalAI/sim/genesis/vtk
habitat-sim physicalAI/sim/habitat-sim
isaac-sim physicalAI/sim/isaac-sim
mimicgen physicalAI/sim/mimicgen
mujoco physicalAI/sim/mujoco
newton physicalAI/sim/newton
physx physicalAI/sim/physx
robogen physicalAI/sim/robogen
robomimic physicalAI/sim/robomimic
robosuite physicalAI/sim/robosuite
sapien physicalAI/sim/sapien

physicalAI/vla

Package Path
crossformer physicalAI/vla/crossformer
isaac-gr00t physicalAI/vla/isaac-gr00t
octo physicalAI/vla/octo
openvla physicalAI/vla/openvla
robopoint physicalAI/vla/robopoint

physicalAI/cosmos

Package Path
cosmos-policy physicalAI/cosmos/cosmos-policy
cosmos-predict2 physicalAI/cosmos/cosmos-predict2
cosmos-reason1 physicalAI/cosmos/cosmos-reason1
cosmos-transfer1 physicalAI/cosmos/cosmos-transfer1
cosmos_diffusion_renderer physicalAI/cosmos/cosmos_diffusion_renderer

physicalAI (other)

Package Path
Isaac-GR00T physicalAI/Isaac-GR00T
isaac-ros physicalAI/isaac-ros
lerobot physicalAI/lerobot
opendronemap physicalAI/opendronemap
openpi physicalAI/openpi
protomotions physicalAI/protomotions
ros physicalAI/ros

RAG

Retrieval-augmented generation and knowledge tools.

Package Path
graphiti rag/graphiti
jetson-copilot rag/jetson-copilot
langchain rag/langchain
llama-index rag/llama-index
memvid rag/memvid
n8n rag/n8n

Smart-Home

Home automation, voice assistants, and Wyoming protocol servers.

Package Path
homeassistant-base smart-home/homeassistant-base
homeassistant-core smart-home/homeassistant-core
ciso8601 smart-home/dependencies/ciso8601
psutil-home-assistant smart-home/dependencies/psutil-home-assistant
wyoming-assist-microphone smart-home/wyoming/wyoming-assist-microphone
wyoming-openwakeword smart-home/wyoming/wyoming-openwakeword
wyoming-piper smart-home/wyoming/wyoming-piper
wyoming-whisper smart-home/wyoming/wyoming-whisper

Speech

Speech recognition, text-to-speech, and audio processing.

Package Path
audiocraft speech/audiocraft
chatterbox-tts speech/chatterbox-tts
espeak speech/espeak
faster-whisper speech/faster-whisper
kokoro-tts-fastapi speech/kokoro-tts/kokoro-tts-fastapi
kokoro-tts-hf speech/kokoro-tts/kokoro-tts-hf
kokoro-tts-onnx speech/kokoro-tts/kokoro-tts-onnx
piper1-tts speech/piper1-tts
riva-client speech/riva-client
spark-tts speech/spark-tts
speaches speech/speaches
speech-dispatcher speech/speech-dispatcher
voice-pro speech/voice-pro
voicecraft speech/voicecraft
whisper speech/whisper
whisper_trt speech/whisper_trt
whisperx speech/whisperx
xtts speech/xtts

VectorDB

Vector databases and similarity search.

Package Path
faiss vectordb/faiss
faiss_lite vectordb/faiss_lite
nanodb vectordb/nanodb

VIT

Vision transformer models and segmentation.

Package Path
clip_trt vit/clip_trt
efficientvit vit/efficientvit
nanoowl vit/nanoowl
nanosam vit/nanosam
sam vit/sam
sapiens vit/sapiens
tam vit/tam

VLM

Vision-language models for multimodal understanding.

Package Path
gemma_vlm vlm/gemma_vlm
lita vlm/lita
llama-vision vlm/llama-vision
llava vlm/llava
minigpt4 vlm/minigpt4
prismatic vlm/prismatic
videollama vlm/videollama
vila vlm/vila
vila-microservice vlm/vila-microservice
xtuner vlm/xtuner

Overview (`deprecated/auto_awq/README.md`)

auto_awq

CONTAINERS IMAGES RUN BUILD

CONTAINERS

auto_awq:0.2.4
   Aliases auto_awq
   Requires L4T ['>=36']
   Dependencies build-essential cuda cudnn python numpy cmake onnx pytorch:2.2 torchvision huggingface_hub rust transformers
   Dockerfile Dockerfile

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag auto_awq)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host auto_awq:35.2.1

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag auto_awq)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag auto_awq) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build auto_awq

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`deprecated/gptq-for-llama/README.md`)

gptq-for-llama

CONTAINERS IMAGES RUN BUILD

CONTAINERS

gptq-for-llama
   Builds
   Requires L4T ['>=32.6']
   Dependencies build-essential cuda cudnn python numpy cmake onnx pytorch:2.2 torchvision huggingface_hub rust transformers
   Dockerfile Dockerfile
   Images dustynv/gptq-for-llama:r35.2.1 (2023-12-06, 5.9GB)dustynv/gptq-for-llama:r35.3.1 (2023-12-14, 5.9GB)dustynv/gptq-for-llama:r35.4.1 (2023-12-15, 5.9GB)dustynv/gptq-for-llama:r36.2.0 (2024-01-02, 7.6GB)
   Notes https://github.com/oobabooga/GPTQ-for-LLaMa

CONTAINER IMAGES

Repository/Tag Date Arch Size
  dustynv/gptq-for-llama:r35.2.1 2023-12-06 arm64 5.9GB
  dustynv/gptq-for-llama:r35.3.1 2023-12-14 arm64 5.9GB
  dustynv/gptq-for-llama:r35.4.1 2023-12-15 arm64 5.9GB
  dustynv/gptq-for-llama:r36.2.0 2024-01-02 arm64 7.6GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag gptq-for-llama)

# or explicitly specify one of the container images above
jetson-containers run dustynv/gptq-for-llama:r36.2.0

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/gptq-for-llama:r36.2.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag gptq-for-llama)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag gptq-for-llama) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build gptq-for-llama

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`deprecated/piper-tts/README.md`)

piper-tts

CONTAINERS IMAGES RUN BUILD

CONTAINERS

piper-tts
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn:9.3 python numpy cmake onnx pytorch:2.8 torchaudio tensorrt onnxruntime espeak
   Dependants nano_llm:24.4 nano_llm:24.4-foxy nano_llm:24.4-galactic nano_llm:24.4-humble nano_llm:24.4-iron nano_llm:24.4.1 nano_llm:24.4.1-foxy nano_llm:24.4.1-galactic nano_llm:24.4.1-humble nano_llm:24.4.1-iron nano_llm:24.5 nano_llm:24.5-foxy nano_llm:24.5-galactic nano_llm:24.5-humble nano_llm:24.5-iron nano_llm:24.5.1 nano_llm:24.5.1-foxy nano_llm:24.5.1-galactic nano_llm:24.5.1-humble nano_llm:24.5.1-iron nano_llm:24.6 nano_llm:24.6-foxy nano_llm:24.6-galactic nano_llm:24.6-humble nano_llm:24.6-iron nano_llm:24.7 nano_llm:24.7-foxy nano_llm:24.7-galactic nano_llm:24.7-humble nano_llm:24.7-iron nano_llm:main nano_llm:main-foxy nano_llm:main-galactic nano_llm:main-humble nano_llm:main-iron speaches wyoming-piper:1.6.2 wyoming-piper:master
   Dockerfile Dockerfile
   Images dustynv/piper-tts:r35.4.1 (2024-04-07, 5.5GB)dustynv/piper-tts:r36.2.0 (2024-04-07, 6.7GB)dustynv/piper-tts:r36.4.0 (2025-02-19, 6.3GB)dustynv/piper-tts:r36.4.0-cu128-24.04 (2025-03-03, 5.6GB)

CONTAINER IMAGES

Repository/Tag Date Arch Size
  dustynv/piper-tts:r35.4.1 2024-04-07 arm64 5.5GB
  dustynv/piper-tts:r36.2.0 2024-04-07 arm64 6.7GB
  dustynv/piper-tts:r36.4.0 2025-02-19 arm64 6.3GB
  dustynv/piper-tts:r36.4.0-cu128-24.04 2025-03-03 arm64 5.6GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag piper-tts)

# or explicitly specify one of the container images above
jetson-containers run dustynv/piper-tts:r36.4.0-cu128-24.04

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/piper-tts:r36.4.0-cu128-24.04

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag piper-tts)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag piper-tts) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build piper-tts

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`deprecated/shape-llm/README.md`)

shape-llm

CONTAINERS IMAGES RUN BUILD

CONTAINERS

shape-llm
   Aliases shape_llm
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu122 cuda:12.2 cudnn python numpy cmake onnx pytorch:2.2 torchvision huggingface_hub rust transformers bitsandbytes flash-attention opencv:4.11.0
   Dockerfile Dockerfile

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag shape-llm)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host shape-llm:36.3.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag shape-llm)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag shape-llm) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build shape-llm

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`deprecated/stable-diffusion/README.md`)

stable-diffusion

CONTAINERS IMAGES RUN BUILD

Generate images from text (txt2img) or from other images (img2img)

See the stable-diffusion-webui container for a faster implementation with a web interface.

txt2img

Download the stable-diffusion-1.4 model (sd-v1-4.ckpt)

bash
wget https://huggingface.co/CompVis/stable-diffusion-v-1-4-original/resolve/main/sd-v1-4.ckpt -O /data/models/stable-diffusion/sd-v1-4.ckpt

Then run this in the container to generate images (by default, six 512x512 images with 50 refinement steps)

bash
cd /opt/stable-diffusion && python3 scripts/txt2img.py --plms \
  --ckpt /data/models/stable-diffusion/sd-v1-4.ckpt \
  --outdir /data/images/stable-diffusion \
  --prompt "a photograph of an astronaut riding a horse"

See here for options: https://github.com/CompVis/stable-diffusion#reference-sampling-script

For just one 512x512 image with 25 steps:

bash
cd /opt/stable-diffusion && python3 scripts/txt2img.py --plms \
  --n_samples 1 --n_iter 1 --ddim_steps 25 \
  --ckpt /data/models/stable-diffusion/sd-v1-4.ckpt \
  --outdir /data/images/stable-diffusion \
  --prompt "two robots walking in the woods"
  • Change the image resolution with --W and --H (the default is 512x512)
  • Change the --seed to have the images be different (the default seed is 42)

For Jetson Orin Nano and reduced memory usage:

bash
cd /opt/stable-diffusion && python3 optimizedSD/optimized_txt2img.py \
  --sampler plms --seed 42 \
  --n_samples 1 --n_iter 1 --ddim_steps 25 \
  --ckpt /data/models/stable-diffusion/sd-v1-4.ckpt \
  --outdir /data/images/stable-diffusion \
  --prompt "a photograph of an astronaut riding a horse"

To run all these steps from a script, see stable-diffusion/test.sh

CONTAINERS

stable-diffusion
   Builds
   Requires L4T ['>=34.1.0']
   Dependencies build-essential cuda cudnn python numpy cmake onnx pytorch:2.2 torchvision huggingface_hub rust transformers
   Dependants l4t-diffusion
   Dockerfile Dockerfile
   Images dustynv/stable-diffusion:r35.2.1 (2023-12-14, 6.1GB)dustynv/stable-diffusion:r35.3.1 (2023-12-12, 6.1GB)dustynv/stable-diffusion:r35.4.1 (2023-12-15, 6.1GB)
   Notes disabled on JetPack 4

CONTAINER IMAGES

Repository/Tag Date Arch Size
  dustynv/stable-diffusion:r35.2.1 2023-12-14 arm64 6.1GB
  dustynv/stable-diffusion:r35.3.1 2023-12-12 arm64 6.1GB
  dustynv/stable-diffusion:r35.4.1 2023-12-15 arm64 6.1GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag stable-diffusion)

# or explicitly specify one of the container images above
jetson-containers run dustynv/stable-diffusion:r35.4.1

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/stable-diffusion:r35.4.1

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag stable-diffusion)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag stable-diffusion) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build stable-diffusion

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`.github/workflows/scripts/README.md`)

GitHub Actions Workflow Scripts

This directory contains reusable scripts for GitHub Actions workflows in the jetson-containers project.

Scripts

Core Scripts

  • step-pre-checkout-cleanup.sh - Cleans up permission-restricted files before checkout
  • step-system-info.sh - Displays Jetson system information
  • step-env-info.sh - Records comprehensive environment variables and system info
  • step-clean-environment.sh - Cleans up Docker, cache, and permission-restricted directories
  • step-git-status.sh - Shows git repository state and recent history

Build Scripts

  • step-build-package.sh - Builds and tests a specific package
  • step-analyze-results.sh - Analyzes build results and outputs status
  • step-test-results-summary.sh - Generates a comprehensive test results summary

Workflow Generation

  • workflow-template.yml - Template for creating new package workflow files
  • generate-workflow.sh [platform] - Generates a new workflow file from template

Usage

Creating a New Workflow

To create a new workflow for a package and platform:

bash
cd .github/workflows/scripts
./generate-workflow.sh vllm orin
./generate-workflow.sh vllm thor

This will create:

  • ../workflows/pr-on-dev_vllm_orin.yml
  • ../workflows/pr-on-dev_vllm_thor.yml

Creating Multiple Workflows

bash
cd .github/workflows/scripts
# For Orin platform
./generate-workflow.sh vllm orin
./generate-workflow.sh cudnn orin
./generate-workflow.sh nccl orin

# For Thor platform
./generate-workflow.sh vllm thor
./generate-workflow.sh cudnn thor
./generate-workflow.sh nccl thor

Platform Support

  • orin - Jetson Orin (default if platform not specified)
  • thor - Jetson Thor
  • Any other platform - Just specify the platform name

Manual Workflow Creation

  1. Copy workflow-template.yml to ../workflows/pr-on-dev__.yml
  2. Replace all instances of PACKAGE_NAME with the actual package name
  3. Replace all instances of PLATFORM with the actual platform name
  4. Update the workflow name as needed

Script Parameters

step-build-package.sh

  • Required: `` - The package to build and test
  • Example: ./step-build-package.sh vllm

step-analyze-results.sh

  • Required: <stage1> <stage2>
  • Optional: [failure_phase] [failure_stage] [failure_component]

step-test-results-summary.sh

  • Required: <stage1> <stage2>
  • Optional: [failure_phase] [failure_stage] [failure_component]

Benefits

  • Reusable: Same scripts work for all packages
  • Maintainable: Update scripts once, affects all workflows
  • Consistent: All workflows have the same behavior and output format
  • Easy to create: Generate new workflows with a single command

Overview (`deprecated/cuda/cuda-python/README.md`)

cuda-python

CONTAINERS IMAGES RUN BUILD

CONTAINERS

cuda-python:12.2
   Requires L4T ['>=34.1.0']
   Dependencies build-essential pip_cache:cu122 cuda:12.2 python numpy
   Dockerfile Dockerfile
cuda-python:12.4
   Requires L4T ['>=34.1.0']
   Dependencies build-essential pip_cache:cu124 cuda:12.4 python numpy
   Dockerfile Dockerfile
cuda-python:12.6
   Aliases cuda-python
   Requires L4T ['>=34.1.0']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 python numpy
   Dependants 3dgrut:2.0.0 audiocraft awq:0.1.0 block_sparse_attn:0.0.1 comfyui cosmos-predict2 cosmos-reason1 cosmos-transfer1 cosmos1-diffusion-renderer:1.0.4 cudf:23.10.03 cudf:25.08.00 cuml cutlass:4.1.0 diffusion_policy dli-nano-ai dynamo:0.3.2 efficientvit exllama:0.1 faiss_lite flash-attention:2.5.7 flash-attention:2.6.3 flash-attention:2.7.2.post1 flash-attention:2.7.4.post1 flash-attention:2.8.0.post2 flash-attention:2.8.1 flexprefill:0.1.0 framepack genai-bench:0.1.0 huggingface_kernels:0.7.0 hymba isaac-gr00t isaac-ros:compression-3.2-humble-desktop isaac-ros:compression-3.2-jazzy-desktop isaac-ros:dnn-inference-3.2-humble-desktop isaac-ros:dnn-inference-3.2-jazzy-desktop isaac-ros:image-pipeline-3.2-humble-desktop isaac-ros:image-pipeline-3.2-jazzy-desktop isaac-ros:manipulator-3.2-humble-desktop isaac-ros:manipulator-3.2-jazzy-desktop isaac-ros:nitros-3.2-humble-desktop isaac-ros:nitros-3.2-jazzy-desktop isaac-ros:nvblox-3.2-humble-desktop isaac-ros:nvblox-3.2-jazzy-desktop isaac-ros:pose-estimation-3.2-humble-desktop isaac-ros:pose-estimation-3.2-jazzy-desktop isaac-ros:visual-slam-3.2-humble-desktop isaac-ros:visual-slam-3.2-jazzy-desktop jupyter_clickable_image_widget jupyterlab:4.2.0 jupyterlab:4.2.0-myst jupyterlab:latest jupyterlab:latest-myst l4t-diffusion l4t-dynamo l4t-ml l4t-text-generation langchain:samples lerobot lita llama-factory llama-index:samples llava lobechat local_llm minference:0.1.7 mlstm_kernels:2.0.1 nano_llm:24.4 nano_llm:24.4-foxy nano_llm:24.4-galactic nano_llm:24.4-humble nano_llm:24.4-iron nano_llm:24.4.1 nano_llm:24.4.1-foxy nano_llm:24.4.1-galactic nano_llm:24.4.1-humble nano_llm:24.4.1-iron nano_llm:24.5 nano_llm:24.5-foxy nano_llm:24.5-galactic nano_llm:24.5-humble nano_llm:24.5-iron nano_llm:24.5.1 nano_llm:24.5.1-foxy nano_llm:24.5.1-galactic nano_llm:24.5.1-humble nano_llm:24.5.1-iron nano_llm:24.6 nano_llm:24.6-foxy nano_llm:24.6-galactic nano_llm:24.6-humble nano_llm:24.6-iron nano_llm:24.7 nano_llm:24.7-foxy nano_llm:24.7-galactic nano_llm:24.7-humble nano_llm:24.7-iron nano_llm:main nano_llm:main-foxy nano_llm:main-galactic nano_llm:main-humble nano_llm:main-iron nanodb nvidia_modelopt:0.32.0 openpi openvla openvla:mimicgen paraattention:0.4.0 partpacker:0.1.0 plstm:0.1.0 prismatic pytorch:2.1-all pytorch:2.2-all pytorch:2.3-all pytorch:2.3.1-all pytorch:2.4-all pytorch:2.5-all pytorch:2.6-all pytorch:2.7-all pytorch:2.8-all raft robopoint sage-attention:3.0.0 sam sdnext self-forcing sgl-kernel:0.2.3 sglang:0.4.4 sglang:0.4.6 sglang:0.4.9 sparc3d:0.1.0 sparge-attention:0.1.0 sudonim:hf tam tensorrt_llm:0.12 tensorrt_llm:0.22.0 text-generation-webui:1.7 text-generation-webui:6a7cd01 text-generation-webui:main transformer-engine:2.7 videollama:1.0.0 vila vllm:0.7.4 vllm:0.8.4 vllm:0.9.0 vllm:0.9.2 vllm:0.9.3 vllm:v0.8.5.post1 voice-pro voicecraft vscode:transformers warp:1.7.0-all warp:1.8.1-all whisper xattention:0.0.1 xlstm:2.0.5 xtuner
   Dockerfile Dockerfile
cuda-python:12.8
   Requires L4T ['>=34.1.0']
   Dependencies build-essential pip_cache:cu128 cuda:12.8 python numpy
   Dockerfile Dockerfile
cuda-python:12.9
   Requires L4T ['>=34.1.0']
   Dependencies build-essential pip_cache:cu129 cuda:12.9 python numpy
   Dockerfile Dockerfile
cuda-python:13.0
   Requires L4T ['>=34.1.0']
   Dependencies build-essential pip_cache:cu130 cuda:13.0 python numpy
   Dockerfile Dockerfile

CONTAINER IMAGES

Repository/Tag Date Arch Size
  dustynv/cuda-python:builder-r35.4.1 2024-03-26 arm64 5.1GB
  dustynv/cuda-python:builder-r36.2.0 2024-03-11 arm64 3.6GB
  dustynv/cuda-python:r35.2.1 2023-12-06 arm64 5.0GB
  dustynv/cuda-python:r35.3.1 2023-08-29 arm64 5.0GB
  dustynv/cuda-python:r35.4.1 2023-12-06 arm64 5.0GB
  dustynv/cuda-python:r36.2.0 2023-12-06 arm64 3.5GB
  dustynv/cuda-python:r36.4.0-cu128-24.04 2025-03-03 arm64 2.3GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag cuda-python)

# or explicitly specify one of the container images above
jetson-containers run dustynv/cuda-python:r36.4.0-cu128-24.04

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/cuda-python:r36.4.0-cu128-24.04

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag cuda-python)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag cuda-python) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build cuda-python

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`deprecated/cuda/cuda/README.md`)

cuda

CONTAINERS IMAGES RUN BUILD

CONTAINERS

cuda:12.2
   Requires L4T ['==36.*', 'aarch64']
   Dependencies build-essential pip_cache:cu122
   Dependants cuda-python:12.2 cuda:12.2-samples cudnn:8.9
   Dockerfile Dockerfile
   Images dustynv/cuda:12.2-r36.2.0 (2023-12-05, 3.4GB)dustynv/cuda:12.2-samples-r36.2.0 (2023-12-07, 4.8GB)
pip_cache:cu122
   Requires L4T ['==36.*']
   Dependencies
   Dependants cuda-python:12.2 cuda:12.2 cuda:12.2-samples cudnn:8.9
   Dockerfile Dockerfile.pip
cuda:12.2-samples
   Requires L4T ['==36.*']
   Dependencies build-essential pip_cache:cu122 cuda:12.2 python cmake
   Dockerfile Dockerfile.samples
   Images dustynv/cuda:12.2-samples-r36.2.0 (2023-12-07, 4.8GB)
   Notes CUDA samples from https://github.com/NVIDIA/cuda-samples installed under /opt/cuda-samples
cuda:12.4
   Requires L4T ['==36.*', 'aarch64']
   Dependencies build-essential pip_cache:cu124
   Dependants cuda-python:12.4 cuda:12.4-samples cudnn:9.0
   Dockerfile Dockerfile
pip_cache:cu124
   Requires L4T ['==36.*']
   Dependencies
   Dependants cuda-python:12.4 cuda:12.4 cuda:12.4-samples cudnn:9.0
   Dockerfile Dockerfile.pip
cuda:12.4-samples
   Requires L4T ['==36.*']
   Dependencies build-essential pip_cache:cu124 cuda:12.4 python cmake
   Dockerfile Dockerfile.samples
   Notes CUDA samples from https://github.com/NVIDIA/cuda-samples installed under /opt/cuda-samples
cuda:12.6
   Aliases cuda
   Requires L4T ['==36.*', 'aarch64']
   Dependencies build-essential pip_cache:cu126
   Dependants 3d_diffusion_policy 3dgrut:2.0.0 4k4d:0.0.0 ai-toolkit apex:0.1 arrow:12.0.1 arrow:14.0.1 arrow:19.0.1 arrow:20.0.0 arrow:5.0.0 audiocraft awq:0.1.0 bitsandbytes:0.39.1 bitsandbytes:0.45.4 bitsandbytes:0.45.5 bitsandbytes:0.46.0 bitsandbytes:0.47.0 bitsandbytes:0.48.0 block_sparse_attn:0.0.1 cache_dit:0.2.0 causalconv1d:1.6.0 chatterbox-tts clip_trt cobra:0.0.1 comfyui cosmos-predict2 cosmos-reason1 cosmos-transfer1 cosmos1-diffusion-renderer:1.0.4 crossformer ctranslate2:4.6.0 ctranslate2:master cuda-python:12.6 cuda:12.6-samples cudf:23.10.03 cudf:25.08.00 cudnn:9.3 cudnn:9.4 cuml cupy cutlass:4.1.0 cv-cuda:0.15 cv-cuda:0.15-cpp decord2:1.0.0 deepspeed-kernels:0.1.0 deepspeed:0.15.2 deepspeed:0.18.0 deepspeed:0.9.5 deepstream diffusers:0.35.0 diffusion_policy dimba:1.0 dli-nano-ai dynamo:0.3.2 easyvolcap:0.0.0 efficientvit exllama:0.1 faiss:1.12.0 faiss_lite fast_gauss:1.0.0 faster-whisper ffmpeg:7.1 flash-attention:2.5.7 flash-attention:2.6.3 flash-attention:2.7.2.post1 flash-attention:2.7.4.post1 flash-attention:2.8.0.post2 flash-attention:2.8.1 flashinfer:0.2.1.post2 flashinfer:0.2.2 flashinfer:0.2.2.post1 flashinfer:0.2.6.post1 flashinfer:0.2.7 flashinfer:0.2.8 flexprefill:0.1.0 framepack fruitnerf:1.0 gdrcopy genai-bench:0.1.0 genesis-world:0.2.2 glomap:2.0.0 gptqmodel:3.0.1 gsplat:1.5.3 gstreamer habitat-sim:0.3.4 hloc:1.4 hloc:1.5 holoscan huggingface_kernels:0.7.0 hymba isaac-gr00t isaac-ros:common-3.2-humble-desktop isaac-ros:common-3.2-jazzy-desktop isaac-ros:compression-3.2-humble-desktop isaac-ros:compression-3.2-jazzy-desktop isaac-ros:data-tools-3.2-humble-desktop isaac-ros:data-tools-3.2-jazzy-desktop isaac-ros:dnn-inference-3.2-humble-desktop isaac-ros:dnn-inference-3.2-jazzy-desktop isaac-ros:image-pipeline-3.2-humble-desktop isaac-ros:image-pipeline-3.2-jazzy-desktop isaac-ros:manipulator-3.2-humble-desktop isaac-ros:manipulator-3.2-jazzy-desktop isaac-ros:nitros-3.2-humble-desktop isaac-ros:nitros-3.2-jazzy-desktop isaac-ros:nvblox-3.2-humble-desktop isaac-ros:nvblox-3.2-jazzy-desktop isaac-ros:pose-estimation-3.2-humble-desktop isaac-ros:pose-estimation-3.2-jazzy-desktop isaac-ros:visual-slam-3.2-humble-desktop isaac-ros:visual-slam-3.2-jazzy-desktop isaaclab:2.2.0 isaacsim:5.0.0 jax:0.4.38 jax:0.6.3 jetcam jetson-copilot jetson-inference:foxy jetson-inference:galactic jetson-inference:humble jetson-inference:iron jetson-inference:jazzy jetson-inference:main jetson-utils:v1 jetson-utils:v2 jupyter_clickable_image_widget jupyterlab:4.2.0 jupyterlab:4.2.0-myst jupyterlab:latest jupyterlab:latest-myst kai_scheduler:0.5.5 kaolin:0.18.0 kat:1 kokoro-tts:fastapi kokoro-tts:hf kokoro-tts:onnx ktransformers:0.3.3 l4t-diffusion l4t-dynamo l4t-ml l4t-pytorch l4t-tensorflow:tf1 l4t-tensorflow:tf2 l4t-text-generation langchain langchain:samples lerobot libcom:0.1.0 lita llama-factory llama-index llama-index:samples llama-vision llama_cpp:0.2.57 llama_cpp:0.2.70 llama_cpp:0.2.83 llama_cpp:0.2.90 llama_cpp:0.3.1 llama_cpp:0.3.2 llama_cpp:0.3.5 llama_cpp:0.3.6 llama_cpp:0.3.7 llama_cpp:0.3.8 llama_cpp:0.3.9 llama_cpp:0.4.0 llama_cpp:b5255 llama_cpp:b5833 llava lobechat local_llm log-linear-attention:0.0.1 mamba:2.2.5 mambavision:1.0 memvid:0.1.4 mimicgen minference:0.1.7 minigpt4 mistral_rs mlc:0.1.0 mlc:0.1.1 mlc:0.1.2 mlc:0.1.3 mlc:0.1.4 mlc:0.19.0 mlc:0.20.0 mlc:0.21.0 mlstm_kernels:2.0.1 mooncake:0.3.5 nano_llm:24.4 nano_llm:24.4-foxy nano_llm:24.4-galactic nano_llm:24.4-humble nano_llm:24.4-iron nano_llm:24.4.1 nano_llm:24.4.1-foxy nano_llm:24.4.1-galactic nano_llm:24.4.1-humble nano_llm:24.4.1-iron nano_llm:24.5 nano_llm:24.5-foxy nano_llm:24.5-galactic nano_llm:24.5-humble nano_llm:24.5-iron nano_llm:24.5.1 nano_llm:24.5.1-foxy nano_llm:24.5.1-galactic nano_llm:24.5.1-humble nano_llm:24.5.1-iron nano_llm:24.6 nano_llm:24.6-foxy nano_llm:24.6-galactic nano_llm:24.6-humble nano_llm:24.6-iron nano_llm:24.7 nano_llm:24.7-foxy nano_llm:24.7-galactic nano_llm:24.7-humble nano_llm:24.7-iron nano_llm:main nano_llm:main-foxy nano_llm:main-galactic nano_llm:main-humble nano_llm:main-iron nanodb nanoowl nanosam nccl nemo nerfacc:0.5.3 nerfacc:0.5.4 nerfstudio:1.1.7 nerfview:0.1.4 nixl:0.3.2 numba nvdiffrast:0.3.4 nvidia_modelopt:0.32.0 nvpl octo ollama:0.10.0 ollama:0.4.0 ollama:0.5.1 ollama:0.5.5 ollama:0.5.7 ollama:0.6.7 ollama:0.7.0 ollama:0.8.0 ollama:0.9.6 onnxruntime:1.19.2 onnxruntime:1.20 onnxruntime:1.20.1 onnxruntime:1.21 onnxruntime:1.22 onnxruntime_genai:0.8.5 open3d:1.19.0 opencv:4.10.0 opencv:4.10.0-meta opencv:4.11.0 opencv:4.11.0-meta opencv:4.12.0 opencv:4.12.0-meta opencv:4.8.1 opencv:4.8.1-deb opencv:4.8.1-meta opendronemap opendronemap:node openpi openvla openvla:mimicgen optimum paraattention:0.4.0 partpacker:0.1.0 physx piper-tts piper1-tts:1.3.0 pixsfm:1.0 plstm:0.1.0 prismatic protomotions:2.5.0 pyav pycolmap:3.12 pycolmap:3.13 pycuda pykan:0.2.9 pytorch3d:0.7.8 pytorch3d:0.7.9 pytorch:2.1 pytorch:2.1-all pytorch:2.2 pytorch:2.2-all pytorch:2.3 pytorch:2.3-all pytorch:2.3.1 pytorch:2.3.1-all pytorch:2.4 pytorch:2.4-all pytorch:2.5 pytorch:2.5-all pytorch:2.6 pytorch:2.6-all pytorch:2.7 pytorch:2.7-all pytorch:2.8 pytorch:2.8-all radial-attention:0.1.0 raft realsense robogen robomimic robopoint robosuite ros:foxy-desktop ros:foxy-ros-base ros:foxy-ros-core ros:galactic-desktop ros:galactic-ros-base ros:galactic-ros-core ros:humble-desktop ros:humble-ros-base ros:humble-ros-core ros:iron-desktop ros:iron-ros-base ros:iron-ros-core ros:jazzy-desktop ros:jazzy-ros-base ros:jazzy-ros-core ros:noetic-desktop ros:noetic-ros-base ros:noetic-ros-core sage-attention:3.0.0 sam sapien sapiens sdnext self-forcing sgl-kernel:0.2.3 sglang:0.4.4 sglang:0.4.6 sglang:0.4.9 sound-utils sparc3d:0.1.0 sparge-attention:0.1.0 spark-tts speaches splashsurf stable-diffusion-webui sudonim:hf quadrants:1.8.0 tam tensorflow2:2.16.1 tensorflow2:2.18.0 tensorflow2:2.19.0 tensorflow2:2.20.0 tensorflow2:2.21.0 tensorflow_graphics:2.18.0 tensorflow_graphics:2.19.0 tensorflow_graphics:2.20.0 tensorflow_text:2.18.0 tensorflow_text:2.19.0 tensorflow_text:2.20.0 tensorrt:10.3 tensorrt:10.4 tensorrt:10.5 tensorrt:10.7 tensorrt_llm:0.12 tensorrt_llm:0.22.0 text-generation-inference text-generation-webui:1.7 text-generation-webui:6a7cd01 text-generation-webui:main tinycudann:1.7 torch-memory-saver:0.0.7 torch2trt torch_tensorrt torchao:0.12.0 torchao:0.13.0 torchaudio:2.1.0 torchaudio:2.2.2 torchaudio:2.3.0 torchaudio:2.4.0 torchaudio:2.5.0 torchaudio:2.6.0 torchaudio:2.7.0 torchaudio:2.8.0 torchsde:0.2.1 torchsde:0.2.2 torchsde:0.2.3 torchsde:0.2.4 torchsde:0.2.5 torchsde:0.2.6 torchsde:0.2.7 torchsde:0.2.8 torchtext:0.18.0 torchtext:0.19.0 torchvision:0.16.2 torchvision:0.17.2 torchvision:0.18.0 torchvision:0.19.1 torchvision:0.20.0 torchvision:0.21.0 torchvision:0.22.0 torchvision:0.23.0 transformer-engine:2.7 transformers:4.53.1 triton:3.0.0 triton:3.1.0 triton:3.2.0 triton:3.3.0 triton:3.3.1 triton:3.4.0 triton:3.5.0 tritonserver tvm video-codec-sdk:12.2.72 video-codec-sdk:12.2.72-samples video-codec-sdk:13.0.19 video-codec-sdk:13.0.19-samples videollama:1.0.0 videomambasuite:1.0 vila vllm:0.7.4 vllm:0.8.4 vllm:0.9.0 vllm:0.9.2 vllm:0.9.3 vllm:v0.8.5.post1 voice-pro voicecraft vpi vscode:cuda vscode:torch vscode:transformers warp:1.7.0 warp:1.7.0-all warp:1.7.0-jax warp:1.7.0-torch warp:1.8.1 warp:1.8.1-all warp:1.8.1-jax warp:1.8.1-torch whisper whisper_trt whisperx wyoming-piper:1.6.2 wyoming-piper:master wyoming-whisper:2.5.0 wyoming-whisper:master xattention:0.0.1 xformers:0.0.32 xformers:0.0.33 xgrammar:0.1.15 xgrammar:0.1.18 xgrammar:0.1.19 xgrammar:0.1.20 xgrammar:0.1.21 xlstm:2.0.5 xtts xtuner zed:5.0 zed:5.0-humble zed:5.0-jazzy zigma:1.0
   Dockerfile Dockerfile
pip_cache:cu126
   Aliases pip_cache pip-cache
   Requires L4T ['==36.*']
   Dependencies
   Dependants 3d_diffusion_policy 3dgrut:2.0.0 4k4d:0.0.0 ai-toolkit aim apex:0.1 arrow:12.0.1 arrow:14.0.1 arrow:19.0.1 arrow:20.0.0 arrow:5.0.0 audiocraft awq:0.1.0 bitsandbytes:0.39.1 bitsandbytes:0.45.4 bitsandbytes:0.45.5 bitsandbytes:0.46.0 bitsandbytes:0.47.0 bitsandbytes:0.48.0 block_sparse_attn:0.0.1 cache_dit:0.2.0 canbus cangaroo causalconv1d:1.6.0 chatterbox-tts ciso8601:v2.3.2 clip_trt cmake:pip cobra:0.0.1 comfyui cosmos-predict2 cosmos-reason1 cosmos-transfer1 cosmos1-diffusion-renderer:1.0.4 crossformer ctranslate2:4.6.0 ctranslate2:master cuda-python:12.6 cuda:12.6 cuda:12.6-samples cudf:23.10.03 cudf:25.08.00 cudnn:9.3 cudnn:9.4 cuml cupy cutlass:4.1.0 cv-cuda:0.15 cv-cuda:0.15-cpp decord2:1.0.0 deepspeed-kernels:0.1.0 deepspeed:0.15.2 deepspeed:0.18.0 deepspeed:0.9.5 deepstream diffusers:0.35.0 diffusion_policy dimba:1.0 dli-nano-ai docker dynamo:0.3.2 easyvolcap:0.0.0 efficientvit exllama:0.1 faiss:1.12.0 faiss_lite fast_gauss:1.0.0 faster-whisper ffmpeg:7.1 flash-attention:2.5.7 flash-attention:2.6.3 flash-attention:2.7.2.post1 flash-attention:2.7.4.post1 flash-attention:2.8.0.post2 flash-attention:2.8.1 flashinfer:0.2.1.post2 flashinfer:0.2.2 flashinfer:0.2.2.post1 flashinfer:0.2.6.post1 flashinfer:0.2.7 flashinfer:0.2.8 flexprefill:0.1.0 framepack fruitnerf:1.0 gdrcopy genai-bench:0.1.0 genesis-world:0.2.2 glomap:2.0.0 gptqmodel:3.0.1 graphiti gsplat:1.5.3 gstreamer h5py habitat-sim:0.3.4 hloc:1.4 hloc:1.5 holoscan homeassistant-core:2025.7.0 huggingface_hub huggingface_kernels:0.7.0 hymba isaac-gr00t isaac-ros:common-3.2-humble-desktop isaac-ros:common-3.2-jazzy-desktop isaac-ros:compression-3.2-humble-desktop isaac-ros:compression-3.2-jazzy-desktop isaac-ros:data-tools-3.2-humble-desktop isaac-ros:data-tools-3.2-jazzy-desktop isaac-ros:dnn-inference-3.2-humble-desktop isaac-ros:dnn-inference-3.2-jazzy-desktop isaac-ros:image-pipeline-3.2-humble-desktop isaac-ros:image-pipeline-3.2-jazzy-desktop isaac-ros:manipulator-3.2-humble-desktop isaac-ros:manipulator-3.2-jazzy-desktop isaac-ros:nitros-3.2-humble-desktop isaac-ros:nitros-3.2-jazzy-desktop isaac-ros:nvblox-3.2-humble-desktop isaac-ros:nvblox-3.2-jazzy-desktop isaac-ros:pose-estimation-3.2-humble-desktop isaac-ros:pose-estimation-3.2-jazzy-desktop isaac-ros:visual-slam-3.2-humble-desktop isaac-ros:visual-slam-3.2-jazzy-desktop isaaclab:2.2.0 isaacsim:5.0.0 jax:0.4.38 jax:0.6.3 jetcam jetson-copilot jetson-inference:foxy jetson-inference:galactic jetson-inference:humble jetson-inference:iron jetson-inference:jazzy jetson-inference:main jetson-utils:python jetson-utils:v1 jetson-utils:v2 jupyter_clickable_image_widget jupyterlab:4.2.0 jupyterlab:4.2.0-myst jupyterlab:latest jupyterlab:latest-myst kai_scheduler:0.5.5 kaolin:0.18.0 kat:1 kokoro-tts:fastapi kokoro-tts:hf kokoro-tts:onnx ktransformers:0.3.3 l4t-diffusion l4t-dynamo l4t-ml l4t-pytorch l4t-tensorflow:tf1 l4t-tensorflow:tf2 l4t-text-generation langchain langchain:samples lerobot libcom:0.1.0 lita llama-factory llama-index llama-index:samples llama-vision llama_cpp:0.2.57 llama_cpp:0.2.70 llama_cpp:0.2.83 llama_cpp:0.2.90 llama_cpp:0.3.1 llama_cpp:0.3.2 llama_cpp:0.3.5 llama_cpp:0.3.6 llama_cpp:0.3.7 llama_cpp:0.3.8 llama_cpp:0.3.9 llama_cpp:0.4.0 llama_cpp:b5255 llama_cpp:b5833 llamaspeak llava llvm:10 llvm:11 llvm:12 llvm:13 llvm:14 llvm:15 llvm:16 llvm:17 llvm:18 llvm:19 llvm:22 llvm:22 lobechat local_llm log-linear-attention:0.0.1 mamba:2.2.5 mambavision:1.0 memvid:0.1.4 meshlab:MeshLab-2023.12 meshlab:MeshLab-2025.03 mimicgen minference:0.1.7 minigpt4 mistral_rs mlc:0.1.0 mlc:0.1.1 mlc:0.1.2 mlc:0.1.3 mlc:0.1.4 mlc:0.19.0 mlc:0.20.0 mlc:0.21.0 mlstm_kernels:2.0.1 mooncake:0.3.5 mujoco nano_llm:24.4 nano_llm:24.4-foxy nano_llm:24.4-galactic nano_llm:24.4-humble nano_llm:24.4-iron nano_llm:24.4.1 nano_llm:24.4.1-foxy nano_llm:24.4.1-galactic nano_llm:24.4.1-humble nano_llm:24.4.1-iron nano_llm:24.5 nano_llm:24.5-foxy nano_llm:24.5-galactic nano_llm:24.5-humble nano_llm:24.5-iron nano_llm:24.5.1 nano_llm:24.5.1-foxy nano_llm:24.5.1-galactic nano_llm:24.5.1-humble nano_llm:24.5.1-iron nano_llm:24.6 nano_llm:24.6-foxy nano_llm:24.6-galactic nano_llm:24.6-humble nano_llm:24.6-iron nano_llm:24.7 nano_llm:24.7-foxy nano_llm:24.7-galactic nano_llm:24.7-humble nano_llm:24.7-iron nano_llm:main nano_llm:main-foxy nano_llm:main-galactic nano_llm:main-humble nano_llm:main-iron nanodb nanoowl nanosam nccl nemo nerfacc:0.5.3 nerfacc:0.5.4 nerfstudio:1.1.7 nerfview:0.1.4 ninja nixl:0.3.2 numba numpy nvdiffrast:0.3.4 nvidia_modelopt:0.32.0 nvpl octo ollama:0.10.0 ollama:0.4.0 ollama:0.5.1 ollama:0.5.5 ollama:0.5.7 ollama:0.6.7 ollama:0.7.0 ollama:0.8.0 ollama:0.9.6 onnx onnxruntime:1.19.2 onnxruntime:1.20 onnxruntime:1.20.1 onnxruntime:1.21 onnxruntime:1.22 onnxruntime_genai:0.8.5 open3d:1.19.0 openai opencv:4.10.0 opencv:4.10.0-meta opencv:4.11.0 opencv:4.11.0-meta opencv:4.12.0 opencv:4.12.0-meta opencv:4.8.1 opencv:4.8.1-deb opencv:4.8.1-meta opendronemap opendronemap:node openpi openvla openvla:mimicgen optimum paraattention:0.4.0 partpacker:0.1.0 physx piper-tts piper1-tts:1.3.0 pixsfm:1.0 plstm:0.1.0 polyscope:2.5.0 prismatic protobuf:apt protobuf:cpp protomotions:2.5.0 psutil-home-assistant:0.0.1 pyav pybind11 pyceres:2.5 pycolmap:3.12 pycolmap:3.13 pycuda pykan:0.2.9 pymeshlab:2023.12.post2 pymeshlab:2023.12.post3 pymeshlab:2025.6.23.dev0 python:3.10 python:3.11 python:3.12 python:3.13 python:3.14 pytorch3d:0.7.8 pytorch3d:0.7.9 pytorch:2.1 pytorch:2.1-all pytorch:2.2 pytorch:2.2-all pytorch:2.3 pytorch:2.3-all pytorch:2.3.1 pytorch:2.3.1-all pytorch:2.4 pytorch:2.4-all pytorch:2.5 pytorch:2.5-all pytorch:2.6 pytorch:2.6-all pytorch:2.7 pytorch:2.7-all pytorch:2.8 pytorch:2.8-all radial-attention:0.1.0 raft realsense riva-client:python robogen robomimic robopoint robosuite ros:foxy-desktop ros:foxy-ros-base ros:foxy-ros-core ros:galactic-desktop ros:galactic-ros-base ros:galactic-ros-core ros:humble-desktop ros:humble-ros-base ros:humble-ros-core ros:iron-desktop ros:iron-ros-base ros:iron-ros-core ros:jazzy-desktop ros:jazzy-ros-base ros:jazzy-ros-core ros:noetic-desktop ros:noetic-ros-base ros:noetic-ros-core rust sage-attention:3.0.0 sam sapien sapiens sdnext self-forcing sgl-kernel:0.2.3 sglang:0.4.4 sglang:0.4.6 sglang:0.4.9 sound-utils sparc3d:0.1.0 sparge-attention:0.1.0 spark-tts speaches splashsurf stable-diffusion-webui sudonim sudonim:hf quadrants:1.8.0 tam tensorboard tensorflow2:2.16.1 tensorflow2:2.18.0 tensorflow2:2.19.0 tensorflow2:2.20.0 tensorflow2:2.21.0 tensorflow_graphics:2.18.0 tensorflow_graphics:2.19.0 tensorflow_graphics:2.20.0 tensorflow_text:2.18.0 tensorflow_text:2.19.0 tensorflow_text:2.20.0 tensorrt:10.3 tensorrt:10.4 tensorrt:10.5 tensorrt:10.7 tensorrt_llm:0.12 tensorrt_llm:0.22.0 text-generation-inference text-generation-webui:1.7 text-generation-webui:6a7cd01 text-generation-webui:main tinycudann:1.7 torch-memory-saver:0.0.7 torch2trt torch_tensorrt torchao:0.12.0 torchao:0.13.0 torchaudio:2.1.0 torchaudio:2.2.2 torchaudio:2.3.0 torchaudio:2.4.0 torchaudio:2.5.0 torchaudio:2.6.0 torchaudio:2.7.0 torchaudio:2.8.0 torchsde:0.2.1 torchsde:0.2.2 torchsde:0.2.3 torchsde:0.2.4 torchsde:0.2.5 torchsde:0.2.6 torchsde:0.2.7 torchsde:0.2.8 torchtext:0.18.0 torchtext:0.19.0 torchvision:0.16.2 torchvision:0.17.2 torchvision:0.18.0 torchvision:0.19.1 torchvision:0.20.0 torchvision:0.21.0 torchvision:0.22.0 torchvision:0.23.0 transformer-engine:2.7 transformers:4.53.1 triton:3.0.0 triton:3.1.0 triton:3.2.0 triton:3.3.0 triton:3.3.1 triton:3.4.0 triton:3.5.0 tritonserver tvm video-codec-sdk:12.2.72 video-codec-sdk:12.2.72-samples video-codec-sdk:13.0.19 video-codec-sdk:13.0.19-samples videollama:1.0.0 videomambasuite:1.0 vila vllm:0.7.4 vllm:0.8.4 vllm:0.9.0 vllm:0.9.2 vllm:0.9.3 vllm:v0.8.5.post1 voice-pro voicecraft vpi vscode vscode:cuda vscode:torch vscode:transformers vtk:9.3.1 vtk:9.4.2 vtk:9.5.0 vulkan:1.3.275 vulkan:1.3.296 vulkan:1.4.309 vulkan:1.4.313 vulkan:1.4.314 warp:1.7.0 warp:1.7.0-all warp:1.7.0-jax warp:1.7.0-torch warp:1.8.1 warp:1.8.1-all warp:1.8.1-jax warp:1.8.1-torch whisper whisper_trt whisperx wyoming-assist-microphone:1.4.1 wyoming-assist-microphone:master wyoming-openwakeword:1.10.0 wyoming-openwakeword:master wyoming-piper:1.6.2 wyoming-piper:master wyoming-whisper:2.5.0 wyoming-whisper:master xattention:0.0.1 xformers:0.0.32 xformers:0.0.33 xgrammar:0.1.15 xgrammar:0.1.18 xgrammar:0.1.19 xgrammar:0.1.20 xgrammar:0.1.21 xlstm:2.0.5 xtts xtuner zed:5.0 zed:5.0-humble zed:5.0-jazzy zigma:1.0
   Dockerfile Dockerfile.pip
cuda:12.6-samples
   Aliases cuda:samples
   Requires L4T ['==36.*']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 python cmake opengl llvm vulkan
   Dockerfile Dockerfile.samples
   Notes CUDA samples from https://github.com/NVIDIA/cuda-samples installed under /opt/cuda-samples
cuda:12.8
   Requires L4T ['>=36', 'aarch64']
   Dependencies build-essential pip_cache:cu128
   Dependants cuda-python:12.8 cuda:12.8-samples cudnn:9.8
   Dockerfile Dockerfile
pip_cache:cu128
   Requires L4T ['>=36']
   Dependencies
   Dependants cuda-python:12.8 cuda:12.8 cuda:12.8-samples cudnn:9.8
   Dockerfile Dockerfile.pip
cuda:12.8-samples
   Requires L4T ['>=36']
   Dependencies build-essential pip_cache:cu128 cuda:12.8 python cmake opengl llvm vulkan
   Dockerfile Dockerfile.samples
   Notes CUDA samples from https://github.com/NVIDIA/cuda-samples installed under /opt/cuda-samples
cuda:12.9
   Requires L4T ['>=36', 'aarch64']
   Dependencies build-essential pip_cache:cu129
   Dependants cuda-python:12.9 cuda:12.9-samples cudnn:9.10
   Dockerfile Dockerfile
   Images dustynv/cuda:12.9-samples-amd64-cu128-24.04 (2025-04-02, 5.7GB)dustynv/cuda:12.9-samples-r36.4.0-cu128-24.04 (2025-04-02, 2.8GB)
pip_cache:cu129
   Requires L4T ['>=36']
   Dependencies
   Dependants cuda-python:12.9 cuda:12.9 cuda:12.9-samples cudnn:9.10
   Dockerfile Dockerfile.pip
cuda:12.9-samples
   Requires L4T ['>=36']
   Dependencies build-essential pip_cache:cu129 cuda:12.9 python cmake opengl llvm vulkan
   Dockerfile Dockerfile.samples
   Images dustynv/cuda:12.9-samples-amd64-cu128-24.04 (2025-04-02, 5.7GB)dustynv/cuda:12.9-samples-r36.4.0-cu128-24.04 (2025-04-02, 2.8GB)
   Notes CUDA samples from https://github.com/NVIDIA/cuda-samples installed under /opt/cuda-samples
cuda:13.0
   Requires L4T ['>=36', 'aarch64']
   Dependencies build-essential pip_cache:cu130
   Dependants cuda-python:13.0 cuda:13.0-samples cudnn:10.0
   Dockerfile Dockerfile
pip_cache:cu130
   Requires L4T ['>=36']
   Dependencies
   Dependants cuda-python:13.0 cuda:13.0 cuda:13.0-samples cudnn:10.0
   Dockerfile Dockerfile.pip
cuda:13.0-samples
   Requires L4T ['>=36']
   Dependencies build-essential pip_cache:cu130 cuda:13.0 python cmake opengl llvm vulkan
   Dockerfile Dockerfile.samples
   Notes CUDA samples from https://github.com/NVIDIA/cuda-samples installed under /opt/cuda-samples

CONTAINER IMAGES

Repository/Tag Date Arch Size
  dustynv/cuda:12.2-r36.2.0 2023-12-05 arm64 3.4GB
  dustynv/cuda:12.2-samples-r36.2.0 2023-12-07 arm64 4.8GB
  dustynv/cuda:12.9-samples-amd64-cu128-24.04 2025-04-02 amd64 5.7GB
  dustynv/cuda:12.9-samples-r36.4.0-cu128-24.04 2025-04-02 arm64 2.8GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag cuda)

# or explicitly specify one of the container images above
jetson-containers run dustynv/cuda:12.9-samples-r36.4.0-cu128-24.04

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/cuda:12.9-samples-r36.4.0-cu128-24.04

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag cuda)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag cuda) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build cuda

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`deprecated/cuda/cutlass/README.md`)

cutlass

CONTAINERS IMAGES RUN BUILD

CONTAINERS

cutlass:4.1.0
   Aliases cutlass
   Requires L4T ['>=34.1.0']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 python numpy cuda-python cudnn cmake onnx pytorch
   Dependants awq:0.1.0 block_sparse_attn:0.0.1 comfyui cosmos-predict2 cosmos-reason1 cosmos-transfer1 cosmos1-diffusion-renderer:1.0.4 dynamo:0.3.2 exllama:0.1 flash-attention:2.5.7 flash-attention:2.6.3 flash-attention:2.7.2.post1 flash-attention:2.7.4.post1 flash-attention:2.8.0.post2 flash-attention:2.8.1 flexprefill:0.1.0 framepack genai-bench:0.1.0 huggingface_kernels:0.7.0 hymba isaac-gr00t l4t-diffusion l4t-dynamo l4t-text-generation lita llama-factory llava lobechat minference:0.1.7 mlstm_kernels:2.0.1 nano_llm:24.4 nano_llm:24.4-foxy nano_llm:24.4-galactic nano_llm:24.4-humble nano_llm:24.4-iron nano_llm:24.4.1 nano_llm:24.4.1-foxy nano_llm:24.4.1-galactic nano_llm:24.4.1-humble nano_llm:24.4.1-iron nano_llm:24.5 nano_llm:24.5-foxy nano_llm:24.5-galactic nano_llm:24.5-humble nano_llm:24.5-iron nano_llm:24.5.1 nano_llm:24.5.1-foxy nano_llm:24.5.1-galactic nano_llm:24.5.1-humble nano_llm:24.5.1-iron nano_llm:24.6 nano_llm:24.6-foxy nano_llm:24.6-galactic nano_llm:24.6-humble nano_llm:24.6-iron nano_llm:24.7 nano_llm:24.7-foxy nano_llm:24.7-galactic nano_llm:24.7-humble nano_llm:24.7-iron nano_llm:main nano_llm:main-foxy nano_llm:main-galactic nano_llm:main-humble nano_llm:main-iron openvla openvla:mimicgen paraattention:0.4.0 partpacker:0.1.0 plstm:0.1.0 prismatic pytorch:2.1-all pytorch:2.2-all pytorch:2.3-all pytorch:2.3.1-all pytorch:2.4-all pytorch:2.5-all pytorch:2.6-all pytorch:2.7-all pytorch:2.8-all robopoint sage-attention:3.0.0 sdnext self-forcing sgl-kernel:0.2.3 sglang:0.4.4 sglang:0.4.6 sglang:0.4.9 sparc3d:0.1.0 sparge-attention:0.1.0 sudonim:hf text-generation-webui:1.7 text-generation-webui:6a7cd01 text-generation-webui:main transformer-engine:2.7 videollama:1.0.0 vila vllm:0.7.4 vllm:0.8.4 vllm:0.9.0 vllm:0.9.2 vllm:0.9.3 vllm:v0.8.5.post1 vscode:transformers xattention:0.0.1 xlstm:2.0.5 xtuner
   Dockerfile Dockerfile

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag cutlass)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host cutlass:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag cutlass)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag cutlass) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build cutlass

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`deprecated/cuda/gdrcopy/README.md`)

gdrcopy

CONTAINERS IMAGES RUN BUILD

CONTAINERS

gdrcopy
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 cuda
   Dependants dynamo:0.3.2 l4t-dynamo nixl:0.3.2 nvidia_modelopt:0.32.0 tensorrt_llm:0.12 tensorrt_llm:0.22.0
   Dockerfile Dockerfile

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag gdrcopy)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host gdrcopy:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag gdrcopy)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag gdrcopy) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build gdrcopy

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`deprecated/cuda/nccl/README.md`)

nccl

CONTAINERS IMAGES RUN BUILD

CONTAINERS

nccl
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 cuda
   Dockerfile Dockerfile

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag nccl)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host nccl:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag nccl)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag nccl) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build nccl

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`deprecated/cuda/nvpl/README.md`)

nvpl

CONTAINERS IMAGES RUN BUILD

CONTAINERS

nvpl
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 cuda
   Dockerfile Dockerfile

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag nvpl)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host nvpl:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag nvpl)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag nvpl) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build nvpl

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`deprecated/cuda/pycuda/README.md`)

pycuda

CONTAINERS IMAGES RUN BUILD

CONTAINERS

pycuda
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 cuda python numpy
   Dependants audiocraft cv-cuda:0.15 diffusion_policy dli-nano-ai efficientvit jupyter_clickable_image_widget jupyterlab:4.2.0 jupyterlab:4.2.0-myst jupyterlab:latest jupyterlab:latest-myst l4t-diffusion l4t-dynamo l4t-ml l4t-pytorch l4t-tensorflow:tf1 l4t-tensorflow:tf2 l4t-text-generation langchain:samples lerobot llama-index:samples openpi pytorch:2.1-all pytorch:2.2-all pytorch:2.3-all pytorch:2.3.1-all pytorch:2.4-all pytorch:2.5-all pytorch:2.6-all pytorch:2.7-all pytorch:2.8-all sam stable-diffusion-webui tam voice-pro voicecraft warp:1.7.0-all warp:1.8.1-all whisper
   Dockerfile Dockerfile
   Images dustynv/pycuda:r32.7.1 (2023-12-06, 0.4GB)dustynv/pycuda:r35.2.1 (2023-09-07, 5.0GB)dustynv/pycuda:r35.3.1 (2023-08-29, 5.0GB)dustynv/pycuda:r35.4.1 (2023-12-06, 5.0GB)dustynv/pycuda:r36.2.0 (2023-12-06, 3.5GB)dustynv/pycuda:r36.4.0-cu128-24.04 (2025-03-03, 2.3GB)

CONTAINER IMAGES

Repository/Tag Date Arch Size
  dustynv/pycuda:r32.7.1 2023-12-06 arm64 0.4GB
  dustynv/pycuda:r35.2.1 2023-09-07 arm64 5.0GB
  dustynv/pycuda:r35.3.1 2023-08-29 arm64 5.0GB
  dustynv/pycuda:r35.4.1 2023-12-06 arm64 5.0GB
  dustynv/pycuda:r36.2.0 2023-12-06 arm64 3.5GB
  dustynv/pycuda:r36.4.0-cu128-24.04 2025-03-03 arm64 2.3GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag pycuda)

# or explicitly specify one of the container images above
jetson-containers run dustynv/pycuda:r36.4.0-cu128-24.04

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/pycuda:r36.4.0-cu128-24.04

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag pycuda)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag pycuda) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build pycuda

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`deprecated/cuda/tensorrt/README.md`)

tensorrt

CONTAINERS IMAGES RUN BUILD

CONTAINERS

tensorrt:10.3
   Aliases tensorrt
   Requires L4T ['==r36.*', '==cu126', 'aarch64']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn:9.3 python
   Dependants ai-toolkit audiocraft clip_trt comfyui deepstream diffusion_policy dli-nano-ai efficientvit faster-whisper fruitnerf:1.0 holoscan isaac-ros:common-3.2-humble-desktop isaac-ros:common-3.2-jazzy-desktop isaac-ros:compression-3.2-humble-desktop isaac-ros:compression-3.2-jazzy-desktop isaac-ros:data-tools-3.2-humble-desktop isaac-ros:data-tools-3.2-jazzy-desktop isaac-ros:dnn-inference-3.2-humble-desktop isaac-ros:dnn-inference-3.2-jazzy-desktop isaac-ros:image-pipeline-3.2-humble-desktop isaac-ros:image-pipeline-3.2-jazzy-desktop isaac-ros:manipulator-3.2-humble-desktop isaac-ros:manipulator-3.2-jazzy-desktop isaac-ros:nitros-3.2-humble-desktop isaac-ros:nitros-3.2-jazzy-desktop isaac-ros:nvblox-3.2-humble-desktop isaac-ros:nvblox-3.2-jazzy-desktop isaac-ros:pose-estimation-3.2-humble-desktop isaac-ros:pose-estimation-3.2-jazzy-desktop isaac-ros:visual-slam-3.2-humble-desktop isaac-ros:visual-slam-3.2-jazzy-desktop jetson-inference:foxy jetson-inference:galactic jetson-inference:humble jetson-inference:iron jetson-inference:jazzy jetson-inference:main jetson-utils:v1 jetson-utils:v2 jupyter_clickable_image_widget jupyterlab:4.2.0 jupyterlab:4.2.0-myst jupyterlab:latest jupyterlab:latest-myst kokoro-tts:onnx l4t-diffusion l4t-ml l4t-pytorch l4t-tensorflow:tf1 l4t-tensorflow:tf2 l4t-text-generation langchain:samples lerobot llama-index:samples local_llm nano_llm:24.4 nano_llm:24.4-foxy nano_llm:24.4-galactic nano_llm:24.4-humble nano_llm:24.4-iron nano_llm:24.4.1 nano_llm:24.4.1-foxy nano_llm:24.4.1-galactic nano_llm:24.4.1-humble nano_llm:24.4.1-iron nano_llm:24.5 nano_llm:24.5-foxy nano_llm:24.5-galactic nano_llm:24.5-humble nano_llm:24.5-iron nano_llm:24.5.1 nano_llm:24.5.1-foxy nano_llm:24.5.1-galactic nano_llm:24.5.1-humble nano_llm:24.5.1-iron nano_llm:24.6 nano_llm:24.6-foxy nano_llm:24.6-galactic nano_llm:24.6-humble nano_llm:24.6-iron nano_llm:24.7 nano_llm:24.7-foxy nano_llm:24.7-galactic nano_llm:24.7-humble nano_llm:24.7-iron nano_llm:main nano_llm:main-foxy nano_llm:main-galactic nano_llm:main-humble nano_llm:main-iron nanodb nanoowl nanosam nvidia_modelopt:0.32.0 onnxruntime:1.19.2 onnxruntime:1.20 onnxruntime:1.20.1 onnxruntime:1.21 onnxruntime:1.22 onnxruntime_genai:0.8.5 opendronemap opendronemap:node openpi optimum partpacker:0.1.0 piper-tts piper1-tts:1.3.0 pytorch:2.1-all pytorch:2.2-all pytorch:2.3-all pytorch:2.3.1-all pytorch:2.4-all pytorch:2.5-all pytorch:2.6-all pytorch:2.7-all pytorch:2.8-all ros:foxy-desktop ros:foxy-ros-base ros:foxy-ros-core ros:galactic-desktop ros:galactic-ros-base ros:galactic-ros-core ros:humble-desktop ros:humble-ros-base ros:humble-ros-core ros:iron-desktop ros:iron-ros-base ros:iron-ros-core ros:jazzy-desktop ros:jazzy-ros-base ros:jazzy-ros-core ros:noetic-desktop ros:noetic-ros-base ros:noetic-ros-core sam sapiens sparc3d:0.1.0 speaches stable-diffusion-webui tam tensorflow2:2.16.1 tensorflow2:2.18.0 tensorflow2:2.19.0 tensorflow2:2.20.0 tensorflow2:2.21.0 tensorflow_graphics:2.18.0 tensorflow_graphics:2.19.0 tensorflow_graphics:2.20.0 tensorflow_text:2.18.0 tensorflow_text:2.19.0 tensorflow_text:2.20.0 tensorrt_llm:0.12 tensorrt_llm:0.22.0 torch2trt torch_tensorrt tritonserver voice-pro voicecraft vscode:cuda vscode:torch warp:1.7.0-all warp:1.8.1-all whisper whisper_trt whisperx wyoming-piper:1.6.2 wyoming-piper:master wyoming-whisper:2.5.0 wyoming-whisper:master xtts zed:5.0 zed:5.0-humble zed:5.0-jazzy
   Dockerfile Dockerfile.tar
tensorrt:10.4
   Requires L4T ['==r36.*', '==cu126', 'aarch64']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn:9.3 python
   Dockerfile Dockerfile.tar
tensorrt:10.5
   Requires L4T ['==r36.*', '==cu126', 'aarch64']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn:9.3 python
   Dockerfile Dockerfile.tar
tensorrt:10.7
   Requires L4T ['==r36.*', '==cu126', 'aarch64']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn:9.3 python
   Dockerfile Dockerfile.tar

CONTAINER IMAGES

Repository/Tag Date Arch Size
  dustynv/tensorrt:8.6-r36.2.0 2023-12-05 arm64 6.7GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag tensorrt)

# or explicitly specify one of the container images above
jetson-containers run dustynv/tensorrt:8.6-r36.2.0

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/tensorrt:8.6-r36.2.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag tensorrt)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag tensorrt) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build tensorrt

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/attention/ParaAttention/README.md`)

ParaAttention

CONTAINERS IMAGES RUN BUILD

https://github.com/chengzeyi/ParaAttention

CONTAINERS

paraattention:0.4.0
   Aliases paraattention
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 torchvision torchaudio triton torchao huggingface_hub rust transformers diffusers xformers cuda-python cutlass flash-attention opengl llvm vulkan video-codec-sdk ffmpeg opencv
   Dependants comfyui l4t-diffusion lobechat sdnext
   Dockerfile Dockerfile

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag ParaAttention)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host ParaAttention:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag ParaAttention)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag ParaAttention) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build ParaAttention

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/attention/block-sparse-attention/README.md`)

block-sparse-attention

CONTAINERS IMAGES RUN BUILD

CONTAINERS

block_sparse_attn:0.0.1
   Aliases block_sparse_attn
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 torchvision torchaudio triton torchao huggingface_hub rust transformers diffusers xformers cuda-python cutlass flash-attention
   Dependants xattention:0.0.1
   Dockerfile Dockerfile

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag block-sparse-attention)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host block-sparse-attention:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag block-sparse-attention)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag block-sparse-attention) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build block-sparse-attention

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/attention/flash-attention/README.md`)

flash-attention

CONTAINERS IMAGES RUN BUILD

CONTAINERS

flash-attention:2.5.7
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 triton torchvision huggingface_hub rust transformers diffusers xformers cuda-python cutlass
   Dockerfile Dockerfile
flash-attention:2.6.3
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 triton torchvision huggingface_hub rust transformers diffusers xformers cuda-python cutlass
   Dockerfile Dockerfile
flash-attention:2.7.2.post1
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 triton torchvision huggingface_hub rust transformers diffusers xformers cuda-python cutlass
   Dockerfile Dockerfile
flash-attention:2.7.4.post1
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 triton torchvision huggingface_hub rust transformers diffusers xformers cuda-python cutlass
   Dockerfile Dockerfile
flash-attention:2.8.0.post2
   Aliases flash-attention
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 triton torchvision huggingface_hub rust transformers diffusers xformers cuda-python cutlass
   Dependants awq:0.1.0 block_sparse_attn:0.0.1 comfyui cosmos-predict2 cosmos-reason1 cosmos-transfer1 cosmos1-diffusion-renderer:1.0.4 dynamo:0.3.2 exllama:0.1 flexprefill:0.1.0 framepack genai-bench:0.1.0 huggingface_kernels:0.7.0 hymba isaac-gr00t l4t-diffusion l4t-dynamo l4t-text-generation lita llama-factory llava lobechat minference:0.1.7 mlstm_kernels:2.0.1 nano_llm:24.4 nano_llm:24.4-foxy nano_llm:24.4-galactic nano_llm:24.4-humble nano_llm:24.4-iron nano_llm:24.4.1 nano_llm:24.4.1-foxy nano_llm:24.4.1-galactic nano_llm:24.4.1-humble nano_llm:24.4.1-iron nano_llm:24.5 nano_llm:24.5-foxy nano_llm:24.5-galactic nano_llm:24.5-humble nano_llm:24.5-iron nano_llm:24.5.1 nano_llm:24.5.1-foxy nano_llm:24.5.1-galactic nano_llm:24.5.1-humble nano_llm:24.5.1-iron nano_llm:24.6 nano_llm:24.6-foxy nano_llm:24.6-galactic nano_llm:24.6-humble nano_llm:24.6-iron nano_llm:24.7 nano_llm:24.7-foxy nano_llm:24.7-galactic nano_llm:24.7-humble nano_llm:24.7-iron nano_llm:main nano_llm:main-foxy nano_llm:main-galactic nano_llm:main-humble nano_llm:main-iron openvla openvla:mimicgen paraattention:0.4.0 partpacker:0.1.0 plstm:0.1.0 prismatic pytorch:2.1-all pytorch:2.2-all pytorch:2.3-all pytorch:2.3.1-all pytorch:2.4-all pytorch:2.5-all pytorch:2.6-all pytorch:2.7-all pytorch:2.8-all robopoint sage-attention:3.0.0 sdnext self-forcing sgl-kernel:0.2.3 sglang:0.4.4 sglang:0.4.6 sglang:0.4.9 sparc3d:0.1.0 sparge-attention:0.1.0 sudonim:hf text-generation-webui:1.7 text-generation-webui:6a7cd01 text-generation-webui:main transformer-engine:2.7 videollama:1.0.0 vila vllm:0.7.4 vllm:0.8.4 vllm:0.9.0 vllm:0.9.2 vllm:0.9.3 vllm:v0.8.5.post1 vscode:transformers xattention:0.0.1 xlstm:2.0.5 xtuner
   Dockerfile Dockerfile
flash-attention:2.8.1
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 triton torchvision huggingface_hub rust transformers diffusers xformers cuda-python cutlass
   Dockerfile Dockerfile

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag flash-attention)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host flash-attention:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag flash-attention)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag flash-attention) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build flash-attention

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/attention/flashinfer/README.md`)

flash-infer

CONTAINERS IMAGES RUN BUILD

CONTAINERS

flashinfer:0.2.1.post2
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch triton
   Dependants vllm:0.8.4
   Dockerfile Dockerfile
flashinfer:0.2.2
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch triton
   Dockerfile Dockerfile
flashinfer:0.2.2.post1
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch triton
   Dependants vllm:v0.8.5.post1
   Dockerfile Dockerfile
flashinfer:0.2.6.post1
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch triton
   Dependants mlc:0.20.0 sglang:0.4.6
   Dockerfile Dockerfile
flashinfer:0.2.7
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch triton
   Dockerfile Dockerfile
flashinfer:0.2.8
   Aliases flashinfer
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch triton
   Dependants cosmos-reason1 dynamo:0.3.2 genai-bench:0.1.0 l4t-dynamo l4t-text-generation llama-factory local_llm mlc:0.21.0 nano_llm:24.4 nano_llm:24.4-foxy nano_llm:24.4-galactic nano_llm:24.4-humble nano_llm:24.4-iron nano_llm:24.4.1 nano_llm:24.4.1-foxy nano_llm:24.4.1-galactic nano_llm:24.4.1-humble nano_llm:24.4.1-iron nano_llm:24.5 nano_llm:24.5-foxy nano_llm:24.5-galactic nano_llm:24.5-humble nano_llm:24.5-iron nano_llm:24.5.1 nano_llm:24.5.1-foxy nano_llm:24.5.1-galactic nano_llm:24.5.1-humble nano_llm:24.5.1-iron nano_llm:24.6 nano_llm:24.6-foxy nano_llm:24.6-galactic nano_llm:24.6-humble nano_llm:24.6-iron nano_llm:24.7 nano_llm:24.7-foxy nano_llm:24.7-galactic nano_llm:24.7-humble nano_llm:24.7-iron nano_llm:main nano_llm:main-foxy nano_llm:main-galactic nano_llm:main-humble nano_llm:main-iron radial-attention:0.1.0 sgl-kernel:0.2.3 sglang:0.4.4 sglang:0.4.9 vllm:0.7.4 vllm:0.9.0 vllm:0.9.2 vllm:0.9.3
   Dockerfile Dockerfile

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag flash-infer)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host flash-infer:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag flash-infer)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag flash-infer) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build flash-infer

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/attention/flexprefill/README.md`)

flexprefill

CONTAINERS IMAGES RUN BUILD

CONTAINERS

flexprefill:0.1.0
   Aliases flexprefill
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 torchvision torchaudio triton torchao huggingface_hub rust transformers diffusers xformers cuda-python cutlass flash-attention
   Dependants comfyui cosmos-reason1 dynamo:0.3.2 l4t-diffusion l4t-dynamo llama-factory lobechat minference:0.1.7 sdnext sglang:0.4.4 sglang:0.4.6 sglang:0.4.9 vllm:0.7.4 vllm:0.8.4 vllm:0.9.0 vllm:0.9.2 vllm:0.9.3 vllm:v0.8.5.post1
   Dockerfile Dockerfile

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag flexprefill)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host flexprefill:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag flexprefill)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag flexprefill) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build flexprefill

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/attention/huggingface_kernels/README.md`)

huggingface_kernels

CONTAINERS IMAGES RUN BUILD

CONTAINERS

huggingface_kernels:0.7.0
   Aliases huggingface_kernels
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 triton huggingface_hub torchvision rust transformers diffusers xformers cuda-python cutlass flash-attention
   Dockerfile Dockerfile

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag huggingface_kernels)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host huggingface_kernels:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag huggingface_kernels)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag huggingface_kernels) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build huggingface_kernels

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/attention/log-linear-attention/README.md`)

log-linear-attention

CONTAINERS IMAGES RUN BUILD

CONTAINERS

log-linear-attention:0.0.1
   Aliases log-linear-attention
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 triton torchvision huggingface_hub rust transformers diffusers xformers ninja torchaudio causalconv1d mamba
   Dockerfile Dockerfile

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag log-linear-attention)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host log-linear-attention:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag log-linear-attention)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag log-linear-attention) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build log-linear-attention

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/attention/radial-attention/README.md`)

radial-attention

CONTAINERS IMAGES RUN BUILD

CONTAINERS

radial-attention:0.1.0
   Aliases radial-attention
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 triton torchvision huggingface_hub rust transformers diffusers xformers flashinfer
   Dockerfile Dockerfile

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag radial-attention)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host radial-attention:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag radial-attention)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag radial-attention) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build radial-attention

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/attention/sage-attention/README.md`)

sage-attention

CONTAINERS IMAGES RUN BUILD

CONTAINERS

sage-attention:3.0.0
   Aliases sage-attention
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 torchvision torchaudio triton torchao huggingface_hub rust transformers diffusers xformers cuda-python cutlass flash-attention opengl llvm vulkan video-codec-sdk ffmpeg opencv
   Dependants comfyui framepack l4t-diffusion lobechat sdnext
   Dockerfile Dockerfile

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag sage-attention)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host sage-attention:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag sage-attention)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag sage-attention) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build sage-attention

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/attention/sparge-attention/README.md`)

sparge-attention

CONTAINERS IMAGES RUN BUILD

CONTAINERS

sparge-attention:0.1.0
   Aliases sparge-attention
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 torchvision torchaudio triton torchao huggingface_hub rust transformers diffusers xformers cuda-python cutlass flash-attention opengl llvm vulkan video-codec-sdk ffmpeg opencv
   Dependants comfyui l4t-diffusion lobechat sdnext
   Dockerfile Dockerfile
   Notes https://github.com/thu-ml/SpargeAttn.git

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag sparge-attention)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host sparge-attention:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag sparge-attention)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag sparge-attention) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build sparge-attention

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/attention/xattention/README.md`)

xattention

CONTAINERS IMAGES RUN BUILD

CONTAINERS

xattention:0.0.1
   Aliases xattention
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 torchvision torchaudio triton torchao huggingface_hub rust transformers diffusers xformers cuda-python cutlass flash-attention opengl llvm vulkan video-codec-sdk ffmpeg opencv block_sparse_attn
   Dockerfile Dockerfile

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag xattention)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host xattention:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag xattention)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag xattention) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build xattention

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/attention/xformers/README.md`)

xformers

CONTAINERS IMAGES RUN BUILD

CONTAINERS

xformers:0.0.32
   Aliases xformers
   Requires L4T ['>=34.1.0']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 triton torchvision huggingface_hub rust transformers diffusers
   Dependants apex:0.1 audiocraft awq:0.1.0 block_sparse_attn:0.0.1 comfyui cosmos-predict2 cosmos-reason1 cosmos-transfer1 cosmos1-diffusion-renderer:1.0.4 dynamo:0.3.2 exllama:0.1 flash-attention:2.5.7 flash-attention:2.6.3 flash-attention:2.7.2.post1 flash-attention:2.7.4.post1 flash-attention:2.8.0.post2 flash-attention:2.8.1 flexprefill:0.1.0 framepack genai-bench:0.1.0 huggingface_kernels:0.7.0 hymba isaac-gr00t l4t-diffusion l4t-dynamo l4t-text-generation lita llama-factory llava lobechat log-linear-attention:0.0.1 minference:0.1.7 mlstm_kernels:2.0.1 nano_llm:24.4 nano_llm:24.4-foxy nano_llm:24.4-galactic nano_llm:24.4-humble nano_llm:24.4-iron nano_llm:24.4.1 nano_llm:24.4.1-foxy nano_llm:24.4.1-galactic nano_llm:24.4.1-humble nano_llm:24.4.1-iron nano_llm:24.5 nano_llm:24.5-foxy nano_llm:24.5-galactic nano_llm:24.5-humble nano_llm:24.5-iron nano_llm:24.5.1 nano_llm:24.5.1-foxy nano_llm:24.5.1-galactic nano_llm:24.5.1-humble nano_llm:24.5.1-iron nano_llm:24.6 nano_llm:24.6-foxy nano_llm:24.6-galactic nano_llm:24.6-humble nano_llm:24.6-iron nano_llm:24.7 nano_llm:24.7-foxy nano_llm:24.7-galactic nano_llm:24.7-humble nano_llm:24.7-iron nano_llm:main nano_llm:main-foxy nano_llm:main-galactic nano_llm:main-humble nano_llm:main-iron openvla openvla:mimicgen paraattention:0.4.0 partpacker:0.1.0 plstm:0.1.0 prismatic pytorch:2.1-all pytorch:2.2-all pytorch:2.3-all pytorch:2.3.1-all pytorch:2.4-all pytorch:2.5-all pytorch:2.6-all pytorch:2.7-all pytorch:2.8-all radial-attention:0.1.0 robopoint sage-attention:3.0.0 sdnext self-forcing sgl-kernel:0.2.3 sglang:0.4.4 sglang:0.4.6 sglang:0.4.9 sparc3d:0.1.0 sparge-attention:0.1.0 stable-diffusion-webui sudonim:hf text-generation-webui:1.7 text-generation-webui:6a7cd01 text-generation-webui:main transformer-engine:2.7 videollama:1.0.0 vila vllm:0.7.4 vllm:0.8.4 vllm:0.9.0 vllm:0.9.2 vllm:0.9.3 vllm:v0.8.5.post1 voice-pro voicecraft vscode:transformers xattention:0.0.1 xlstm:2.0.5 xtuner zigma:1.0
   Dockerfile Dockerfile
   Notes https://github.com/facebookresearch/xformers
xformers:0.0.33
   Requires L4T ['>=34.1.0']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 triton torchvision huggingface_hub rust transformers diffusers
   Dockerfile Dockerfile
   Notes https://github.com/facebookresearch/xformers

CONTAINER IMAGES

Repository/Tag Date Arch Size
  dustynv/xformers:r35.2.1 2023-12-06 arm64 5.8GB
  dustynv/xformers:r35.3.1 2023-12-14 arm64 5.8GB
  dustynv/xformers:r35.4.1 2024-01-09 arm64 5.9GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag xformers)

# or explicitly specify one of the container images above
jetson-containers run dustynv/xformers:r35.4.1

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/xformers:r35.4.1

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag xformers)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag xformers) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build xformers

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/code/jupyterlab/README.md`)

jupyterlab

CONTAINERS IMAGES RUN BUILD

Running the jupyerlab container will automatically start a JupyterLab server in the background on port 8888, with default login password nvidia. The JupyterLab server logs will be saved to /data/logs/jupyter.log if you need to inspect them (this location is automatically mounted under your jetson-containers/data directory)

To change the default settings, you can set the $JUPYTER_ROOT, $JUPYTER_PORT, $JUPYTER_PASSWORD, and $JUPYTER_LOG environment variables when starting the container like so:

bash
jetson-containers run \
  --env JUPYTER_ROOT=/home/user \
  --env JUPYTER_PORT=8000 \
  --env JUPYTER_PASSWORD=password \
  --env JUPYTER_LOGS=/dev/null \
  $(autotag jupyterlab)

The /start_jupyter script is the default CMD that the container runs when it starts - however, if you don't want the JupyterLab server started by default, you can either add a different CMD in your own Dockerfile, or override it at startup:

bash
# skip straight to the terminal instead of starting JupyterLab first
jetson-containers run /bin/bash

You can then still manually run the /start_jupyter script later when desired.

CONTAINERS

jupyterlab:latest
   Aliases jupyterlab
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn:9.3 python tensorrt numpy cuda-python pycuda rust
   Dependants audiocraft diffusion_policy dli-nano-ai efficientvit jupyter_clickable_image_widget jupyterlab:latest-myst l4t-ml l4t-text-generation langchain:samples lerobot llama-index:samples openpi pytorch:2.1-all pytorch:2.2-all pytorch:2.3-all pytorch:2.3.1-all pytorch:2.4-all pytorch:2.5-all pytorch:2.6-all pytorch:2.7-all pytorch:2.8-all sam tam voice-pro voicecraft warp:1.7.0-all warp:1.8.1-all whisper
   Dockerfile Dockerfile
   Notes will autostart Jupyter server on port 8888 unless container entry CMD is overridden
jupyterlab:latest-myst
   Aliases jupyterlab:myst
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn:9.3 python tensorrt numpy cuda-python pycuda rust jupyterlab:latest
   Dependants lerobot llama-index:samples openpi
   Dockerfile Dockerfile.myst
   Notes will autostart Jupyter server on port 8888 unless container entry CMD is overridden
jupyterlab:4.2.0
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn:9.3 python tensorrt numpy cuda-python pycuda rust
   Dependants jupyterlab:4.2.0-myst
   Dockerfile Dockerfile
   Notes will autostart Jupyter server on port 8888 unless container entry CMD is overridden
jupyterlab:4.2.0-myst
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn:9.3 python tensorrt numpy cuda-python pycuda rust jupyterlab:4.2.0
   Dockerfile Dockerfile.myst
   Notes will autostart Jupyter server on port 8888 unless container entry CMD is overridden

CONTAINER IMAGES

Repository/Tag Date Arch Size
  dustynv/jupyterlab:r32.7.1 2024-03-07 arm64 0.7GB
  dustynv/jupyterlab:r35.2.1 2023-12-06 arm64 5.3GB
  dustynv/jupyterlab:r35.3.1 2024-03-07 arm64 5.4GB
  dustynv/jupyterlab:r35.4.1 2023-10-07 arm64 5.3GB
  dustynv/jupyterlab:r36.2.0 2024-03-07 arm64 0.6GB
  dustynv/jupyterlab:r36.4.0 2025-03-10 arm64 5.8GB
  dustynv/jupyterlab:r36.4.0-cu128-24.04 2025-03-03 arm64 5.1GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag jupyterlab)

# or explicitly specify one of the container images above
jetson-containers run dustynv/jupyterlab:r36.4.0

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/jupyterlab:r36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag jupyterlab)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag jupyterlab) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build jupyterlab

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/code/vscode/README.md`)

vscode

CONTAINERS IMAGES RUN BUILD

CONTAINERS

vscode
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache python
   Dockerfile Dockerfile
   Notes installs portable build of VSCode inside container
vscode:cuda
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 python cuda:12.6 cudnn:9.3 tensorrt
   Dockerfile Dockerfile
   Notes installs portable build of VSCode inside container
vscode:torch
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 python cuda:12.6 cudnn:9.3 numpy cmake onnx pytorch:2.8 torchvision torchaudio triton torchao tensorrt torch2trt
   Dockerfile Dockerfile
   Notes installs portable build of VSCode inside container
vscode:transformers
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 python cuda:12.6 cudnn numpy cmake onnx pytorch:2.8 torchvision huggingface_hub rust transformers triton diffusers xformers cuda-python cutlass flash-attention bitsandbytes
   Dockerfile Dockerfile
   Notes installs portable build of VSCode inside container

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag vscode)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host vscode:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag vscode)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag vscode) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build vscode

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/cuda/cuda-python/README.md`)

cuda-python

CONTAINERS IMAGES RUN BUILD

CONTAINERS

cuda-python:12.2
   Requires L4T ['>=34.1.0']
   Dependencies build-essential pip_cache:cu122 cuda:12.2 python numpy
   Dockerfile Dockerfile
cuda-python:12.4
   Requires L4T ['>=34.1.0']
   Dependencies build-essential pip_cache:cu124 cuda:12.4 python numpy
   Dockerfile Dockerfile
cuda-python:12.6
   Aliases cuda-python
   Requires L4T ['>=34.1.0']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 python numpy
   Dependants 3dgrut:2.0.0 audiocraft awq:0.1.0 block_sparse_attn:0.0.1 comfyui cosmos-predict2 cosmos-reason1 cosmos-transfer1 cosmos1-diffusion-renderer:1.0.4 cudf:23.10.03 cudf:25.08.00 cuml cutlass:4.1.0 diffusion_policy dli-nano-ai dynamo:0.3.2 efficientvit exllama:0.1 faiss_lite flash-attention:2.5.7 flash-attention:2.6.3 flash-attention:2.7.2.post1 flash-attention:2.7.4.post1 flash-attention:2.8.0.post2 flash-attention:2.8.1 flexprefill:0.1.0 framepack genai-bench:0.1.0 huggingface_kernels:0.7.0 hymba isaac-gr00t isaac-ros:compression-3.2-humble-desktop isaac-ros:compression-3.2-jazzy-desktop isaac-ros:dnn-inference-3.2-humble-desktop isaac-ros:dnn-inference-3.2-jazzy-desktop isaac-ros:image-pipeline-3.2-humble-desktop isaac-ros:image-pipeline-3.2-jazzy-desktop isaac-ros:manipulator-3.2-humble-desktop isaac-ros:manipulator-3.2-jazzy-desktop isaac-ros:nitros-3.2-humble-desktop isaac-ros:nitros-3.2-jazzy-desktop isaac-ros:nvblox-3.2-humble-desktop isaac-ros:nvblox-3.2-jazzy-desktop isaac-ros:pose-estimation-3.2-humble-desktop isaac-ros:pose-estimation-3.2-jazzy-desktop isaac-ros:visual-slam-3.2-humble-desktop isaac-ros:visual-slam-3.2-jazzy-desktop jupyter_clickable_image_widget jupyterlab:4.2.0 jupyterlab:4.2.0-myst jupyterlab:latest jupyterlab:latest-myst l4t-diffusion l4t-dynamo l4t-ml l4t-text-generation langchain:samples lerobot lita llama-factory llama-index:samples llava lobechat local_llm minference:0.1.7 mlstm_kernels:2.0.1 nano_llm:24.4 nano_llm:24.4-foxy nano_llm:24.4-galactic nano_llm:24.4-humble nano_llm:24.4-iron nano_llm:24.4.1 nano_llm:24.4.1-foxy nano_llm:24.4.1-galactic nano_llm:24.4.1-humble nano_llm:24.4.1-iron nano_llm:24.5 nano_llm:24.5-foxy nano_llm:24.5-galactic nano_llm:24.5-humble nano_llm:24.5-iron nano_llm:24.5.1 nano_llm:24.5.1-foxy nano_llm:24.5.1-galactic nano_llm:24.5.1-humble nano_llm:24.5.1-iron nano_llm:24.6 nano_llm:24.6-foxy nano_llm:24.6-galactic nano_llm:24.6-humble nano_llm:24.6-iron nano_llm:24.7 nano_llm:24.7-foxy nano_llm:24.7-galactic nano_llm:24.7-humble nano_llm:24.7-iron nano_llm:main nano_llm:main-foxy nano_llm:main-galactic nano_llm:main-humble nano_llm:main-iron nanodb nvidia_modelopt:0.32.0 openpi openvla openvla:mimicgen paraattention:0.4.0 partpacker:0.1.0 plstm:0.1.0 prismatic pytorch:2.1-all pytorch:2.2-all pytorch:2.3-all pytorch:2.3.1-all pytorch:2.4-all pytorch:2.5-all pytorch:2.6-all pytorch:2.7-all pytorch:2.8-all raft robopoint sage-attention:3.0.0 sam sdnext self-forcing sgl-kernel:0.2.3 sglang:0.4.4 sglang:0.4.6 sglang:0.4.9 sparc3d:0.1.0 sparge-attention:0.1.0 sudonim:hf tam tensorrt_llm:0.12 tensorrt_llm:0.22.0 text-generation-webui:1.7 text-generation-webui:6a7cd01 text-generation-webui:main transformer-engine:2.7 videollama:1.0.0 vila vllm:0.7.4 vllm:0.8.4 vllm:0.9.0 vllm:0.9.2 vllm:0.9.3 vllm:v0.8.5.post1 voice-pro voicecraft vscode:transformers warp:1.7.0-all warp:1.8.1-all whisper xattention:0.0.1 xlstm:2.0.5 xtuner
   Dockerfile Dockerfile
cuda-python:12.8
   Requires L4T ['>=34.1.0']
   Dependencies build-essential pip_cache:cu128 cuda:12.8 python numpy
   Dockerfile Dockerfile
cuda-python:12.9
   Requires L4T ['>=34.1.0']
   Dependencies build-essential pip_cache:cu129 cuda:12.9 python numpy
   Dockerfile Dockerfile
cuda-python:13.0
   Requires L4T ['>=34.1.0']
   Dependencies build-essential pip_cache:cu130 cuda:13.0 python numpy
   Dockerfile Dockerfile

CONTAINER IMAGES

Repository/Tag Date Arch Size
  dustynv/cuda-python:builder-r35.4.1 2024-03-26 arm64 5.1GB
  dustynv/cuda-python:builder-r36.2.0 2024-03-11 arm64 3.6GB
  dustynv/cuda-python:r35.2.1 2023-12-06 arm64 5.0GB
  dustynv/cuda-python:r35.3.1 2023-08-29 arm64 5.0GB
  dustynv/cuda-python:r35.4.1 2023-12-06 arm64 5.0GB
  dustynv/cuda-python:r36.2.0 2023-12-06 arm64 3.5GB
  dustynv/cuda-python:r36.4.0-cu128-24.04 2025-03-03 arm64 2.3GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag cuda-python)

# or explicitly specify one of the container images above
jetson-containers run dustynv/cuda-python:r36.4.0-cu128-24.04

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/cuda-python:r36.4.0-cu128-24.04

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag cuda-python)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag cuda-python) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build cuda-python

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/cuda/cuda/README.md`)

cuda

CONTAINERS IMAGES RUN BUILD

CONTAINERS

cuda:12.2
   Requires L4T ['==36.*', 'aarch64']
   Dependencies build-essential pip_cache:cu122
   Dependants cuda-python:12.2 cuda:12.2-samples cudnn:8.9
   Dockerfile Dockerfile
   Images dustynv/cuda:12.2-r36.2.0 (2023-12-05, 3.4GB)dustynv/cuda:12.2-samples-r36.2.0 (2023-12-07, 4.8GB)
pip_cache:cu122
   Requires L4T ['==36.*']
   Dependencies
   Dependants cuda-python:12.2 cuda:12.2 cuda:12.2-samples cudnn:8.9
   Dockerfile Dockerfile.pip
cuda:12.2-samples
   Requires L4T ['==36.*']
   Dependencies build-essential pip_cache:cu122 cuda:12.2 python cmake
   Dockerfile Dockerfile.samples
   Images dustynv/cuda:12.2-samples-r36.2.0 (2023-12-07, 4.8GB)
   Notes CUDA samples from https://github.com/NVIDIA/cuda-samples installed under /opt/cuda-samples
cuda:12.4
   Requires L4T ['==36.*', 'aarch64']
   Dependencies build-essential pip_cache:cu124
   Dependants cuda-python:12.4 cuda:12.4-samples cudnn:9.0
   Dockerfile Dockerfile
pip_cache:cu124
   Requires L4T ['==36.*']
   Dependencies
   Dependants cuda-python:12.4 cuda:12.4 cuda:12.4-samples cudnn:9.0
   Dockerfile Dockerfile.pip
cuda:12.4-samples
   Requires L4T ['==36.*']
   Dependencies build-essential pip_cache:cu124 cuda:12.4 python cmake
   Dockerfile Dockerfile.samples
   Notes CUDA samples from https://github.com/NVIDIA/cuda-samples installed under /opt/cuda-samples
cuda:12.6
   Aliases cuda
   Requires L4T ['==36.*', 'aarch64']
   Dependencies build-essential pip_cache:cu126
   Dependants 3d_diffusion_policy 3dgrut:2.0.0 4k4d:0.0.0 ai-toolkit apex:0.1 arrow:12.0.1 arrow:14.0.1 arrow:19.0.1 arrow:20.0.0 arrow:5.0.0 audiocraft awq:0.1.0 bitsandbytes:0.39.1 bitsandbytes:0.45.4 bitsandbytes:0.45.5 bitsandbytes:0.46.0 bitsandbytes:0.47.0 bitsandbytes:0.48.0 block_sparse_attn:0.0.1 cache_dit:0.2.0 causalconv1d:1.6.0 chatterbox-tts clip_trt cobra:0.0.1 comfyui cosmos-predict2 cosmos-reason1 cosmos-transfer1 cosmos1-diffusion-renderer:1.0.4 crossformer ctranslate2:4.6.0 ctranslate2:master cuda-python:12.6 cuda:12.6-samples cudf:23.10.03 cudf:25.08.00 cudnn:9.3 cudnn:9.4 cuml cupy cutlass:4.1.0 cv-cuda:0.15 cv-cuda:0.15-cpp decord2:1.0.0 deepspeed-kernels:0.1.0 deepspeed:0.15.2 deepspeed:0.18.0 deepspeed:0.9.5 deepstream diffusers:0.35.0 diffusion_policy dimba:1.0 dli-nano-ai dynamo:0.3.2 easyvolcap:0.0.0 efficientvit exllama:0.1 faiss:1.12.0 faiss_lite fast_gauss:1.0.0 faster-whisper ffmpeg:7.1 flash-attention:2.5.7 flash-attention:2.6.3 flash-attention:2.7.2.post1 flash-attention:2.7.4.post1 flash-attention:2.8.0.post2 flash-attention:2.8.1 flashinfer:0.2.1.post2 flashinfer:0.2.2 flashinfer:0.2.2.post1 flashinfer:0.2.6.post1 flashinfer:0.2.7 flashinfer:0.2.8 flexprefill:0.1.0 framepack fruitnerf:1.0 gdrcopy genai-bench:0.1.0 genesis-world:0.2.2 glomap:2.0.0 gptqmodel:3.0.1 gsplat:1.5.3 gstreamer habitat-sim:0.3.4 hloc:1.4 hloc:1.5 holoscan huggingface_kernels:0.7.0 hymba isaac-gr00t isaac-ros:common-3.2-humble-desktop isaac-ros:common-3.2-jazzy-desktop isaac-ros:compression-3.2-humble-desktop isaac-ros:compression-3.2-jazzy-desktop isaac-ros:data-tools-3.2-humble-desktop isaac-ros:data-tools-3.2-jazzy-desktop isaac-ros:dnn-inference-3.2-humble-desktop isaac-ros:dnn-inference-3.2-jazzy-desktop isaac-ros:image-pipeline-3.2-humble-desktop isaac-ros:image-pipeline-3.2-jazzy-desktop isaac-ros:manipulator-3.2-humble-desktop isaac-ros:manipulator-3.2-jazzy-desktop isaac-ros:nitros-3.2-humble-desktop isaac-ros:nitros-3.2-jazzy-desktop isaac-ros:nvblox-3.2-humble-desktop isaac-ros:nvblox-3.2-jazzy-desktop isaac-ros:pose-estimation-3.2-humble-desktop isaac-ros:pose-estimation-3.2-jazzy-desktop isaac-ros:visual-slam-3.2-humble-desktop isaac-ros:visual-slam-3.2-jazzy-desktop isaaclab:2.2.0 isaacsim:5.0.0 jax:0.4.38 jax:0.6.3 jetcam jetson-copilot jetson-inference:foxy jetson-inference:galactic jetson-inference:humble jetson-inference:iron jetson-inference:jazzy jetson-inference:main jetson-utils:v1 jetson-utils:v2 jupyter_clickable_image_widget jupyterlab:4.2.0 jupyterlab:4.2.0-myst jupyterlab:latest jupyterlab:latest-myst kai_scheduler:0.5.5 kaolin:0.18.0 kat:1 kokoro-tts:fastapi kokoro-tts:hf kokoro-tts:onnx ktransformers:0.3.3 l4t-diffusion l4t-dynamo l4t-ml l4t-pytorch l4t-tensorflow:tf1 l4t-tensorflow:tf2 l4t-text-generation langchain langchain:samples lerobot libcom:0.1.0 lita llama-factory llama-index llama-index:samples llama-vision llama_cpp:0.2.57 llama_cpp:0.2.70 llama_cpp:0.2.83 llama_cpp:0.2.90 llama_cpp:0.3.1 llama_cpp:0.3.2 llama_cpp:0.3.5 llama_cpp:0.3.6 llama_cpp:0.3.7 llama_cpp:0.3.8 llama_cpp:0.3.9 llama_cpp:0.4.0 llama_cpp:b5255 llama_cpp:b5833 llava lobechat local_llm log-linear-attention:0.0.1 mamba:2.2.5 mambavision:1.0 memvid:0.1.4 mimicgen minference:0.1.7 minigpt4 mistral_rs mlc:0.1.0 mlc:0.1.1 mlc:0.1.2 mlc:0.1.3 mlc:0.1.4 mlc:0.19.0 mlc:0.20.0 mlc:0.21.0 mlstm_kernels:2.0.1 mooncake:0.3.5 nano_llm:24.4 nano_llm:24.4-foxy nano_llm:24.4-galactic nano_llm:24.4-humble nano_llm:24.4-iron nano_llm:24.4.1 nano_llm:24.4.1-foxy nano_llm:24.4.1-galactic nano_llm:24.4.1-humble nano_llm:24.4.1-iron nano_llm:24.5 nano_llm:24.5-foxy nano_llm:24.5-galactic nano_llm:24.5-humble nano_llm:24.5-iron nano_llm:24.5.1 nano_llm:24.5.1-foxy nano_llm:24.5.1-galactic nano_llm:24.5.1-humble nano_llm:24.5.1-iron nano_llm:24.6 nano_llm:24.6-foxy nano_llm:24.6-galactic nano_llm:24.6-humble nano_llm:24.6-iron nano_llm:24.7 nano_llm:24.7-foxy nano_llm:24.7-galactic nano_llm:24.7-humble nano_llm:24.7-iron nano_llm:main nano_llm:main-foxy nano_llm:main-galactic nano_llm:main-humble nano_llm:main-iron nanodb nanoowl nanosam nccl nemo nerfacc:0.5.3 nerfacc:0.5.4 nerfstudio:1.1.7 nerfview:0.1.4 nixl:0.3.2 numba nvdiffrast:0.3.4 nvidia_modelopt:0.32.0 nvpl octo ollama:0.10.0 ollama:0.4.0 ollama:0.5.1 ollama:0.5.5 ollama:0.5.7 ollama:0.6.7 ollama:0.7.0 ollama:0.8.0 ollama:0.9.6 onnxruntime:1.19.2 onnxruntime:1.20 onnxruntime:1.20.1 onnxruntime:1.21 onnxruntime:1.22 onnxruntime_genai:0.8.5 open3d:1.19.0 opencv:4.10.0 opencv:4.10.0-meta opencv:4.11.0 opencv:4.11.0-meta opencv:4.12.0 opencv:4.12.0-meta opencv:4.8.1 opencv:4.8.1-deb opencv:4.8.1-meta opendronemap opendronemap:node openpi openvla openvla:mimicgen optimum paraattention:0.4.0 partpacker:0.1.0 physx piper-tts piper1-tts:1.3.0 pixsfm:1.0 plstm:0.1.0 prismatic protomotions:2.5.0 pyav pycolmap:3.12 pycolmap:3.13 pycuda pykan:0.2.9 pytorch3d:0.7.8 pytorch3d:0.7.9 pytorch:2.1 pytorch:2.1-all pytorch:2.2 pytorch:2.2-all pytorch:2.3 pytorch:2.3-all pytorch:2.3.1 pytorch:2.3.1-all pytorch:2.4 pytorch:2.4-all pytorch:2.5 pytorch:2.5-all pytorch:2.6 pytorch:2.6-all pytorch:2.7 pytorch:2.7-all pytorch:2.8 pytorch:2.8-all radial-attention:0.1.0 raft realsense robogen robomimic robopoint robosuite ros:foxy-desktop ros:foxy-ros-base ros:foxy-ros-core ros:galactic-desktop ros:galactic-ros-base ros:galactic-ros-core ros:humble-desktop ros:humble-ros-base ros:humble-ros-core ros:iron-desktop ros:iron-ros-base ros:iron-ros-core ros:jazzy-desktop ros:jazzy-ros-base ros:jazzy-ros-core ros:noetic-desktop ros:noetic-ros-base ros:noetic-ros-core sage-attention:3.0.0 sam sapien sapiens sdnext self-forcing sgl-kernel:0.2.3 sglang:0.4.4 sglang:0.4.6 sglang:0.4.9 sound-utils sparc3d:0.1.0 sparge-attention:0.1.0 spark-tts speaches splashsurf stable-diffusion-webui sudonim:hf quadrants:1.8.0 tam tensorflow2:2.16.1 tensorflow2:2.18.0 tensorflow2:2.19.0 tensorflow2:2.20.0 tensorflow2:2.21.0 tensorflow_graphics:2.18.0 tensorflow_graphics:2.19.0 tensorflow_graphics:2.20.0 tensorflow_text:2.18.0 tensorflow_text:2.19.0 tensorflow_text:2.20.0 tensorrt:10.3 tensorrt:10.4 tensorrt:10.5 tensorrt:10.7 tensorrt_llm:0.12 tensorrt_llm:0.22.0 text-generation-inference text-generation-webui:1.7 text-generation-webui:6a7cd01 text-generation-webui:main tinycudann:1.7 torch-memory-saver:0.0.7 torch2trt torch_tensorrt torchao:0.12.0 torchao:0.13.0 torchaudio:2.1.0 torchaudio:2.2.2 torchaudio:2.3.0 torchaudio:2.4.0 torchaudio:2.5.0 torchaudio:2.6.0 torchaudio:2.7.0 torchaudio:2.8.0 torchsde:0.2.1 torchsde:0.2.2 torchsde:0.2.3 torchsde:0.2.4 torchsde:0.2.5 torchsde:0.2.6 torchsde:0.2.7 torchsde:0.2.8 torchtext:0.18.0 torchtext:0.19.0 torchvision:0.16.2 torchvision:0.17.2 torchvision:0.18.0 torchvision:0.19.1 torchvision:0.20.0 torchvision:0.21.0 torchvision:0.22.0 torchvision:0.23.0 transformer-engine:2.7 transformers:4.53.1 triton:3.0.0 triton:3.1.0 triton:3.2.0 triton:3.3.0 triton:3.3.1 triton:3.4.0 triton:3.5.0 tritonserver tvm video-codec-sdk:12.2.72 video-codec-sdk:12.2.72-samples video-codec-sdk:13.0.19 video-codec-sdk:13.0.19-samples videollama:1.0.0 videomambasuite:1.0 vila vllm:0.7.4 vllm:0.8.4 vllm:0.9.0 vllm:0.9.2 vllm:0.9.3 vllm:v0.8.5.post1 voice-pro voicecraft vpi vscode:cuda vscode:torch vscode:transformers warp:1.7.0 warp:1.7.0-all warp:1.7.0-jax warp:1.7.0-torch warp:1.8.1 warp:1.8.1-all warp:1.8.1-jax warp:1.8.1-torch whisper whisper_trt whisperx wyoming-piper:1.6.2 wyoming-piper:master wyoming-whisper:2.5.0 wyoming-whisper:master xattention:0.0.1 xformers:0.0.32 xformers:0.0.33 xgrammar:0.1.15 xgrammar:0.1.18 xgrammar:0.1.19 xgrammar:0.1.20 xgrammar:0.1.21 xlstm:2.0.5 xtts xtuner zed:5.0 zed:5.0-humble zed:5.0-jazzy zigma:1.0
   Dockerfile Dockerfile
pip_cache:cu126
   Aliases pip_cache pip-cache
   Requires L4T ['==36.*']
   Dependencies
   Dependants 3d_diffusion_policy 3dgrut:2.0.0 4k4d:0.0.0 ai-toolkit aim apex:0.1 arrow:12.0.1 arrow:14.0.1 arrow:19.0.1 arrow:20.0.0 arrow:5.0.0 audiocraft awq:0.1.0 bitsandbytes:0.39.1 bitsandbytes:0.45.4 bitsandbytes:0.45.5 bitsandbytes:0.46.0 bitsandbytes:0.47.0 bitsandbytes:0.48.0 block_sparse_attn:0.0.1 cache_dit:0.2.0 canbus cangaroo causalconv1d:1.6.0 chatterbox-tts ciso8601:v2.3.2 clip_trt cmake:pip cobra:0.0.1 comfyui cosmos-predict2 cosmos-reason1 cosmos-transfer1 cosmos1-diffusion-renderer:1.0.4 crossformer ctranslate2:4.6.0 ctranslate2:master cuda-python:12.6 cuda:12.6 cuda:12.6-samples cudf:23.10.03 cudf:25.08.00 cudnn:9.3 cudnn:9.4 cuml cupy cutlass:4.1.0 cv-cuda:0.15 cv-cuda:0.15-cpp decord2:1.0.0 deepspeed-kernels:0.1.0 deepspeed:0.15.2 deepspeed:0.18.0 deepspeed:0.9.5 deepstream diffusers:0.35.0 diffusion_policy dimba:1.0 dli-nano-ai docker dynamo:0.3.2 easyvolcap:0.0.0 efficientvit exllama:0.1 faiss:1.12.0 faiss_lite fast_gauss:1.0.0 faster-whisper ffmpeg:7.1 flash-attention:2.5.7 flash-attention:2.6.3 flash-attention:2.7.2.post1 flash-attention:2.7.4.post1 flash-attention:2.8.0.post2 flash-attention:2.8.1 flashinfer:0.2.1.post2 flashinfer:0.2.2 flashinfer:0.2.2.post1 flashinfer:0.2.6.post1 flashinfer:0.2.7 flashinfer:0.2.8 flexprefill:0.1.0 framepack fruitnerf:1.0 gdrcopy genai-bench:0.1.0 genesis-world:0.2.2 glomap:2.0.0 gptqmodel:3.0.1 graphiti gsplat:1.5.3 gstreamer h5py habitat-sim:0.3.4 hloc:1.4 hloc:1.5 holoscan homeassistant-core:2025.7.0 huggingface_hub huggingface_kernels:0.7.0 hymba isaac-gr00t isaac-ros:common-3.2-humble-desktop isaac-ros:common-3.2-jazzy-desktop isaac-ros:compression-3.2-humble-desktop isaac-ros:compression-3.2-jazzy-desktop isaac-ros:data-tools-3.2-humble-desktop isaac-ros:data-tools-3.2-jazzy-desktop isaac-ros:dnn-inference-3.2-humble-desktop isaac-ros:dnn-inference-3.2-jazzy-desktop isaac-ros:image-pipeline-3.2-humble-desktop isaac-ros:image-pipeline-3.2-jazzy-desktop isaac-ros:manipulator-3.2-humble-desktop isaac-ros:manipulator-3.2-jazzy-desktop isaac-ros:nitros-3.2-humble-desktop isaac-ros:nitros-3.2-jazzy-desktop isaac-ros:nvblox-3.2-humble-desktop isaac-ros:nvblox-3.2-jazzy-desktop isaac-ros:pose-estimation-3.2-humble-desktop isaac-ros:pose-estimation-3.2-jazzy-desktop isaac-ros:visual-slam-3.2-humble-desktop isaac-ros:visual-slam-3.2-jazzy-desktop isaaclab:2.2.0 isaacsim:5.0.0 jax:0.4.38 jax:0.6.3 jetcam jetson-copilot jetson-inference:foxy jetson-inference:galactic jetson-inference:humble jetson-inference:iron jetson-inference:jazzy jetson-inference:main jetson-utils:python jetson-utils:v1 jetson-utils:v2 jupyter_clickable_image_widget jupyterlab:4.2.0 jupyterlab:4.2.0-myst jupyterlab:latest jupyterlab:latest-myst kai_scheduler:0.5.5 kaolin:0.18.0 kat:1 kokoro-tts:fastapi kokoro-tts:hf kokoro-tts:onnx ktransformers:0.3.3 l4t-diffusion l4t-dynamo l4t-ml l4t-pytorch l4t-tensorflow:tf1 l4t-tensorflow:tf2 l4t-text-generation langchain langchain:samples lerobot libcom:0.1.0 lita llama-factory llama-index llama-index:samples llama-vision llama_cpp:0.2.57 llama_cpp:0.2.70 llama_cpp:0.2.83 llama_cpp:0.2.90 llama_cpp:0.3.1 llama_cpp:0.3.2 llama_cpp:0.3.5 llama_cpp:0.3.6 llama_cpp:0.3.7 llama_cpp:0.3.8 llama_cpp:0.3.9 llama_cpp:0.4.0 llama_cpp:b5255 llama_cpp:b5833 llamaspeak llava llvm:10 llvm:11 llvm:12 llvm:13 llvm:14 llvm:15 llvm:16 llvm:17 llvm:18 llvm:19 llvm:22 llvm:22 lobechat local_llm log-linear-attention:0.0.1 mamba:2.2.5 mambavision:1.0 memvid:0.1.4 meshlab:MeshLab-2023.12 meshlab:MeshLab-2025.03 mimicgen minference:0.1.7 minigpt4 mistral_rs mlc:0.1.0 mlc:0.1.1 mlc:0.1.2 mlc:0.1.3 mlc:0.1.4 mlc:0.19.0 mlc:0.20.0 mlc:0.21.0 mlstm_kernels:2.0.1 mooncake:0.3.5 mujoco nano_llm:24.4 nano_llm:24.4-foxy nano_llm:24.4-galactic nano_llm:24.4-humble nano_llm:24.4-iron nano_llm:24.4.1 nano_llm:24.4.1-foxy nano_llm:24.4.1-galactic nano_llm:24.4.1-humble nano_llm:24.4.1-iron nano_llm:24.5 nano_llm:24.5-foxy nano_llm:24.5-galactic nano_llm:24.5-humble nano_llm:24.5-iron nano_llm:24.5.1 nano_llm:24.5.1-foxy nano_llm:24.5.1-galactic nano_llm:24.5.1-humble nano_llm:24.5.1-iron nano_llm:24.6 nano_llm:24.6-foxy nano_llm:24.6-galactic nano_llm:24.6-humble nano_llm:24.6-iron nano_llm:24.7 nano_llm:24.7-foxy nano_llm:24.7-galactic nano_llm:24.7-humble nano_llm:24.7-iron nano_llm:main nano_llm:main-foxy nano_llm:main-galactic nano_llm:main-humble nano_llm:main-iron nanodb nanoowl nanosam nccl nemo nerfacc:0.5.3 nerfacc:0.5.4 nerfstudio:1.1.7 nerfview:0.1.4 ninja nixl:0.3.2 numba numpy nvdiffrast:0.3.4 nvidia_modelopt:0.32.0 nvpl octo ollama:0.10.0 ollama:0.4.0 ollama:0.5.1 ollama:0.5.5 ollama:0.5.7 ollama:0.6.7 ollama:0.7.0 ollama:0.8.0 ollama:0.9.6 onnx onnxruntime:1.19.2 onnxruntime:1.20 onnxruntime:1.20.1 onnxruntime:1.21 onnxruntime:1.22 onnxruntime_genai:0.8.5 open3d:1.19.0 openai opencv:4.10.0 opencv:4.10.0-meta opencv:4.11.0 opencv:4.11.0-meta opencv:4.12.0 opencv:4.12.0-meta opencv:4.8.1 opencv:4.8.1-deb opencv:4.8.1-meta opendronemap opendronemap:node openpi openvla openvla:mimicgen optimum paraattention:0.4.0 partpacker:0.1.0 physx piper-tts piper1-tts:1.3.0 pixsfm:1.0 plstm:0.1.0 polyscope:2.5.0 prismatic protobuf:apt protobuf:cpp protomotions:2.5.0 psutil-home-assistant:0.0.1 pyav pybind11 pyceres:2.5 pycolmap:3.12 pycolmap:3.13 pycuda pykan:0.2.9 pymeshlab:2023.12.post2 pymeshlab:2023.12.post3 pymeshlab:2025.6.23.dev0 python:3.10 python:3.11 python:3.12 python:3.13 python:3.14 pytorch3d:0.7.8 pytorch3d:0.7.9 pytorch:2.1 pytorch:2.1-all pytorch:2.2 pytorch:2.2-all pytorch:2.3 pytorch:2.3-all pytorch:2.3.1 pytorch:2.3.1-all pytorch:2.4 pytorch:2.4-all pytorch:2.5 pytorch:2.5-all pytorch:2.6 pytorch:2.6-all pytorch:2.7 pytorch:2.7-all pytorch:2.8 pytorch:2.8-all radial-attention:0.1.0 raft realsense riva-client:python robogen robomimic robopoint robosuite ros:foxy-desktop ros:foxy-ros-base ros:foxy-ros-core ros:galactic-desktop ros:galactic-ros-base ros:galactic-ros-core ros:humble-desktop ros:humble-ros-base ros:humble-ros-core ros:iron-desktop ros:iron-ros-base ros:iron-ros-core ros:jazzy-desktop ros:jazzy-ros-base ros:jazzy-ros-core ros:noetic-desktop ros:noetic-ros-base ros:noetic-ros-core rust sage-attention:3.0.0 sam sapien sapiens sdnext self-forcing sgl-kernel:0.2.3 sglang:0.4.4 sglang:0.4.6 sglang:0.4.9 sound-utils sparc3d:0.1.0 sparge-attention:0.1.0 spark-tts speaches splashsurf stable-diffusion-webui sudonim sudonim:hf quadrants:1.8.0 tam tensorboard tensorflow2:2.16.1 tensorflow2:2.18.0 tensorflow2:2.19.0 tensorflow2:2.20.0 tensorflow2:2.21.0 tensorflow_graphics:2.18.0 tensorflow_graphics:2.19.0 tensorflow_graphics:2.20.0 tensorflow_text:2.18.0 tensorflow_text:2.19.0 tensorflow_text:2.20.0 tensorrt:10.3 tensorrt:10.4 tensorrt:10.5 tensorrt:10.7 tensorrt_llm:0.12 tensorrt_llm:0.22.0 text-generation-inference text-generation-webui:1.7 text-generation-webui:6a7cd01 text-generation-webui:main tinycudann:1.7 torch-memory-saver:0.0.7 torch2trt torch_tensorrt torchao:0.12.0 torchao:0.13.0 torchaudio:2.1.0 torchaudio:2.2.2 torchaudio:2.3.0 torchaudio:2.4.0 torchaudio:2.5.0 torchaudio:2.6.0 torchaudio:2.7.0 torchaudio:2.8.0 torchsde:0.2.1 torchsde:0.2.2 torchsde:0.2.3 torchsde:0.2.4 torchsde:0.2.5 torchsde:0.2.6 torchsde:0.2.7 torchsde:0.2.8 torchtext:0.18.0 torchtext:0.19.0 torchvision:0.16.2 torchvision:0.17.2 torchvision:0.18.0 torchvision:0.19.1 torchvision:0.20.0 torchvision:0.21.0 torchvision:0.22.0 torchvision:0.23.0 transformer-engine:2.7 transformers:4.53.1 triton:3.0.0 triton:3.1.0 triton:3.2.0 triton:3.3.0 triton:3.3.1 triton:3.4.0 triton:3.5.0 tritonserver tvm video-codec-sdk:12.2.72 video-codec-sdk:12.2.72-samples video-codec-sdk:13.0.19 video-codec-sdk:13.0.19-samples videollama:1.0.0 videomambasuite:1.0 vila vllm:0.7.4 vllm:0.8.4 vllm:0.9.0 vllm:0.9.2 vllm:0.9.3 vllm:v0.8.5.post1 voice-pro voicecraft vpi vscode vscode:cuda vscode:torch vscode:transformers vtk:9.3.1 vtk:9.4.2 vtk:9.5.0 vulkan:1.3.275 vulkan:1.3.296 vulkan:1.4.309 vulkan:1.4.313 vulkan:1.4.314 warp:1.7.0 warp:1.7.0-all warp:1.7.0-jax warp:1.7.0-torch warp:1.8.1 warp:1.8.1-all warp:1.8.1-jax warp:1.8.1-torch whisper whisper_trt whisperx wyoming-assist-microphone:1.4.1 wyoming-assist-microphone:master wyoming-openwakeword:1.10.0 wyoming-openwakeword:master wyoming-piper:1.6.2 wyoming-piper:master wyoming-whisper:2.5.0 wyoming-whisper:master xattention:0.0.1 xformers:0.0.32 xformers:0.0.33 xgrammar:0.1.15 xgrammar:0.1.18 xgrammar:0.1.19 xgrammar:0.1.20 xgrammar:0.1.21 xlstm:2.0.5 xtts xtuner zed:5.0 zed:5.0-humble zed:5.0-jazzy zigma:1.0
   Dockerfile Dockerfile.pip
cuda:12.6-samples
   Aliases cuda:samples
   Requires L4T ['==36.*']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 python cmake opengl llvm vulkan
   Dockerfile Dockerfile.samples
   Notes CUDA samples from https://github.com/NVIDIA/cuda-samples installed under /opt/cuda-samples
cuda:12.8
   Requires L4T ['>=36', 'aarch64']
   Dependencies build-essential pip_cache:cu128
   Dependants cuda-python:12.8 cuda:12.8-samples cudnn:9.8
   Dockerfile Dockerfile
pip_cache:cu128
   Requires L4T ['>=36']
   Dependencies
   Dependants cuda-python:12.8 cuda:12.8 cuda:12.8-samples cudnn:9.8
   Dockerfile Dockerfile.pip
cuda:12.8-samples
   Requires L4T ['>=36']
   Dependencies build-essential pip_cache:cu128 cuda:12.8 python cmake opengl llvm vulkan
   Dockerfile Dockerfile.samples
   Notes CUDA samples from https://github.com/NVIDIA/cuda-samples installed under /opt/cuda-samples
cuda:12.9
   Requires L4T ['>=36', 'aarch64']
   Dependencies build-essential pip_cache:cu129
   Dependants cuda-python:12.9 cuda:12.9-samples cudnn:9.10
   Dockerfile Dockerfile
   Images dustynv/cuda:12.9-samples-amd64-cu128-24.04 (2025-04-02, 5.7GB)dustynv/cuda:12.9-samples-r36.4.0-cu128-24.04 (2025-04-02, 2.8GB)
pip_cache:cu129
   Requires L4T ['>=36']
   Dependencies
   Dependants cuda-python:12.9 cuda:12.9 cuda:12.9-samples cudnn:9.10
   Dockerfile Dockerfile.pip
cuda:12.9-samples
   Requires L4T ['>=36']
   Dependencies build-essential pip_cache:cu129 cuda:12.9 python cmake opengl llvm vulkan
   Dockerfile Dockerfile.samples
   Images dustynv/cuda:12.9-samples-amd64-cu128-24.04 (2025-04-02, 5.7GB)dustynv/cuda:12.9-samples-r36.4.0-cu128-24.04 (2025-04-02, 2.8GB)
   Notes CUDA samples from https://github.com/NVIDIA/cuda-samples installed under /opt/cuda-samples
cuda:13.0
   Requires L4T ['>=36', 'aarch64']
   Dependencies build-essential pip_cache:cu130
   Dependants cuda-python:13.0 cuda:13.0-samples cudnn:10.0
   Dockerfile Dockerfile
pip_cache:cu130
   Requires L4T ['>=36']
   Dependencies
   Dependants cuda-python:13.0 cuda:13.0 cuda:13.0-samples cudnn:10.0
   Dockerfile Dockerfile.pip
cuda:13.0-samples
   Requires L4T ['>=36']
   Dependencies build-essential pip_cache:cu130 cuda:13.0 python cmake opengl llvm vulkan
   Dockerfile Dockerfile.samples
   Notes CUDA samples from https://github.com/NVIDIA/cuda-samples installed under /opt/cuda-samples

CONTAINER IMAGES

Repository/Tag Date Arch Size
  dustynv/cuda:12.2-r36.2.0 2023-12-05 arm64 3.4GB
  dustynv/cuda:12.2-samples-r36.2.0 2023-12-07 arm64 4.8GB
  dustynv/cuda:12.9-samples-amd64-cu128-24.04 2025-04-02 amd64 5.7GB
  dustynv/cuda:12.9-samples-r36.4.0-cu128-24.04 2025-04-02 arm64 2.8GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag cuda)

# or explicitly specify one of the container images above
jetson-containers run dustynv/cuda:12.9-samples-r36.4.0-cu128-24.04

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/cuda:12.9-samples-r36.4.0-cu128-24.04

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag cuda)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag cuda) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build cuda

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/cuda/cudastack/README.md`)

CUDA Stack - Consolidated Library Installation

What is cudastack?

cudastack is a consolidation package that installs multiple CUDA libraries (cuDNN, NCCL, TensorRT, CUTLASS, etc.) in ONE RUN command to avoid Docker's "max depth exceeded" error.

Important: cudastack vs cuda

text
cuda/                           cudastack/
├── Dockerfile                  ├── Dockerfile (ONE RUN for all libs)
├── Dockerfile.pip              ├── config.py (variants)
├── Dockerfile.builtin          └── install/ & build/ scripts
├── Dockerfile.samples
└── config.py
    ├── cuda_package()          cudastack DEPENDS ON cuda
    ├── cuda_builtin()          (doesn't replace it!)
    ├── cuda_samples()
    └── pip_cache()

Key Points:

  1. ✅ cuda package - Installs CUDA toolkit, provides pip_cache, samples, builtin variants
  2. ✅ cudastack package - Builds ON TOP of cuda, adds cuDNN/NCCL/TensorRT/etc. in ONE layer
  3. ✅ pip_cache, cuda_samples, cuda_builtin - Still work! They're part of cuda, not cudastack

The Problem It Solves

Before (Separate Packages):

text
Layer 1: cuda
Layer 2: cudnn
Layer 3: tensorrt
Layer 4: nccl
Layer 5: cutlass
...
Layer 50+: "max depth exceeded" ❌

After (cudastack):

text
Layer 1: cuda (with pip_cache, samples, etc.)
Layer 2: cudastack (cudnn + nccl + tensorrt + cutlass in ONE RUN)
Layer 3: your-app
Result: Works! ✅

Architecture

text
BASE_IMAGE
    ↓
cuda:12.4 (from cuda/Dockerfile)
    ├── pip_cache:cu124 (from cuda/Dockerfile.pip)
    └── cuda:12.4-samples (from cuda/Dockerfile.samples)
    ↓
cudastack:minimal (from cudastack/Dockerfile)
    ├── cuDNN
    ├── NCCL
    └── (all installed in ONE RUN)
    ↓
your-app

Variants

Variant Includes Use Case
cudastack:minimal cuDNN + NCCL Training, inference
cudastack:standard + TensorRT Optimized inference
cudastack:full + CUTLASS + GDRCopy Research, development

Usage

Build with jetson-containers:

bash
# Build minimal stack
./build.sh cudastack:minimal

# Build standard (with TensorRT)
./build.sh cudastack:standard

# Build full (with CUTLASS)
./build.sh cudastack:full

# Use as base for your app
./build.sh --base cudastack:minimal pytorch

The cudastack Dockerfile does ONE RUN:

dockerfile
# Copy all install/build scripts
COPY install/*.sh /tmp/cudastack/install/
COPY build/*.sh /tmp/cudastack/build/

# ONE RUN command calls all scripts conditionally
RUN set -ex && \
    if [ "$WITH_CUDNN" = "1" ]; then \
        ./install/install_cudnn.sh; \
    fi && \
    if [ "$WITH_NCCL" = "1" ]; then \
        ./install/install_nccl.sh; \
    fi && \
    if [ "$WITH_TENSORRT" = "1" ]; then \
        ./install/install_tensorrt.sh; \
    fi && \
    # ... more components ...
    rm -rf /tmp/cudastack

Key: All library installations happen in this ONE RUN = ONE Docker layer!

Setup

The install scripts need to be populated from existing packages:

bash
cd packages/cuda/cudastack
./setup-scripts.sh

Then review and complete the scripts in install/ and build/.

What About pip_cache, samples, builtin?

These are still available from the cuda package:

bash
# pip_cache is automatically included by cuda package
./build.sh cuda:12.4
# This creates both:
# - cuda:12.4 (main CUDA toolkit)
# - pip_cache:cu124 (pip caching)

# CUDA samples work as before
./build.sh cuda:12.4-samples

# Builtin works as before (for JetPack 4-5)
./build.sh cuda:11.4  # Uses Dockerfile.builtin when CUDA pre-installed

The cuda package's config.py returns multiple packages:

python
# In cuda/config.py
def cuda_package(version, url, ...):
    cuda = package.copy()
    cuda['name'] = f'cuda:{version}'
    
    cuda_pip = pip_cache(version, requires)  # Creates pip_cache package
    
    return cuda, cuda_pip  # Returns TWO packages!

cudastack doesn't need to duplicate this - it just depends on cuda being installed first.

Component Toggles

Controlled by WITH_* build args (set in config.py):

  • ✅ WITH_CUDNN=1 - cuDNN (always on)
  • ✅ WITH_NCCL=1 - NCCL (always on)
  • 🎛️ WITH_TENSORRT - TensorRT (on in standard/full)
  • 🎛️ WITH_CUTLASS - CUTLASS (on in full only)
  • 🎛️ WITH_GDRCOPY - GDRCopy (on for Tegra)
  • ⚙️ WITH_CUDSS=0 - cuDSS (off by default)
  • ⚙️ WITH_CUSPARSELT=0 - cuSPARSELt (off by default)
  • ⚙️ WITH_CUTENSOR=0 - cuTENSOR (off by default)
  • ⚙️ WITH_NVPL=0 - NVPL (off by default)
  • ⚙️ WITH_NVSHMEM=0 - NVSHMEM (off by default)

How config.py Works

Following the jetson-containers pattern:

python
def cuda_stack(name, with_tensorrt=False, with_cutlass=False, requires=None):
    """Generate a cudastack package variant"""
    pkg = package.copy()
    pkg['name'] = name
    pkg['depends'] = ['cuda']  # Depends ON cuda, doesn't replace it
    
    pkg['build_args'] = {
        'WITH_CUDNN': '1',
        'WITH_TENSORRT': '1' if with_tensorrt else '0',
        'WITH_NCCL': '1',
        # ... etc
    }
    
    return pkg

# Define variants
package = [
    cuda_stack('cudastack:minimal', with_tensorrt=False),
    cuda_stack('cudastack:standard', with_tensorrt=True),
    cuda_stack('cudastack:full', with_tensorrt=True, with_cutlass=True),
]

Comparison with Individual Packages

Approach Layers Build Time Complexity
Individual packages 50+ Longer Simple per-package
cudastack (consolidated) 2-3 Faster One complex layer

Both approaches work! Use cudastack when you need multiple libraries and want to avoid layer limits.

See Also

Summary

✅ cudastack is a consolidation layer on top of cuda
✅ pip_cache, samples, builtin still work from the cuda package
✅ ONE RUN command installs all libraries to avoid layer limits
✅ Follows jetson-containers patterns with config.py and variants


Overview (`packages/cuda/cutlass/README.md`)

cutlass

CONTAINERS IMAGES RUN BUILD

CONTAINERS

cutlass:4.1.0
   Aliases cutlass
   Requires L4T ['>=34.1.0']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 python numpy cuda-python cudnn cmake onnx pytorch
   Dependants awq:0.1.0 block_sparse_attn:0.0.1 comfyui cosmos-predict2 cosmos-reason1 cosmos-transfer1 cosmos1-diffusion-renderer:1.0.4 dynamo:0.3.2 exllama:0.1 flash-attention:2.5.7 flash-attention:2.6.3 flash-attention:2.7.2.post1 flash-attention:2.7.4.post1 flash-attention:2.8.0.post2 flash-attention:2.8.1 flexprefill:0.1.0 framepack genai-bench:0.1.0 huggingface_kernels:0.7.0 hymba isaac-gr00t l4t-diffusion l4t-dynamo l4t-text-generation lita llama-factory llava lobechat minference:0.1.7 mlstm_kernels:2.0.1 nano_llm:24.4 nano_llm:24.4-foxy nano_llm:24.4-galactic nano_llm:24.4-humble nano_llm:24.4-iron nano_llm:24.4.1 nano_llm:24.4.1-foxy nano_llm:24.4.1-galactic nano_llm:24.4.1-humble nano_llm:24.4.1-iron nano_llm:24.5 nano_llm:24.5-foxy nano_llm:24.5-galactic nano_llm:24.5-humble nano_llm:24.5-iron nano_llm:24.5.1 nano_llm:24.5.1-foxy nano_llm:24.5.1-galactic nano_llm:24.5.1-humble nano_llm:24.5.1-iron nano_llm:24.6 nano_llm:24.6-foxy nano_llm:24.6-galactic nano_llm:24.6-humble nano_llm:24.6-iron nano_llm:24.7 nano_llm:24.7-foxy nano_llm:24.7-galactic nano_llm:24.7-humble nano_llm:24.7-iron nano_llm:main nano_llm:main-foxy nano_llm:main-galactic nano_llm:main-humble nano_llm:main-iron openvla openvla:mimicgen paraattention:0.4.0 partpacker:0.1.0 plstm:0.1.0 prismatic pytorch:2.1-all pytorch:2.2-all pytorch:2.3-all pytorch:2.3.1-all pytorch:2.4-all pytorch:2.5-all pytorch:2.6-all pytorch:2.7-all pytorch:2.8-all robopoint sage-attention:3.0.0 sdnext self-forcing sgl-kernel:0.2.3 sglang:0.4.4 sglang:0.4.6 sglang:0.4.9 sparc3d:0.1.0 sparge-attention:0.1.0 sudonim:hf text-generation-webui:1.7 text-generation-webui:6a7cd01 text-generation-webui:main transformer-engine:2.7 videollama:1.0.0 vila vllm:0.7.4 vllm:0.8.4 vllm:0.9.0 vllm:0.9.2 vllm:0.9.3 vllm:v0.8.5.post1 vscode:transformers xattention:0.0.1 xlstm:2.0.5 xtuner
   Dockerfile Dockerfile

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag cutlass)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host cutlass:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag cutlass)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag cutlass) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build cutlass

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/cuda/pycuda/README.md`)

pycuda

CONTAINERS IMAGES RUN BUILD

CONTAINERS

pycuda
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 cuda python numpy
   Dependants audiocraft cv-cuda:0.15 diffusion_policy dli-nano-ai efficientvit jupyter_clickable_image_widget jupyterlab:4.2.0 jupyterlab:4.2.0-myst jupyterlab:latest jupyterlab:latest-myst l4t-diffusion l4t-dynamo l4t-ml l4t-pytorch l4t-tensorflow:tf1 l4t-tensorflow:tf2 l4t-text-generation langchain:samples lerobot llama-index:samples openpi pytorch:2.1-all pytorch:2.2-all pytorch:2.3-all pytorch:2.3.1-all pytorch:2.4-all pytorch:2.5-all pytorch:2.6-all pytorch:2.7-all pytorch:2.8-all sam stable-diffusion-webui tam voice-pro voicecraft warp:1.7.0-all warp:1.8.1-all whisper
   Dockerfile Dockerfile
   Images dustynv/pycuda:r32.7.1 (2023-12-06, 0.4GB)dustynv/pycuda:r35.2.1 (2023-09-07, 5.0GB)dustynv/pycuda:r35.3.1 (2023-08-29, 5.0GB)dustynv/pycuda:r35.4.1 (2023-12-06, 5.0GB)dustynv/pycuda:r36.2.0 (2023-12-06, 3.5GB)dustynv/pycuda:r36.4.0-cu128-24.04 (2025-03-03, 2.3GB)

CONTAINER IMAGES

Repository/Tag Date Arch Size
  dustynv/pycuda:r32.7.1 2023-12-06 arm64 0.4GB
  dustynv/pycuda:r35.2.1 2023-09-07 arm64 5.0GB
  dustynv/pycuda:r35.3.1 2023-08-29 arm64 5.0GB
  dustynv/pycuda:r35.4.1 2023-12-06 arm64 5.0GB
  dustynv/pycuda:r36.2.0 2023-12-06 arm64 3.5GB
  dustynv/pycuda:r36.4.0-cu128-24.04 2025-03-03 arm64 2.3GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag pycuda)

# or explicitly specify one of the container images above
jetson-containers run dustynv/pycuda:r36.4.0-cu128-24.04

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/pycuda:r36.4.0-cu128-24.04

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag pycuda)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag pycuda) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build pycuda

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/cv/cv-cuda/README.md`)

cv-cuda

CONTAINERS IMAGES RUN BUILD

CONTAINERS

cv-cuda:0.15
   Aliases cvcuda:0.15 cv-cuda cvcuda
   Requires L4T ['>=36']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 torchvision video-codec-sdk ffmpeg:git pyav pycuda
   Dockerfile Dockerfile
cv-cuda:0.15-cpp
   Aliases cvcuda:0.15-cpp cv-cuda:cpp cvcuda:cpp
   Requires L4T ['>=36']
   Dependencies build-essential pip_cache:cu126 cuda
   Dependants isaac-ros:compression-3.2-humble-desktop isaac-ros:compression-3.2-jazzy-desktop isaac-ros:dnn-inference-3.2-humble-desktop isaac-ros:dnn-inference-3.2-jazzy-desktop isaac-ros:image-pipeline-3.2-humble-desktop isaac-ros:image-pipeline-3.2-jazzy-desktop isaac-ros:manipulator-3.2-humble-desktop isaac-ros:manipulator-3.2-jazzy-desktop isaac-ros:nitros-3.2-humble-desktop isaac-ros:nitros-3.2-jazzy-desktop isaac-ros:nvblox-3.2-humble-desktop isaac-ros:nvblox-3.2-jazzy-desktop isaac-ros:pose-estimation-3.2-humble-desktop isaac-ros:pose-estimation-3.2-jazzy-desktop isaac-ros:visual-slam-3.2-humble-desktop isaac-ros:visual-slam-3.2-jazzy-desktop
   Dockerfile Dockerfile

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag cv-cuda)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host cv-cuda:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag cv-cuda)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag cv-cuda) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build cv-cuda

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/cv/deepstream/README.md`)

deepstream

CONTAINERS IMAGES RUN BUILD

CONTAINERS

deepstream
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn:9.3 python tensorrt cmake numpy opengl llvm vulkan video-codec-sdk ffmpeg opencv gstreamer tritonserver
   Dockerfile Dockerfile
   Images dustynv/deepstream:r32.7.1 (2024-03-06, 2.3GB)dustynv/deepstream:r35.2.1 (2023-12-22, 6.8GB)dustynv/deepstream:r35.3.1 (2024-03-05, 6.8GB)dustynv/deepstream:r35.4.1 (2023-12-06, 6.7GB)dustynv/deepstream:r36.2.0 (2024-03-05, 9.8GB)
   Notes https://docs.nvidia.com/metropolis/deepstream/dev-guide/text/DS_Quickstart.html

CONTAINER IMAGES

Repository/Tag Date Arch Size
  dustynv/deepstream:r32.7.1 2024-03-06 arm64 2.3GB
  dustynv/deepstream:r35.2.1 2023-12-22 arm64 6.8GB
  dustynv/deepstream:r35.3.1 2024-03-05 arm64 6.8GB
  dustynv/deepstream:r35.4.1 2023-12-06 arm64 6.7GB
  dustynv/deepstream:r36.2.0 2024-03-05 arm64 9.8GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag deepstream)

# or explicitly specify one of the container images above
jetson-containers run dustynv/deepstream:r32.7.1

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/deepstream:r32.7.1

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag deepstream)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag deepstream) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build deepstream

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/cv/holoscan/README.md`)

holoscan

CONTAINERS IMAGES RUN BUILD

CONTAINERS

holoscan
   Requires L4T ['>=36']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn:9.3 python numpy cmake onnx pytorch cupy tensorrt ffmpeg
   Dockerfile Dockerfile
   Images dustynv/holoscan:r36.3.0 (2024-07-03, 6.9GB)
   Notes https://docs.nvidia.com/holoscan/sdk-user-guide/overview.html

CONTAINER IMAGES

Repository/Tag Date Arch Size
  dustynv/holoscan:r36.3.0 2024-07-03 arm64 6.9GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag holoscan)

# or explicitly specify one of the container images above
jetson-containers run dustynv/holoscan:r36.3.0

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/holoscan:r36.3.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag holoscan)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag holoscan) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build holoscan

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/cv/jetson-inference/README.md`)

jetson-inference

CONTAINERS IMAGES RUN BUILD

CONTAINERS

jetson-inference:main
   Aliases jetson-inference
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn:9.3 python numpy cmake onnx pytorch:2.8 torchvision tensorrt opengl llvm vulkan video-codec-sdk ffmpeg opencv gstreamer
   Dependants jetson-inference:foxy jetson-inference:galactic jetson-inference:humble jetson-inference:iron jetson-inference:jazzy local_llm nano_llm:24.4-foxy nano_llm:24.4-galactic nano_llm:24.4-humble nano_llm:24.4-iron nano_llm:24.4.1-foxy nano_llm:24.4.1-galactic nano_llm:24.4.1-humble nano_llm:24.4.1-iron nano_llm:24.5-foxy nano_llm:24.5-galactic nano_llm:24.5-humble nano_llm:24.5-iron nano_llm:24.5.1-foxy nano_llm:24.5.1-galactic nano_llm:24.5.1-humble nano_llm:24.5.1-iron nano_llm:24.6-foxy nano_llm:24.6-galactic nano_llm:24.6-humble nano_llm:24.6-iron nano_llm:24.7-foxy nano_llm:24.7-galactic nano_llm:24.7-humble nano_llm:24.7-iron nano_llm:main-foxy nano_llm:main-galactic nano_llm:main-humble nano_llm:main-iron
   Dockerfile Dockerfile
jetson-inference:foxy
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn:9.3 python tensorrt numpy opengl cmake llvm vulkan video-codec-sdk ffmpeg opencv pybind11 ros:foxy-desktop onnx pytorch:2.8 torchvision gstreamer jetson-inference:main
   Dependants nano_llm:24.4-foxy nano_llm:24.4.1-foxy nano_llm:24.5-foxy nano_llm:24.5.1-foxy nano_llm:24.6-foxy nano_llm:24.7-foxy nano_llm:main-foxy
   Dockerfile Dockerfile.ros
jetson-inference:galactic
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn:9.3 python tensorrt numpy opengl cmake llvm vulkan video-codec-sdk ffmpeg opencv pybind11 ros:galactic-desktop onnx pytorch:2.8 torchvision gstreamer jetson-inference:main
   Dependants nano_llm:24.4-galactic nano_llm:24.4.1-galactic nano_llm:24.5-galactic nano_llm:24.5.1-galactic nano_llm:24.6-galactic nano_llm:24.7-galactic nano_llm:main-galactic
   Dockerfile Dockerfile.ros
jetson-inference:humble
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn:9.3 python tensorrt numpy opengl cmake llvm vulkan video-codec-sdk ffmpeg opencv pybind11 ros:humble-desktop onnx pytorch:2.8 torchvision gstreamer jetson-inference:main
   Dependants nano_llm:24.4-humble nano_llm:24.4.1-humble nano_llm:24.5-humble nano_llm:24.5.1-humble nano_llm:24.6-humble nano_llm:24.7-humble nano_llm:main-humble
   Dockerfile Dockerfile.ros
jetson-inference:iron
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn:9.3 python tensorrt numpy opengl cmake llvm vulkan video-codec-sdk ffmpeg opencv pybind11 ros:iron-desktop onnx pytorch:2.8 torchvision gstreamer jetson-inference:main
   Dependants nano_llm:24.4-iron nano_llm:24.4.1-iron nano_llm:24.5-iron nano_llm:24.5.1-iron nano_llm:24.6-iron nano_llm:24.7-iron nano_llm:main-iron
   Dockerfile Dockerfile.ros
jetson-inference:jazzy
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn:9.3 python tensorrt numpy opengl cmake llvm vulkan video-codec-sdk ffmpeg opencv pybind11 ros:jazzy-desktop onnx pytorch:2.8 torchvision gstreamer jetson-inference:main
   Dockerfile Dockerfile.ros

CONTAINER IMAGES

Repository/Tag Date Arch Size
  dustynv/jetson-inference:22.06 2022-09-30 amd64 6.5GB
  dustynv/jetson-inference:r32.4.3 2020-10-27 arm64 0.9GB
  dustynv/jetson-inference:r32.4.4 2021-11-16 arm64 0.9GB
  dustynv/jetson-inference:r32.5.0 2021-08-09 arm64 0.9GB
  dustynv/jetson-inference:r32.6.1 2021-08-24 arm64 0.9GB
  dustynv/jetson-inference:r32.7.1 2023-05-15 arm64 1.1GB
  dustynv/jetson-inference:r34.1.0 2022-04-08 arm64 5.9GB
  dustynv/jetson-inference:r34.1.1 2023-03-18 arm64 6.1GB
  dustynv/jetson-inference:r35.1.0 2023-05-15 arm64 6.1GB
  dustynv/jetson-inference:r35.2.1 2023-05-15 arm64 6.0GB
  dustynv/jetson-inference:r35.3.1 2023-05-15 arm64 5.6GB
  dustynv/jetson-inference:r35.4.1 2023-08-30 arm64 5.7GB
  dustynv/jetson-inference:r36.2.0 2024-06-20 arm64 7.2GB
  dustynv/jetson-inference:r36.3.0 2024-06-20 arm64 7.2GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag jetson-inference)

# or explicitly specify one of the container images above
jetson-containers run dustynv/jetson-inference:r36.2.0

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/jetson-inference:r36.2.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag jetson-inference)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag jetson-inference) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build jetson-inference

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/cv/opencv/README.md`)

opencv

CONTAINERS IMAGES RUN BUILD

CONTAINERS

opencv:4.8.1
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy opengl cmake llvm vulkan video-codec-sdk ffmpeg
   Dockerfile Dockerfile
   Images dustynv/opencv:4.8.1-r36.2.0 (2023-12-07, 5.1GB)
   Notes https://github.com/opencv/opencv-python
opencv:4.8.1-meta
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy opengl cmake llvm vulkan video-codec-sdk ffmpeg
   Dockerfile Dockerfile.meta
   Notes https://github.com/opencv/opencv-python
opencv:4.10.0
   Aliases opencv
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy opengl cmake llvm vulkan video-codec-sdk ffmpeg
   Dependants 3dgrut:2.0.0 4k4d:0.0.0 audiocraft awq:0.1.0 comfyui cosmos-predict2 cosmos-reason1 cosmos-transfer1 cosmos1-diffusion-renderer:1.0.4 crossformer deepstream diffusion_policy dli-nano-ai easyvolcap:0.0.0 efficientvit fast_gauss:1.0.0 framepack fruitnerf:1.0 genesis-world:0.2.2 gstreamer hloc:1.4 hloc:1.5 isaac-gr00t isaac-ros:common-3.2-humble-desktop isaac-ros:common-3.2-jazzy-desktop isaac-ros:compression-3.2-humble-desktop isaac-ros:compression-3.2-jazzy-desktop isaac-ros:data-tools-3.2-humble-desktop isaac-ros:data-tools-3.2-jazzy-desktop isaac-ros:dnn-inference-3.2-humble-desktop isaac-ros:dnn-inference-3.2-jazzy-desktop isaac-ros:image-pipeline-3.2-humble-desktop isaac-ros:image-pipeline-3.2-jazzy-desktop isaac-ros:manipulator-3.2-humble-desktop isaac-ros:manipulator-3.2-jazzy-desktop isaac-ros:nitros-3.2-humble-desktop isaac-ros:nitros-3.2-jazzy-desktop isaac-ros:nvblox-3.2-humble-desktop isaac-ros:nvblox-3.2-jazzy-desktop isaac-ros:pose-estimation-3.2-humble-desktop isaac-ros:pose-estimation-3.2-jazzy-desktop isaac-ros:visual-slam-3.2-humble-desktop isaac-ros:visual-slam-3.2-jazzy-desktop jetcam jetson-inference:foxy jetson-inference:galactic jetson-inference:humble jetson-inference:iron jetson-inference:jazzy jetson-inference:main jetson-utils:v1 jetson-utils:v2 l4t-diffusion l4t-ml l4t-pytorch l4t-tensorflow:tf1 l4t-tensorflow:tf2 lerobot libcom:0.1.0 lobechat local_llm memvid:0.1.4 mimicgen nano_llm:24.4 nano_llm:24.4-foxy nano_llm:24.4-galactic nano_llm:24.4-humble nano_llm:24.4-iron nano_llm:24.4.1 nano_llm:24.4.1-foxy nano_llm:24.4.1-galactic nano_llm:24.4.1-humble nano_llm:24.4.1-iron nano_llm:24.5 nano_llm:24.5-foxy nano_llm:24.5-galactic nano_llm:24.5-humble nano_llm:24.5-iron nano_llm:24.5.1 nano_llm:24.5.1-foxy nano_llm:24.5.1-galactic nano_llm:24.5.1-humble nano_llm:24.5.1-iron nano_llm:24.6 nano_llm:24.6-foxy nano_llm:24.6-galactic nano_llm:24.6-humble nano_llm:24.6-iron nano_llm:24.7 nano_llm:24.7-foxy nano_llm:24.7-galactic nano_llm:24.7-humble nano_llm:24.7-iron nano_llm:main nano_llm:main-foxy nano_llm:main-galactic nano_llm:main-humble nano_llm:main-iron nanoowl nerfstudio:1.1.7 octo open3d:1.19.0 openpi openvla:mimicgen paraattention:0.4.0 partpacker:0.1.0 pixsfm:1.0 protomotions:2.5.0 robogen robomimic robopoint robosuite ros:foxy-desktop ros:foxy-ros-base ros:foxy-ros-core ros:galactic-desktop ros:galactic-ros-base ros:galactic-ros-core ros:humble-desktop ros:humble-ros-base ros:humble-ros-core ros:iron-desktop ros:iron-ros-base ros:iron-ros-core ros:jazzy-desktop ros:jazzy-ros-base ros:jazzy-ros-core ros:noetic-desktop ros:noetic-ros-base ros:noetic-ros-core sage-attention:3.0.0 sam sapiens sdnext self-forcing sparc3d:0.1.0 sparge-attention:0.1.0 stable-diffusion-webui sudonim:hf tam videollama:1.0.0 vila voice-pro voicecraft xattention:0.0.1 zed:5.0-humble zed:5.0-jazzy zigma:1.0
   Dockerfile Dockerfile
   Notes https://github.com/opencv/opencv-python
opencv:4.10.0-meta
   Aliases opencv:meta
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy opengl cmake llvm vulkan video-codec-sdk ffmpeg
   Dockerfile Dockerfile.meta
   Notes https://github.com/opencv/opencv-python
opencv:4.11.0
   Aliases opencv
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy opengl cmake llvm vulkan video-codec-sdk ffmpeg
   Dockerfile Dockerfile
   Images dustynv/opencv:4.11.0-amd64-cu128-24.04 (2025-04-21, 6.9GB)dustynv/opencv:4.11.0-r36.4.0-cu128-24.04 (2025-03-02, 3.3GB)
   Notes https://github.com/opencv/opencv-python
opencv:4.11.0-meta
   Aliases opencv:meta
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy opengl cmake llvm vulkan video-codec-sdk ffmpeg
   Dockerfile Dockerfile.meta
   Notes https://github.com/opencv/opencv-python
opencv:4.12.0
   Requires L4T ['>=36']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy opengl cmake llvm vulkan video-codec-sdk ffmpeg
   Dockerfile Dockerfile
   Notes https://github.com/opencv/opencv-python
opencv:4.12.0-meta
   Requires L4T ['>=36']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy opengl cmake llvm vulkan video-codec-sdk ffmpeg
   Dockerfile Dockerfile.meta
   Notes https://github.com/opencv/opencv-python
opencv:4.8.1-deb
   Aliases opencv:deb
   Requires L4T ['==36.*']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy opengl cmake llvm vulkan video-codec-sdk ffmpeg
   Dockerfile Dockerfile
   Notes https://github.com/opencv/opencv-python

CONTAINER IMAGES

Repository/Tag Date Arch Size
  dustynv/opencv:4.11.0-amd64-cu128-24.04 2025-04-21 amd64 6.9GB
  dustynv/opencv:4.11.0-r36.4.0-cu128-24.04 2025-03-02 arm64 3.3GB
  dustynv/opencv:4.8.1-r36.2.0 2023-12-07 arm64 5.1GB
  dustynv/opencv:r32.7.1 2023-12-06 arm64 0.5GB
  dustynv/opencv:r35.2.1 2023-12-05 arm64 5.0GB
  dustynv/opencv:r35.3.1 2023-08-29 arm64 5.1GB
  dustynv/opencv:r35.4.1 2023-10-07 arm64 5.0GB
  dustynv/opencv:r36.3.0 2024-10-15 arm64 5.4GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag opencv)

# or explicitly specify one of the container images above
jetson-containers run dustynv/opencv:4.11.0-amd64-cu128-24.04

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/opencv:4.11.0-amd64-cu128-24.04

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag opencv)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag opencv) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build opencv

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/cv/vpi/README.md`)

vpi

CONTAINERS IMAGES RUN BUILD

CONTAINERS

vpi
   Requires L4T ['>=36.4']
   Dependencies build-essential pip_cache:cu126 cuda opengl python numpy
   Dependants isaac-ros:common-3.2-humble-desktop isaac-ros:common-3.2-jazzy-desktop isaac-ros:compression-3.2-humble-desktop isaac-ros:compression-3.2-jazzy-desktop isaac-ros:data-tools-3.2-humble-desktop isaac-ros:data-tools-3.2-jazzy-desktop isaac-ros:dnn-inference-3.2-humble-desktop isaac-ros:dnn-inference-3.2-jazzy-desktop isaac-ros:image-pipeline-3.2-humble-desktop isaac-ros:image-pipeline-3.2-jazzy-desktop isaac-ros:manipulator-3.2-humble-desktop isaac-ros:manipulator-3.2-jazzy-desktop isaac-ros:nitros-3.2-humble-desktop isaac-ros:nitros-3.2-jazzy-desktop isaac-ros:nvblox-3.2-humble-desktop isaac-ros:nvblox-3.2-jazzy-desktop isaac-ros:pose-estimation-3.2-humble-desktop isaac-ros:pose-estimation-3.2-jazzy-desktop isaac-ros:visual-slam-3.2-humble-desktop isaac-ros:visual-slam-3.2-jazzy-desktop zed:5.0-humble zed:5.0-jazzy
   Dockerfile Dockerfile

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag vpi)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host vpi:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag vpi)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag vpi) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build vpi

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/hw/canable/README.md`)

canable

CONTAINERS IMAGES RUN BUILD

CONTAINERS

canable
   Aliases cannable
   Requires L4T ['>=32.6']
   Dependencies build-essential
   Dockerfile Dockerfile
   Notes Kernel module builder for CANable USB-to-CAN bus adapter (canable.io)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag canable)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host canable:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag canable)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag canable) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build canable

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/hw/canbus/README.md`)

canbus

CONTAINERS IMAGES RUN BUILD

CONTAINERS

canbus
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache python
   Dependants cangaroo
   Dockerfile Dockerfile
   Notes CAN bus utilities for Linux and Python

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag canbus)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host canbus:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag canbus)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag canbus) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build canbus

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/hw/cangaroo/README.md`)

cangaroo

CONTAINERS IMAGES RUN BUILD

CONTAINERS

cangaroo
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache python canbus cmake
   Dockerfile Dockerfile
   Notes CAN bus analyzer (github.com/normaldotcom/cangaroo)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag cangaroo)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host cangaroo:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag cangaroo)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag cangaroo) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build cangaroo

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/hw/jetcam/README.md`)

jetcam

CONTAINERS IMAGES RUN BUILD

CONTAINERS

jetcam
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy opengl cmake llvm vulkan video-codec-sdk ffmpeg opencv gstreamer
   Dependants dli-nano-ai
   Dockerfile Dockerfile
   Notes https://github.com/NVIDIA-AI-IOT/jetcam

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag jetcam)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host jetcam:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag jetcam)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag jetcam) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build jetcam

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/hw/jupyter_clickable_image_widget/README.md`)

jupyter_clickable_image_widget

CONTAINERS IMAGES RUN BUILD

CONTAINERS

jupyter_clickable_image_widget
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn:9.3 python tensorrt numpy cuda-python pycuda rust jupyterlab
   Dependants dli-nano-ai
   Dockerfile Dockerfile
   Notes https://github.com/jaybdub/jupyter_clickable_image_widget

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag jupyter_clickable_image_widget)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host jupyter_clickable_image_widget:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag jupyter_clickable_image_widget)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag jupyter_clickable_image_widget) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build jupyter_clickable_image_widget

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/hw/librealsense/README.md`)

realsense

CONTAINERS IMAGES RUN BUILD

CONTAINERS

realsense
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache:cu126 cuda python cmake
   Dockerfile Dockerfile
   Images dustynv/realsense:r32.7.1 (2024-02-22, 0.8GB)dustynv/realsense:r35.2.1 (2023-08-29, 5.5GB)dustynv/realsense:r35.3.1 (2024-02-22, 5.4GB)dustynv/realsense:r35.4.1 (2023-10-07, 5.5GB)dustynv/realsense:r36.2.0 (2024-02-22, 4.0GB)
   Notes https://github.com/IntelRealSense/librealsense/blob/master/doc/installation_jetson.md

CONTAINER IMAGES

Repository/Tag Date Arch Size
  dustynv/realsense:r32.7.1 2024-02-22 arm64 0.8GB
  dustynv/realsense:r35.2.1 2023-08-29 arm64 5.5GB
  dustynv/realsense:r35.3.1 2024-02-22 arm64 5.4GB
  dustynv/realsense:r35.4.1 2023-10-07 arm64 5.5GB
  dustynv/realsense:r36.2.0 2024-02-22 arm64 4.0GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag realsense)

# or explicitly specify one of the container images above
jetson-containers run dustynv/realsense:r36.2.0

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/realsense:r36.2.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag realsense)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag realsense) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build realsense

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/hw/oled/README.md`)

oled

CONTAINERS IMAGES RUN BUILD

CONTAINERS

oled
   Requires L4T ['>=32.6']
   Dependencies
   Dockerfile Dockerfile
   Notes https://github.com/NVIDIA-AI-IOT/jetcard/

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag oled)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host oled:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag oled)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag oled) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build oled

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/hw/pl2303/README.md`)

pl2303

CONTAINERS IMAGES RUN BUILD

CONTAINERS

pl2303
   Requires L4T ['>=32.6']
   Dependencies build-essential
   Dockerfile Dockerfile
   Notes Kernel module builder for PL2303 serial-to-USB converter

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag pl2303)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host pl2303:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag pl2303)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag pl2303) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build pl2303

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/hw/zed/README.md`)

zed

CONTAINERS IMAGES RUN BUILD

CONTAINERS

zed:5.0
   Aliases zed
   Requires L4T ['>=36']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn:9.3 python tensorrt opengl
   Dockerfile Dockerfile
   Notes Stereolabs ZED SDK
zed:5.0-humble
   Aliases zed-humble
   Requires L4T ['>=36']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn:9.3 python tensorrt numpy opengl cmake llvm vulkan video-codec-sdk ffmpeg opencv pybind11 ros:humble-desktop vpi
   Dockerfile /home/narandill/Projects/fph/Internal-AI-Base-Station-Server/third_party/jetson-containers/packages/robots/ros/Dockerfile.ros2.extras
   Notes Stereolabs ZED SDK
zed:5.0-jazzy
   Aliases zed-jazzy
   Requires L4T ['>=36']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn:9.3 python tensorrt numpy opengl cmake llvm vulkan video-codec-sdk ffmpeg opencv pybind11 ros:jazzy-desktop vpi
   Dockerfile /home/narandill/Projects/fph/Internal-AI-Base-Station-Server/third_party/jetson-containers/packages/robots/ros/Dockerfile.ros2.extras
   Notes Stereolabs ZED SDK

CONTAINER IMAGES

Repository/Tag Date Arch Size
  dustynv/zed:r32.7.1 2023-09-07 arm64 0.6GB
  dustynv/zed:r35.2.1 2023-12-11 arm64 5.2GB
  dustynv/zed:r35.3.1 2023-08-29 arm64 5.2GB
  dustynv/zed:r35.4.1 2023-10-07 arm64 5.1GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag zed)

# or explicitly specify one of the container images above
jetson-containers run dustynv/zed:r35.2.1

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/zed:r35.2.1

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag zed)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag zed) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build zed

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/llm/awq/README.md`)

awq

CONTAINERS IMAGES RUN BUILD

Quantization

Follow the instructions from https://github.com/mit-han-lab/llm-awq#usage to quantize your model of choice. Or use awq/quantize.py

bash
./run.sh --env HUGGINGFACE_TOKEN=<YOUR-ACCESS-TOKEN> $(./autotag awq) /bin/bash -c \
  '/opt/awq/quantize.py --model=$(huggingface-downloader meta-llama/Llama-2-7b-hf) \
      --output=/data/models/awq/Llama-2-7b'

If you downloaded a model from the AWQ Model Zoo that already has the AWQ search results applied, you can load that with --load_awq and skip the search step (which can take a while and use lots of memory)

bash
./run.sh --env HUGGINGFACE_TOKEN=<YOUR-ACCESS-TOKEN> $(./autotag awq) /bin/bash -c \
  '/opt/awq/quantize.py --model=$(huggingface-downloader meta-llama/Llama-2-7b-hf) \
      --output=/data/models/awq/Llama-2-7b \
      --load_awq=/data/models/awq/Llama-2-7b/llama-2-7b-w4-g128.pt'

This process will save the model with the real quantized weights (to a file like $OUTPUT/w4-g128-awq.pt)

Inference Benchmark

You can use the awq/benchmark.py tool to gather performance and memory measurements:

bash
./run.sh --env HUGGINGFACE_TOKEN=<YOUR-ACCESS-TOKEN> $(./autotag awq) /bin/bash -c \
  '/opt/awq/benchmark.py --model=$(huggingface-downloader meta-llama/Llama-2-7b-hf) \
      --quant=/data/models/awq/Llama-2-7b/w4-g128-awq.pt'

Make sure that you load the output from the quantization steps above with --quant (use the model that ends with -awq.pt)

CONTAINERS

awq:0.1.0
   Aliases awq
   Requires L4T ['>=34.1.0']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 triton torchvision huggingface_hub rust transformers diffusers xformers cuda-python cutlass flash-attention opengl llvm vulkan video-codec-sdk ffmpeg opencv deepspeed-kernels deepspeed:0.9.5 decord2 vila sudonim
   Dependants nano_llm:24.4 nano_llm:24.4-foxy nano_llm:24.4-galactic nano_llm:24.4-humble nano_llm:24.4-iron nano_llm:24.4.1 nano_llm:24.4.1-foxy nano_llm:24.4.1-galactic nano_llm:24.4.1-humble nano_llm:24.4.1-iron nano_llm:24.5 nano_llm:24.5-foxy nano_llm:24.5-galactic nano_llm:24.5-humble nano_llm:24.5-iron nano_llm:24.5.1 nano_llm:24.5.1-foxy nano_llm:24.5.1-galactic nano_llm:24.5.1-humble nano_llm:24.5.1-iron nano_llm:24.6 nano_llm:24.6-foxy nano_llm:24.6-galactic nano_llm:24.6-humble nano_llm:24.6-iron nano_llm:24.7 nano_llm:24.7-foxy nano_llm:24.7-galactic nano_llm:24.7-humble nano_llm:24.7-iron nano_llm:main nano_llm:main-foxy nano_llm:main-galactic nano_llm:main-humble nano_llm:main-iron
   Dockerfile Dockerfile

CONTAINER IMAGES

Repository/Tag Date Arch Size
  dustynv/awq:r35.2.1 2023-12-14 arm64 6.1GB
  dustynv/awq:r35.3.1 2023-12-15 arm64 6.1GB
  dustynv/awq:r35.4.1 2023-12-12 arm64 6.1GB
  dustynv/awq:r36.2.0 2023-12-15 arm64 7.8GB
  dustynv/awq:r36.4.0 2025-02-02 arm64 5.3GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag awq)

# or explicitly specify one of the container images above
jetson-containers run dustynv/awq:r36.4.0

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/awq:r36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag awq)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag awq) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build awq

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/llm/bitsandbytes/README.md`)

bitsandbytes

CONTAINERS IMAGES RUN BUILD

CONTAINERS

bitsandbytes:0.39.1
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 torchvision huggingface_hub rust transformers triton
   Dockerfile Dockerfile
   Notes https://github.com/bitsandbytes-foundation/bitsandbytes
bitsandbytes:0.45.4
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 torchvision huggingface_hub rust transformers triton
   Dockerfile Dockerfile
   Images dustynv/bitsandbytes:0.45.4-r36.4.0-cu128-24.04 (2025-03-03, 4.4GB)
   Notes https://github.com/bitsandbytes-foundation/bitsandbytes
bitsandbytes:0.45.5
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 torchvision huggingface_hub rust transformers triton
   Dockerfile Dockerfile
   Notes https://github.com/bitsandbytes-foundation/bitsandbytes
bitsandbytes:0.46.0
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 torchvision huggingface_hub rust transformers triton
   Dockerfile Dockerfile
   Notes https://github.com/bitsandbytes-foundation/bitsandbytes
bitsandbytes:0.47.0
   Aliases bitsandbytes
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 torchvision huggingface_hub rust transformers triton
   Dependants ai-toolkit comfyui cosmos-predict2 cosmos-reason1 cosmos-transfer1 cosmos1-diffusion-renderer:1.0.4 dimba:1.0 dynamo:0.3.2 framepack fruitnerf:1.0 isaac-gr00t l4t-diffusion l4t-dynamo lita llama-factory llama-vision lobechat nerfstudio:1.1.7 openvla openvla:mimicgen prismatic robopoint sdnext self-forcing sglang:0.4.4 sglang:0.4.6 sglang:0.4.9 sudonim:hf text-generation-inference videollama:1.0.0 vllm:0.7.4 vllm:0.8.4 vllm:0.9.0 vllm:0.9.2 vllm:0.9.3 vllm:v0.8.5.post1 vscode:transformers xtuner
   Dockerfile Dockerfile
   Notes https://github.com/bitsandbytes-foundation/bitsandbytes
bitsandbytes:0.48.0
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 torchvision huggingface_hub rust transformers triton
   Dockerfile Dockerfile
   Notes https://github.com/bitsandbytes-foundation/bitsandbytes

CONTAINER IMAGES

Repository/Tag Date Arch Size
  dustynv/bitsandbytes:0.45.4-r36.4.0-cu128-24.04 2025-03-03 arm64 4.4GB
  dustynv/bitsandbytes:r35.2.1 2023-12-15 arm64 5.9GB
  dustynv/bitsandbytes:r35.3.1 2023-12-11 arm64 6.0GB
  dustynv/bitsandbytes:r35.4.1 2023-12-14 arm64 5.9GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag bitsandbytes)

# or explicitly specify one of the container images above
jetson-containers run dustynv/bitsandbytes:0.45.4-r36.4.0-cu128-24.04

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/bitsandbytes:0.45.4-r36.4.0-cu128-24.04

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag bitsandbytes)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag bitsandbytes) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build bitsandbytes

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/llm/deepspeed/README.md`)

deepspeed

CONTAINERS IMAGES RUN BUILD

CONTAINERS

deepspeed:0.9.5
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 torchvision huggingface_hub rust transformers deepspeed-kernels triton
   Dependants awq:0.1.0 nano_llm:24.4 nano_llm:24.4-foxy nano_llm:24.4-galactic nano_llm:24.4-humble nano_llm:24.4-iron nano_llm:24.4.1 nano_llm:24.4.1-foxy nano_llm:24.4.1-galactic nano_llm:24.4.1-humble nano_llm:24.4.1-iron nano_llm:24.5 nano_llm:24.5-foxy nano_llm:24.5-galactic nano_llm:24.5-humble nano_llm:24.5-iron nano_llm:24.5.1 nano_llm:24.5.1-foxy nano_llm:24.5.1-galactic nano_llm:24.5.1-humble nano_llm:24.5.1-iron nano_llm:24.6 nano_llm:24.6-foxy nano_llm:24.6-galactic nano_llm:24.6-humble nano_llm:24.6-iron nano_llm:24.7 nano_llm:24.7-foxy nano_llm:24.7-galactic nano_llm:24.7-humble nano_llm:24.7-iron nano_llm:main nano_llm:main-foxy nano_llm:main-galactic nano_llm:main-humble nano_llm:main-iron vila
   Dockerfile Dockerfile
deepspeed:0.15.2
   Aliases deepspeed
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 torchvision huggingface_hub rust transformers deepspeed-kernels triton
   Dependants llama-factory
   Dockerfile Dockerfile
deepspeed:0.18.0
   Requires L4T ['>=35']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 torchvision huggingface_hub rust transformers deepspeed-kernels triton
   Dockerfile Dockerfile

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag deepspeed)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host deepspeed:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag deepspeed)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag deepspeed) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build deepspeed

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/llm/exllama/README.md`)

exllama

CONTAINERS IMAGES RUN BUILD

This package provides containers for both ExLlama and exllamav3:

Both loaders are also supported in the oobabooga text-generation-webui container.

Inference Benchmark

Substitute the GPTQ model from HuggingFace Hub that you want to run (see exllama compatible models)

bash
./run.sh --workdir=/opt/exllama $(./autotag exllama) /bin/bash -c \
  'python3 test_benchmark_inference.py --perf --validate -d $(huggingface-downloader TheBloke/Llama-2-7B-GPTQ)'

If the model repository is private or requires authentication, add --env HUGGINGFACE_TOKEN=<YOUR-ACCESS-TOKEN>

Memory Usage

Model Memory (MB)
TheBloke/Llama-2-7B-GPTQ 5,200
TheBloke/Llama-2-13B-GPTQ 9,135
TheBloke/LLaMA-30b-GPTQ 20,206
TheBloke/Llama-2-70B-GPTQ 35,462

CONTAINERS

exllama:0.1
   Aliases exllama
   Requires L4T ['>=36']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 huggingface_hub triton torchvision rust transformers diffusers xformers cuda-python cutlass flash-attention flash-attention
   Dependants l4t-text-generation text-generation-webui:1.7 text-generation-webui:6a7cd01 text-generation-webui:main
   Dockerfile Dockerfile

CONTAINER IMAGES

Repository/Tag Date Arch Size
  dustynv/exllama:r35.2.1 2023-12-15 arm64 5.5GB
  dustynv/exllama:r35.3.1 2023-12-11 arm64 5.5GB
  dustynv/exllama:r35.4.1 2023-12-14 arm64 5.4GB
  dustynv/exllama:v1-r36.2.0 2023-12-15 arm64 7.2GB
  dustynv/exllama:v2-r35.2.1 2023-12-15 arm64 5.5GB
  dustynv/exllama:v2-r35.3.1 2023-12-14 arm64 5.5GB
  dustynv/exllama:v2-r35.4.1 2023-12-12 arm64 5.5GB
  dustynv/exllama:v2-r36.2.0 2023-12-15 arm64 7.2GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag exllama)

# or explicitly specify one of the container images above
jetson-containers run dustynv/exllama:v1-r36.2.0

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/exllama:v1-r36.2.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag exllama)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag exllama) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build exllama

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/llm/gptqmodel/README.md`)

gptqmodel

CONTAINERS IMAGES RUN BUILD

GPTQModel from https://github.com/ModelCloud/GPTQModel (installed under /opt/gptqmodel)

Inference Benchmark

Substitute the GPTQ model from HuggingFace Hub (or model path) that you want to run:

bash
./run.sh --workdir=/opt/gptqmodel/examples/benchmark/ $(./autotag auto_gptq) \
   python3 generation_speed.py --model_name_or_path TheBloke/LLaMA-7b-GPTQ --use_safetensors --max_new_tokens=128

If you get the error Exllama kernel does not support query/key/value fusion with act-order, try adding --no_inject_fused_attention

CONTAINERS

gptqmodel:3.0.1
   Aliases gptqmodel
   Requires L4T ['>=34.1.0']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 torchvision huggingface_hub rust transformers
   Dependants llama-factory
   Dockerfile Dockerfile

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag gptqmodel)

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host gptqmodel:36.4.0

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag gptqmodel)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag gptqmodel) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build gptqmodel

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/llm/huggingface_hub/README.md`)

huggingface_hub

CONTAINERS IMAGES RUN BUILD

CONTAINERS

huggingface_hub
   Requires L4T ['>=32.6']
   Dependencies build-essential pip_cache python
   Dependants 3d_diffusion_policy ai-toolkit apex:0.1 audiocraft awq:0.1.0 bitsandbytes:0.39.1 bitsandbytes:0.45.4 bitsandbytes:0.45.5 bitsandbytes:0.46.0 bitsandbytes:0.47.0 bitsandbytes:0.48.0 block_sparse_attn:0.0.1 cache_dit:0.2.0 chatterbox-tts clip_trt cobra:0.0.1 comfyui cosmos-predict2 cosmos-reason1 cosmos-transfer1 cosmos1-diffusion-renderer:1.0.4 crossformer deepspeed:0.15.2 deepspeed:0.18.0 deepspeed:0.9.5 diffusers:0.35.0 diffusion_policy dimba:1.0 dynamo:0.3.2 efficientvit exllama:0.1 faster-whisper flash-attention:2.5.7 flash-attention:2.6.3 flash-attention:2.7.2.post1 flash-attention:2.7.4.post1 flash-attention:2.8.0.post2 flash-attention:2.8.1 flexprefill:0.1.0 framepack fruitnerf:1.0 genai-bench:0.1.0 gptqmodel:3.0.1 huggingface_kernels:0.7.0 hymba isaac-gr00t isaaclab:2.2.0 isaacsim:5.0.0 jetson-copilot kat:1 kokoro-tts:fastapi kokoro-tts:hf ktransformers:0.3.3 l4t-diffusion l4t-dynamo l4t-text-generation langchain langchain:samples lerobot lita llama-factory llama-vision llama_cpp:0.2.57 llama_cpp:0.2.70 llama_cpp:0.2.83 llama_cpp:0.2.90 llama_cpp:0.3.1 llama_cpp:0.3.2 llama_cpp:0.3.5 llama_cpp:0.3.6 llama_cpp:0.3.7 llama_cpp:0.3.8 llama_cpp:0.3.9 llama_cpp:0.4.0 llama_cpp:b5255 llama_cpp:b5833 llava lobechat local_llm log-linear-attention:0.0.1 mamba:2.2.5 mambavision:1.0 minference:0.1.7 minigpt4 mlc:0.1.0 mlc:0.1.1 mlc:0.1.2 mlc:0.1.3 mlc:0.1.4 mlc:0.19.0 mlc:0.20.0 mlc:0.21.0 mlstm_kernels:2.0.1 mooncake:0.3.5 nano_llm:24.4 nano_llm:24.4-foxy nano_llm:24.4-galactic nano_llm:24.4-humble nano_llm:24.4-iron nano_llm:24.4.1 nano_llm:24.4.1-foxy nano_llm:24.4.1-galactic nano_llm:24.4.1-humble nano_llm:24.4.1-iron nano_llm:24.5 nano_llm:24.5-foxy nano_llm:24.5-galactic nano_llm:24.5-humble nano_llm:24.5-iron nano_llm:24.5.1 nano_llm:24.5.1-foxy nano_llm:24.5.1-galactic nano_llm:24.5.1-humble nano_llm:24.5.1-iron nano_llm:24.6 nano_llm:24.6-foxy nano_llm:24.6-galactic nano_llm:24.6-humble nano_llm:24.6-iron nano_llm:24.7 nano_llm:24.7-foxy nano_llm:24.7-galactic nano_llm:24.7-humble nano_llm:24.7-iron nano_llm:main nano_llm:main-foxy nano_llm:main-galactic nano_llm:main-humble nano_llm:main-iron nanodb nanoowl nanosam nemo nerfstudio:1.1.7 nixl:0.3.2 nvdiffrast:0.3.4 nvidia_modelopt:0.32.0 octo onnxruntime_genai:0.8.5 openpi openvla openvla:mimicgen optimum paraattention:0.4.0 partpacker:0.1.0 plstm:0.1.0 prismatic pytorch:2.1-all pytorch:2.2-all pytorch:2.3-all pytorch:2.3.1-all pytorch:2.4-all pytorch:2.5-all pytorch:2.6-all pytorch:2.7-all pytorch:2.8-all radial-attention:0.1.0 robopoint sage-attention:3.0.0 sdnext self-forcing sgl-kernel:0.2.3 sglang:0.4.4 sglang:0.4.6 sglang:0.4.9 sparc3d:0.1.0 sparge-attention:0.1.0 spark-tts speaches stable-diffusion-webui sudonim:hf tensorrt_llm:0.12 tensorrt_llm:0.22.0 text-generation-inference text-generation-webui:1.7 text-generation-webui:6a7cd01 text-generation-webui:main transformer-engine:2.7 transformers:4.53.1 videollama:1.0.0 videomambasuite:1.0 vila vllm:0.7.4 vllm:0.8.4 vllm:0.9.0 vllm:0.9.2 vllm:0.9.3 vllm:v0.8.5.post1 voice-pro voicecraft vscode:transformers whisperx wyoming-whisper:2.5.0 wyoming-whisper:master xattention:0.0.1 xformers:0.0.32 xformers:0.0.33 xgrammar:0.1.15 xgrammar:0.1.18 xgrammar:0.1.19 xgrammar:0.1.20 xgrammar:0.1.21 xlstm:2.0.5 xtts xtuner zigma:1.0
   Dockerfile Dockerfile
   Images dustynv/huggingface_hub:r32.7.1 (2023-12-15, 0.4GB)dustynv/huggingface_hub:r35.2.1 (2023-12-15, 5.0GB)dustynv/huggingface_hub:r35.3.1 (2023-09-07, 5.0GB)dustynv/huggingface_hub:r35.4.1 (2023-10-07, 5.0GB)
   Notes https://github.com/huggingface/huggingface_hub

CONTAINER IMAGES

Repository/Tag Date Arch Size
  dustynv/huggingface_hub:r32.7.1 2023-12-15 arm64 0.4GB
  dustynv/huggingface_hub:r35.2.1 2023-12-15 arm64 5.0GB
  dustynv/huggingface_hub:r35.3.1 2023-09-07 arm64 5.0GB
  dustynv/huggingface_hub:r35.4.1 2023-10-07 arm64 5.0GB

Container images are compatible with other minor versions of JetPack/L4T:
    • L4T R32.7 containers can run on other versions of L4T R32.7 (JetPack 4.6+)
    • L4T R35.x containers can run on other versions of L4T R35.x (JetPack 5.1+)

RUN CONTAINER

To start the container, you can use jetson-containers run and autotag, or manually put together a docker run command:

bash
# automatically pull or build a compatible container image
jetson-containers run $(autotag huggingface_hub)

# or explicitly specify one of the container images above
jetson-containers run dustynv/huggingface_hub:r35.2.1

# or if using 'docker run' (specify image and mounts/ect)
sudo docker run --runtime nvidia -it --rm --network=host dustynv/huggingface_hub:r35.2.1

jetson-containers run forwards arguments to docker run with some defaults added (like --runtime nvidia, mounts a /data cache, and detects devices)
autotag finds a container image that's compatible with your version of JetPack/L4T - either locally, pulled from a registry, or by building it.

To mount your own directories into the container, use the -v or --volume flags:

bash
jetson-containers run -v /path/on/host:/path/in/container $(autotag huggingface_hub)

To launch the container running a command, as opposed to an interactive shell:

bash
jetson-containers run $(autotag huggingface_hub) my_app --abc xyz

You can pass any options to it that you would to docker run, and it'll print out the full command that it constructs before executing it.

BUILD CONTAINER

If you use autotag as shown above, it'll ask to build the container for you if needed. To manually build it, first do the system setup, then run:

bash
jetson-containers build huggingface_hub

The dependencies from above will be built into the container, and it'll be tested during. Run it with --help for build options.


Overview (`packages/llm/hymba/README.md`)

hymba

CONTAINERS IMAGES RUN BUILD

CONTAINERS

hymba
   Requires L4T ['>=34.1.0']
   Dependencies build-essential pip_cache:cu126 cuda:12.6 cudnn python numpy cmake onnx pytorch:2.8 torchvision huggingface_hub rust transformers ninja [`tor