Text

DiffusionGemma 26B-A4B

A diffusion language model with platform-specific NVFP4 and AWQ-INT4 checkpoints for Jetson Thor and Orin

Command to Run on Jetson Model Details

Parameters 26B total / 4B active

Modalities

Text

Context Length 8K

Precision

NVFP4 AWQ-INT4

Serve the model

Start server

Choose module, then engine and optional parameters on the left, then copy the serve command by clicking the button on the right.

Command

Call the model over Web API

Copy a client command below and paste it into your terminal to make a Web API request to the model you just served.

curl -s http://${JETSON_HOST}:8000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "nvidia/diffusiongemma-26B-A4B-it-NVFP4",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from openai import OpenAI

client = OpenAI(
    base_url="http://${JETSON_HOST}:8000/v1",
    api_key="not-needed",  # vLLM / llama.cpp typically do not enforce a key
)

completion = client.chat.completions.create(
    model="nvidia/diffusiongemma-26B-A4B-it-NVFP4",
    messages=[{"role": "user", "content": "Hello!"}],
)
print(completion.choices[0].message.content)

Model Details

View on HuggingFace

If you want to learn more about the Gemma 4 family and the different ways to run it on Jetson, check out the Gemma 4 on Jetson tutorial .

DiffusionGemma 26B-A4B can be served on Jetson Thor with the official NVIDIA NVFP4 checkpoint and on Jetson Orin with an AWQ-INT4 checkpoint.

Inputs and Outputs

Input: Text

Output: Text

Supported Platforms

Jetson AGX Orin
Jetson Thor

Speculative Decoding

No compatible MTP assistant is configured for this model.