Text

Qwen3 4B

Alibaba's efficient 4 billion parameter instruction-tuned language model

Parameters 4B
Inputs
Text
Outputs
Text
Context Length 128K
License Apache 2.0
Precision
W4A16

Serve the model

Pick your Jetson, then copy the command and paste it into a terminal on the Jetson. New to Jetson? Setup guide

Run on your Jetson
Engine
Speculative decoding
Weights
First, one-time setup

Model Details

Qwen3 is Alibaba Cloud’s latest generation of large language models, offering state-of-the-art performance across a wide range of tasks. The Qwen3 4B model provides an excellent balance of capability and efficiency for edge deployment.

Inputs and Outputs

Input: Text

Output: Text

Intended Use Cases

  • Reasoning: Advanced logical and analytical reasoning tasks
  • Function Calling: Native support for tool use and function calling
  • Subject Matter Experts: Fine-tuning for domain-specific expertise
  • Multilingual Instruction Following: Following instructions across 100+ languages
  • Translation: High-quality translation between supported languages

Performance on Jetson

2K input · 128 output tokens
Concurrent requests
llama.cpp
  • 12.4 llama.cpp on Orin Nano: 12.4 tok/s
    Orin Nano8 GB

Output tokens/s