Text
Qwen3 4B
Alibaba's efficient 4 billion parameter instruction-tuned language model
Parameters 4B
Inputs
Text
Outputs
Text
Context Length 128K
License Apache 2.0
Precision
W4A16
Serve the model
Pick your Jetson, then copy the command and paste it into a terminal on the Jetson. New to Jetson? Setup guide
Run on your Jetson
Engine
Speculative decoding
Weights
Model Details
Qwen3 is Alibaba Cloud’s latest generation of large language models, offering state-of-the-art performance across a wide range of tasks. The Qwen3 4B model provides an excellent balance of capability and efficiency for edge deployment.
Inputs and Outputs
Input: Text
Output: Text
Intended Use Cases
- Reasoning: Advanced logical and analytical reasoning tasks
- Function Calling: Native support for tool use and function calling
- Subject Matter Experts: Fine-tuning for domain-specific expertise
- Multilingual Instruction Following: Following instructions across 100+ languages
- Translation: High-quality translation between supported languages
Performance on Jetson
2K input · 128 output tokens
Concurrent requests
llama.cpp
- 12.4 llama.cpp on Orin Nano: 12.4 tok/sOrin Nano8 GB
Output tokens/s