Text

Llama 3.1 70B

Meta's flagship 70 billion parameter model delivering state-of-the-art performance on Jetson Thor

Parameters 70B
Inputs
Text
Outputs
Text
Context Length 128K
License Llama 3.1 Community License
Precision
W4A16

Serve the model

Pick your Jetson, then copy the command and paste it into a terminal on the Jetson. New to Jetson? Setup guide

Run on your Jetson
Engine
Speculative decoding
Weights
First, one-time setup

One-shot inference

Choose a Jetson module, adjust optional parameters, then copy the command to run a single inference on the device.

Command

·Shell


												
											

Meta’s Llama 3.1 70B Instruct is the flagship model in the Llama 3.1 family, featuring 70 billion parameters for state-of-the-art performance. This quantized version (W4A16) enables deployment on Jetson Thor.

Ideal for complex reasoning tasks, detailed content generation, and applications requiring the highest quality outputs.