Llama 3.1 70B
Meta's flagship 70 billion parameter model delivering state-of-the-art performance on Jetson Thor
Serve the model
Pick your Jetson, then copy the command and paste it into a terminal on the Jetson. New to Jetson? Setup guide
One-shot inference
Choose a Jetson module, adjust optional parameters, then copy the command to run a single inference on the device.
Command
·Shell
No snippet for this module and type in model data.
Model Details
Meta’s Llama 3.1 70B Instruct is the flagship model in the Llama 3.1 family, featuring 70 billion parameters for state-of-the-art performance. This quantized version (W4A16) enables deployment on Jetson Thor.
Ideal for complex reasoning tasks, detailed content generation, and applications requiring the highest quality outputs.