Skip to content

Tutorial - AudioCraft

Let's run Meta's AudioCraft, to produce high-quality audio and music on Jetson!

What you need

  1. One of the following Jetson:

    Jetson AGX Orin 64GB Jetson AGX Orin (32GB) Jetson Orin Nano Orin (8GB)

  2. Running one of the following JetPack.5x

    JetPack 5.1.2 (L4T r35.4.1) JetPack 5.1.1 (L4T r35.3.1) JetPack 5.1 (L4T r35.2.1)

  3. Sufficient storage space (preferably with NVMe SSD).

    • 10.7 GB for audiocraft container image
    • Space for checkpoints

Clone and set up jetson-containers

git clone https://github.com/dusty-nv/jetson-containers
cd jetson-containers
sudo apt update; sudo apt install -y python3-pip
pip3 install -r requirements.txt

How to start

Use run.sh and autotag script to automatically pull or build a compatible container image.

cd jetson-containers
./run.sh $(./autotag audiocraft)

The container has a default run command (CMD) that will automatically start the Jupyter Lab server.

Open your browser and access http://<IP_ADDRESS>:8888.

The default password for Jupyter Lab is nvidia.

Run Jupyter notebooks

AudioCraft repo comes with demo Jupyter notebooks.

On Jupyter Lab navigation pane on the left, double-click demos folder.

AudioGen demo

For "Text-conditional Generation", you should get something like this.

Info

You may encounter an error message like the following when executing the first cell, but you can keep going. 

A matching Triton is not available, some optimizations will not be enabled.
Error caught was: No module named 'triton'

Warning

When running the 5-th cell of audiogen_demo.ipynb, you may run into "Failed to load audio" RuntimeError.

MusicGen demo

For "Text-conditional Generation", you should get something like this.

Warning

When running the 5-th cell of musicgen_demo.ipynb, you may run into "Failed to load audio" RuntimeError.