Tutorial - SAM (Segment Anything)

Let's run TAM to perform Segment Anything on videos on NVIDIA Jetson.

What you need

One of the following Jetson:

Jetson AGX Orin (64GB) Jetson AGX Orin (32GB)
Running one of the following versions of JetPack:

JetPack 5 (L4T r35.x)
Sufficient storage space (preferably with NVMe SSD).
- 6.8GB for container image
- Spaces for models

Clone and setup jetson-containers:

git clone https://github.com/dusty-nv/jetson-containers
bash jetson-containers/install.sh

How to start

Use the jetson-containers run and autotag commands to automatically pull or build a compatible container image.

jetson-containers run $(autotag tam)

The container has a default run command (CMD) that will automatically start TAM's web server.

Open your browser and access http://<IP_ADDRESS>:12212.

TAM web UI

Check out the official tutorial to learn how to operate the web UI.

Results

Troubleshooting

`FileNotFoundError: [Errno 2] No such file or directory: './checkpoints/E2FGVI-HQ-CVPR22.pth'`

You may find the TAM app fails to download a checkpoint file E2FGVI-HQ-CVPR22.pth.

Downloading checkpoints from Google Drive... tips: If you cannot see the progress bar, please try to download it manuall               and put it in the checkpointes directory. E2FGVI-HQ-CVPR22.pth: https://github.com/MCG-NKU/E2FGVI(E2FGVI-HQ model)
Access denied with the following error:

        Cannot retrieve the public link of the file. You may need to change
        the permission to 'Anyone with the link', or have had many accesses. 

You may still be able to access the file from the browser:

         https://drive.google.com/uc?id=10wGdKSUOie0XmCr8SQ2A2FeDe-mfn5w3

You can manually download the checkpoint file on your Docker host machine.

cd jetson-containers/
pip install gdown
source ~/.profile
gdown https://drive.google.com/uc?id=10wGdKSUOie0XmCr8SQ2A2FeDe-mfn5w3 
mv E2FGVI-HQ-CVPR22.pth ./data/models/tam/

And you can try running the TAM container.

jetson-containers run $(autotag tam)