Community Articles
Below, you'll find a collection of community articles showcasing the implementation of generative AI on the Jetson platform.
JetsonHacks Jetson AI Labs – Generative AI Playground (10-31-2023)
JetsonHacks publishes an insightful video that walks developers through the typical steps for running generative AI models on Jetson following this site's tutorials. The video shows the interaction with the LLaVA model.
Hackster Vision2Audio - Giving the blind an understanding through AI (10-15-2023)
Nurgaliyev Shakhizat demonstrates Vision2Audio running on Jetson AGX Orin 64GB Developer Kit to harness the power of LLaVA to help visually impaired people.
NVIDIA Bringing Generative AI to Life with NVIDIA Jetson (10-19-2023)
Follow this walkthrough of the Jetson AI Lab tutorials along with coverage of the latest features and advances coming to JetPack 6 and beyond:
https://developer.nvidia.com/blog/bringing-generative-ai-to-life-with-jetson/
Medium How to set up your Jetson device for LLM inference and fine-tuning (10-02-2023)
Michael Yuan's guide demonstrating how to set up the Jetson AGX Orin 64GB Developer Kit specifically for large language model (LLM) inference, highlighting the crucial role of GPUs and the cost-effectiveness of the Jetson AGX Orin for LLM tasks.
Hackster Getting Started with AI on Nvidia Jetson AGX Orin Dev Kit (09-16-2023)
Nurgaliyev Shakhizat demonstrates llamaspeak on Jetson AGX Orin 64GB Developer Kit.
https://www.hackster.io/shahizat/getting-started-with-ai-on-nvidia-jetson-agx-orin-dev-kit-5a55b5
Hackster New AI Tool Is Generating a Lot of Buzz (09-13-2023)
Nick Bild provides an insightful introduction to the Jetson Generative AI Playground.
https://www.hackster.io/news/new-ai-tool-is-generating-a-lot-of-buzz-3cc5f23a3598
JetsonHacks Use These! Jetson Docker Containers Tutorial (09-04-2023)
JetsonHacks has a in-depth tutorial on how to use jetson-containers and even show text-generation-webui and stable-diffusion-webui containers in action!
https://jetsonhacks.com/2023/09/04/use-these-jetson-docker-containers-tutorial/
Hackster LLaMa 2 LLMs w/ NVIDIA Jetson and textgeneration-web-ui (08-17-2023)
Paul DeCarlo demonstrates 13B and 70B parameter LLama 2 models running locally on Jetson AGX Orin 64GB Developer Kit.
https://www.hackster.io/pjdecarlo/llama-2-llms-w-nvidia-jetson-and-textgeneration-web-ui-96b070
Hackster Running a ChatGPT-Like LLM-LLaMA2 on a Nvidia Jetson Cluster (08-14-2023)
Discover how to run a LLaMA-2 7B model on an NVIDIA Jetson cluster in this insightful tutorial by Nurgaliyev Shakhizat.
https://www.hackster.io/shahizat/running-a-chatgpt-like-llm-llama2-on-a-nvidia-jetson-cluster-cbc7d4
JetsonHacks Speech AI on NVIDIA Jetson Tutorial (08-07-2023)
JetsonHacks gives a nice introduction to NVIDIA RIVA SDK and demonstrate its automated speech recognition (ASR) capability on Jetson Orin Nano Developer Kit.
https://jetsonhacks.com/2023/08/07/speech-ai-on-nvidia-jetson-tutorial/
Hackster LLM based Multimodal AI w/ Azure Open AI & NVIDIA Jetson (07-12-2023)
Learn how to harness the power of Multimodal AI by running Microsoft JARVIS on an Jetson AGX Orin 64GB Developer Kit, enabling a wide range of AI tasks with ChatGPT-like capabilities, image generation, and more, in this comprehensive guide by Paul DeCarlo.
https://www.hackster.io/pjdecarlo/llm-based-multimodal-ai-w-azure-open-ai-nvidia-jetson-135ff2
Hackster How to Run a ChatGPT-Like LLM on NVIDIA Jetson board (06-13-2023)
Nurgaliyev Shakhizat explores voice AI assistant on Jetson using FastChat and VoskAPI.
https://www.hackster.io/shahizat/how-to-run-a-chatgpt-like-llm-on-nvidia-jetson-board-41fd79