Jetson AI Lab Research Group

The Jetson AI Lab Research Group is a global collective for advancing open-source Edge ML, open to anyone to join and collaborate with others from the community and leverage each other's work. Our goal is using advanced AI for good in real-world applications in accessible and responsible ways. By coordinating together as a group, we can keep up with the rapidly evolving pace of AI and more quickly arrive at deploying intelligent multimodal agents and autonomous robots into the field.

There are virtual meetings that anyone is welcome to join, offline discussion on the Jetson Projects forum, and guidelines for upstreaming open-source contributions .

Upcoming Meetings

Regular Series Begins: 2nd Tuesday of every month starting September 9, 2025

We are pleased to announce the resumption of the Jetson AI Lab Research Group Community calls. The primary objective of these calls remains consistent with our past meetings. We aim to discuss emerging trends, share insights on exciting projects undertaken by members of this group, address any issues or roadblocks, and explore new frameworks and libraries, among other topics.

We will share more details during the call. We look forward to reconnecting with all of you.

Join the Discord server to stay involved and receive the latest updates.

Research Topics

Our group explores cutting-edge research areas in edge AI and robotics. These topics represent our current focus areas and will evolve as the state-of-the-art progresses and new challenges emerge:

• Controller LLMs for dynamic pipeline code generation	• Fine-tuning LLM/VLM onboard Jetson AGX Orin 64GB
• HomeAssistant.io integration for smart home [ 1 ] [ 2 ]	• Continuous multi-image VLM streaming and change detection
• Recurrent LLM architectures (Mamba, RKVW, etc) [ 1 ]	• Lightweight low-memory streaming ASR/TTS models
• Diffusion models for image processing and enhancement	• Time Series Forecasting with Transformers [ 1 ] [ 2 ]
• Guidance, grammars, and guardrails for constrained output	• Inline LLM function calling / plugins from API definitions
• ML DevOps, edge deployment, and orchestration	• Robotics, IoT, and cyberphysical systems integration

Contribution Guidelines

When experiments are successful, we package the results in ways that make them easily reusable for others to integrate into their own projects. We encourage contributions through multiple channels:

Open-source libraries & code on GitHub
Models on HuggingFace Hub
Containers provided by jetson-containers
Discussions on the Jetson Projects forum
Documentation & tutorials on Jetson AI Lab
Hackster.io for hardware-centric builds

Ongoing technical discussions are encouraged to occur on the forums, Discord, or GitHub Issues, with status updates on projects given during the meetings.

Meeting Schedule

Regular Series: 2nd Tuesday of every month starting September 9, 2025

We hold virtual meetings that anyone is welcome to join and speak during. We discuss the latest updates and experiments that we want to explore. Please remain courteous to others during the calls. We'll stick around after for anyone who has questions or didn't get the chance to be heard.

Next Meeting: Tuesday, September 9 ^th , 2025

Time: 9:00 AM PST / 12:00 PM EST / 5:00 PM GMT
Platform: Microsoft Teams
Meeting Link: Join Meeting
Meeting ID: 288 976 487 014 3
Passcode: 6oG2uK2A

Future Meetings

October 14 ^th , 2025 - 2nd Tuesday
November 11 ^th , 2025 - 2nd Tuesday
December 9 ^th , 2025 - 2nd Tuesday
January 13 ^th , 2026 - 2nd Tuesday

Please join the #events channel on the Discord server for the latest info. The meetings will be recorded so anyone unable to attend live can watch them after.

Past Meetings

Our meeting recordings and resources are available for review and reference.

Recordings Archive

Microsoft Teams: (August 2025 - present)

Date	Topic	Link
Sep 9, 2025	Jetson Community Back-to-School call	TBD
Aug 13, 2025	Jetson Community Q3 Kick-of call & new format	Recording

Google Drive: (October 2024 - August 2025)

Jetson AI Lab Research Group Recordings

Youtube Developer Channel: (April 2024 - October 2024)

October 15, 2024

Topics Covered:

HuggingFace LeRobot (Chitoku Yato)
Stanley H1 Humanoid (Dave Niewinski)

October 1, 2024

Topics Covered:

ReMEmbR: Long-Horizon Memory for Navigation (Abrar Anwar)
Diffusion Policies , Shape LLM , 3D Encoders

September 17, 2024

Topics Covered:

NASA JPL - ROSA (Rob Royce & Shehryar Khattak)
LeRobot Walkthrough (Chitoku Yato)
VLM Agent in Isaac Sim/ROS (Kabilan Kb)

September 3, 2024

Topics Covered:

Edge NeRF's and nerfstudio (Johnny Núñez Cano)
Review of OpenVLA results (Dustin Franklin)
Oculus Interface for Jetson (Al Costa)
TAO Toolkit 5.5

August 20, 2024

Topics Covered:

GenAI ROS Nodes for VLM (Khannah Shaltiel)
Isaac Sim and Orin Nano with Hardware-in-the-Loop (Kabilan Kb)
Miru Edge Deployment Infrastructure (Vedant Nair)

August 6, 2024

Topics Covered:

OpenVLA Fine-Tuning
Gemma-2-2b (Asier Arranz)
Ultralytics YOLOv8 (Lakshantha Dissanayake)

July 23, 2024

Topics Covered:

Llama-3 Function & Specs
OpenVLA with MimicGen
Phi-3 Vision via ONNX (Jambo Chen)
OStream GenRunner (Kerry Shih)

July 9, 2024

Topics Covered:

OpenVLA Quantization ( openvla.github.io )
visualnav-transformer ( robodhruv/visualnav-transformer )
Florence-2, Holoscan, Grammars (Nigel Nelson, florence-2-vision )
LLaMa-Factory ( hiyouga/LLaMA-Factory )

June 25, 2024

Topics Covered:

Function Calling in Agent Studio
Jetson Copilot (Chitoku Yato)
Jetson Platform Services (Sammy Ochoa)
On-device Fine-tuning (Nurgaliyev Shakhizat)

June 11, 2024

Topics Covered:

Agent Studio
HomeAssistant 2024.6
AWS IoT Greengrass (Romil Shah)

May 29, 2024

Topics Covered:

OpenAI-style Tools with NousResearch/Hermes-2-Pro-Llama-3-8B
Jetson Copilot with jetrag
whisper_trt for Orin Nano

May 15, 2024

Topics Covered:

VILA-1.5 on Video Sequences
Voicecraft Container ( Martin Cerven )
JetBot / Nanosaur Updates for Orin Nano (Chitoku Yato & Raffaello Bonghi)
Controller LLM & Advanced Function Calling ( NousResearch/Hermes-2-Pro-Llama-3-8B )
RAG Samples with LlamaIndex (Chitoku Yato)

May 1, 2024

Topics Covered:

April 17, 2024

Topics Covered:

April 3, 2024

Project Kickoffs:

Team Members

Our research group brings together experts from academia, industry, and the open-source community who are passionate about advancing edge AI and robotics. Below are some of our sustaining members who have been actively contributing to generative AI in edge computing:

Core Contributors

Dustin Franklin, NVIDIA
Principal Engineer | Pittsburgh, PA
( jetson-inference , jetson-containers )

Nurgaliyev Shakhizat
Institute of Smart Systems and AI | Kazakhstan
( Assistive Devices , Vision2Audio , HPC )

Kris Kersey, Kersey Fabrications
Embedded Software Engineer | Atlanta, GA
( The OASIS Project , AR/VR, 3D Fabrication)

Johnny Núñez Cano
PhD Researcher in CV/AI | Barcelona, Spain
(Recurrent LLMs, Pose & Behavior Analysis)

Doruk Sönmez, ConnectTech
Intelligent Video Analytics Engineer | Turkey
(NVIDIA DLI Certified Instructor, IVA, VLM)

Akash James, Spark Cognition
AI Architect, UC Berkeley Researcher | Oakland
(NVIDIA AI Ambassador, Personal Assistants )

Mieszko Syty, FutureProofHomes
AI/ML Engineer | Warsaw, Poland
(LLM, ML DevOps, Edge AI, Home Assistant, Nexus: AI Home Assistant , jetson-containers )

Jim Benson, JetsonHacks
DIY Extraordinaire | Los Angeles, CA
(AI in Education, RACECAR/J )

Chitoku Yato, NVIDIA
Jetson AI DevTech | Santa Clara, CA
( JetBot , JetRacer , MinDisk , Containers)

Dana Sheahen, NVIDIA
DLI Curriculum Developer | Santa Clara, CA
(AI in Education, Jetson AI Fundamentals )

Sammy Ochoa, NVIDIA
Jetson AI DevTech | Austin, TX
( Metropolis Microservices )

John Welsh, NVIDIA
( NanoOWL , NanoSAM , JetBot , JetRacer , torch2trt , trt_pose , Knowledge Distillation )

Dave Niewinski
Dave's Armoury | Waterloo, Ontario
( GLaDOS , Fetch , Offroad La-Z-Boy , KUKA Bot )

Gary Hilgemann, REBOTNIX
CEO & AI Roboticist | Lünen, Germany
( GUSTAV , SPIKE , VisionTools , GenAI )

Elaine Wu, Seeed Studio
AI & Robotics Partnerships | Shenzhen, China
( reComputer , YOLOv8 , LocalJARVIS , Voice Bot )

Patty Delafuente, NVIDIA
Data Scientist & UMBC PhD Student | MD
(AI in Education, DLI Robotics Teaching Kit )

Song Han, MIT HAN Lab
NVIDIA Research | Cambridge, MA
( Efficient Large Models , AWQ , VILA )

Bryan Hughes, Mimzy AI
Founder, Entrepreneur | SF Bay Area
(Multimodal Assistants, AI at the Edge)

Tianqi Chen, CMU Catalyst
OctoML , CTO | Seattle, WA
( MLC , Apache TVM , XGBoost )

Michael Grüner, RidgeRun
Team Lead / Architect | Costa Rica
(Embedded Vision & AI, Multimedia)

Jesse Flot, CMU Robotics Academy
Co-Director | Pittsburgh, PA
( Applied AI & Robotics , Autonomy Foundations )

Paul DeCarlo, Microsoft
Professor | University of Houston
( Azure IoT , Video Analytics , Microsoft JARVIS )

Mike Hansen, Nabu Casa
Voice Engineering Lead | Urbandale, Iowa
( Home Assistant , Piper TTS , Wyoming )

Lakshantha Dissanayake, Ultralytics
Embedded CV Engineer | Vancouver, BC
( YOLOv8 , TensorRT , DeepStream )

Kerry Shih, GenAI Nerds
Founder, CEO | Los Angeles, CA
( Gapi )

Ziad Youssfi, CMU
ECE Professor | Pittsburgh, PA
(ML in Robotics & Embedded Systems)

Walter Lucetti, Stereolabs
Robotics & Vision Engineer | Paris, France
( MyzharBot , ROS2 , GStreamer )

Raffaello Bonghi, NVIDIA
AI & Robotics Engineer | Manchester, UK
( Nanosaur , Panther , jetson-stats )

Alvaro Costa, TeknTrash
CEO & Founder | Epsom, UK
( Stipra Dataset , Industrial Automation)

David Pearson, ConnectTech
Embedded Systems Engineer | Ontario, CA
(Edge AI Systems, Vision/Language Models)

Jason Seawall, Numurus
CEO | Seattle, WA
( NEPI , Edge AI & Automation)

Martin Cerven
AI Researcher | Germany
(Autonomous Robotics, Voicecraft)

Romil Shah, Amazon
GenAI IIoT @ AWS | San Jose, CA
(


             aws-samples/genai-at-edge

)

Kabilan Kb, Roboticist
NVIDIA DLI Ambassador | Tamil Nadu, IN
( ROS2 Tutorials , Autonomous Wheelchair )