Skip to main content

Running Gen AI models and applications on NVIDIA Jetson devices with one-line command

Project description

jetson-examples

jetson

Discord

This repository provides examples for running AI models and applications on NVIDIA Jetson devices with a single command.

This repo builds upon the work of the jetson-containers, ultralytics and other excellent projects.

Features

  • 🚀 Easy Deployment: Deploy state-of-the-art AI models on Jetson devices in one line.
  • 🔄 Versatile Examples: Supports text generation, image generation, computer vision and so on.
  • Optimized for Jetson: Leverages Nvidia Jetson hardware for efficient performance.

Install

To install the package, run:

pip3 install jetson-examples

Notes:

  • Check here for more installation methods
  • To upgrade to the latest version, use: pip3 install jetson-examples --upgrade.

Quickstart

To run and chat with LLaVA, execute:

reComputer run llava
jetson

Example list

Here are some examples that can be run:

Example Type Model/Data Size Docker Image Size Command Supported JetPack
🆕 Ultralytics-yolo Computer Vision 15.4GB reComputer run ultralytics-yolo 4.6, 5.1.1, 5.1.2, 5.1.3, 6.0, 6.1, 6.2
🆕 Deep-Live-Cam Face-swapping 0.5GB 20GB reComputer run deep-live-cam 6.0
🆕 Live-VLM-WebUI Computer Vision (VLM) * * reComputer run live-vlm-webui 6.0, 6.1, 6.2, 6.2.1, 7.0, 7.1
🆕 llama-factory Finetune LLM 13.5GB reComputer run llama-factory 5.1.1, 5.1.2, 5.1.3
🆕 ComfyUI Computer Vision 20GB reComputer run comfyui 5.1.1, 5.1.2, 5.1.3
Depth-Anything-V2 Computer Vision 15GB reComputer run depth-anything-v2 5.1.1, 5.1.2, 5.1.3
Depth-Anything-V3 Computer Vision 7.6GB reComputer run depth-anything-v3 6.1, 6.2, 6.2.1
🆕 Gemma4 Text (LLM) 2.5GB 0.49GB reComputer run gemma4 6.1, 6.2, 6.2.1
🆕 Qwen3.5-4B Text (LLM) 2.5GB 0.2GB reComputer run qwen3.5-4b 6.1, 6.2, 6.2.1
🆕 Qwen3.6-35B Text (LLM) 28GB 0.59GB reComputer run qwen3.6-35b 6.1, 6.2, 6.2.1
🆕 Nemotron-3-Nano-30B Text (LLM) 24.5GB 0.59GB reComputer run nemotron-3-nano 6.1, 6.2, 6.2.1
Depth-Anything Computer Vision 12.9GB reComputer run depth-anything 5.1.1, 5.1.2, 5.1.3
Yolov10 Computer Vision 7.2M 5.74 GB reComputer run yolov10 5.1.1, 5.1.2, 5.1.3, 6.0
Llama3 Text (LLM) 4.9GB 10.5GB reComputer run llama3 5.1.1, 5.1.2, 5.1.3, 6.0
gpt-oss Text (LLM) 39GB 31.28GB reComputer run gpt-oss 6.1, 6.2, 6.2.1
ros1-jp6 Robotics / ROS 1 * 1.27GB reComputer run ros1-jp6 6.1, 6.2, 6.2.1
nvblox Robotics / Mapping * 20.5GB+ reComputer run nvblox 6.x

Note: You should have enough space to run example, like LLaVA, at least 27.4GB totally

More Examples can be found examples.md

Calling Contributors Join Us!

How to work with us?

Want to add your own example? Check out the development guide.

We welcome contributions to improve jetson-examples! If you have an example you'd like to share, please submit a pull request. Thank you to all of our contributors! 🙏

This open call is listed in our Contributor Project. If this is your first time joining us, click here to learn how the project works. We follow the steps with:

  • Assignments: We offer a variety of assignments to enhance wiki content, each with a detailed description.
  • Submission: Contributors can submit their content via a Pull Request after completing the assignments.
  • Review: Maintainers will merge the submission and record the contributions.

Contributors receive a $250 cash bonus as a token of appreciation.

For any questions or further information, feel free to reach out via the GitHub issues page or contact edgeai@seeed.cc

TODO List

  • detect host environment and install what we need
  • all type jetson support checking list
  • try jetpack 6.0
  • check disk space enough or not before run
  • allow to setting some configs, such as BASE_PATH
  • support jetson-containers update
  • better table to show example's difference

👥 Contributors

License

This project is licensed under the MIT License.

Resources

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

jetson_examples-0.2.6.tar.gz (113.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

jetson_examples-0.2.6-py3-none-any.whl (187.6 kB view details)

Uploaded Python 3

File details

Details for the file jetson_examples-0.2.6.tar.gz.

File metadata

  • Download URL: jetson_examples-0.2.6.tar.gz
  • Upload date:
  • Size: 113.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.4

File hashes

Hashes for jetson_examples-0.2.6.tar.gz
Algorithm Hash digest
SHA256 b0cfb0f69d008521a1c5599b7816b3c8e6bd90708a0e7723bbf299f4d4482439
MD5 1ae75114b91524ae10e3f6c1ddc69045
BLAKE2b-256 5bc1aa798a97398c4824ddd94d3e5641bd6f9d4a8ace30d8b6cd36aea5fc81d2

See more details on using hashes here.

File details

Details for the file jetson_examples-0.2.6-py3-none-any.whl.

File metadata

File hashes

Hashes for jetson_examples-0.2.6-py3-none-any.whl
Algorithm Hash digest
SHA256 021105cfd5a81af2ef1fb540c2f436e2ff2187850ef5b2aba0b06eb2a6396584
MD5 d1c15d3fb8e958f3839d88071379ff9b
BLAKE2b-256 d535bd9158cea75088673fae7cee59ba31e5f9d86cd7e0dfc61f2c4198d20811

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page