Skip to main content

Running Gen AI models and applications on NVIDIA Jetson devices with one-line command

Project description

jetson-examples

jetson

Discord

This repository provides examples for running AI models and applications on NVIDIA Jetson devices with a single command.

This repo builds upon the work of the jetson-containers, ultralytics and other excellent projects.

Features

  • 🚀 Easy Deployment: Deploy state-of-the-art AI models on Jetson devices in one line.
  • 🔄 Versatile Examples: Supports text generation, image generation, computer vision and so on.
  • Optimized for Jetson: Leverages Nvidia Jetson hardware for efficient performance.

Install

To install the package, run:

pip3 install jetson-examples

Notes:

  • Check here for more installation methods
  • To upgrade to the latest version, use: pip3 install jetson-examples --upgrade.

Quickstart

To run and chat with LLaVA, execute:

reComputer run llava
jetson

Example list

Here are some examples that can be run:

Example Type Model/Data Size Docker Image Size Command Supported JetPack
🆕 Ultralytics-yolo Computer Vision 15.4GB reComputer run ultralytics-yolo 4.6, 5.1.1, 5.1.2, 5.1.3, 6.0, 6.1, 6.2
🆕 Deep-Live-Cam Face-swapping 0.5GB 20GB reComputer run deep-live-cam 6.0
🆕 llama-factory Finetune LLM 13.5GB reComputer run llama-factory 5.1.1, 5.1.2, 5.1.3
🆕 ComfyUI Computer Vision 20GB reComputer run comfyui 5.1.1, 5.1.2, 5.1.3
Depth-Anything-V2 Computer Vision 15GB reComputer run depth-anything-v2 5.1.1, 5.1.2, 5.1.3
Depth-Anything-V3 Computer Vision 7.6GB reComputer run depth-anything-v3 6.1, 6.2, 6.2.1
🆕 Qwen3.5-4B Text (LLM) 2.5GB 0.2GB reComputer run qwen3.5-4b 6.1, 6.2, 6.2.1
Depth-Anything Computer Vision 12.9GB reComputer run depth-anything 5.1.1, 5.1.2, 5.1.3
Yolov10 Computer Vision 7.2M 5.74 GB reComputer run yolov10 5.1.1, 5.1.2, 5.1.3, 6.0
Llama3 Text (LLM) 4.9GB 10.5GB reComputer run llama3 5.1.1, 5.1.2, 5.1.3, 6.0
gpt-oss Text (LLM) 39GB 31.28GB reComputer run gpt-oss 6.1, 6.2, 6.2.1
ros1-jp6 Robotics / ROS 1 * 1.27GB reComputer run ros1-jp6 6.1, 6.2, 6.2.1
nvblox Robotics / Mapping * 20.5GB+ reComputer run nvblox 6.x

Note: You should have enough space to run example, like LLaVA, at least 27.4GB totally

More Examples can be found examples.md

Calling Contributors Join Us!

How to work with us?

Want to add your own example? Check out the development guide.

We welcome contributions to improve jetson-examples! If you have an example you'd like to share, please submit a pull request. Thank you to all of our contributors! 🙏

This open call is listed in our Contributor Project. If this is your first time joining us, click here to learn how the project works. We follow the steps with:

  • Assignments: We offer a variety of assignments to enhance wiki content, each with a detailed description.
  • Submission: Contributors can submit their content via a Pull Request after completing the assignments.
  • Review: Maintainers will merge the submission and record the contributions.

Contributors receive a $250 cash bonus as a token of appreciation.

For any questions or further information, feel free to reach out via the GitHub issues page or contact edgeai@seeed.cc

TODO List

  • detect host environment and install what we need
  • all type jetson support checking list
  • try jetpack 6.0
  • check disk space enough or not before run
  • allow to setting some configs, such as BASE_PATH
  • support jetson-containers update
  • better table to show example's difference

👥 Contributors

License

This project is licensed under the MIT License.

Resources

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

jetson_examples-0.2.5.tar.gz (91.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

jetson_examples-0.2.5-py3-none-any.whl (155.9 kB view details)

Uploaded Python 3

File details

Details for the file jetson_examples-0.2.5.tar.gz.

File metadata

  • Download URL: jetson_examples-0.2.5.tar.gz
  • Upload date:
  • Size: 91.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.4

File hashes

Hashes for jetson_examples-0.2.5.tar.gz
Algorithm Hash digest
SHA256 aec500ae74349cc248993cbc5031187f683417aef49f46df5eec7436e70429dd
MD5 93cc652966a4a286d00d771756392b25
BLAKE2b-256 c25049a666f9b59b251663ed1a74cb349c162f133e1c95b3c9eb0b159e8c726a

See more details on using hashes here.

File details

Details for the file jetson_examples-0.2.5-py3-none-any.whl.

File metadata

File hashes

Hashes for jetson_examples-0.2.5-py3-none-any.whl
Algorithm Hash digest
SHA256 7d71d2fd9b77f79dcd3025efca4e935bff333cb636603a4ad1158a50bcd58a5a
MD5 9719a85d1e0afc65f4eda62b4c13b58b
BLAKE2b-256 6673d88878385c997dba5ad4d21090ca9d22a95a76404648f0cf2ba5f64f6e98

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page