Awesome general_navigation created by AdityaNG
Project description
General Navigation Python Module
General Navigation Models based on GNM, ViNT, NoMaD as a pytorch repo installable from pip for quick and easy deployment. This repo provides functionality to load and run the models and use MPC to generate steering commands for your robot. If you find any functionality in this repo useful, consider citing it:
@misc{aditya2024general_navigation,
title = {General Navigation Python Module},
author = {Aditya, NG},
howpublished = {\url{https://pypi.org/project/general-navigation/}},
version = {1.0.0},
year = {2024},
note = {Accessed: 2024-06-09}
}
Install it from PyPI
Install our project from pip and quickly get started by trying it out on your own test video!
pip install general_navigation
python3 -m general_navigation --media media/test.mp4
If you want to connect with the Carla simulator, you will also need to seperately install carla
pip install carla==0.9.15 # Linux and Windows
pip install carla==0.9.5 # Mac
Usage
Creating a pytorch instance of the model
from general_navigation.models.factory import (
get_default_config, get_model, get_weights
)
config = get_default_config()
model = get_model(config)
model = get_weights(config, model, device)
Using the command line tool for inference on a video
$ python3 -m general_navigation --help
usage: general_navigation [-h] [--device {auto,cuda,cpu}] [--media MEDIA]
options:
-h, --help show this help message and exit
--device {auto,cuda,cpu}, -d {auto,cuda,cpu}
--media MEDIA, -m MEDIA
File path, use camera index if you want to use the webcam
$ python3 -m general_navigation --media media/test.mp4
Using the command line tool for working with Carla simulator
$ python3 -m general_navigation.carla_run
TODO
- Import models from visualnav-transformer
- Script to use specified video camera to feed video into the models
- Visualize model's trajectory output
- Arguments to CLI
- Auto download model weights from google drive
- Demo video
- PyPi release
- Example usage
- Carla Integration
- MPC implementation
- Visualize MPC reconstructed trajectory
- Visualize all of the model's trajectories
- Visualize Steering angle
- Fix scaling issue
- Intrinsic matrix as argument
- Documentation:
mkdocs gh-deploy
- Linting fixes
- MyPy testing
- Add test cases for code coverage
Development
Read the CONTRIBUTING.md file.
References
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.