LISA (Reasoning Segmentation via Large Language Model) on cuda, now with huggingface ZeroGPU support!
Project description
title: lisa + gradio + fastapi + ZeroGPU emoji: ⚡ colorFrom: red colorTo: purple sdk: gradio sdk_version: 4.37.2 app_file: app.py pinned: true
LISA (Reasoning Segmentation via Large Language Model) on cuda, now with huggingface ZeroGPU support!
Exec jupyter on the remote server with port forwarding on localhost
- checkout repo, install venv with jupyter
- port forwarding in localhost wiht private key:
ssh -i /path/to/private_key name@endpoint.com -L 8889:localhost:8889 -N -f
- start the jupyter-lab server
- connect to page in localhost
Commands to work on remote virtual machines (e.g. SaturnCloud) after clone and git lfs install
cd ~/workspace/lisa-on-cuda/
rm -rf lisa_venv
python3 -m venv lisa_venv
ln -s lisa_venv/ venv
source venv/bin/activate
pip --version
which python
python -m pip install pip wheel --upgrade
python -m pip install pytest pytest-cov jupyterlab
python -m pip install -r requirements.txt
nohup jupyter-lab &
tail -F nohup.out
Jupyterlab Howto
To run the test.ipynb
notebook you should already:
- cloned project https://huggingface.co/spaces/aletrn/lisa-on-cuda with active git lfs
- created and activated a virtualenv
- installed jupyterlab dependencies from requirements_jupyter.txt
- installed dependencies from requirements.txt
Hardware requirements for local usage
- an nvidia gpu with 10 or 12GB of memory (a T4 should suffice)
- at least 16GB of system ram
Hardware requirements on huggingface ZeroGPU
Right now (July 2024) huggingface let use ZeroGPU Nvidia A100 GPUs.
See LISA for details on the original project. Note that the authors don't keep the project updated anymore.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
lisa_on_cuda-1.3.1.tar.gz
(120.0 kB
view hashes)
Built Distribution
lisa_on_cuda-1.3.1-py3-none-any.whl
(151.6 kB
view hashes)
Close
Hashes for lisa_on_cuda-1.3.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ed30b1e40d31fa26d0942082b1dee779e7efcae367157cbfdeaeb723f0d888c1 |
|
MD5 | 687f02ccae6a0b9bc146e283636aa5a2 |
|
BLAKE2b-256 | 92545cbcdda790690641df5263133e4400317ae6cbe6e4347d9003e204540435 |