Skip to main content

a python wrapper around nodejs orbitdb

Project description

IPFS ACCELERATE

This is meant to be an extension of the Huggingface accelerate library, with the intent that the method load_checkpoint_and_dispatch() is going to be overloaded with a new function which will have some modular back ends, such as Libp2p, Akash, Lilypad, Huggingface Zero, Vast AI. If the model is already listed in the ipfs_model_manager there should be an associated hw_requirements key of the manifest. In the case of libp2p the request to do inference will go out to peers if there are peers in the network available to fulfill the task, otherwise a docker container will need to be launched with one of the providers here. The docker containers will will then be loaded with the ipfs_model_manager, and will use the from_auto_download() method to download the requested model and perform inference for the user.

Method #1 Huggingface Zero

Method #2 Akash

Method #3 Lilypad

Method #4 Vast AI

IPFS Huggingface Bridge:

for huggingface transformers python library visit: https://github.com/endomorphosis/ipfs_transformers/

for huggingface datasets python library visit: https://github.com/endomorphosis/ipfs_datasets/

for faiss KNN index python library visit: https://github.com/endomorphosis/ipfs_faiss

for transformers.js visit:
https://github.com/endomorphosis/ipfs_transformers_js

for orbitdb_kit nodejs library visit: https://github.com/endomorphosis/orbitdb_kit/

for fireproof_kit nodejs library visit: https://github.com/endomorphosis/fireproof_kit

for ipfs_kit nodejs library visit: https://github.com/endomorphosis/ipfs_kit/

for python model manager library visit: https://github.com/endomorphosis/ipfs_model_manager/

for nodejs model manager library visit: https://github.com/endomorphosis/ipfs_model_manager_js/

for nodejs ipfs huggingface scraper with pinning services visit: https://github.com/endomorphosis/ipfs_huggingface_scraper/

for ipfs agents visit: https://github.com/endomorphosis/ipfs_agents/

for ipfs accelerate visit: https://github.com/endomorphosis/ipfs_accelerate/

Author - Benjamin Barber QA - Kevin De Haan

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ipfs_accelerate_py-0.0.9.tar.gz (28.2 kB view details)

Uploaded Source

Built Distribution

ipfs_accelerate_py-0.0.9-py3-none-any.whl (29.3 kB view details)

Uploaded Python 3

File details

Details for the file ipfs_accelerate_py-0.0.9.tar.gz.

File metadata

  • Download URL: ipfs_accelerate_py-0.0.9.tar.gz
  • Upload date:
  • Size: 28.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.12.3

File hashes

Hashes for ipfs_accelerate_py-0.0.9.tar.gz
Algorithm Hash digest
SHA256 ef025431797a818fa990a6502e65df80f1779b3c99dfb47efc00355b1b26da6b
MD5 1f8684e80e8d61d43a591aa54c34fbcb
BLAKE2b-256 5434782b1a4fbb4b58796aa8ec4f0d03519177aa567eb9b35b613a287ec470b2

See more details on using hashes here.

File details

Details for the file ipfs_accelerate_py-0.0.9-py3-none-any.whl.

File metadata

File hashes

Hashes for ipfs_accelerate_py-0.0.9-py3-none-any.whl
Algorithm Hash digest
SHA256 69d4be831c2205fec4352f7b5045d4b99be1803854dd2bbdf30b0de10da9887c
MD5 8dac6918850596c2dd68ba6ebf13390e
BLAKE2b-256 35007a4bdcaf4ca7854463442366486c3e01138b5593953c7125dc7acbadf065

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page