gguf connector core built on ctransformers
Project description
ctransformers
Follow up the stopping updated project ctransformers; continue working on it.
install it by (pip/pip3):
pip install ctransformers-0.2.28.tar.gz
run it by (python/python3):
python -m ctransformers
User interfaces are available to choose (eithr CLI or GUI); while chosen, GGUF file(s) in the current directory will be searched and detected.
This is another solo connector core; same as llama-core; being able to work independently as well.
reference
All other functions are same as ctransformers; please see the reference above.
build from ctransformers-(version).tar.gz (examples below are for CPU)
According to the latest note inside vs code, msys64 is recommended by Microsoft; or you can opt w64devkit or etc. as source of your gcc and g++ compilers.
for windows user(s):
$env:CMAKE_GENERATOR = "MinGW Makefiles"
$env:CMAKE_ARGS = "-DCMAKE_C_COMPILER=C:/msys64/mingw64/bin/gcc.exe -DCMAKE_CXX_COMPILER=C:/msys64/mingw64/bin/g++.exe"
pip install ctransformers-(version).tar.gz
In mac, xcode command line tools are recommended by Apple for dealing all coding related issue(s); or you can bypass it for your own good/preference.
for mac user(s):
pip3 install ctransformers-(version).tar.gz
Make sure your gcc and g++ are >=11; you can check it by: gcc --version and g++ --version if you opt to build the wheel from source code.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distributions
File details
Details for the file ctransformer_core-0.2.28.tar.gz
.
File metadata
- Download URL: ctransformer_core-0.2.28.tar.gz
- Upload date:
- Size: 10.6 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.4
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9dbcc4cfabc3cc272e1d71e49583a78581db776cd81ffb96ba250ce52de3859d |
|
MD5 | 04a8978823a1293c8d81dfecb887372c |
|
BLAKE2b-256 | 7da219a0bf200fc9f0b055b1cb2e6dc6437e70156c6d145abf525b50b3ac1537 |
File details
Details for the file ctransformer_core-0.2.28-cp312-cp312-macosx_11_0_x86_64.whl
.
File metadata
- Download URL: ctransformer_core-0.2.28-cp312-cp312-macosx_11_0_x86_64.whl
- Upload date:
- Size: 2.6 MB
- Tags: CPython 3.12, macOS 11.0+ x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.4
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 38839aefaa5365fa212181474714dc477fc00864cd805a3ccf556a41674b9082 |
|
MD5 | 9d95ee301c1bcf5224464e8992b7ef6d |
|
BLAKE2b-256 | 5dce7ec4ce8d298f772e7ef70c6a38d09a7b7e8966168f778ee4aecb63c4cc24 |
File details
Details for the file ctransformer_core-0.2.28-cp311-cp311-win_amd64.whl
.
File metadata
- Download URL: ctransformer_core-0.2.28-cp311-cp311-win_amd64.whl
- Upload date:
- Size: 3.1 MB
- Tags: CPython 3.11, Windows x86-64
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.11.4
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5dbf9aad4d79a8fd1566760342ba8f75628fbcfa3338208ebf1eafac37556d7f |
|
MD5 | b2b1266f7a5cb7852da0c7172bce77bd |
|
BLAKE2b-256 | 9eecabe481a235baeda7832a98d743dd4a27f76fc25172a9def14f8ca318b2f1 |