Python bindings for the GGML GPT-J Laguage model
Project description
PyGPT-J
Official supported Python bindings for GPT4All-J language model based on ggml.
Table of contents
Installation
- The easy way is to use the prebuilt wheels
pip install pygptj
- Build it from source:
git clone --recursive https://github.com/abdeladim-s/pygptj && cd pygptj
pip install .
Usage
from pygptj.model import Model
def new_text_callback(text):
print(text, end="")
model = Model('./models/ggml-gpt4all-j.bin')
model.generate("Once upon a time, ", n_predict=55, new_text_callback=new_text_callback)
If you don't want to use the callback
, you can get the results from the generate
method once the inference is finished:
generated_text = model.generate("Once upon a time, ", n_predict=55)
print(generated_text)
GPT4All-J Model
Download the GPT4All-J model.
License
This project is licensed under the MIT License.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pygptj-1.0.7.tar.gz
(217.5 kB
view hashes)
Built Distributions
pygptj-1.0.7-cp311-cp311-win32.whl
(137.5 kB
view hashes)
pygptj-1.0.7-cp310-cp310-win32.whl
(137.6 kB
view hashes)
pygptj-1.0.7-cp39-cp39-win_amd64.whl
(166.1 kB
view hashes)
pygptj-1.0.7-cp39-cp39-win32.whl
(137.7 kB
view hashes)
pygptj-1.0.7-cp38-cp38-win_amd64.whl
(165.9 kB
view hashes)
pygptj-1.0.7-cp38-cp38-win32.whl
(137.7 kB
view hashes)
Close
Hashes for pygptj-1.0.7-pp39-pypy39_pp73-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 452f7bf289ef808b094bf6ad3cb8aa0d4ec4e4e2e171f86f06b4367f71d0ac4b |
|
MD5 | 5bc5525d6ae3b20305982892cfa20407 |
|
BLAKE2b-256 | 67cdb2f22031874af309207ecb62ba472c87352300eabd48219deb9dc84350a8 |
Close
Hashes for pygptj-1.0.7-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ba256002c3ceeaea294660d8b0305ac991080afd90f17cd215a97fb0bcba5e93 |
|
MD5 | e86a4d9b1d5dcfd3e74e5d966ce714fd |
|
BLAKE2b-256 | 03bf7a00515fdfd7cdf493ab8c902dabc8952ce9bb0bfd3c8ca1ef1cebf1e063 |
Close
Hashes for pygptj-1.0.7-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f23dcd33c1ccea093010baf871a15d1dd80952ee2631cb396fcb7c2bf809f03e |
|
MD5 | 3bbc3ecfb7cb5735f17b93e315295a1e |
|
BLAKE2b-256 | 85e70965b692f60b13c3f4abc130ae389613eb047b80e6bac0519562dd4c89ef |
Close
Hashes for pygptj-1.0.7-pp39-pypy39_pp73-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a27e062f9066816814769e8827a6271594aef9a9e8072984fed6aa1b9e5500d2 |
|
MD5 | 755d83d5fde1e30159f2edd3c484650e |
|
BLAKE2b-256 | 1c011fd5c797b773bf855b0e049296183cf3b4067fb7b2c98077e97114ffe22d |
Close
Hashes for pygptj-1.0.7-pp38-pypy38_pp73-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a9f84b554adcc7569d7decc849e699f258e145fc81bf1de8729d503f4b104cfa |
|
MD5 | f0034ecd9321f732737af230ba3e14f3 |
|
BLAKE2b-256 | 42d67994281efb815ef64f7ce19d1684f7ed2520307261554bc29479b73d2e34 |
Close
Hashes for pygptj-1.0.7-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 40292c24c6cea66551a90b14411942046544e51f735286f5609b21188c17b74f |
|
MD5 | 0345b92e4a608f01df1e6630798fec96 |
|
BLAKE2b-256 | c12de30ed92b513c40e16edfd5d2b4e5b48682b36273cbb56d5bdb79527c7fe2 |
Close
Hashes for pygptj-1.0.7-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 71fd41a310ef7c99f599aac1dace2d2fef7a82aff8148070a589d5600e3f767e |
|
MD5 | 96618c37403d97d4d7359bac57bd6ca3 |
|
BLAKE2b-256 | fa5deeb09a7f0538e8fc858161fa05bdc9eff494ff03ba46b0fd889b10f84d82 |
Close
Hashes for pygptj-1.0.7-pp38-pypy38_pp73-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f718e0d5f66d70c350d21fd24370ae5b50b3930592ccd3c807a6b364848797b3 |
|
MD5 | 8ecaad9ca935e7c9270c6276486d5aac |
|
BLAKE2b-256 | cef3805d876dbc92354d552624eb40ec4da5578ad2c47b926a0661875d2b7f92 |
Close
Hashes for pygptj-1.0.7-cp311-cp311-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6f5b70aba239cca9f725fe133947e799104c7bd0963fe7ac31993ac167453f6e |
|
MD5 | 3b5e09bf66ccd7500bb89940de63ba87 |
|
BLAKE2b-256 | 2bfe80643fc9af098cfcce267c3cb9650ffa58ec7d69d1823dbbb5e13aa1c079 |
Close
Hashes for pygptj-1.0.7-cp311-cp311-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 077378b89585a79f6e4cc61a2a24bd40443b10721ab41909c21686ab59419c9d |
|
MD5 | c697567a5f2af6cc56ee34e073e83142 |
|
BLAKE2b-256 | 3a1068d7d52249170b56c7ea2ab8eb6a116e9445e3c3a21329e40c3032617835 |
Close
Hashes for pygptj-1.0.7-cp311-cp311-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4a14c25d734a11151c56ff8a02c7c4f234ccb54e5c558ff36c035685a821adff |
|
MD5 | 31d15f670dac580995644a39896c0ee9 |
|
BLAKE2b-256 | 2c60dc243b86c5eb4e5a1cf7bb7feb1c15aaebe813b5b653d2589e5dfb9ba07f |
Close
Hashes for pygptj-1.0.7-cp311-cp311-musllinux_1_1_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5f504ae98aba58f6aa5e966820a5eee3e732dc2d1f2c60afa8b0a7293c848100 |
|
MD5 | c16d424c4613df5fd60008a32404a8c8 |
|
BLAKE2b-256 | dbde82ed9057f70f4180c0f9bf7bc16fb20bbb2b2efa1dc7d0b215477f28c32d |
Close
Hashes for pygptj-1.0.7-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ad70a67e670a12be98901e9aa4ccb69b43de02e35e885feda0d8c45bbaef5914 |
|
MD5 | a58f4076769c1e831151002c2a2c9006 |
|
BLAKE2b-256 | 83de20fc5d7bc044b683e067732b9f649a932877e14a1b2997568ccbfb9f666e |
Close
Hashes for pygptj-1.0.7-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 76336b5bcbfcd3dbd7408eb0b22fbf22253450274a29e85c13c4858ee21e7756 |
|
MD5 | 39f4198e3d07c17777861a147050a89b |
|
BLAKE2b-256 | 4469abf13da08ed44b44dc822ad0d9263deb6c7fc3632c4c1d7765aa8e62d66e |
Close
Hashes for pygptj-1.0.7-cp311-cp311-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 84492f031a621b844ac0214751088775f4b08cf14b4998747e97ddfe7dc372dd |
|
MD5 | b71961e4d6889f603a79764193778d99 |
|
BLAKE2b-256 | c6c6ca50ed9bafcdbc1e189c1caa90b4bb0193102329938514b2cddb8e3e9c98 |
Close
Hashes for pygptj-1.0.7-cp311-cp311-macosx_10_9_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 05cad0321fa3111c17cb157f7bc54159677f5ec9f8be7d3a4d987927db4e46a8 |
|
MD5 | 933a90ac9b938d3728e10dcd80f01c40 |
|
BLAKE2b-256 | 1ce957094649bf928e94d11335bba5b214ebd0762564692b07cb475a4a77a60d |
Close
Hashes for pygptj-1.0.7-cp310-cp310-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | efd1375cca87ba0f64d8b376d33ef3e11445e5bc91f73a2eb47da330390d2e84 |
|
MD5 | 169d26ebae61dba6a5bfed6f5f7422e8 |
|
BLAKE2b-256 | 5ab54eeb583be7244be04e7d227fa5281a9cacc92e1b65a17e0bebe60df66808 |
Close
Hashes for pygptj-1.0.7-cp310-cp310-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 89db7a5811beb5b033fc86f8581e733f527ff0ce02eaf6ce8dfe2656865198ca |
|
MD5 | 75333dfc60165ae6f418021e864a0b51 |
|
BLAKE2b-256 | d0d4101c4134f55f9078e9609956ff8087b13f5c2130d80bef4ec0e63107c6fd |
Close
Hashes for pygptj-1.0.7-cp310-cp310-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e355604fd06d39820da73c077f30effd25f8a0c86d00c7b7c183d39c7f379112 |
|
MD5 | fef54e2d61a9ca9967b5ca3b3df2c0e7 |
|
BLAKE2b-256 | 871025bab62d6844e16845c8601a3dbfdb09fd89d31d666e8d592398256d556a |
Close
Hashes for pygptj-1.0.7-cp310-cp310-musllinux_1_1_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d244a969290fbe0eb7bddb168c128cc2707f640bac04941b05502e9a76224700 |
|
MD5 | 4775b09744e586e8a3a2163fc16a706b |
|
BLAKE2b-256 | 5790a2d9b71f68f7a10d31a4609066cfa0b872f1c93ae2fc4a229f1b5b10c467 |
Close
Hashes for pygptj-1.0.7-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a6478b18be3e7f59b7c9361a7e784802eccf7884cd84c3086fb1c0fab092c088 |
|
MD5 | 6e448e4f8d448e4fa137b07495373f36 |
|
BLAKE2b-256 | ee81c5e87d0f97124eb69e0241d438b007db5bba9f6fcf1d4928e1efefc7e39f |
Close
Hashes for pygptj-1.0.7-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 96c22eded9b64f6bd61bf2f60f234e0faff12b9ce67e064ba15187570d39fd16 |
|
MD5 | c36eee90c9bb3a3a8fb027ea78c291b9 |
|
BLAKE2b-256 | ce36fcecaf3681e8f56eb906eaa01bf5bf39d9c63a5c470f2c4b40fc690a4fab |
Close
Hashes for pygptj-1.0.7-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b75b1afe3e685c24d4d8ec187550cff420cbf92c28f1db1b3a53c0a9062898b2 |
|
MD5 | 82f4912eda0b4f38a5b764ca0e9a3aa4 |
|
BLAKE2b-256 | b71bcbb66e3eef664629f8269d6f233e87d643a5dc3901248255a1e1d354edce |
Close
Hashes for pygptj-1.0.7-cp310-cp310-macosx_10_9_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f43c2120faa78ba32d95104c61feefcdb48db687ab4faf27b460c5bd781ebb35 |
|
MD5 | 93a62a22fc018262a898c303af2db717 |
|
BLAKE2b-256 | 1c46c39ab079101488a0a7f15364ff82eb1948cbcace6fc0b7aeed3389921fc4 |
Close
Hashes for pygptj-1.0.7-cp39-cp39-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0c78ceb0a9172c91ffd5dd8b6ba54099e4e90c8dadeb98adf90e47a18e2ff1d9 |
|
MD5 | 98b82f08a99d9e8b3f822c3f5a7180fd |
|
BLAKE2b-256 | 9facedae2bb0c61f8d20de24e3bb0a4ba4cbb3f363d10542727c7a83684efbd3 |
Close
Hashes for pygptj-1.0.7-cp39-cp39-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | afbfe72b11a4f1e942bf4f7cdb6072fcc2128d98d67527ba4c310d6c82b5295a |
|
MD5 | 92e544c2f9d46ac643984602ee926e12 |
|
BLAKE2b-256 | 5f5d3a2e8a0faf84422ec541b05d53e2cd565b1f3cb7cc3e77050f66211b5739 |
Close
Hashes for pygptj-1.0.7-cp39-cp39-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5c2c809e7263aac8d9df56ab9b35ea1588dfea1c434a89eff47465c42c737265 |
|
MD5 | 8eddb62d354c74fd3d8a9536a50cdff3 |
|
BLAKE2b-256 | a278a12a5391c8b387fed05de672af1d5dbc135f2b4d69e9cb1d6eacb10e97a1 |
Close
Hashes for pygptj-1.0.7-cp39-cp39-musllinux_1_1_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b3084d772ac62c8f49aefa31cf97e1877a7cd562d8926299071d295843a5ff4a |
|
MD5 | 8aeb3458449808812a6da4127bdabe4a |
|
BLAKE2b-256 | 3ae0d2f301c5c9e7f843b5f37cc6836d7e183116f18ede677fcf46d02743ac07 |
Close
Hashes for pygptj-1.0.7-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f11c092ed5fb49267ac8cc84e3664a5f903f34a95a7a8f21e35288326df9dd92 |
|
MD5 | ddb795f6068135200d136fa878bb13d8 |
|
BLAKE2b-256 | aae5046b9c0fe04529ab83386243447a959eac7374e2fc9e752ca6f6d80431cb |
Close
Hashes for pygptj-1.0.7-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c643cfbb601cfb52deeaf6f712b6918a0164ba5ae88416d7116af66327149a4a |
|
MD5 | 551c846ffced5f69c0ddcd4eeccd2894 |
|
BLAKE2b-256 | 5b683b1392b2791a332e01867feffa9f705eb8d904aba747566b696b45b2bd01 |
Close
Hashes for pygptj-1.0.7-cp39-cp39-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ce2d7e3037b252b97ef0cf4f18958f01c7f9211294c417c5b44acb3c1a9d87ca |
|
MD5 | 7dcf618c13a735f5dbc60d3c80b02213 |
|
BLAKE2b-256 | 03010a2f572e280cfd6f7d51e7992ac5b6db1a85d7f5dbf3454ce7179bc22f24 |
Close
Hashes for pygptj-1.0.7-cp39-cp39-macosx_10_9_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 89ef0f083dcdc80c91719e02d2a5d85507c9b0f7e94d1163eabcba5ab1b629ee |
|
MD5 | ddc6ed36cc21a7413c5d5c47d3306085 |
|
BLAKE2b-256 | 5cf7704e5886733feaf93ef53e29caac0a4acc6a967df620c34cb8f3e676504a |
Close
Hashes for pygptj-1.0.7-cp38-cp38-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a1ad151607261b614ddf248b336edd6ad4d7b5118ed412b0af8d9fd734131596 |
|
MD5 | 1d451396c437380a176439168b2623d3 |
|
BLAKE2b-256 | 27905dd9782573b288db5f7c9237f6610eab177606f6501f4f326add0d1581ae |
Close
Hashes for pygptj-1.0.7-cp38-cp38-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6f447c178543d81eef042257ddc24f4928319ceafe86469be5f08af2194ff23e |
|
MD5 | 2b2a08b8aa442f9ee9a8f6b1db422df1 |
|
BLAKE2b-256 | f27920d71f71d7add2f08e5d490fa644d7771cef1870ec49e23317a2d60dd953 |
Close
Hashes for pygptj-1.0.7-cp38-cp38-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ad3aa47a5a196f11c4ede34748570312a82ebf27b6018e00f59e25b401702795 |
|
MD5 | e2a11d11ec507385fae71ef99ec65c24 |
|
BLAKE2b-256 | 28d6ea522cfb22c8885b7fc906accc22f304781aedfcec3c75c97caefea5bfb1 |
Close
Hashes for pygptj-1.0.7-cp38-cp38-musllinux_1_1_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f481c2297d82984964fb282b07b928cd6ea23514f80912e8ea0b8c9cbfdb7eba |
|
MD5 | ced99d8bf274462258fa13d1884379a0 |
|
BLAKE2b-256 | f9ab8bdb2606131c0873ce4e9f7b60aeb17beaac1b568d48449a585ee306861e |
Close
Hashes for pygptj-1.0.7-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f2923954460282900050bf7f65c5dbc0f1fcda84ef1ce2667eaf0b4499e07515 |
|
MD5 | bf6f592ba67dafc6b82c5517b8ce895e |
|
BLAKE2b-256 | 6a5f0d5444a1616d56a564c49c9679da093cf1790e498797b2022d6bf872528c |
Close
Hashes for pygptj-1.0.7-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f885b4800de49c5f3c490af13aacc889667cfd59b459e8181f9a1125febab039 |
|
MD5 | 46d478ea902d4f74755e93526a38057d |
|
BLAKE2b-256 | 92a41db046e0adbdb8f76504e1152de5f94b73dbbe8459f5228a8e9a6e73757c |
Close
Hashes for pygptj-1.0.7-cp38-cp38-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a276b9f3c9d32233e1ca82e65b117eaed60945d766f4f12ba3aabd42fc2a6814 |
|
MD5 | 41dfcab723a1f5e022d1c66145a238df |
|
BLAKE2b-256 | d30da2ed4147c203009dd221f6026ca540f6a6f1be647d3e66eeda7547a159ed |
Close
Hashes for pygptj-1.0.7-cp38-cp38-macosx_10_9_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4274207fb68c7f92e078dd1da41688170bddc66edede0eefe6bf9f5da24d9457 |
|
MD5 | ede43c8cb8178eb94c2806e7f17ee4a7 |
|
BLAKE2b-256 | 95c19540fd696e5bac547b33a4a8a849ef869a1a3756aa53f9d9b9bfefd10ac7 |