Python bindings for the GGML GPT-J Laguage model
Project description
PyGPT-J
Official supported Python bindings for GPT4All-J language model based on ggml.
Table of contents
Installation
- The easy way is to use the prebuilt wheels
pip install pygptj
- Build it from source:
git clone --recursive https://github.com/abdeladim-s/pygptj && cd pygptj
pip install .
Usage
from pygptj.model import Model
def new_text_callback(text):
print(text, end="")
model = Model('./models/ggml-gpt4all-j.bin')
model.generate("Once upon a time, ", n_predict=55, new_text_callback=new_text_callback)
If you don't want to use the callback
, you can get the results from the generate
method once the inference is finished:
generated_text = model.generate("Once upon a time, ", n_predict=55)
print(generated_text)
GPT4All-J Model
Download the GPT4All-J model.
License
This project is licensed under the MIT License.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pygptj-1.0.10.tar.gz
(218.1 kB
view hashes)
Built Distributions
pygptj-1.0.10-cp311-cp311-win32.whl
(145.2 kB
view hashes)
pygptj-1.0.10-cp310-cp310-win32.whl
(145.2 kB
view hashes)
pygptj-1.0.10-cp39-cp39-win_amd64.whl
(174.9 kB
view hashes)
pygptj-1.0.10-cp39-cp39-win32.whl
(145.4 kB
view hashes)
pygptj-1.0.10-cp38-cp38-win_amd64.whl
(174.7 kB
view hashes)
pygptj-1.0.10-cp38-cp38-win32.whl
(145.5 kB
view hashes)
Close
Hashes for pygptj-1.0.10-pp39-pypy39_pp73-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b166b8bce01789dc6752a7620d91c863d028e0607a5a3d5233ff8d33d763d7eb |
|
MD5 | 8dbebc2002020ea636209050ba7afcef |
|
BLAKE2b-256 | 9cb75ce4888231071f6959d9234128ba84b1468d8dce848d71a52b55d29523a5 |
Close
Hashes for pygptj-1.0.10-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 453a01247a77fa23bd564adebe69b8f39a4da7f8b00c3babb23c176e36cc849b |
|
MD5 | f06e9c110803cbb3a2665a7cc4a131b2 |
|
BLAKE2b-256 | 60bd89605a69e98a2e2ad669d908e4ea2810e6c895b661d6d2db924b06a34387 |
Close
Hashes for pygptj-1.0.10-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | afe2db2b5f09e9aa57203ff7e36444dba20c3dba8a73b9b2b3849a2a1130c71b |
|
MD5 | ecf40b06af2ee9d049da84da3afbfcc0 |
|
BLAKE2b-256 | 96d61a8f534913c4972e077b8eace23321d76109edb784c0f96aaa965fe3658c |
Close
Hashes for pygptj-1.0.10-pp39-pypy39_pp73-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 466d02d0faeff04480345c22fcd0601429cea8aec4dbac5c919f952c30cce9a8 |
|
MD5 | 6b7ae0a6c3f1b4af0b6c705c69d6ecc7 |
|
BLAKE2b-256 | fca996f14869d9bb4e83a1cd4891ae790e5f36bb1f7258e539cbfdc3a11e78e5 |
Close
Hashes for pygptj-1.0.10-pp38-pypy38_pp73-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0e86944ccc1be77bf106f87dbbfbe572bf95b44bb29519ab2e80707f0128d8db |
|
MD5 | 336d3dd64429815cd2dad0e6b322388a |
|
BLAKE2b-256 | 9efbc1355c58b593d48c863d9448066044e768203e09eafaaeba55591be14da3 |
Close
Hashes for pygptj-1.0.10-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 20b4157afbd1be11b8b0ffa5ce9bd7448e0a5174b2ea3f12cccae7c7845c05ca |
|
MD5 | 31f24cef9b50c677979610bf1e459ec0 |
|
BLAKE2b-256 | 6b4b3f6990de947fe875a56dff36569b35f5e0a3b92e3adbb418d1b0e13d263b |
Close
Hashes for pygptj-1.0.10-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 052430c673b35835587aad11cfd28d01aa0efb860894a8db6844bd32703bd947 |
|
MD5 | d61172b42fa3e3ccafcc7e826334026e |
|
BLAKE2b-256 | 9fe15d5eca12c0731070ad40b3ffab04773fd7873eb14ce0482daf3f8cc98fd4 |
Close
Hashes for pygptj-1.0.10-pp38-pypy38_pp73-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1fcc21f6a1a57fa8b3998506d26edbd795506e8f5cfd0f805c252e82ebb20110 |
|
MD5 | 2fb85e84306093568bbdc294542ed615 |
|
BLAKE2b-256 | ffc78e057cace4f9edd17e1e0c09752511042fe6a12627bb0c1a9d21c1b4ac2e |
Close
Hashes for pygptj-1.0.10-cp311-cp311-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ebf40d076dcbba9efb67283de88768b1591671ce429f72da87a90ca3010eae23 |
|
MD5 | a05bce2c1eedfcd247f5b105f22955de |
|
BLAKE2b-256 | 758d7fd45d499c8f5b9a531fe843e5ccf447b53977ff1eea58136a503d560ee0 |
Close
Hashes for pygptj-1.0.10-cp311-cp311-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 84a8141b7713375861767b6f18e4bfd8c020401d041e10db878924ffd5ea2c01 |
|
MD5 | afad80414915498d52b1940a87b4c617 |
|
BLAKE2b-256 | 7d6c4e63c4806364237a42840f0458eea77a9c67ebb7ed743414aa63d68a2555 |
Close
Hashes for pygptj-1.0.10-cp311-cp311-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 81d43fb5a9aadf278426c3258ddbf692d84d791dd6edea26257b01baae3f1013 |
|
MD5 | 601940de06cf4a541d986828898dcd5e |
|
BLAKE2b-256 | 337de9d0daf568daaa49089f158a2f6c420dec0ee6c4acecd284dc594e2a3de9 |
Close
Hashes for pygptj-1.0.10-cp311-cp311-musllinux_1_1_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a6b582d13845ce5498f959b71e0866fa475efba39ee352b6b51af1338e42f341 |
|
MD5 | cc957338e51a1957ad253c474cadb043 |
|
BLAKE2b-256 | 7a3a777b71bb81ca60dabe64e1f803f93a3bd271613043336f3a75d9d1f8bb48 |
Close
Hashes for pygptj-1.0.10-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 82439f9dc9c0f0088905dbe1090e70d7ea6686fb8b6cbc00577969130e92ce41 |
|
MD5 | ee85f3a9e77d348bea8aff18f573a9df |
|
BLAKE2b-256 | a5c63df330a8658e652398d96e00b25c421bb2c8c343686a438ee383c1aded77 |
Close
Hashes for pygptj-1.0.10-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c5b5c1b82ae7be48760ad14cab258bf6c228a5e19b8f334cd64d1288fbc3cd37 |
|
MD5 | 665886ab53ef29f7612a1e5946a2be22 |
|
BLAKE2b-256 | 46e4627a61b77bbcca83a898fa07ba7a1a1acfa750bc960939b9c1540cde046b |
Close
Hashes for pygptj-1.0.10-cp311-cp311-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7af64c8b5ad4bb168eecb91a7e433601ce25be6bbdbcd56c6624e06ae56cc394 |
|
MD5 | 4c456067eb945f4f50936655303f8b74 |
|
BLAKE2b-256 | fe10583632698a0f7d04ebbf77d74047dae3b99f8cd5932bf80a60b19ef31d6e |
Close
Hashes for pygptj-1.0.10-cp311-cp311-macosx_10_9_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3fa5d773149ecaa6a4a813a2c803620bbb9a10bdfaf44fedafb2f485627345cf |
|
MD5 | 326cb9d9b4cf8418a691254e50d82add |
|
BLAKE2b-256 | d9b34b40c7f1c268740fbc9395f473f396f7516b490184b490dbf66f8cf15b44 |
Close
Hashes for pygptj-1.0.10-cp310-cp310-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4e512c3d22da8cff7f26e7785d9536b5c39abd0104a16206c44b244048736e73 |
|
MD5 | 7280d90d35165942cb15a210bafac0ed |
|
BLAKE2b-256 | 6fb14aa521db32ccdbb7e2fa2230bc4c6150aaccd310ede0427bf89d5f38aab8 |
Close
Hashes for pygptj-1.0.10-cp310-cp310-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5a46925efc84a3b0efd77f13e2691401394ef0bc760b46261eda39d69124fa44 |
|
MD5 | b144c4d26ede96adc77918721734c6ef |
|
BLAKE2b-256 | 967eeb12ab3f03195487bf73a501b33038f38123e67e4247ae5b6b819e94f6bf |
Close
Hashes for pygptj-1.0.10-cp310-cp310-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 554985198f87b19c0c464e02c6af293840c2bcbfeb514e6020308974fff69997 |
|
MD5 | 7962612a53eaf7ff188810fb8317d383 |
|
BLAKE2b-256 | 1d48eda307aab30f793505e751efdc4bbfa3f461772b7bf7fa097ae6fc7b4604 |
Close
Hashes for pygptj-1.0.10-cp310-cp310-musllinux_1_1_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 33f6ffc8e98769bd33cd473359f4963eacec10fcdd0c23e28c69271c8404def8 |
|
MD5 | b6cda5274f97bc7dd3b4869567026b30 |
|
BLAKE2b-256 | 9af937b3515c81f9285dcfa2874b61dd7c7d56ab4d20f66c4e59cd5bfc76d738 |
Close
Hashes for pygptj-1.0.10-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9b5cbe2ebfaf3f75e5564164c92b903150cdc0e5015da88bc1860ed74486acd8 |
|
MD5 | 3286cc381275fd44eaae632ada33f05f |
|
BLAKE2b-256 | 654e3a8088420bd547a5bb8ad6db0172702a24ef4afb671e1a736bff59893d5f |
Close
Hashes for pygptj-1.0.10-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 90fe52eaadc495966f21e026fc1ddae537e48981e555d04e2f62090c6a788e37 |
|
MD5 | b89032771b9c815ad7197464a6801f86 |
|
BLAKE2b-256 | 98f11ba3213c02b5cfa0c11fe1d7dc4cabaeb1c41da0f9dee351e039165ffa01 |
Close
Hashes for pygptj-1.0.10-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2d826743129d37603cb1542f7b68ca3c0acce486389f01ce32683a8f879ac6b6 |
|
MD5 | 7db99024f72e5b2c943ed8aeaefbf39e |
|
BLAKE2b-256 | d1f6c75b3457cffe808ab556b3af0df95a3fa00f8e533c6ed5218a25919b0b48 |
Close
Hashes for pygptj-1.0.10-cp310-cp310-macosx_10_9_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | efdcb0d25d8f68b1746d61e373ab87c1da7c32945f09a2815496d833ef5dac62 |
|
MD5 | 81376d2e39f79e3f0f3284d17b96e9ca |
|
BLAKE2b-256 | f872dcd1345a175a67fd08a3db878cd01fc0113b90d43813f8afb3ec9d7bc357 |
Close
Hashes for pygptj-1.0.10-cp39-cp39-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 705442eae7140017fa5b06d0ad44556258d3c35d0b1686b3a3ca5a484c816411 |
|
MD5 | 84d3e32757264941b7fd294125525c65 |
|
BLAKE2b-256 | d7fbdcd701df709fd2f798c2da78a9fd1d257954d730d00556d9e7ac88c432e4 |
Close
Hashes for pygptj-1.0.10-cp39-cp39-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 727c0c07396ca3696d6382544eced596a56318bf0eb2f1a81cc4663aa78e2390 |
|
MD5 | a2bd001e6bb7aecb34024051d6d7eef6 |
|
BLAKE2b-256 | c56bf56bd8b0fb46e70f7d69a85c84c8c33a168b1f17e428aa7fcf30b193b4b7 |
Close
Hashes for pygptj-1.0.10-cp39-cp39-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ec00740b96d5719c5abe2456b4c2ce9137cf5c3075b1599d62bb97f4b2fcf4c1 |
|
MD5 | 23003c3532f2c3ed6c49360b0a4af32f |
|
BLAKE2b-256 | c1628d5bc1f1d8d15bcbc35b19ed9938768412f0c4c078cff710a218ef51b71f |
Close
Hashes for pygptj-1.0.10-cp39-cp39-musllinux_1_1_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6a8e060906b7f799de7873f7fa1e623209112b186613c176f597bcc68931002a |
|
MD5 | 6c4e78e7f232794d3a88c406d1539038 |
|
BLAKE2b-256 | 649b1192662f41902b43ad5ab95bb9ab01f975cfff4ad7b10c2e35d833066d0b |
Close
Hashes for pygptj-1.0.10-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1cb7226476cfd0d411a3693d568bc7aeebd90eb8f29d88db3cd5b050b5f50afb |
|
MD5 | d6e44290c3bbbc5056c466349aed1574 |
|
BLAKE2b-256 | a8ffe1d13c63225a43a431683c5765e71865e188fa0dcf4add884254aacec340 |
Close
Hashes for pygptj-1.0.10-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4c14d179da73366d96a7431af7c49dee5740848518ae0299c9d7360f651045cf |
|
MD5 | f3a99f6df99a2eaf36539a6ca10fa98b |
|
BLAKE2b-256 | 3e2f09f74358808448166b10b5bdcacfd156bf7c75ac00a2b4a894e188df0185 |
Close
Hashes for pygptj-1.0.10-cp39-cp39-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9dec90a050b158430fd063ca8fcccf97751c9033221f7509717c84e6a1db8dc8 |
|
MD5 | ad0259d31a7832e449bae7f8c0a63bda |
|
BLAKE2b-256 | 303607977806438fa0be69c6ad5634a1558d8cd00edbedaf68ef55a70fd8c33c |
Close
Hashes for pygptj-1.0.10-cp39-cp39-macosx_10_9_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b8d7ced05d7ae41bcc04c4993baceb4f09541a9519cb2c34990eb99f4b1dd0e1 |
|
MD5 | 0f25374cffe615b0ca0fa512823e9e6f |
|
BLAKE2b-256 | abfc6bfa84dcb38bafb413b0ea476480f4ef90f2227a3055a275ad4e83bf6192 |
Close
Hashes for pygptj-1.0.10-cp38-cp38-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2002ca885254ba6760743d996ddd2d7b0f1fa593c4718e4d915fd693a0c69825 |
|
MD5 | 844a65f099a106d099ef23c08a9c7c3b |
|
BLAKE2b-256 | c202e80960f2f0faf3eb79902c95a988d8a86ac55ebb8da34f608e36f986a930 |
Close
Hashes for pygptj-1.0.10-cp38-cp38-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d8a2d3eaf7046cc1943cc2b586f258f76eebe5896cbee6e610ed9bdb8a97e9c2 |
|
MD5 | 4a83fcbd02a33ac14a4b1295a147a156 |
|
BLAKE2b-256 | cf21d7937c3d8e968f6a86116adaf7fc397fcf1286ac5f6d59017090e229bce6 |
Close
Hashes for pygptj-1.0.10-cp38-cp38-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 708145137086cf5431f1885d8f05de04d5173831d88e416929605dd4c90d8313 |
|
MD5 | 6eed093f38b1450f83d13b8662e5b437 |
|
BLAKE2b-256 | 4dc988e0762a1e9026ed7c26a6b3913f1d47ffba0fc6170bb2e6934bbbb9bbb8 |
Close
Hashes for pygptj-1.0.10-cp38-cp38-musllinux_1_1_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1eecf76740b175874f0b47b04f25bfda9c712bec6b78813ef1dbb226e9021d6d |
|
MD5 | 1ac5cbf1f24369c136a9dd4a62326640 |
|
BLAKE2b-256 | cab5ea561d31b775404fb0558bf79adc6af2c8078c8190f67883d590465cb266 |
Close
Hashes for pygptj-1.0.10-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0baa9ab90c6ddf0e08c9d592413c7e52dac183cd5a72f48bd7d542e0ce77b3a5 |
|
MD5 | d9c5aba29f8b7d4169a50822cebc03a3 |
|
BLAKE2b-256 | aa888a106b11b6c9beab6e8c78bf000b65d4ae0dbe0ad11b6b163b1e335528cf |
Close
Hashes for pygptj-1.0.10-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 466b06ccd7f5fb0fd08c90d70c23983604dba59a3563b37cb0de2a4cec9f9897 |
|
MD5 | eec1826cbfb7a5b735131d9d0bcbc5d9 |
|
BLAKE2b-256 | 508c0ef22e820af92a0987879205ecf17993ad20019aa53fb8bc3b8ff08cfad7 |
Close
Hashes for pygptj-1.0.10-cp38-cp38-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3c85d8a52e68b30701e6502849a9db2ded04e028b811520f81330393cabeffd1 |
|
MD5 | 3ee2c4384c4616ae8445145e326f3b9e |
|
BLAKE2b-256 | 75ec6343f725898bc496cdf6429a6cae79d40575c7a3d799b395365cc736b00f |
Close
Hashes for pygptj-1.0.10-cp38-cp38-macosx_10_9_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0856dffea05eacef8a7b2e7bfc18ecad0a87d577d7f8bd316321fba31e966027 |
|
MD5 | a1b56cf1004932a24414356c99cd6aa9 |
|
BLAKE2b-256 | 044e22bf32fb6eef02bf261600e75c790d725140f6ac5af652a698ef59349017 |