Python bindings for the GGML GPT-J Laguage model
Project description
PyGPT-J
Official supported Python bindings for GPT4All-J language model based on ggml.
Table of contents
Installation
- The easy way is to use the prebuilt wheels
pip install pygptj
- Build it from source:
git clone --recursive https://github.com/abdeladim-s/pygptj && cd pygptj
pip install .
Usage
from pygptj.model import Model
def new_text_callback(text):
print(text, end="")
model = Model('./models/ggml-gpt4all-j.bin')
model.generate("Once upon a time, ", n_predict=55, new_text_callback=new_text_callback)
If you don't want to use the callback
, you can get the results from the generate
method once the inference is finished:
generated_text = model.generate("Once upon a time, ", n_predict=55)
print(generated_text)
GPT4All-J Model
Download the GPT4All-J model.
License
This project is licensed under the MIT License.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pygptj-1.0.9.tar.gz
(217.7 kB
view hashes)
Built Distributions
pygptj-1.0.9-cp311-cp311-win32.whl
(140.2 kB
view hashes)
pygptj-1.0.9-cp310-cp310-win32.whl
(140.2 kB
view hashes)
pygptj-1.0.9-cp39-cp39-win_amd64.whl
(169.2 kB
view hashes)
pygptj-1.0.9-cp39-cp39-win32.whl
(140.3 kB
view hashes)
pygptj-1.0.9-cp38-cp38-win_amd64.whl
(169.1 kB
view hashes)
pygptj-1.0.9-cp38-cp38-win32.whl
(140.3 kB
view hashes)
Close
Hashes for pygptj-1.0.9-pp39-pypy39_pp73-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 01fb7659c903be13847eac76d86eb3344e290076927de9cfd1e8c3a2ac980a92 |
|
MD5 | e704fc66e1f61f84690c9ed56c36a9b5 |
|
BLAKE2b-256 | da7e05f4e52b5d375517938a84077a568e4ad278252bb8bd5050cadb9f244f81 |
Close
Hashes for pygptj-1.0.9-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 60116fea35c46f0cd849efc2dde23aedb16fd72e2d32498d15edfa33d68756f1 |
|
MD5 | 311c2eb88632fde5d33221e25912b65a |
|
BLAKE2b-256 | 206d0ec90e2aa10e5e018efd9631ad3daa68f60c295296db3b5f8028e121fb2d |
Close
Hashes for pygptj-1.0.9-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 05c4405f67535e636fc30875f50bfc1ce958893f25e4b453fdaa8979770313d4 |
|
MD5 | 8647c853d99fc77c94f7644a195f2088 |
|
BLAKE2b-256 | cb3e23a34f283630e1e86a5e97f8cbf31294e7f0e4a939843ec984f59781d2a2 |
Close
Hashes for pygptj-1.0.9-pp39-pypy39_pp73-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fde8d7fe540183db4dece6d9d86b6eaa9c9ebf7d5d3d5d3ca0f990753c7b29be |
|
MD5 | 79f28d8fc565b37e5c66859c18499cf6 |
|
BLAKE2b-256 | a986ea218929d97296cb2249b62265641e1a29a03a0db4185815b122ac319561 |
Close
Hashes for pygptj-1.0.9-pp38-pypy38_pp73-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 74ee3173a6d9cfabbba8b8d87504d627a295ab2f6e188c887d7de872b7cfd472 |
|
MD5 | 92555fd8282a4374bf6a6928a6de1392 |
|
BLAKE2b-256 | bfefcd35897394bd342e67b3faf88e005e59462587dd2abcd88631f60a600a4a |
Close
Hashes for pygptj-1.0.9-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bd423a550866c3564c88ef8818114e2cc97e37fb957d4892edcd7ac0b0d2e1c2 |
|
MD5 | 37b7adc4ffb507cc6259ca94d0c553ff |
|
BLAKE2b-256 | 9d4702c4214104cf0de44ea1c3b7f70421fc9ebbbd4b96098ffeaba81dfd4118 |
Close
Hashes for pygptj-1.0.9-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3850107711cf750e3debc0a2604260c8e0987d7933fa198996c43ddbcc8c52d7 |
|
MD5 | 3de44028458a24cd0bcf47df5b99d62c |
|
BLAKE2b-256 | d15c3633b90df0b1c5b5f398f6455072b154ae68c1f31c67396caede748dddaa |
Close
Hashes for pygptj-1.0.9-pp38-pypy38_pp73-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f81c4c4fa6023cb51fbad38dd195493b99de837c3b421a360c2f0f3511753395 |
|
MD5 | bc179f7e88500746c5448798ce78cb6f |
|
BLAKE2b-256 | 9670fcf8298cd3aa05a48ec083ee1afa7c9f81af50bd2c3238fd3378f525262a |
Close
Hashes for pygptj-1.0.9-cp311-cp311-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 00790fa18b1c16ff7b565a214ef2546b6f107f9c8e23570d8dd377cb6bd08d7c |
|
MD5 | 22bc658c82e30379e2e99f1bf6f15d58 |
|
BLAKE2b-256 | f178308021a3179f7a15678f4342dfdceb51bce9065fe949a9762efae4e9f156 |
Close
Hashes for pygptj-1.0.9-cp311-cp311-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2f20aa7a7d10bca395206ba3191aeedd098b3b562a3aa315f4ca244dfaf6f72e |
|
MD5 | a95695ea68facd3e0b8df4d0b3c0a138 |
|
BLAKE2b-256 | a9327f6bdc107297575138ec1bd874ea68858bc7b975566999dba1e0b19831d3 |
Close
Hashes for pygptj-1.0.9-cp311-cp311-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6112aa2927e9d7e775a585cd83a689862e854942af97d105b785819e343518dd |
|
MD5 | e6e79e64b429cd7cee99f2f1f6f23b95 |
|
BLAKE2b-256 | 1c7efcfed10b41891280bec3cc111475425aa12e1bb4bfffa5b060f095aa5d64 |
Close
Hashes for pygptj-1.0.9-cp311-cp311-musllinux_1_1_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | afdf0d83a7d9d373b10aa41996a2d4aa9c287cc5a5da96d99393d77f55dd9795 |
|
MD5 | 4059fc2f82836958eef677b9f0832156 |
|
BLAKE2b-256 | 4ca3d5243838c956a097bda527395148ff49ac8c6e5ddfc1a19e15fe8ca11400 |
Close
Hashes for pygptj-1.0.9-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 63dd95bf0a49cba3f75a4c0926da01666328460a6bcec48de7dde7376ea1c7f5 |
|
MD5 | b1127fa49ee864a2878c502fdde071db |
|
BLAKE2b-256 | 337dfd62f9ce27ae250e60facc44e8876045ff7b002a8032dd19b2d515a83f96 |
Close
Hashes for pygptj-1.0.9-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5cfb3a0db71b4a36c4859e3e3099db3f57229924448b7324f14fce8f95c8468c |
|
MD5 | e60a3e5c855d7a4f66ec28e7c37b419d |
|
BLAKE2b-256 | 5b66d4d4f7fe5e1ca0878ad3cc9519d7622815b0ea8ddbc4c7c58d74de48cfcc |
Close
Hashes for pygptj-1.0.9-cp311-cp311-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 98ce15227cabda1535fc9a8ae416ad301018a5a56d1563898eeef5176fc51dd0 |
|
MD5 | bcfa7c31936c10f59b8ba2e37afe1f6a |
|
BLAKE2b-256 | abdbfd30fb061ee6cc5f877e40680d1f3408a097de9401f5789272b09bfca9b9 |
Close
Hashes for pygptj-1.0.9-cp311-cp311-macosx_10_9_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1a126af02c7172cc1e72c3d3adc7319518851b1a5e22f9a067cdd0b5fe0f45ce |
|
MD5 | 39576fca575aa19b0928713f59abc2b3 |
|
BLAKE2b-256 | d1dca4bf2c0859a167af767d25b73385c5a0e5ba41c936f40bd607f2d0d834a4 |
Close
Hashes for pygptj-1.0.9-cp310-cp310-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 166cd7b0203367c678feba58df0d21b38b43e1c3dbdd851331a3ce615798b8a7 |
|
MD5 | 4568906e54b6f3d2e07506e819acc248 |
|
BLAKE2b-256 | d62695a59d573de66637e28d875ef0426af332ab64ce606c8735d1a2630710fb |
Close
Hashes for pygptj-1.0.9-cp310-cp310-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | db552c194b32450d625f844c2e31af45a7f7da40214f723c192284550af465e4 |
|
MD5 | c9dab25ab0d9f95bd6ed1a5a2f2b5f6e |
|
BLAKE2b-256 | 2ce979c2685f26ba7634751c84e06261fac611796540ac7183ff1dfb14555b7d |
Close
Hashes for pygptj-1.0.9-cp310-cp310-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b8541f10bbceabff9190219087d3164549b617941cd37123ddcbf4f8cccea3b0 |
|
MD5 | eb97015a296cdb59c208215fbd2da24c |
|
BLAKE2b-256 | 37d94ba6fa77eeae5496609a35797994ad23061e23ef82dac2f69adaba3c5f9a |
Close
Hashes for pygptj-1.0.9-cp310-cp310-musllinux_1_1_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | af9af11bce8f9a448d778d7d3e750765888fdbe36ae2b377a3f217330a69d994 |
|
MD5 | d99483c2f20c50e84659b744175e099c |
|
BLAKE2b-256 | b19538ac6b5569bfb5afda1b59b2c9057488814b6777660a994fca2b5a0bd819 |
Close
Hashes for pygptj-1.0.9-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 914fb1975faaff117ca08a99b34fb1bcf572e53ebb10cb544c6e27fdacb77a5d |
|
MD5 | d8b3054c4a4b8063df36a0e1c2ee29be |
|
BLAKE2b-256 | 170313b79ffae20c19a9bd2bc95c05ff4e81f9a30c0ce30495acbfb7c7110efa |
Close
Hashes for pygptj-1.0.9-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8c0dd710703420a1d34fa5a910f556329188ffe0a90de1ad2054a483e97bd9de |
|
MD5 | 67e1142e7b6dc2ebd452e1f9d6e1dfd4 |
|
BLAKE2b-256 | 63c07083090e254ff8dd445d79aafa1ed8cee56566dbaeb01b50775b95dd4bd5 |
Close
Hashes for pygptj-1.0.9-cp310-cp310-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 47658261c961a21a1882b7e17d048cba0156175319a91303e4d61725feecd882 |
|
MD5 | bc2e924eb3b998efc8d75d54a424d7eb |
|
BLAKE2b-256 | eb184b1de70eea05ea20d7bcbfb4957c53948fd8e2e7539b405bf8f86204c74b |
Close
Hashes for pygptj-1.0.9-cp310-cp310-macosx_10_9_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 395802d085dd2fb54ee480b0fc74fb03f5a7ef0e5140398208d7e55a99afee81 |
|
MD5 | 6546fdc28075fc3e62a8596df3865aaa |
|
BLAKE2b-256 | 77ae37614049119e0235a82c712cad4cec2602fd3dbc5fe3ab607b9d73dec540 |
Close
Hashes for pygptj-1.0.9-cp39-cp39-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 667719854d331ba14d5b68e07c62470c1cefcf042ba1343380b17f26ea74beba |
|
MD5 | 50ece88df99aa8c5a63c68ba8c6fba51 |
|
BLAKE2b-256 | 7dd2ebba630b82cef27445df675e5a500a43282f28cd70750eb953d24f3e36f4 |
Close
Hashes for pygptj-1.0.9-cp39-cp39-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ed3702a5dca6fe039fd24a39d3d21e0da7d90c09c4399dd0796cf4223abe0098 |
|
MD5 | c436354fc9be9a44e465610c968e2384 |
|
BLAKE2b-256 | 7fda1e61f454088d9108ee019d6add0275de1b96c180532a9ac98ce279b7548e |
Close
Hashes for pygptj-1.0.9-cp39-cp39-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ca07022c6a874cffcfa1eb94d46f52cc8bf50ac0f0e1b7f76cb9a945ce24f482 |
|
MD5 | 69f0cde9811b2f8b8133deb67b6b7b0a |
|
BLAKE2b-256 | 8bb6e28a994ee536968b1271f3f2d2832229436ec9023c81688baaa73afa9f17 |
Close
Hashes for pygptj-1.0.9-cp39-cp39-musllinux_1_1_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1b13c5ca44be4f5fa9c025e17cbdb72e200ac614d28ba2794d19843f812b82a7 |
|
MD5 | b6a086b52b81da27750dcf69531e4308 |
|
BLAKE2b-256 | 7649bbef3d26b214c2828b39b9618c70d48a8ac48a421a7d4314fdeca83851bf |
Close
Hashes for pygptj-1.0.9-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9d0595e3ef4f34e964ee544982155e73e9efad5b6592257e14f5ca3fa8b5f02c |
|
MD5 | 2efbd81fd9e50b0ff3f2a302f026c3ea |
|
BLAKE2b-256 | 8508721afff42b01e4e2856beccbdb744367d23d20c93e8e5bab86e2f154a5f1 |
Close
Hashes for pygptj-1.0.9-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e637c088128ff1b71012aa2783878d1354d2053e6a8fa9f842526739a84e8a90 |
|
MD5 | cd5d500f6c771fa43dc22183e7240306 |
|
BLAKE2b-256 | 36806e1cfae1737962cf8d82c66c4781080fcec232adc274497bd6a9cbeebc6e |
Close
Hashes for pygptj-1.0.9-cp39-cp39-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 661372b01c7193fd41fddc9d559ef727b743973769bce05e7051e4087bed058b |
|
MD5 | 818d76f73de23553593193afab27ec4b |
|
BLAKE2b-256 | b8979ad1ad6fb14deec87d8862e75c90dd5136d4c69418b3bf129a121ddfc047 |
Close
Hashes for pygptj-1.0.9-cp39-cp39-macosx_10_9_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 768adc804fe0b85214f9d99cb6f114092a94e426483e64b5f165fc2d65c424f3 |
|
MD5 | deb3058be91753bf29e93b5f746f9062 |
|
BLAKE2b-256 | 96103bb4f115ae0de6b61381effe1489c860606a9acfeffc4af975abc556baa4 |
Close
Hashes for pygptj-1.0.9-cp38-cp38-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | cfd85c5484a6933fbd722904db168594f72602cd24b79cd5cf0e5ee05dd07661 |
|
MD5 | ea2f40b0d4dfc2a4a766ed8071a73d51 |
|
BLAKE2b-256 | f94c436059e06db0380508d21b874591070b71eb41e97a7567bcbd0ce87351ff |
Close
Hashes for pygptj-1.0.9-cp38-cp38-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 826125273dd1764bfe921fb008e422390a5e917c617fec5d8b8dd964cd8f1f12 |
|
MD5 | ac2b3b3a9d3b5c06f0c34a3d569e265d |
|
BLAKE2b-256 | 38ce04994ff8c41e437c84ce99953b4c5414a56e7a7558b7127061eda3967544 |
Close
Hashes for pygptj-1.0.9-cp38-cp38-musllinux_1_1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 240725b269b9a0054817d7aa0da0eee8592d839647e56a4683126726c5761145 |
|
MD5 | 76bdfbb009319a5f3f8b9b5b83fa0b0c |
|
BLAKE2b-256 | 0105ac33b465828e13e566e6a485ea8dcd41eeed0dec930b830404cf8fbec798 |
Close
Hashes for pygptj-1.0.9-cp38-cp38-musllinux_1_1_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 976b599d42fc8cd3f2f205463f81be42c44ee993c2cab3f6600f1eca15c46052 |
|
MD5 | 7facf7bb1f5b243f41df767984c6eeb7 |
|
BLAKE2b-256 | e02628f6e0a3a5e005067df7023ecb7332e699f0c9859fbdaac583fc073306df |
Close
Hashes for pygptj-1.0.9-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 108039281d1261ad8b1992b544fa6dad80662523396ca241b49fdd4e3968a441 |
|
MD5 | fd874535eb1036c1dbb35961e3343953 |
|
BLAKE2b-256 | b850093f6ad9b99f8be602bc2d53b1668feaf5a14e83dd259cad63418251a12d |
Close
Hashes for pygptj-1.0.9-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2a4c9b0e3edd16f67a1400e89b48f6e4a43b70e54750edba1c3af922e84463e9 |
|
MD5 | 2b3cca1444a8ca9bafaf207efbb6b8a3 |
|
BLAKE2b-256 | 8ad6c21dde2b2eb3da3634098aa88e0e20125e114f3d57e3c59f11d21483477c |
Close
Hashes for pygptj-1.0.9-cp38-cp38-macosx_10_9_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8e4ed010f63200a0d8126e3ccd320583bd2309ba9f3a53223e35e6a932d24a65 |
|
MD5 | 48487459fecf64216569847b4e49d118 |
|
BLAKE2b-256 | f0a482c366f5cf39fbbb98967cb83341016b9729a0780d94d02dfc473761e620 |
Close
Hashes for pygptj-1.0.9-cp38-cp38-macosx_10_9_universal2.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 581477e1a358a0050a35a75a29e6a83bf5e8fe270abc360ef35aa2492a59687e |
|
MD5 | 7b1a8e491198eed36c0bd0be630e0022 |
|
BLAKE2b-256 | c259858b2a5078fded3c33b8d6ed7fe6f8b8c473ba31992aff54c186acef7dd4 |