Skip to main content

Calculate the surprisal of words in texts.

Project description

Bikkuri

Calculate the surprisal of words in texts.

Tests PyPI Version crates.io Version

Usage

Python

from bikkuri.ngram import NGramSurprisal


unigram_surprisal = NGramSurprisal(1)
unigram_surprisal.fit([
    ["lorem", "ipsum", "dolor", "sit", "amet", ...],
    ["convallis", "fringilla", "dignissim", "massa", ...],
    ...
])

unigram_surprisal.surprisal([["lorem", "ipsum", "dolor"]])

Rust

extern crate bikkuri;
use bikkuri::ngram::NGramSurprisal;

let mut unigram_surprisal = NGramSurprisal::new(1);
unigram_surprisal.fit(&vec![
    vec!["lorem", "ipsum", "dolor", "sit", "amet", ...],
    vec!["convallis", "fringilla", "dignissim", "massa", ...],
    ...
]);
unigram_surprisal.surprisal(&vec![vec!["lorem", "ipsum", "dolor"]]);

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

bikkuri-0.2.0rc34-cp314-cp314-manylinux_2_34_x86_64.whl (289.8 kB view details)

Uploaded CPython 3.14manylinux: glibc 2.34+ x86-64

bikkuri-0.2.0rc34-cp314-cp314-manylinux_2_34_aarch64.whl (283.7 kB view details)

Uploaded CPython 3.14manylinux: glibc 2.34+ ARM64

bikkuri-0.2.0rc34-cp313-cp313-manylinux_2_34_x86_64.whl (290.2 kB view details)

Uploaded CPython 3.13manylinux: glibc 2.34+ x86-64

bikkuri-0.2.0rc34-cp313-cp313-manylinux_2_34_aarch64.whl (284.6 kB view details)

Uploaded CPython 3.13manylinux: glibc 2.34+ ARM64

bikkuri-0.2.0rc34-cp312-cp312-manylinux_2_34_x86_64.whl (290.6 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.34+ x86-64

bikkuri-0.2.0rc34-cp312-cp312-manylinux_2_34_aarch64.whl (284.8 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.34+ ARM64

bikkuri-0.2.0rc34-cp311-cp311-win_amd64.whl (153.0 kB view details)

Uploaded CPython 3.11Windows x86-64

bikkuri-0.2.0rc34-cp311-cp311-manylinux_2_34_x86_64.whl (292.4 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.34+ x86-64

bikkuri-0.2.0rc34-cp311-cp311-manylinux_2_34_aarch64.whl (286.8 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.34+ ARM64

File details

Details for the file bikkuri-0.2.0rc34-cp314-cp314-manylinux_2_34_x86_64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc34-cp314-cp314-manylinux_2_34_x86_64.whl
Algorithm Hash digest
SHA256 4d2e81dfa2811822645ac479c673d6eaf28ffe3eec81c5cd149f0b3b8fdb0a74
MD5 160a1230dc4e18fa8453a03128ec9f3e
BLAKE2b-256 4079692bc24df57b90dd5738eeb9ae2a2db5262794149bf891133516eb6d4237

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc34-cp314-cp314-manylinux_2_34_aarch64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc34-cp314-cp314-manylinux_2_34_aarch64.whl
Algorithm Hash digest
SHA256 ececa3268f49f41c22c6e1a44abaf19f8e25c509e2e61165ef85d7a00c9c5031
MD5 f2bba65d38d32f3966e73797e4b7c67c
BLAKE2b-256 7689f53dfcb453e0ea116605286f7646e6a1f0b425549ad1db6442f591a65eee

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc34-cp313-cp313-manylinux_2_34_x86_64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc34-cp313-cp313-manylinux_2_34_x86_64.whl
Algorithm Hash digest
SHA256 a32bf76ad6fc31fa535fe5ede9fa6063cc3f59ab1dc4e9231699288a3149b62f
MD5 ceee0df9b9c1c4f27902fdbbf5adc560
BLAKE2b-256 4f7554b2695f8265247b2302998645291e1f7c765d0ab6717f1bb1903053f201

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc34-cp313-cp313-manylinux_2_34_aarch64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc34-cp313-cp313-manylinux_2_34_aarch64.whl
Algorithm Hash digest
SHA256 a56d97f26a790fdb6675cb9ce9ee6a1a35c34ae6103a99c57b3907e718b6b7fc
MD5 f688195db89dbcef6cbb7cf0045f5a06
BLAKE2b-256 e0c777aac8d4341d22059916bd390ccff97d7cc460827fa2c2779a92dd7a093a

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc34-cp312-cp312-manylinux_2_34_x86_64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc34-cp312-cp312-manylinux_2_34_x86_64.whl
Algorithm Hash digest
SHA256 8b18365c420aafb02c497e8c82d3b11ef2145c64163c676a0a1fde2c2ed80fd2
MD5 b4c590d54612def96d1fe61fcd408b6e
BLAKE2b-256 8205268f3d848b3846d3a31b01dc1eedb86242f9127ef1552acddcffe22617f2

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc34-cp312-cp312-manylinux_2_34_aarch64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc34-cp312-cp312-manylinux_2_34_aarch64.whl
Algorithm Hash digest
SHA256 bf0de0aa85eea0d0326087aec2063503664132343cb3b65d68988436329f06ce
MD5 088b2a7851352d69e71a00639ff847d8
BLAKE2b-256 de94887cebd90dc3c21e991f1e49f9526025e45d3060fa94c10424d0f11f3078

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc34-cp311-cp311-win_amd64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc34-cp311-cp311-win_amd64.whl
Algorithm Hash digest
SHA256 4fe3e29ca4bdd3bf6703d725313a5c743e69fa655916a032a502a59fe00d4410
MD5 1828a21057c686b498207b97d7002eaf
BLAKE2b-256 b2dd93b90cf7efefb67addb84d220bd10ccb86711f10c3080e8d5b00d6aac2ab

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc34-cp311-cp311-manylinux_2_34_x86_64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc34-cp311-cp311-manylinux_2_34_x86_64.whl
Algorithm Hash digest
SHA256 e2fc3f2e5c8c3b6807b3ab193624657c9dd5a17a6ab585b55a1374045ddf4071
MD5 857c6b82d9bec13984864b9c056160bc
BLAKE2b-256 cc680ed1d9466d25e9e3d4de03763cd0a9d821254ba03c13e02d85e83b1132ab

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc34-cp311-cp311-manylinux_2_34_aarch64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc34-cp311-cp311-manylinux_2_34_aarch64.whl
Algorithm Hash digest
SHA256 c0554f97880c8462167602b9465e4d433e719c7b6dd64ff7fd835bc623b3c421
MD5 9472ba5645e72595ef112f7babb40210
BLAKE2b-256 4415fd7f648322bfc789fd10fdf44b31e2ba4817af57783b62a205edf82ccf6f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page