Skip to main content

Calculate the surprisal of words in texts.

Project description

Bikkuri

Calculate the surprisal of words in texts.

Tests pypi Version

Usage

Python

from bikkuri.ngram import NGramSurprisal


unigram_surprisal = NGramSurprisal(1)
unigram_surprisal.fit([
    ["lorem", "ipsum", "dolor", "sit", "amet", ...],
    ["convallis", "fringilla", "dignissim", "massa", ...],
    ...
])

unigram_surprisal.surprisal([["lorem", "ipsum", "dolor"]])

Rust

extern crate bikkuri;
use bikkuri::ngram::NGramSurprisal;

let mut unigram_surprisal = NGramSurprisal::new(1);
unigram_surprisal.fit(&vec![
    vec!["lorem", "ipsum", "dolor", "sit", "amet", ...],
    vec!["convallis", "fringilla", "dignissim", "massa", ...],
    ...
]);
unigram_surprisal.surprisal(&vec![vec!["lorem", "ipsum", "dolor"]]);

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

bikkuri-0.2.0rc9-cp314-cp314-manylinux_2_34_aarch64.whl (283.7 kB view details)

Uploaded CPython 3.14manylinux: glibc 2.34+ ARM64

bikkuri-0.2.0rc9-cp313-cp313-manylinux_2_34_aarch64.whl (284.6 kB view details)

Uploaded CPython 3.13manylinux: glibc 2.34+ ARM64

bikkuri-0.2.0rc9-cp312-cp312-manylinux_2_34_aarch64.whl (284.7 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.34+ ARM64

bikkuri-0.2.0rc9-cp311-cp311-manylinux_2_34_aarch64.whl (286.8 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.34+ ARM64

File details

Details for the file bikkuri-0.2.0rc9-cp314-cp314-manylinux_2_34_aarch64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc9-cp314-cp314-manylinux_2_34_aarch64.whl
Algorithm Hash digest
SHA256 1d0346f78d1475bacb5f0760c9c8f708bd9f4a3a6007a8b2c63b299b0fd09372
MD5 9e30257462c64e0151e536de8b9d6d3f
BLAKE2b-256 1e10434e391791641c77092c8d25e0901a066599f61c18badbbb1ac3bfbb50c1

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc9-cp313-cp313-manylinux_2_34_aarch64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc9-cp313-cp313-manylinux_2_34_aarch64.whl
Algorithm Hash digest
SHA256 74c5114f2975fbf97711b044471cc5d5528046c6e99de217bae2166595e1a927
MD5 c32ddcd3cba5259a181008b2f0070c93
BLAKE2b-256 414d2f11942301522b77a431c8164e248ab72231585c95aeb761504bb12b575e

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc9-cp312-cp312-manylinux_2_34_aarch64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc9-cp312-cp312-manylinux_2_34_aarch64.whl
Algorithm Hash digest
SHA256 d5a9a48556ac4c4bff94b9bf737017d9aaa8f755d10ada5af33a7be81b0d0896
MD5 16183a11aee9aa705e69727e487cb38e
BLAKE2b-256 26e3fdfe4921bb2490aee019b97208e60dee467a3db48a614eec8fc3ae9312e2

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc9-cp311-cp311-manylinux_2_34_aarch64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc9-cp311-cp311-manylinux_2_34_aarch64.whl
Algorithm Hash digest
SHA256 5b29e2073fcda7c053dfe42a7d272239d5949c80580b6739237056de4006d15b
MD5 28af8b4e33800d7d187f8ad6d94f5e75
BLAKE2b-256 b2f5510c0fe9da62e23ea01558cdeae22879fe207be0f3e062d4b89907848eec

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page