Skip to main content

Calculate the surprisal of words in texts.

Project description

Bikkuri

Calculate the surprisal of words in texts.

Tests pypi Version

Usage

Python

from bikkuri.ngram import NGramSurprisal


unigram_surprisal = NGramSurprisal(1)
unigram_surprisal.fit([
    ["lorem", "ipsum", "dolor", "sit", "amet", ...],
    ["convallis", "fringilla", "dignissim", "massa", ...],
    ...
])

unigram_surprisal.surprisal([["lorem", "ipsum", "dolor"]])

Rust

extern crate bikkuri;
use bikkuri::ngram::NGramSurprisal;

let mut unigram_surprisal = NGramSurprisal::new(1);
unigram_surprisal.fit(&vec![
    vec!["lorem", "ipsum", "dolor", "sit", "amet", ...],
    vec!["convallis", "fringilla", "dignissim", "massa", ...],
    ...
]);
unigram_surprisal.surprisal(&vec![vec!["lorem", "ipsum", "dolor"]]);

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

bikkuri-0.2.0rc8-cp314-cp314-manylinux_2_34_x86_64.whl (289.3 kB view details)

Uploaded CPython 3.14manylinux: glibc 2.34+ x86-64

bikkuri-0.2.0rc8-cp311-cp311-manylinux_2_34_x86_64.whl (292.3 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.34+ x86-64

bikkuri-0.2.0rc8-cp311-cp311-manylinux_2_34_aarch64.whl (286.9 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.34+ ARM64

File details

Details for the file bikkuri-0.2.0rc8-cp314-cp314-manylinux_2_34_x86_64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc8-cp314-cp314-manylinux_2_34_x86_64.whl
Algorithm Hash digest
SHA256 2f4fe6652c34b095a49542d6ac99040719b77dbad5e67d587e9ad37b54bcf2d5
MD5 d54c3b436c6eaf7535cc04e7f7dab671
BLAKE2b-256 90f83a1b55450320781a5f780202b076c6c25732c14a1b78debaa6d67ccddb9c

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc8-cp311-cp311-manylinux_2_34_x86_64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc8-cp311-cp311-manylinux_2_34_x86_64.whl
Algorithm Hash digest
SHA256 d6a2b3cf38e5eff9c5d6e7e397106fdbaf0cf632a5e7fbd6972e0c5e4c9f21ad
MD5 45670f9567e9fc2ad4d9d22157947ab6
BLAKE2b-256 5f9f1c1c173a2e3e9d40d70f97f8b7c92d6ceeb6a8e9e8ad3b24da7a21ccc36e

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc8-cp311-cp311-manylinux_2_34_aarch64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc8-cp311-cp311-manylinux_2_34_aarch64.whl
Algorithm Hash digest
SHA256 03ac1209b749f5a1976d152a19b46da77bf0232a982f41b75b3c9026f836246f
MD5 2ec5f3cc7bde6613b00a611f1169046f
BLAKE2b-256 4eea6a9bb9a6d13bbe367c5fc9e286e9d3c264250499f3bfcbfc235a61a7b48d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page