Skip to main content

Calculate the surprisal of words in texts.

Project description

Bikkuri

Calculate the surprisal of words in texts.

Tests pypi Version

Usage

Python

from bikkuri.ngram import NGramSurprisal


unigram_surprisal = NGramSurprisal(1)
unigram_surprisal.fit([
    ["lorem", "ipsum", "dolor", "sit", "amet", ...],
    ["convallis", "fringilla", "dignissim", "massa", ...],
    ...
])

unigram_surprisal.surprisal([["lorem", "ipsum", "dolor"]])

Rust

extern crate bikkuri;
use bikkuri::ngram::NGramSurprisal;

let mut unigram_surprisal = NGramSurprisal::new(1);
unigram_surprisal.fit(&vec![
    vec!["lorem", "ipsum", "dolor", "sit", "amet", ...],
    vec!["convallis", "fringilla", "dignissim", "massa", ...],
    ...
]);
unigram_surprisal.surprisal(&vec![vec!["lorem", "ipsum", "dolor"]]);

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

bikkuri-0.2.0rc7-cp311-cp311-manylinux_2_34_x86_64.whl (292.3 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.34+ x86-64

bikkuri-0.2.0rc7-cp311-cp311-manylinux_2_34_aarch64.whl (286.8 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.34+ ARM64

File details

Details for the file bikkuri-0.2.0rc7-cp311-cp311-manylinux_2_34_x86_64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc7-cp311-cp311-manylinux_2_34_x86_64.whl
Algorithm Hash digest
SHA256 9d53ad557104e5827fe17d6d0640d9b1962b9d775b79106e3590ff06b9c01ccf
MD5 ff14d262f253c0410ef62a6f974014be
BLAKE2b-256 f033a6be5c712780490b6aa08e8a9d9f2c1535dd819e13bffb38d81af96c419d

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc7-cp311-cp311-manylinux_2_34_aarch64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc7-cp311-cp311-manylinux_2_34_aarch64.whl
Algorithm Hash digest
SHA256 094e573e10b664e29ea523eefe7037354777eac7cbdf40066e4f03dd2ce3e72b
MD5 96c3706bc6631035b00a6af9a36a87d9
BLAKE2b-256 2ba3a4a0249fd14040852d782d4c3d83c264b462e343f34f01e636769578cd0b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page