Skip to main content

Calculate the surprisal of words in texts.

Project description

Bikkuri

Calculate the surprisal of words in texts.

Tests PyPI Version crates.io Version

Usage

Python

from bikkuri.ngram import NGramSurprisal


unigram_surprisal = NGramSurprisal(1)
unigram_surprisal.fit([
    ["lorem", "ipsum", "dolor", "sit", "amet", ...],
    ["convallis", "fringilla", "dignissim", "massa", ...],
    ...
])

unigram_surprisal.surprisal([["lorem", "ipsum", "dolor"]])

Rust

extern crate bikkuri;
use bikkuri::ngram::NGramSurprisal;

let mut unigram_surprisal = NGramSurprisal::new(1);
unigram_surprisal.fit(&vec![
    vec!["lorem", "ipsum", "dolor", "sit", "amet", ...],
    vec!["convallis", "fringilla", "dignissim", "massa", ...],
    ...
]);
unigram_surprisal.surprisal(&vec![vec!["lorem", "ipsum", "dolor"]]);

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

bikkuri-0.2.0rc32-cp313-cp313-win_arm64.whl (147.8 kB view details)

Uploaded CPython 3.13Windows ARM64

bikkuri-0.2.0rc32-cp311-cp311-manylinux_2_34_x86_64.whl (292.5 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.34+ x86-64

File details

Details for the file bikkuri-0.2.0rc32-cp313-cp313-win_arm64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc32-cp313-cp313-win_arm64.whl
Algorithm Hash digest
SHA256 5c19460863f59defad06eac7dd909e27f85ced5bd64c3ee26232b92f0f00950e
MD5 f90b37f1cc0055456d47e6831da9c088
BLAKE2b-256 f441c8cfbae5dc8d4a2a1ddf067d2511125ce03dcacb628f7630ef0e322d7e90

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc32-cp311-cp311-manylinux_2_34_x86_64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc32-cp311-cp311-manylinux_2_34_x86_64.whl
Algorithm Hash digest
SHA256 5ab972087610450b405f004ffe1a496a13f6db55bae7a3311867e7db962e2a06
MD5 63961790c941dc3d0a1e6169b98bd562
BLAKE2b-256 0a89e1822f179a61de085b4ec32cf39e100ea7ba9482e814c5987441743fd5af

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page