Skip to main content

Calculate the surprisal of words in texts.

Project description

Bikkuri

Calculate the surprisal of words in texts.

Tests pypi Version

Usage

Python

from bikkuri.ngram import NGramSurprisal


unigram_surprisal = NGramSurprisal(1)
unigram_surprisal.fit([
    ["lorem", "ipsum", "dolor", "sit", "amet", ...],
    ["convallis", "fringilla", "dignissim", "massa", ...],
    ...
])

unigram_surprisal.surprisal([["lorem", "ipsum", "dolor"]])

Rust

extern crate bikkuri;
use bikkuri::ngram::NGramSurprisal;

let mut unigram_surprisal = NGramSurprisal::new(1);
unigram_surprisal.fit(&vec![
    vec!["lorem", "ipsum", "dolor", "sit", "amet", ...],
    vec!["convallis", "fringilla", "dignissim", "massa", ...],
    ...
]);
unigram_surprisal.surprisal(&vec![vec!["lorem", "ipsum", "dolor"]]);

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

bikkuri-0.2.0rc19-cp314-cp314-win_amd64.whl (155.2 kB view details)

Uploaded CPython 3.14Windows x86-64

bikkuri-0.2.0rc19-cp314-cp314-manylinux_2_34_aarch64.whl (283.7 kB view details)

Uploaded CPython 3.14manylinux: glibc 2.34+ ARM64

bikkuri-0.2.0rc19-cp313-cp313-manylinux_2_34_aarch64.whl (284.7 kB view details)

Uploaded CPython 3.13manylinux: glibc 2.34+ ARM64

bikkuri-0.2.0rc19-cp311-cp311-macosx_11_0_universal2.whl (254.8 kB view details)

Uploaded CPython 3.11macOS 11.0+ universal2 (ARM64, x86-64)

File details

Details for the file bikkuri-0.2.0rc19-cp314-cp314-win_amd64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc19-cp314-cp314-win_amd64.whl
Algorithm Hash digest
SHA256 4e31490ab3b06b60475e42a72a6ca18e1ed8318d08522c57a0c6d6339091dace
MD5 82ee8ce6dbbab2a053b9157c30df801a
BLAKE2b-256 c743b89c2bf887f643c4b7bc79b487f8a7d40000ce13b876cd5255c78848bf4c

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc19-cp314-cp314-manylinux_2_34_aarch64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc19-cp314-cp314-manylinux_2_34_aarch64.whl
Algorithm Hash digest
SHA256 ba8f46f8dd7c1b08c42b5b950d096a7b64c6c607a9c15dc6f65dcb8edcbfc2a6
MD5 b79873a7a6234b82e539042805659bd7
BLAKE2b-256 72322f2e1cc86ec923bdd18ae9f659552cfaf5703270463fc5af20d0654203a9

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc19-cp313-cp313-manylinux_2_34_aarch64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc19-cp313-cp313-manylinux_2_34_aarch64.whl
Algorithm Hash digest
SHA256 00faebfd07e939bfd6e19126e0ed33f4651e5b616e9b4410497f8bbad03db7ab
MD5 74ce94a799dab7f974f6230982f4fac7
BLAKE2b-256 40fcaf15e022bfc2c1cf7cef5198242b010899b5dc37931c8bef620b3e69d559

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc19-cp311-cp311-macosx_11_0_universal2.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc19-cp311-cp311-macosx_11_0_universal2.whl
Algorithm Hash digest
SHA256 480a9de15f2ea77490d26e27cb218fa1eb12205644b231d6a92d078e0b43337d
MD5 8ac205bae36bbdf9d7f85a6199c351a7
BLAKE2b-256 058b157b86384035e5e4bea5f1d6caa5a14c5de600ea4fe880389658cc185f78

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page