Skip to main content

Calculate the surprisal of words in texts.

Project description

Bikkuri

Calculate the surprisal of words in texts.

Tests pypi Version

Usage

Python

from bikkuri.ngram import NGramSurprisal


unigram_surprisal = NGramSurprisal(1)
unigram_surprisal.fit([
    ["lorem", "ipsum", "dolor", "sit", "amet", ...],
    ["convallis", "fringilla", "dignissim", "massa", ...],
    ...
])

unigram_surprisal.surprisal([["lorem", "ipsum", "dolor"]])

Rust

extern crate bikkuri;
use bikkuri::ngram::NGramSurprisal;

let mut unigram_surprisal = NGramSurprisal::new(1);
unigram_surprisal.fit(&vec![
    vec!["lorem", "ipsum", "dolor", "sit", "amet", ...],
    vec!["convallis", "fringilla", "dignissim", "massa", ...],
    ...
]);
unigram_surprisal.surprisal(&vec![vec!["lorem", "ipsum", "dolor"]]);

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

bikkuri-0.2.0rc20-cp314-cp314-macosx_11_0_universal2.whl (253.1 kB view details)

Uploaded CPython 3.14macOS 11.0+ universal2 (ARM64, x86-64)

bikkuri-0.2.0rc20-cp313-cp313-win_amd64.whl (151.1 kB view details)

Uploaded CPython 3.13Windows x86-64

bikkuri-0.2.0rc20-cp313-cp313-manylinux_2_34_aarch64.whl (284.8 kB view details)

Uploaded CPython 3.13manylinux: glibc 2.34+ ARM64

bikkuri-0.2.0rc20-cp312-cp312-win_amd64.whl (151.1 kB view details)

Uploaded CPython 3.12Windows x86-64

bikkuri-0.2.0rc20-cp312-cp312-manylinux_2_34_x86_64.whl (290.6 kB view details)

Uploaded CPython 3.12manylinux: glibc 2.34+ x86-64

bikkuri-0.2.0rc20-cp312-cp312-macosx_11_0_universal2.whl (253.0 kB view details)

Uploaded CPython 3.12macOS 11.0+ universal2 (ARM64, x86-64)

File details

Details for the file bikkuri-0.2.0rc20-cp314-cp314-macosx_11_0_universal2.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc20-cp314-cp314-macosx_11_0_universal2.whl
Algorithm Hash digest
SHA256 4cf7c9330e0d62fcca078f40b26e99ba84f613c8955c88a4ca330f6b24b7a879
MD5 c05acc344c2cb2bfc2e84a05ccaff2cc
BLAKE2b-256 dee3287f4bb69dd1920fc4e03c458f067fee0b619afd809939348bb6a70a71ad

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc20-cp313-cp313-win_amd64.whl.

File metadata

  • Download URL: bikkuri-0.2.0rc20-cp313-cp313-win_amd64.whl
  • Upload date:
  • Size: 151.1 kB
  • Tags: CPython 3.13, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.13

File hashes

Hashes for bikkuri-0.2.0rc20-cp313-cp313-win_amd64.whl
Algorithm Hash digest
SHA256 ab091a13dd286acf1b0a5aaf9956e290a984e0e1db08897ed88a42374caa637a
MD5 1ce20a9919d8e9804b89d01c46f42d25
BLAKE2b-256 ceb915c8690b469e4df78fa426d6d07dcc713605e166399fde3dc2332354b0f2

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc20-cp313-cp313-manylinux_2_34_aarch64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc20-cp313-cp313-manylinux_2_34_aarch64.whl
Algorithm Hash digest
SHA256 97606e432318ff2142cb20e0b82506c148da9b032a974c49a9c3e8e78745d35d
MD5 f498b55cf2029b88591f6a3d9e3334bf
BLAKE2b-256 33b4b7cfd531b239a22edf9a41237e5b7b7923368da3a97a6a526ad5444d6237

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc20-cp312-cp312-win_amd64.whl.

File metadata

  • Download URL: bikkuri-0.2.0rc20-cp312-cp312-win_amd64.whl
  • Upload date:
  • Size: 151.1 kB
  • Tags: CPython 3.12, Windows x86-64
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.10

File hashes

Hashes for bikkuri-0.2.0rc20-cp312-cp312-win_amd64.whl
Algorithm Hash digest
SHA256 8223b4248f12027f758d1303223c92711504c4ddd07beae207608a5d3ea1b659
MD5 950520d6f9438cba85aac344fbe95bbb
BLAKE2b-256 eadd42a80abdc7bae2b86c7fe11389bf30b04504d390dc83f2428d5a14ef6fec

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc20-cp312-cp312-manylinux_2_34_x86_64.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc20-cp312-cp312-manylinux_2_34_x86_64.whl
Algorithm Hash digest
SHA256 8f0cc978c926a698c80c0ac5914e79beb73f953dde1c418a70ceafac8b0617af
MD5 7aafc4b0086bf04bc67d633bd5094bf7
BLAKE2b-256 63c3f60dfd026330090e1a44a243f5991f855ab4768d69da4706c88dc9f60ceb

See more details on using hashes here.

File details

Details for the file bikkuri-0.2.0rc20-cp312-cp312-macosx_11_0_universal2.whl.

File metadata

File hashes

Hashes for bikkuri-0.2.0rc20-cp312-cp312-macosx_11_0_universal2.whl
Algorithm Hash digest
SHA256 905a5d6204eec73598306858c81067f39290589080439929ada045b6ce1369e0
MD5 dd0612cf9aa408d7ec9202d0329275cb
BLAKE2b-256 c0259ab5b966a36b3448987d9f3417134bb3e30e81fb47c3bc56a7f86383304f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page