Skip to main content

Allennlp Integration for Shiba

CI Release Python PyPI

allennlp-shiab-model is a Python library that provides AllenNLP integration for shiba-model.

SHIBA is an approximate reimplementation of CANINE [1] in raw Pytorch, pretrained on the Japanese wikipedia corpus using random span masking. If you are unfamiliar with CANINE, you can think of it as a very efficient (approximately 4x as efficient) character-level BERT model. Of course, the name SHIBA comes from the identically named Japanese canine.

Installation

Installing the library and dependencies is simple using pip.

pip install allennlp-shiba

Example

This library enables users to specify the in a jsonnet config file. Here is an example of the model in jsonnet config file:

{
    "dataset_reader": {
        "tokenizer": {
            "type": "shiba",
        },
        "token_indexers": {
            "tokens": {
                "type": "shiba",
            }
        },
    },
    "model": {
        "shiba_embedder": {
            "type": "basic",
            "token_embedders": {
                "shiba": {
                    "type": "shiba",
                    "eval_model": true,
                }
            }

        }
    }
}

Reference

Metadata

Release files for allennlp-shiba 0.1.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for allennlp-shiba 0.1.1
File Size Uploaded Provenance Actions
allennlp-shiba-0.1.1.tar.gz 9.6 kB Without provenance Details for allennlp-shiba-0.1.1.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for allennlp-shiba 0.1.1
File Interpreter ABI Platform Actions
allennlp_shiba-0.1.1-py3-none-any.whl Python 3 none any Details for allennlp_shiba-0.1.1-py3-none-any.whl

Total release size: 21.0 kB

Release files / allennlp-shiba-0.1.1.tar.gz

Download URL allennlp-shiba-0.1.1.tar.gz
Size 9.6 kB
Tags Source
SHA-256 checksum
How to use checksums
ef960fd93daa426d5bf6e505044d62533cc11ea34381490f59e4b175929d5566
BLAKE2b-256 checksum
How to use checksums
ef7488a29b9a93eda9125abb787b6a1cc5c7053e186fc42c4264a738ef6caab8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.1.7 CPython/3.9.5 Linux/5.8.0-1033-azure

Release files / allennlp_shiba-0.1.1-py3-none-any.whl

Download URL allennlp_shiba-0.1.1-py3-none-any.whl
Size 11.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
e9a25373d154bd13568fce3f91f712cc038ebf6b97d0c091e9799b9932885eef
BLAKE2b-256 checksum
How to use checksums
f513dcbee8b8dc91e86a5fdf76c7f24aab4bc41bf9fbdd659c60606fe8431d46
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.1.7 CPython/3.9.5 Linux/5.8.0-1033-azure

Security for allennlp-shiba 0.1.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page