Skip to main content

tkitAutoTokenizerPosition

用于处理AutoTokenizer分词后位置修正,可用于BIO序列问题。

安装


pip install tkitAutoTokenizerPosition
# or
pip install git+https://github.com/napoler/tkit-AutoTokenizerPosition

示例

https://github.com/napoler/tkit-AutoTokenizerPosition/blob/master/demo.ipynb

文档查看 https://www.terrychan.org/tkit-AutoTokenizerPosition/

Metadata

Release files for tkitAutoTokenizerPosition 0.0.0.616340152

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for tkitAutoTokenizerPosition 0.0.0.616340152
File Size Uploaded
tkitAutoTokenizerPosition-0.0.0.616340152.tar.gz 10.1 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for tkitAutoTokenizerPosition 0.0.0.616340152
File Interpreter ABI Platform
tkitAutoTokenizerPosition-0.0.0.616340152-py3-none-any.whl Python 3 none any Details

Total release size: 20.6 kB

Release files / tkitAutoTokenizerPosition-0.0.0.616340152.tar.gz

Download URL tkitAutoTokenizerPosition-0.0.0.616340152.tar.gz
Size 10.1 kB
Tags Source
SHA-256 checksum
How to use checksums
4b61cdedd728902cfb9d5ac19cfe18294ee9c0f78899d0b309cfe3def690a60b
BLAKE2b-256 checksum
How to use checksums
569e41bbb692db7e2a9d8dd1c5e9e6d347f6af41f2dd3a138f7c381b2acc4069
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.8.12

Release files / tkitAutoTokenizerPosition-0.0.0.616340152-py3-none-any.whl

Download URL tkitAutoTokenizerPosition-0.0.0.616340152-py3-none-any.whl
Size 10.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
5fc9a7244e62400cfe5e10922ea3cb526cfb20f03056554fa96acfe5cfadef9f
BLAKE2b-256 checksum
How to use checksums
c86be4bb6bbd696f490f901de466297de35e6c2bf0e273b3072568b5b06352ba
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.8.12
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page