BulidDataset
数据集预处理
包含lm，孪生，seq2seq，文本分类，示例参考dataDome目录下
默认使用Bert 21128分词方案，如果想要修改自己的分词可以修改config下的词典方案。
Getting Started
Download links:
SSH clone URL: ssh://git@git.jetbrains.space/terrychanorg/yuxunlianlm-bert/BulidDataset.git
HTTPS clone URL: https://git.jetbrains.space/terrychanorg/yuxunlianlm-bert/BulidDataset.git
These instructions will get you a copy of the project up and running on your local machine for development and testing purposes.
Prerequisites
What things you need to install the software and how to install them.
Examples
Deployment
Add additional notes about how to deploy this on a production system.
Resources
Add links to external resources for this project, such as CI server, bug tracker, etc.
关于tkitDatasetEx
tkitDatasetEx各种函数
1 maintainer
Metadata
1 maintainer
Release files for tkitDatasetEx 0.0.0.116399031
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| tkitDatasetEx-0.0.0.116399031.tar.gz | 4.1 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| tkitDatasetEx-0.0.0.116399031-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 8.2 kB
Release files / tkitDatasetEx-0.0.0.116399031.tar.gz
| Download URL | tkitDatasetEx-0.0.0.116399031.tar.gz |
|---|---|
| Size | 4.1 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
6caf560569e833bed17fdeb4f587b97912c9b637e80533c6338ab2a39239c164
|
|
BLAKE2b-256 checksum How to use checksums |
605efe2fb3570076e4f294e603854056d550257eb96b8dae65846b39f7b18099
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.7.1 importlib_metadata/4.9.0 pkginfo/1.8.2 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.8.12
|
Release files / tkitDatasetEx-0.0.0.116399031-py3-none-any.whl
| Download URL | tkitDatasetEx-0.0.0.116399031-py3-none-any.whl |
|---|---|
| Size | 4.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
583263853a9a6f43d82d2e1c22d5fd93825e2ced3ef73e5e2cc3f528ed3c1c5b
|
|
BLAKE2b-256 checksum How to use checksums |
c1b0a2392fadeac98e30fa3c7be91ab179bf19904cc83422b71705055596eae0
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.7.1 importlib_metadata/4.9.0 pkginfo/1.8.2 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.3 CPython/3.8.12
|
