tfds-korean
A collection of Korean Text Datasets ready to use using Tensorflow-Datasets.
TensorFlow-Datasets를 이용한 한국어/한글 데이터셋 모음입니다.
Dataset Catalog | pypi | CONTRIBUTING.md
Usage
Installation
pip install tfds-korean
Loading dataset
import tensorflow_datasets as tfds
import tfds_korean.nsmc # register nsmc dataset
ds = tfds.load('nsmc')
train_ds = ds['train'].batch(32)
test_ds = ds['test'].batch(128)
# define model
# ....
# ....
model.fit(train_ds)
model.evaluate(test_ds)
See Dataset Catalog page for dataset list and details of each dataset.
Examples
Licenses
The license for this repository and licenses for datasets are applied separately. It is recommended to use each dataset after checking the dataset's website.
본 레포지토리의 라이선스와 데이터셋의 라이선스는 별도로 적용됩니다. 데이터셋을 사용하기 전 각 데이터셋의 라이선스와 웹 사이트를 확인 후 사용하시길 권해드리며, 본 라이브러리는 데이터셋을 호스팅하거나 배포하지 않는 점을 참고부탁드립니다.
1 maintainer
Metadata
1 maintainer
Release files for tfds-korean 0.4.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| tfds-korean-0.4.0.tar.gz | 120.5 kB | Without provenance | Details for tfds-korean-0.4.0.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| tfds_korean-0.4.0-py3-none-any.whl | Python 3 | none | any | Details for tfds_korean-0.4.0-py3-none-any.whl |
Total release size: 281.6 kB
Release files / tfds-korean-0.4.0.tar.gz
| Download URL | tfds-korean-0.4.0.tar.gz |
|---|---|
| Size | 120.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
1c6235f9546fa2dd754dd817a77a53823cb7c2a97ccebf29d3affdcdd32d92c7
|
|
BLAKE2b-256 checksum How to use checksums |
c6e6d88b09c0ad631d4e5a96f1db66e5838ceeceadd93becdc5032e3bdb7a398
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.1 importlib_metadata/3.10.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.8.7
|
Release files / tfds_korean-0.4.0-py3-none-any.whl
| Download URL | tfds_korean-0.4.0-py3-none-any.whl |
|---|---|
| Size | 161.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
9b0cff8dd24a84bd72a34e1ff18d66d62453c4542cbd35f4a8b38fedbcbef0b1
|
|
BLAKE2b-256 checksum How to use checksums |
c6e6f6417343bbfb3da22ecbf992396a697b7d28f77e781d201c25946ec1804b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.1 importlib_metadata/3.10.1 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.60.0 CPython/3.8.7
|
Security for tfds-korean 0.4.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
