Skip to main content

# A series of Chinese processing tools

  • There are some features in the package. If you need to use it can be installed directly

extract_chinese(self, text, symbols= “”, remove_letter=False)

  • Extract chinese from raw text. You can choose symbols to replace non-Chinese characters in the corpus

filter_words_in_corups(self, sensitive_list, raw_text_list)

  • Use AC automata to filter sensitive words

is_chinese(self, uchar)

  • Determine if a character is Chinese

get_json_data(self, path)

  • Read json data from a file, where each line is a Dict

save_data_to_npy(self, data, path)

  • read_data_from_npy(self, path)

Metadata

Release files for chptools 0.0.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for chptools 0.0.1
File Size Uploaded Provenance
chptools-0.0.1.tar.gz 2.4 kB Without provenance Details

Release files / chptools-0.0.1.tar.gz

Download URL chptools-0.0.1.tar.gz
Size 2.4 kB
Tags Source
SHA-256 checksum
How to use checksums
2caf0ee60e53a6b9b6f18b90f459838a20e2a36a31790b56a81d285a66c97343
BLAKE2b-256 checksum
How to use checksums
7edf3c766bdd725f34d30298feb4452aa95121563b9689f6cfe824f308db23cb
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.2.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.7.3

Security for chptools 0.0.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

Release history Release notifications | RSS feed

This release

0.0.1 This release

1 release file No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page