Purpose: This module is designed to make complex tasks accessible and convenient, even for beginners. By providing a unified set of tools, it simplifies the workflow for data collection, processing, and analysis. Whether you're scraping data from the web, cleaning text, or performing LLM-based NLP tasks, this module ensures you can focus on your research without getting bogged down by technical challenges.
Key Features:
- Web Scraping: Easily scrape data from websites and download multimedia content.
- Package Management: Install, uninstall, and manage Python packages with simple commands.
- Data Retrieval: Extract data from various file formats like text, JSON, CSV, TSV, XLSX, XML, TMX, and HTML (both online and offline).
- Data Storage: Write and append data to text files, Excel, JSON, TMX, and JSON lines.
- File and Folder Processing: Manage file paths, create directories, move or copy files, convert CSV to JSON, and search for files with specific keywords.
- Data Cleaning: Clean text, handle punctuation, remove stopwords, detect noisy text, convert Markdown strings into Python objects, and prepare data for analysis, utilizing valuable corpora and dictionaries such as CET-4/6 and TEM-8 vocabulary, BE21 and BNC-COCA word lists.
- NLP: Perform OCR, word tokenization, lemmatization, idiom extraction, POS tagging, NER, dependency parsing, ATE, MDD, WSD, LIWC, MIP analysis, text classification, and Chinese-English sentence alignment using prepared LLM prompts.
- Math Operations: Format numbers, convert decimals to percentages, and validate data.
- Visualization: Process images (e.g., make white pixels transparent, resize images) and manage fonts for rendering text.
Author: Dr. Guisheng Pan (潘贵生) is an instructor at the School of Foreign Studies, Shanghai University of Finance and Economics (SUFE). Email: panguisheng@sufe.edu.cn Homepage: https://sfs.sufe.edu.cn/bf/ef/c4221a245743/page.htm
1 maintainer
Release files for pgsfile 0.7.5
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| pgsfile-0.7.5.tar.gz | 42.4 MB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| pgsfile-0.7.5-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 86.5 MB
Release files / pgsfile-0.7.5.tar.gz
| Download URL | pgsfile-0.7.5.tar.gz |
|---|---|
| Size | 42.4 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
bac045c6b032287137233946be0d3ff0a6aa2140752401de3bbdd684ef86eaed
|
|
BLAKE2b-256 checksum How to use checksums |
dcf9a8db580640ff8d2959766d113fd74553eac2462b96f993e26ef0df477642
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.11.9
|
Release files / pgsfile-0.7.5-py3-none-any.whl
| Download URL | pgsfile-0.7.5-py3-none-any.whl |
|---|---|
| Size | 44.1 MB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
13a6aca39f591f0b77b733ae260405dcfe77b72bb16ea3bdbca9cb6522032626
|
|
BLAKE2b-256 checksum How to use checksums |
77cbfdb9c02fd5995acb34fa27485489f64a446d81bc0d60627b8ec1b0e66e8c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.11.9
|
