Purpose: This module is designed to make complex tasks accessible and convenient, even for beginners. By providing a unified set of tools, it simplifies the workflow for data collection, processing, and analysis. Whether you're scraping data from the web, cleaning text, or performing LLM-based NLP tasks, this module ensures you can focus on your research without getting bogged down by technical challenges.
Key Features:
- Web Scraping: Easily scrape data from websites and download multimedia content.
- Package Management: Install, uninstall, and manage Python packages with simple commands.
- Data Retrieval: Extract data from various file formats like text, JSON, CSV, TSV, XLSX, XML, TMX, and HTML (both online and offline).
- Data Storage: Write and append data to text files, Excel, JSON, TMX, and JSON lines.
- File and Folder Processing: Manage file paths, create directories, move or copy files, convert CSV to JSON, and search for files with specific keywords.
- Data Cleaning: Clean text, handle punctuation, remove stopwords, detect noisy text, convert Markdown strings into Python objects, and prepare data for analysis, utilizing valuable corpora and dictionaries such as CET-4/6 and TEM-8 vocabulary, BE21 and BNC-COCA word lists.
- NLP: Perform OCR, word tokenization, lemmatization, idiom extraction, POS tagging, NER, dependency parsing, ATE, MDD, WSD, LIWC, MIP analysis, text classification, and Chinese-English sentence alignment using prepared LLM prompts.
- Math Operations: Format numbers, convert decimals to percentages, and validate data.
- Visualization: Process images (e.g., make white pixels transparent, resize images) and manage fonts for rendering text.
Author: Dr. Guisheng Pan (潘贵生) is an instructor at the School of Foreign Studies, Shanghai University of Finance and Economics (SUFE). Email: panguisheng@sufe.edu.cn Homepage: https://sfs.sufe.edu.cn/bf/ef/c4221a245743/page.htm
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file pgsfile-0.7.5.tar.gz.
File metadata
- Download URL: pgsfile-0.7.5.tar.gz
- Upload date:
- Size: 42.4 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
bac045c6b032287137233946be0d3ff0a6aa2140752401de3bbdd684ef86eaed
|
|
| MD5 |
a01ad672c468688a8d13d61d66e2aa56
|
|
| BLAKE2b-256 |
dcf9a8db580640ff8d2959766d113fd74553eac2462b96f993e26ef0df477642
|
File details
Details for the file pgsfile-0.7.5-py3-none-any.whl.
File metadata
- Download URL: pgsfile-0.7.5-py3-none-any.whl
- Upload date:
- Size: 44.1 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.11.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
13a6aca39f591f0b77b733ae260405dcfe77b72bb16ea3bdbca9cb6522032626
|
|
| MD5 |
7316eaf58128675e61a01327abfe50e3
|
|
| BLAKE2b-256 |
77cbfdb9c02fd5995acb34fa27485489f64a446d81bc0d60627b8ec1b0e66e8c
|
