Purpose: This module is designed to make complex tasks accessible and convenient, even for beginners. By providing a unified set of tools, it simplifies the workflow for data collection, processing, and analysis. Whether you're scraping data from the web, cleaning text, or performing LLM-based NLP tasks, this module ensures you can focus on your research without getting bogged down by technical challenges.
Key Features:
- Web Scraping: Easily scrape data from websites and download multimedia content.
- Package Management: Install, uninstall, and manage Python packages with simple commands.
- Data Retrieval: Extract data from various file formats like text, JSON, CSV, TSV, XLSX, XML, TMX, and HTML (both online and offline).
- Data Storage: Write and append data to text files, Excel, JSON, TMX, and JSON lines.
- File and Folder Processing: Manage file paths, create directories, move or copy files, convert CSV to JSON, and search for files with specific keywords.
- Data Cleaning: Clean text, handle punctuation, remove stopwords, detect noisy text, convert Markdown strings into Python objects, and prepare data for analysis, utilizing valuable corpora and dictionaries such as CET-4/6 and TEM-8 vocabulary, BE21 and BNC-COCA word lists.
- NLP: Perform OCR, word tokenization, lemmatization, idiom extraction, POS tagging, NER, dependency parsing, ATE, MDD, WSD, LIWC, MIP analysis, text classification, and Chinese-English sentence alignment using prepared LLM prompts.
- Math Operations: Format numbers, convert decimals to percentages, and validate data.
- Visualization: Process images (e.g., make white pixels transparent, resize images) and manage fonts for rendering text.
Author: Dr. Guisheng Pan (潘贵生) is an instructor at the School of Foreign Studies, Shanghai University of Finance and Economics (SUFE). Email: panguisheng@sufe.edu.cn Homepage: https://sfs.sufe.edu.cn/bf/ef/c4221a245743/page.htm
1 maintainer
Metadata
1 maintainer
Release files for pgsfile 0.7.6
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| pgsfile-0.7.6.tar.gz | 42.4 MB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| pgsfile-0.7.6-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 86.5 MB
Release files / pgsfile-0.7.6.tar.gz
| Download URL | pgsfile-0.7.6.tar.gz |
|---|---|
| Size | 42.4 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
a64c078cde926b05bb3219cbb1622d17324bd4866deb7735b4d5f787cb5e4d84
|
|
BLAKE2b-256 checksum How to use checksums |
8f770204fb6decc82397ff943dd6461939e3d38b7f396237ec9dc58554acbc61
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.11.9
|
Release files / pgsfile-0.7.6-py3-none-any.whl
| Download URL | pgsfile-0.7.6-py3-none-any.whl |
|---|---|
| Size | 44.1 MB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
4a84ff246867640c3540ebb2d1920892cfe9bb12aa5e632f957b1c2858a6924c
|
|
BLAKE2b-256 checksum How to use checksums |
0e2cc9052b043545267fb20357d0819e9a2aeb7d9d16d84b62c36b75b3fa6333
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.11.9
|
