Korean News Scraper
Hello World! Korean News Scraper aims to be a Korean language data collection tool for LLM.
After version 0.1.1. is possible to use. Please do not use it before.
Build
$ python3 setup.py
Required Libraries
- beautifulsoup4
- selenium
- pandas
- requests
- tqdm
Quick Start
import korean_news_scraper
keywords = ["news", "happy", "environment"]
korean_news_scraper.save_article_links(keywords, "data", lang="en-EN")
korean_news_scraper.extract_article_content("data")
1 maintainer
Metadata
1 maintainer
Release files for korean-news-scraper 0.1.5
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| korean_news_scraper-0.1.5.tar.gz | 4.5 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| korean_news_scraper-0.1.5-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 10.1 kB
Release files / korean_news_scraper-0.1.5.tar.gz
| Download URL | korean_news_scraper-0.1.5.tar.gz |
|---|---|
| Size | 4.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
25ea2e4d4965f809e4eba89909f628167287dcef1eced6e2808140874c737387
|
|
BLAKE2b-256 checksum How to use checksums |
0b40eaa46802ddfb7217eaceec59e0fd2f94cbbf9ef6152bb0830a4cf9c0b3a8
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.0.0 CPython/3.10.12
|
Release files / korean_news_scraper-0.1.5-py3-none-any.whl
| Download URL | korean_news_scraper-0.1.5-py3-none-any.whl |
|---|---|
| Size | 5.6 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
b25f728e48a0e6bf79c06cad30fde4a7cb81b1d0743136d79f06e026d9a766b7
|
|
BLAKE2b-256 checksum How to use checksums |
aa724b7c7624209e0316c074711f91e77b0ba83bcaa7327ea4ae9ec3935d2c74
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.0.0 CPython/3.10.12
|
