Scraipe scrapers for cyber research.
Project description
scraipe-cyber
Scraipe scrapers for cyber research. Features UkraineCyberMultiScraper which orchestrates news article, Cert UA API, and Telegram scraping.
Installation
Ensure you have Python>=3.10 installed. Run pip install scraipe-cyber.
Example Usage
# Configure a TelegramMessageScraper to use within a UkraineCyberMultiScraper
telegram_scraper = TelegramMessageScraper(telegram_api_id, telegram_api_hash, telegram_phone_number, session_name="my_session")
ukraine_scraper = UkraineCyberMultiScraper(telegram_message_scraper=telegram_scraper)
ukraine_scraper can be plugged into a Scraipe workflow.
See ukraine_europoc_research.ipynb for a use case with LLM location extraction.
Contributing
Contributions are welcome. Please open an issue or submit a pull request for improvements.
Maintainer
This project is maintained by nibs.
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file scraipe_cyber-0.1.3.tar.gz.
File metadata
- Download URL: scraipe_cyber-0.1.3.tar.gz
- Upload date:
- Size: 3.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/2.1.2 CPython/3.12.9 Linux/5.15.167.4-microsoft-standard-WSL2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
312a3dc597b7da563b98e964051c125ae5245b90c821ad600c9058335753fb6d
|
|
| MD5 |
3c74af98269f88e201fe46df518d5143
|
|
| BLAKE2b-256 |
35296572451d43140dc66079002942984a4304694e0a1e4bd111d8b320574330
|
File details
Details for the file scraipe_cyber-0.1.3-py3-none-any.whl.
File metadata
- Download URL: scraipe_cyber-0.1.3-py3-none-any.whl
- Upload date:
- Size: 5.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/2.1.2 CPython/3.12.9 Linux/5.15.167.4-microsoft-standard-WSL2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3f05a823cfd47bd3dcde622d518d20db1cb89072f527fe4d644419f8bf161329
|
|
| MD5 |
53098e4906f90da34c065faf21d48afe
|
|
| BLAKE2b-256 |
fe598ecc55583944b3c5ec187b3deb7d17b55d8c3c6c9b43fb5dcb1645c0a5dd
|
