asynchronously scrapes eksisozluk threads and exports to csv or json
Project description
eksi-scraper
fast, asynchronous eksisozluk thread scraper. exports entries to csv or json.
installation
uv pip install eksi-scraper
or with pip:
pip install eksi-scraper
usage
eksi-scraper -t [thread1] [thread2] ... -f [inputFile.txt] -o (csv or json)
you can pass full URLs or just the slug (the part of the url after '/' and before '?'). for example:
eksi-scraper -t https://eksisozluk.com/murat-kurum--2582131 https://eksisozluk.com/ekrem-imamoglu--2577439 -o json
or using slugs:
eksi-scraper -t murat-kurum--2582131 ekrem-imamoglu--2577439 -o json
or from a file:
eksi-scraper -f threads.txt -o csv
where in threads.txt, threads are listed as URLs or slugs, one per line:
https://eksisozluk.com/murat-kurum--2582131
ekrem-imamoglu--2577439
...
output
each entry has the following fields:
| field | description |
|---|---|
| Content | the entry text, with full URLs restored |
| Author | username of the author |
| Date Created | original post date |
| Last Changed | last edit date, or null if never edited |
contact
reach out to me at ceylaniberkay@gmail.com
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file eksi_scraper-0.1.1.tar.gz.
File metadata
- Download URL: eksi_scraper-0.1.1.tar.gz
- Upload date:
- Size: 6.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.11.2 {"installer":{"name":"uv","version":"0.11.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b5b8c84228c4bedc9812b1f3f288a01407b1003fcda23e83493f9159700636e8
|
|
| MD5 |
64878d963f0f17bdf5d332a392716803
|
|
| BLAKE2b-256 |
2da5e93b3822ab9881f777c48b67d59de6b169d7611c9d918fa6672576f44c33
|
File details
Details for the file eksi_scraper-0.1.1-py3-none-any.whl.
File metadata
- Download URL: eksi_scraper-0.1.1-py3-none-any.whl
- Upload date:
- Size: 7.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.11.2 {"installer":{"name":"uv","version":"0.11.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
a202aa0f6e1bb75bd6610c7935be12824b83a302c8a5fd016418c610850b69b2
|
|
| MD5 |
91994fd01726173e326a6c78cbc6ff4d
|
|
| BLAKE2b-256 |
4ab70496c7e54fc4ea282bbd41eb640c9de73c123ad14746f576d29449a6ea89
|
