asynchronously scrapes eksisozluk threads and exports to csv or json
Project description
eksi-scraper
asynchronously scrapes eksisozluk threads in python, and puts entries in a csv or json file, named after the thread. intended for educational purposes only.
installation
uv pip install eksi-scraper
or with pip:
pip install eksi-scraper
usage
eksi-scraper -t [thread1] [thread2] ... -f [inputFile.txt] -o (csv or json)
you can pass full URLs or just the slug (the part of the url after '/' and before '?'). for example:
eksi-scraper -t https://eksisozluk.com/murat-kurum--2582131 https://eksisozluk.com/ekrem-imamoglu--2577439 -o json
or using slugs:
eksi-scraper -t murat-kurum--2582131 ekrem-imamoglu--2577439 -o json
or from a file:
eksi-scraper -f threads.txt -o csv
where in threads.txt, threads are listed as URLs or slugs, one per line:
https://eksisozluk.com/murat-kurum--2582131
ekrem-imamoglu--2577439
...
contact
reach out to me at ceylaniberkay@gmail.com
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file eksi_scraper-0.1.0.tar.gz.
File metadata
- Download URL: eksi_scraper-0.1.0.tar.gz
- Upload date:
- Size: 6.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.11.2 {"installer":{"name":"uv","version":"0.11.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
1ce1dfd11d9ef5efbefdb6a32f9142f010d4e76a9173e7a0342e3a3af15ed6ab
|
|
| MD5 |
5d6485156f0498414162084f4602c16e
|
|
| BLAKE2b-256 |
89873130380e922b733293e7414b6b6a890ad368b0e2ba80c4d5286e6e332555
|
File details
Details for the file eksi_scraper-0.1.0-py3-none-any.whl.
File metadata
- Download URL: eksi_scraper-0.1.0-py3-none-any.whl
- Upload date:
- Size: 7.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.11.2 {"installer":{"name":"uv","version":"0.11.2","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
ffd366f8675a14b84def25d64e0865007e0ace77983017df59b70c9efcc574a5
|
|
| MD5 |
d238687a243571ff69308ff348af8c8c
|
|
| BLAKE2b-256 |
e24a21b1bbd3c5dec01bd7a3b33f39f7ead89c87d96a2b24b97c9a8642c5b4d0
|
