eksiminer is a Python package for scraping entries, topics, authors, and daily highlights from eksisozluk.com
Project description
eksiminer
A Python package for scraping Ekşi Sözlük - trending topics, entries, authors, and DEBE lists.
Installation
pip install eksiminer
Quick Start
from eksiminer import get_trending_topics
results = get_trending_topics(headless=True)
print(results[0])
Usage
Get Trending Topics
from eksiminer import get_trending_topics
# All trending topics
results = get_trending_topics(headless=True)
# Specific channel (spor, siyaset, iliskiler, etc.)
results = get_trending_topics(channel="siyaset", headless=True)
Get Topic Entries
from eksiminer import get_topic_entries
# Single topic
results = get_topic_entries(
topic="yapay zeka",
max_page_limit=2,
headless=True
)
# Multiple topics
results = get_topic_entries(
topic=["topic1", "topic2"],
max_page_limit=2,
headless=True
)
Get DEBE List
from eksiminer import get_debe_topics_list
results = get_debe_topics_list(headless=True)
Get Entry by URL
from eksiminer import get_entry_by_url
entry = get_entry_by_url("https://eksisozluk.com/entry/123456", headless=True)
Get Author Entries
from eksiminer import get_author_entries
entries = get_author_entries(
author="username",
number_endless_scroll=10,
headless=True
)
Reuse Driver (Faster)
from eksiminer import UCDriverClient, get_trending_topics, get_debe_topics_list
driver = UCDriverClient(headless=True)
trending = get_trending_topics(driver=driver)
debe = get_debe_topics_list(driver=driver)
driver.close()
LangChain Integration
pip install eksiminer langchain langchain-openai
from eksiminer.extensions.tools.langchain import (
get_trending_topics_tool,
get_topic_entries_tool,
get_debe_topics_list_tool,
get_entry_by_url_tool,
get_author_entries_tool
)
See TUTORIAL.md for detailed LangChain examples.
Documentation
- TUTORIAL.md - Comprehensive guide
- tutorial.ipynb - Interactive examples
License
MIT License
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file eksiminer-0.0.3.tar.gz.
File metadata
- Download URL: eksiminer-0.0.3.tar.gz
- Upload date:
- Size: 14.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.11.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2497cde5a1cf44890ef928fe6b0e21f1cdfcfcfcc38078e65f767a9ccdee664d
|
|
| MD5 |
fdc6ecec46f88b9027ff29b903446f96
|
|
| BLAKE2b-256 |
978837b413cf33551476ddea990c5e037cc6f689b999c35c2f11d449552a6397
|
File details
Details for the file eksiminer-0.0.3-py3-none-any.whl.
File metadata
- Download URL: eksiminer-0.0.3-py3-none-any.whl
- Upload date:
- Size: 19.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.11.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
54adb5d5c07ab708560438bde32f57e449b04a8ef35938fe34c3b0d4671ca185
|
|
| MD5 |
9186cd235c57ab97cd5327fc728dd81e
|
|
| BLAKE2b-256 |
988a6f3636e1f49cca936a3c533779112149b3db1b47ce53e1f698b59b1f1494
|