Skip to main content

A Python library for interacting with 4chan in a programmatically-friendly way.

Project description

pychan master PyPI codecov

  1. Overview
  2. Installation
  3. Usage
    1. General Notes
    2. Setup
    3. Iterating Over Threads
    4. Search 4chan
    5. Get All Boards
    6. Fetch Posts for a Specific Thread
  4. pychan Models
    1. Threads
    2. Posts
    3. Files
    4. Posters
  5. Contributing

Overview

pychan is a Python client for interacting with 4chan. 4chan does not have an official API, and attempts to implement one by third parties have tended to languish, so instead, this library provides abstractions over interacting with (scraping) 4chan directly. pychan is object-oriented and its implementation is lazy where reasonable (using Python Generators) in order to optimize performance and minimize superfluous blocking I/O operations.

Installation

If you have Python >=3.10 and <4.0 installed, pychan can be installed from PyPI using something like

pip install pychan

Usage

General Notes

All 4chan interactions are throttled internally by sleeping the executing thread. If you execute pychan in a multithreaded way, you will not get the benefits of this throttling. pychan does not take responsibility for the consequences of excessive HTTP requests in such cases.

For all thread-level iteration shown below, the generators returned will maintain internal state about which page of 4chan you are currently on. Threads are fetched one page at a time up to page 10 (which is the highest page at which 4chan renders threads for any given board). Once page 10 is reached internally by the generator, it stops returning threads.

Setup

from pychan import FourChan, LogLevel, PychanLogger

# With all logging disabled (default)
fourchan = FourChan()

# Configure logging explicitly
logger = PychanLogger(LogLevel.INFO)
fourchan = FourChan(logger)

The rest of the examples in this README assume that you have already created an instance of the FourChan class as shown above.

Iterating Over Threads

# Iterate over all threads in /b/ lazily (Python Generator)
for thread in fourchan.get_threads("b"):
    # Iterate over all posts in each thread
    for post in fourchan.get_posts(thread):
        # Do stuff with the post
        print(post.text)

Search 4chan

# Iterate over all threads returned in the search results lazily (Python Generator)
for thread in fourchan.search(board="b", text="ylyl"):
    # The thread object is the same class as the one returned by get_threads()
    ...

Get All Boards

This function dynamically fetches boards from 4chan at call time.

boards = fourchan.get_boards()
# Sample return value:
# ['a', 'b', 'c', 'd', 'e', 'g', 'gif', 'h', 'hr', 'k', 'm', 'o', 'p', 'r', 's', 't', 'u', 'v', 'vg', 'vm', 'vmg', 'vr', 'vrpg', 'vst', 'w', 'wg', 'i', 'ic', 'r9k', 's4s', 'vip', 'qa', 'cm', 'hm', 'lgbt', 'y', '3', 'aco', 'adv', 'an', 'bant', 'biz', 'cgl', 'ck', 'co', 'diy', 'fa', 'fit', 'gd', 'hc', 'his', 'int', 'jp', 'lit', 'mlp', 'mu', 'n', 'news', 'out', 'po', 'pol', 'pw', 'qst', 'sci', 'soc', 'sp', 'tg', 'toy', 'trv', 'tv', 'vp', 'vt', 'wsg', 'wsr', 'x', 'xs']

Fetch Posts for a Specific Thread

Warning: this will NOT work if the thread has become "stale" in 4chan and has entered an "archived" state. This happens to almost all threads after they have gone inactive long enough. Therefore, it is recommended to use the iterating-based functionality shown above instead of doing what is shown below.

from pychan.models import Thread

# Instantiate a Thread instance with which to query for posts
thread = Thread("int", 168484869)

# Note: the thread contained within the returned posts will have all applicable metadata (such as
# title and sticky status), regardless of whether you provided such data above - pychan will
# "auto-discover" all metadata and include it in the post models' copy of the thread
posts = fourchan.get_posts(thread)

pychan Models

The following tables enumerate all the kinds of data that are available on the various models used by this library.

Also note that all model classes in pychan implement the following methods:

  • __repr__
  • __str__
  • __hash__
  • __eq__
  • __copy__
  • __deepcopy__

Threads

The table below corresponds to the pychan.models.Thread class.

Field Type Example Value(s)
thread.board str "b", "int"
thread.number int 882774935, 168484869
thread.title Optional[str] None, "YLYL thread"
thread.stickied bool True, False
thread.closed bool True, False

Posts

The table below corresponds to the pychan.models.Post class.

Field Type Example Value(s)
post.thread Thread pychan.models.Thread
post.number int 882774935, 882774974
post.timestamp datetime.datetime datetime.datetime
post.poster Poster pychan.models.Poster
post.text str ">be me\n>be bored\n>write pychan\n>somehow it works"
post.is_original_post bool True, False
post.file Optional[File] None, pychan.models.File

Posters

The table below corresponds to the pychan.models.Poster class.

Field Type Example Value(s)
poster.name str "Anonymous"
poster.is_moderator bool True, False
poster.id Optional[str] None, "BYagKQXI"
poster.flag Optional[str] None, "United States", "Canada"

Files

The table below corresponds to the pychan.models.File class.

Field Type Example Value(s)
file.url str "https://i.4cdn.org/pol/1658892700380132.jpg"
file.name str "wojak.jpg", "i feel alone.jpg"
file.size str "601 KB"
file.dimensions tuple[int, int] (1920, 1080), (800, 600)

Contributing

See CONTRIBUTING.md for developer-oriented information.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pychan-0.2.3.tar.gz (76.8 kB view details)

Uploaded Source

Built Distribution

pychan-0.2.3-py3-none-any.whl (22.9 kB view details)

Uploaded Python 3

File details

Details for the file pychan-0.2.3.tar.gz.

File metadata

  • Download URL: pychan-0.2.3.tar.gz
  • Upload date:
  • Size: 76.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.9.13

File hashes

Hashes for pychan-0.2.3.tar.gz
Algorithm Hash digest
SHA256 8e4075e7ddb69181e46edc1e84f2f6dd2bb72f3487e8c659a6d6c078d2958275
MD5 ae36df96a46e53960486d40bca9ca906
BLAKE2b-256 b3f30d4086d7825849ca852ff16754c756dc2b23d78c73ff31a9f08550b0bd76

See more details on using hashes here.

Provenance

File details

Details for the file pychan-0.2.3-py3-none-any.whl.

File metadata

  • Download URL: pychan-0.2.3-py3-none-any.whl
  • Upload date:
  • Size: 22.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.9.13

File hashes

Hashes for pychan-0.2.3-py3-none-any.whl
Algorithm Hash digest
SHA256 ffd11c0064a9671c059f602915a012ba97cddfa8d2bf0794ff6058acb8be2dcd
MD5 311677e09ba9b5ac1fe366dff3e8352c
BLAKE2b-256 7a742c8f3fa4375b6a5b774084f366e76b678c6476ec4a6b014e2172fff7e86b

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page