Skip to main content

Reddit Gateway API Library

Project description

GateRed

A library to fetch Reddit data using Reddit WebAPI (gateway), w/ pushshift historical submissions support.

Latest Version Supported Python Versions CI Code style: black GitHub license

Documentation · Replit Playground

Why this library?

Although there are existing libraries (e.g. praw) to interact with Reddit developer's API, there are still several drawbacks when we trying to collect vast amount of data. gatered tries to counter these problems to provide these features:

  • No authentication (API key) is needed to access the data.
  • Extra attributes is presented using the Reddit webAPI compared to the public devAPI.
  • Fully Async based.
  • Proxy support via httpx.

Install

You can install this library easily from pypi:

# with pip
pip install gatered

# with poetry
poetry add gatered

Using

The library provides easy functions to get start fast:

  • gatered.func.get_post_comments
  • gatered.func.get_posts_with_subreddit_info
  • gatered.func.get_posts
  • gatered.func.get_comments
  • gatered.func.get_pushshift_posts

Alternatively you can directly use gatered.client.Client and gatered.pushshift.PushShiftAPI classes as your base to implement your own logics.

Errors can be handled by importing either gatered.RequestError or gatered.HTTPStatusError, see httpx exceptions to learn more.

See examples/ for more examples. Alternately, you can fork the example repo on Replit and play around online.

License

Copyright 2022 CounterTek

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gatered-1.3.1.tar.gz (12.9 kB view details)

Uploaded Source

Built Distribution

gatered-1.3.1-py3-none-any.whl (15.6 kB view details)

Uploaded Python 3

File details

Details for the file gatered-1.3.1.tar.gz.

File metadata

  • Download URL: gatered-1.3.1.tar.gz
  • Upload date:
  • Size: 12.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.1.13 CPython/3.8.2 Linux/5.13.0-1021-azure

File hashes

Hashes for gatered-1.3.1.tar.gz
Algorithm Hash digest
SHA256 ce2080c3e1bfa5de03fd29df006921c86ef3a28bb341e4af2520e50cdc59f523
MD5 17b758274a207be5b9dd724aa0782954
BLAKE2b-256 2c4d46df1f320b6b1e586931cc08631223c65606996aa0d212992fa6779eb221

See more details on using hashes here.

File details

Details for the file gatered-1.3.1-py3-none-any.whl.

File metadata

  • Download URL: gatered-1.3.1-py3-none-any.whl
  • Upload date:
  • Size: 15.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.1.13 CPython/3.8.2 Linux/5.13.0-1021-azure

File hashes

Hashes for gatered-1.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 452e283219362cb02dbeae4c2177f4cb6d2c2f821fe7c68efa4407aec55cec2d
MD5 25ab5de2cfa5e209ad8c7ccc4446dae7
BLAKE2b-256 24208433f0503337e91119069fcff8123360fdee974d0fb126582c1e3f2bf284

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page