Skip to main content

django-overcomingbias-api: an API to Robin Hanson’s content

django-overcomingbias-api is a standalone Django app which lets you create and manage an API to (some of) Robin Hanson’s content.

It scrapes the overcomingbias blog (and other sites) and presents the data in a structured form via a REST API. (I may add a GraphQL API later, too.)

Basic Usage

Legacy blog imports

The obscraper dependency targets the former WordPress blog. Its repository was archived after the blog moved to Substack in 2023, and its live post and edit-date fetching no longer works. This compatibility update preserves access to previously stored content; it does not add a Substack importer. The pull/sync instructions below describe the legacy interface.

Tests of legacy post assembly, database updates and exports use synthetic obscraper.Post responses at the download boundary. They still exercise the real application implementations, but do not verify live blog importing. Other live essay/YouTube/Spotify tests retain their existing credential requirements.

A graphical user interface is provided through the Django admin site.

To initialise a database of all overcomingbias posts, use the “pull” button:

Create and update overcomingbias posts from the admin site

Add new posts with “pull”, and update modified posts with “sync”. (You can also add content from YouTube and Spotify.)

Categorise content according to the “ideas” and “topics” it contains, or by generic “tags”. Use the admin site and custom Admin Actions to manage content.

Link the app in your URL config to access the REST API:

# urls.py

urlpatterns = [
    ...
    path("", include("obapi.urls")),
    ...
]

You should then be able to access the automatic API documentation at URL /api/docs.

Alternatively, provide your own views for each post:

# urls.py
from django.urls import path, register_converter
from obapi.converters import OBPostNameConverter
from myapp.views import ob_detail_view

register_converter(OBPostNameConverter, "ob_name")
urlpatterns = [
    ...
    path(
        "content/overcomingbias/<ob_name:item_id>",
        ob_detail_view, # custom view
        name="obcontentitem_detail",
    ),
    ...
]

Features

Currently, content can be scraped from the following sources:

  • The overcomingbias blog (added automatically)

  • Robin Hanson’s home page

  • YouTube videos (add videos manually using their URLs)

  • Spotify podcast episodes (add episodes manually using their URLs)

Documentation

Read the full documentation here, including the Installation and Getting Started Guide.

Bugs/Requests

Please use the GitHub issue tracker to submit bugs or request features.

Changelog

See the Changelog for a list of fixes and enhancements at each version.

License

Copyright (c) 2022 Christopher McDonald

Distributed under the terms of the MIT license.

All overcomingbias posts are copyright the original authors.

Metadata

Release files for django-overcomingbias-api 0.7.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for django-overcomingbias-api 0.7.1
File Size Uploaded Provenance Actions
django_overcomingbias_api-0.7.1.tar.gz 293.4 kB Without provenance Details for django_overcomingbias_api-0.7.1.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for django-overcomingbias-api 0.7.1
File Interpreter ABI Platform Actions
django_overcomingbias_api-0.7.1-py3-none-any.whl Python 3 none any Details for django_overcomingbias_api-0.7.1-py3-none-any.whl

Total release size: 335.4 kB

Release files / django_overcomingbias_api-0.7.1.tar.gz

Download URL django_overcomingbias_api-0.7.1.tar.gz
Size 293.4 kB
Tags Source
SHA-256 checksum
How to use checksums
576bcc2cfc28cfcd2fafcb16a8cd40d956e91e6df9ab1fc7fab0c0f64e197944
BLAKE2b-256 checksum
How to use checksums
25938e75141f0d25be12b1669745ccda9904d46eb6acb445740b43f63e1a4d97
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.16

Release files / django_overcomingbias_api-0.7.1-py3-none-any.whl

Download URL django_overcomingbias_api-0.7.1-py3-none-any.whl
Size 42.0 kB
Tags Python 3
SHA-256 checksum
How to use checksums
30439fcd130ea569460353907efd403b1d50b4facd0c531a21a136d9b8a8afc3
BLAKE2b-256 checksum
How to use checksums
5a697dd08e273d0f405de7646b5a32849b6d1bf5d55a87bcde83517859ab76fd
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.13.16

Security for django-overcomingbias-api 0.7.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page