drupal-download 0.0.9

Python support

Only Python 3 is supported at the moment. Let Python 2 die in quiet dignity!

Drupal support

Currently Drupal 7 and 8 are supported. In theory this module could work with previous versions of Drupal and it might work with some future ones as well. Your mileage can vary.

Installation

This package is available on PyPi. Simply use pip to install (assuming you are running in a Python 3 virtual environment):

pip install drupal_download

On a Drupal web site

First, you must enable a JSON-based REST API in Drupal. Naturally, both 7 and 8 will have different ways to achieve this (evil laughter!).

Make the relevant configuration changes and take node of the APIs endpoints. Make sure you configure the desired authentication controls. At the moment, the module supports these methods:

• Anonymous - no authentication is needed. This also means that anyone can access you endpoint and download the data

• HTTP Basic - the standard basic authentication

• Session - cookie-driven authentication, the same in fact, that you use when accessing a Drupal site interactively

NB: I very strongly recommend using HTTPS for all these communications. If you don’t have an SSL certificate yet and can’t afford one, get one for free from Letsencrypt.

Drupal 7

For Drupal 7 you should use the Services module.

Drupal 8

While the same services module has a version for Drupal 8, it doesn’t work. It looks like a port job abandoned in the middle. However, Drupal 8 includes a support for RESTful APIs in the core. Naturally, it works a bit differently from the services module. In particular, services exposes an index view of, say, nodes. This view contains only the bare bones information about each node. It also has a link to the view with the full details, which the module follows. Drupal 8 RESTful API on the other hand can export all the fields in the main view. Read more about it here. Note, that the half cooked Drupal 8 services port causes the built in RESTful API to break somehow, if enabled. For faster downloads you are advised to use larger page sizes in the view configuration.

In a script

You can use the API from this module directly, in this manner:

def data_callback(obj):
    # process the data

dl = Drupal7DadaDownloader("https://www.example.com/export/node.json", "john", "123", AuthType.CookieSession, data_callback)
dl.load_data()

From the command line

Alternatively, there is a simple command line tool shipped with this module. You can invoke it like this:

python3 -m download_drupal --help

This will display some help information. Calling it like this:

python3 -m download_drupal -b https://www.example.com/export/node.json --username jane --password secret --auth-type CookieSession -o example_node.json --drupal-version 7

will download all nodes from a Drupal 7 website.