Skip to main content

Add file-based data transfer to server for offline-use

Project description

pypi travis coverage

django-collect-offline-files

Transfer django_collect_offline transactions as files using SFTP over an SSH connection.

Data flows from client to server where a server is either a node server or the central server.

see also django_collect_offline.

Usage

On the client:

python manage.py export_transactions

On the server or receiving host:

python manage.py incoming_observer

python manage.py deserialize_observer

FileQueueObservers

Two FileQueueObservers do the work using use watchdog observers; IncomingTransactionsFileQueueObserver and DeserializeTransactionsFileQueueObserver. They are called using management commands:

python manage.py incoming_observer

and

python manage.py deserialize_observer

IncomingTransactionsFileQueueObserver

The client exports data to JSON and sends to the server. Using TransactionExporter, data is exported into a JSON file from django_collect_offline.models.OutgoingTransaction on the client and sent to the server using TransactionFileSender.

Once a file is sent to the server, the IncomingTransactionsFileQueueObserver detects it and adds the filename to the queue (IncomingTransactionsFileQueue).

DeserializeTransactionsFileQueue

Processed files in the queue IncomingTransactionsFileQueue are moved to the pending folder watched by DeserializeTransactionsFileQueueObserver.and added to the its queue, DeserializeTransactionsFileQueue.

Processing queue items / filenames

Each queue has a processor, (see process_queue). The processor calls the next_task method for each item in the queue in FIFO order infinitely or until it gets a None item.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
django-collect-offline-files-0.1.21.macosx-10.13-x86_64.tar.gz (77.7 kB) Copy SHA256 hash SHA256 Source None
django_collect_offline_files-0.1.21-py3-none-any.whl (53.1 kB) Copy SHA256 hash SHA256 Wheel py3

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page