Skip to main content

Fast delta encoding using xdelta3

Project description

BuildStatus Coverage pypi

Fast delta encoding in python using xdelta3.

Requirements

  • Python 3.6
  • linux

Usage

import xdelta3
value_one = b'this is a wonderful string to demonstrate with. Much of the two strings is duplicated.'
value_two = b'this is a different string to demonstrate with. Much of the two strings is duplicated.'
delta = xdelta3.encode(value_one, value_two)

print(f'New string length: {len(value_two)}, delta length: {len(delta)}')
value_two_rebuilt = xdelta3.decode(value_one, delta)
if value_two_rebuilt == value_two:
    print('Boo Ya! Delta encoding successful.')

How fast?

xdelta3-python is a thing wrapper around xdelta 3.1.1 which is a highly optimised c library for delta encoding calculation and compression.

It can encode a delta and decode it again for 5 small changes in a 5.4M character string (the complete works of shakespeare) in around 30ms. Boom. See performance.py.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for xdelta3, version 0.0.1
Filename, size File type Python version Upload date Hashes
Filename, size xdelta3-0.0.1.tar.gz (4.6 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page