Skip to main content

mysql spliting/sharding tools

Project description

What is this?

Mysql query will become slow when table contains millions of rows. A simple way of solving this probolem is spliting the big table into small ones. We use some method to decide which table each row should be moved into. A widely used method is “modulus”, e.g. group rows by [ID mod 100]. This tool will help you to do this job easily.

Features

  • Move records from one table to another(or other) table(s) according to user specified rules.

  • Dynamically create new tables during moving.

  • Move records between different mysql servers.

  • Check data integrity of the new tables.

  • For records who have been moved to new tables, remove them from source table.

  • Using it as a python module which means dynamically changing the behavior.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

pymysql_split_tool-0.5.4-py2.py3-none-any.whl (11.5 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page