Skip to main content

elastic2-doc-manager

The mongo-connector project originated as a MongoDB mongo-labs project and is now community-maintained under the custody of YouGov, Plc.

This is just a fork for the original elastic2-doc-manager but it is attached to mongo-connector-transaction to fix the transaction sync issue

Getting Started

This package is a document manager for mongo-connector-transaction that targets Elasticsearch versions 2.x and 5.x – don’t let the name fool you! For information on running mongo-connector with Elasticsearch, please see the MongoConnector Usage with Elasticsearch wiki page.

Installation

The installation of the elastic2-doc-manager depends on which version of Elasticsearch you are targeting.

Elasticsearch 2.x

For use with an Elasticsearch 2.x server, install with pip:

pip install 'elastic2-doc-manager-transaction[elastic2]'

Elasticsearch 5.x

For use with an Elasticsearch 5.x server, install with:

pip install 'elastic2-doc-manager[elastic5]'

Amazon Elasticsearch Service

To use with Amazon Elasticsearch Service, you must install the required AWS dependencies along with the version of Elasticsearch:

pip install 'elastic2-doc-manager[elastic2,aws]'

Development

You can also install the development version of elastic2-doc-manager manually:

git clone https://github.com/AmrAdelKhalil/elastic2-doc-manager
pip install -e './elastic2-doc-manager[elastic2]'

You may have to run pip with sudo, depending on where you’re installing and what privileges you have.

note:: Please note that before mongo-connector version 2.2.2, the elastic doc manager was packaged with mongo-connector and only supported Elasticsearch 1.x.

Running the tests

Requirements

  1. Copy of the Elastic 2.x Document Manager Github repository

The tests are not included in the package from PyPI and can only be acquired by cloning this repository on Github:

git clonehttps://github.com/AmrAdelKhalil/elastic2-doc-manager
  1. Tox

Install tox.

  1. Environment variables

There are a few influential environment variables that affect the tests. These are defined in the tox.ini.

All the tests live in the tests directory.

Running tests on the command-line

While the tests take care of setting up and tearing down MongoDB clusters on their own, make sure to start Elasticsearch before doing a full test run!

You can run all the tests with one command (this works in all supported Python versions):

tox

Error messages

Some of the tests are meant to generate lots of ERROR-level log messages, especially the rollback tests. mongo-connector logs exceptions it encounters while iterating the cursor in the oplog, so we see these in the console output while MongoDB clusters are being torn apart in the tests. As long as all the tests pass with an OK message, all is well.

Metadata

Release files for elastic2-doc-manager-transaction 1.2.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for elastic2-doc-manager-transaction 1.2.0
File Size Uploaded
elastic2-doc-manager-transaction-1.2.0.tar.gz 21.3 kB Details

Release files / elastic2-doc-manager-transaction-1.2.0.tar.gz

Download URL elastic2-doc-manager-transaction-1.2.0.tar.gz
Size 21.3 kB
Tags Source
SHA-256 checksum
How to use checksums
cd9507bc34528424595f4acaeb6ee3ee3bbef08cf3134109d26bb6b3948ce230
BLAKE2b-256 checksum
How to use checksums
c3185b3eebe49f75bb2d7a9599c65c200967ae6ec3841124e5997ccff11a9089
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.7.11

Release history Release notifications | RSS feed

This release

1.2.0 This release

1 release file

1.1.5

1 release file

1.1.4

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page