Skip to main content

ElasticSearch Extensions for datapackage-pipelines

Install

::

# use pip install

pip install datapackage-pipelines-elasticsearch

# OR clone the repo and install it with pip

git clone https://github.com/frictionlessdata/datapackage-pipelines-elasticsearch.git
pip install -e .

Usage

You can use datapackage-pipelines-elasticsearch as a plugin for (dpp)[https://github.com/frictionlessdata/datapackage-pipelines#datapackage-pipelines\ ]. In pipeline-spec.yaml it will look like this

.. code:: yaml

  ...
  - run: elasticseach.dump.to_index

dump.to_index


Saves the datapackage to an ElasticSearch instance.

*Parameters*:

-  ``engine`` - Connection string for connecting to the ElasticSearch
   instance (URL syntax)
    Also supports ``env://<environment-variable>``, which indicates that
   the connection string should be fetched from the indicated
   environment variable.
    If not specified, assumes a default of ``env://DPP_ELASTICSEARCH``
    Environment variable should take the form of 'host:port' or a
   fully-qualified url (e.g.
   '`https://user:pass@host:port <https://user:pass@host:port>`__\ ' or
   '`https://host:port <https://host:port>`__\ ' etc.)
-  ``indexes`` - Mapping between resources and indexes. Keys are index
   names, value is a list of objects with the following attributes:
-  ``resource-name`` - name of the resource that should be dumped to the
   table
-  ``doc-type`` - The document type to use when indexing docuemtns

Release files for datapackage-pipelines-elasticsearch 0.0.14

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for datapackage-pipelines-elasticsearch 0.0.14
File Size Uploaded
datapackage-pipelines-elasticsearch-0.0.14.tar.gz 6.2 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for datapackage-pipelines-elasticsearch 0.0.14
File Interpreter ABI Platform
datapackage_pipelines_elasticsearch-0.0.14-py2.py3-none-any.whl Python 2, Python 3 none any Details

Total release size: 11.8 kB

Release files / datapackage-pipelines-elasticsearch-0.0.14.tar.gz

Download URL datapackage-pipelines-elasticsearch-0.0.14.tar.gz
Size 6.2 kB
Tags Source
SHA-256 checksum
How to use checksums
153383cc1dbbf6174591019242968c4e7ff6073ee9d056e1f7c4ce1f9fd391b9
BLAKE2b-256 checksum
How to use checksums
91049f2a264ba643e4c46688ec12c66b7aed8f4d0b64d434186a5605c6a6f71a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.6.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.6.3

Release files / datapackage_pipelines_elasticsearch-0.0.14-py2.py3-none-any.whl

Download URL datapackage_pipelines_elasticsearch-0.0.14-py2.py3-none-any.whl
Size 5.6 kB
Tags Python 2 Python 3
SHA-256 checksum
How to use checksums
4fe0a2f582367e19d3197b3fafcf488d6162b1b0501249a43a8852498d5a3a83
BLAKE2b-256 checksum
How to use checksums
b2aa3cf7ae2110e381eb7b9e4296b0d6330a6cfccf497610450e319d5d18336c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.6.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.6.3

Release history Release notifications | RSS feed

This release

0.0.14 This release

2 release files

0.0.13

2 release files

0.0.11

1 release file

0.0.10

1 release file

0.0.9

1 release file

0.0.8

1 release file

0.0.6

1 release file

0.0.5

1 release file

0.0.4

1 release file

0.0.3

1 release file

0.0.2

1 release file

0.0.1

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page