ElasticSearch Extensions for datapackage-pipelines
Install
::
# use pip install
pip install datapackage-pipelines-elasticsearch
# OR clone the repo and install it with pip
git clone https://github.com/frictionlessdata/datapackage-pipelines-elasticsearch.git
pip install -e .
Usage
You can use datapackage-pipelines-elasticsearch as a plugin for (dpp)[https://github.com/frictionlessdata/datapackage-pipelines#datapackage-pipelines\ ]. In pipeline-spec.yaml it will look like this
.. code:: yaml
...
- run: elasticseach.dump.to_index
dump.to_index
Saves the datapackage to an ElasticSearch instance.
*Parameters*:
- ``engine`` - Connection string for connecting to the ElasticSearch
instance (URL syntax)
Also supports ``env://<environment-variable>``, which indicates that
the connection string should be fetched from the indicated
environment variable.
If not specified, assumes a default of ``env://DPP_ELASTICSEARCH``
Environment variable should take the form of 'host:port' or a
fully-qualified url (e.g.
'`https://user:pass@host:port <https://user:pass@host:port>`__\ ' or
'`https://host:port <https://host:port>`__\ ' etc.)
- ``indexes`` - Mapping between resources and indexes. Keys are index
names, value is a list of objects with the following attributes:
- ``resource-name`` - name of the resource that should be dumped to the
table
- ``doc-type`` - The document type to use when indexing docuemtns
Release files for datapackage-pipelines-elasticsearch 0.0.14
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| datapackage-pipelines-elasticsearch-0.0.14.tar.gz | 6.2 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| datapackage_pipelines_elasticsearch-0.0.14-py2.py3-none-any.whl | Python 2, Python 3 | none | any | Details |
Total release size: 11.8 kB
Release files / datapackage-pipelines-elasticsearch-0.0.14.tar.gz
| Download URL | datapackage-pipelines-elasticsearch-0.0.14.tar.gz |
|---|---|
| Size | 6.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
153383cc1dbbf6174591019242968c4e7ff6073ee9d056e1f7c4ce1f9fd391b9
|
|
BLAKE2b-256 checksum How to use checksums |
91049f2a264ba643e4c46688ec12c66b7aed8f4d0b64d434186a5605c6a6f71a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.6.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.6.3
|
Release files / datapackage_pipelines_elasticsearch-0.0.14-py2.py3-none-any.whl
| Download URL | datapackage_pipelines_elasticsearch-0.0.14-py2.py3-none-any.whl |
|---|---|
| Size | 5.6 kB |
| Tags | Python 2 Python 3 |
|
SHA-256 checksum How to use checksums |
4fe0a2f582367e19d3197b3fafcf488d6162b1b0501249a43a8852498d5a3a83
|
|
BLAKE2b-256 checksum How to use checksums |
b2aa3cf7ae2110e381eb7b9e4296b0d6330a6cfccf497610450e319d5d18336c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.6.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.6.3
|