Skip to main content

Connect to ES and write documents with two modes: append and overwrite!

Project description

Using to insert/update ES document

To build and upload to pypi, run two commands

python setup.py bdist_wheel

python -m twine upload dist/

How to use

create es connection
import elasticwriter
from elasticwriter.elasticwriter import *

es = get_es([
    "http://username:password@es-host"
])

create index if not exsited with mapping and setting

	mapping = {
           "_doc": { 
               "properties": {
                   "name": {
                        "type": "text",
                   },
               }
            }
        }

    index_name = 'tuan-test'
    create_index_if_not_existed(es, index_name, mapping)

handle with dataframe

test_df = spark.createDataFrame([(1, 'tuan', 30), (2, 'tank', 27)], ['es_id', 'name', 'age'])

push_df_to_index(es, index_name, test_df, 'overwrite')

handle with list dictionary

test_list = [
    {'es_id': 3, 'name': 'tuyet', 'age': 25}
]
push_list_dict_to_index(es, index_name, test_list, 'overwrite')

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

elasticwriter-2.2.1-py3-none-any.whl (3.1 kB view details)

Uploaded Python 3

File details

Details for the file elasticwriter-2.2.1-py3-none-any.whl.

File metadata

  • Download URL: elasticwriter-2.2.1-py3-none-any.whl
  • Upload date:
  • Size: 3.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.19.1 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.6.8

File hashes

Hashes for elasticwriter-2.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 7758972e4d793db650a34621746cfdc2f140993f2f5cc8e1b9d8fcc04cf0569f
MD5 9de2237d5fad2ca7ce032f72c06cc12b
BLAKE2b-256 9dfbf48e3108e24f884e846d2bb6582a29279c13f8d17db7cd8ef6d56d570db8

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page