Connect to ES and write documents with two modes: append and overwrite!
Project description
Using to insert/update ES document
To build and upload to pypi, run two commands
python setup.py bdist_wheel
python -m twine upload dist/
How to use
create es connection
import elasticwriter
from elasticwriter.elasticwriter import *
es = get_es([
"http://username:password@es-host"
])
create index if not exsited with mapping and setting
mapping = {
"_doc": {
"properties": {
"name": {
"type": "text",
},
}
}
}
index_name = 'tuan-test'
create_index_if_not_existed(es, index_name, mapping)
handle with dataframe
test_df = spark.createDataFrame([(1, 'tuan', 30), (2, 'tank', 27)], ['es_id', 'name', 'age'])
push_df_to_index(es, index_name, test_df, 'overwrite')
handle with list dictionary
test_list = [
{'es_id': 3, 'name': 'tuyet', 'age': 25}
]
push_list_dict_to_index(es, index_name, test_list, 'overwrite')
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
No source distribution files available for this release.See tutorial on generating distribution archives.
Built Distribution
Close
Hashes for elasticwriter-2.2.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7758972e4d793db650a34621746cfdc2f140993f2f5cc8e1b9d8fcc04cf0569f |
|
MD5 | 9de2237d5fad2ca7ce032f72c06cc12b |
|
BLAKE2b-256 | 9dfbf48e3108e24f884e846d2bb6582a29279c13f8d17db7cd8ef6d56d570db8 |