Connect to ES and write documents with two modes: append and overwrite!
Project description
Using to insert/update ES document
To build and upload to pypi, run two commands
python setup.py bdist_wheel
python -m twine upload dist/
How to use
create es connection
import elasticwriter
from elasticwriter.elasticwriter import *
es = get_es([
"http://username:password@es-host"
])
create index if not exsited with mapping and setting
mapping = {
"_doc": {
"properties": {
"name": {
"type": "text",
},
}
}
}
index_name = 'tuan-test'
create_index_if_not_existed(es, index_name, mapping)
handle with dataframe
test_df = spark.createDataFrame([(1, 'tuan', 30), (2, 'tank', 27)], ['es_id', 'name', 'age'])
push_df_to_index(es, index_name, test_df, 'overwrite')
handle with list dictionary
test_list = [
{'es_id': 3, 'name': 'tuyet', 'age': 25}
]
push_list_dict_to_index(es, index_name, test_list, 'overwrite')
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Built Distribution
Close
Hashes for elasticwriter-2.2.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7758972e4d793db650a34621746cfdc2f140993f2f5cc8e1b9d8fcc04cf0569f |
|
MD5 | 9de2237d5fad2ca7ce032f72c06cc12b |
|
BLAKE2-256 | 9dfbf48e3108e24f884e846d2bb6582a29279c13f8d17db7cd8ef6d56d570db8 |