Connect to ES and write documents with two modes: append and overwrite!
Project description
Using to insert/update ES document
To build and upload to pypi, run two commands
python setup.py bdist_wheel
python -m twine upload dist/
How to use
create es connection
import elasticwriter
from elasticwriter.elasticwriter import *
es = get_es([
"http://username:password@es-host"
])
create index if not exsited with mapping and setting
mapping = {
"_doc": {
"properties": {
"name": {
"type": "text",
},
}
}
}
index_name = 'tuan-test'
create_index_if_not_existed(es, index_name, mapping)
handle with dataframe
test_df = spark.createDataFrame([(1, 'tuan', 30), (2, 'tank', 27)], ['es_id', 'name', 'age'])
push_df_to_index(es, index_name, test_df, 'overwrite')
handle with list dictionary
test_list = [
{'es_id': 3, 'name': 'tuyet', 'age': 25}
]
push_list_dict_to_index(es, index_name, test_list, 'overwrite')
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
No source distribution files available for this release.See tutorial on generating distribution archives.
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file elasticwriter-2.2.1-py3-none-any.whl.
File metadata
- Download URL: elasticwriter-2.2.1-py3-none-any.whl
- Upload date:
- Size: 3.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.19.1 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.6.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7758972e4d793db650a34621746cfdc2f140993f2f5cc8e1b9d8fcc04cf0569f
|
|
| MD5 |
9de2237d5fad2ca7ce032f72c06cc12b
|
|
| BLAKE2b-256 |
9dfbf48e3108e24f884e846d2bb6582a29279c13f8d17db7cd8ef6d56d570db8
|