Store Implementation for Data Sets in MongoDB
Project description
MongoDB User Stores for Python
Python Store Implementation for Data Sets in MongoDB
Usage
from frappymongodataset import DataStore
MONGO_URL = "mongodb://localhost:27017"
data_set_store = DataStore(mongo_url=MONGO_URL, mongo_db="myDatabase", collection_name="dataSets")
all_data_sets = data_set_store.get_all()
specific_data_sets = data_set_store.get_by_assignment("primaryKey")
The return objects from get
methods are objects of type Data
. Data
provides an attribute payload
, which returns
the type of payload represented by the data set. These types are:
DataImagePayload
for images providing attributesimage_path
,width
andheight
DataJsonPayload
providing the JSON payload with the attributedata
DataTimeSeriesPayload
providing attributescolumns
,data
(the rows),date_format
,index_column
andcolumn_mapping
Examples
from frappymongodataset import DataTypes
images = data_set_store.get_by_type(DataTypes.IMAGE)
print(images[0].payload.path, images[0].payload.dimensions["width"], images[0].payload.dimensions["height"])
# prints out something like: "_data/5e846d104e61db060094ed14.jpg 1200 600"
nd_array = images[0].to_np_array() # will only work for IMAGE
time_series = data_set_store.get_by_type(DataTypes.TIME_SERIES)
print(time_series[0].payload.columns)
df = time_series[0].to_pd_data_frame() # will only work for TIME_SERIES
Methods
Base methods provided by pbu
get_all()
- contrary to other stores, this will not return the payload of the individual data sets, but just the meta informationupdate_meta(data_id, meta_update)
- updating meta information, needs to contain "label" and "assignments" updateget_by_type(data_type)
- filters by the data setstype
attributeget_by_assignment_and_type(assignment_id, data_type)
- filters by the data setstype
attribute and has to have an assignment for the groupassignment_id
get_by_assignment(assignment_id)
- just checks for anassignments
to the group providedget_by_assignment_type(assignment_id, assignment_type)
- not to be confused withget_by_assignment_and_type
- this method will check for theassignment_id
in theassignments
, and within that (a list of identifier) assignment for the typeassignment_type
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for frappymongodataset-1.3.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 956c16d5b3f621107d3cf810d039ef7f1b1fb6be00ab7ccacb0c9879cf9524e3 |
|
MD5 | fe41a30e3ad8280c651b0de0c6bb1040 |
|
BLAKE2b-256 | b84deffebe76e38ba354e69d7b8d395a3cb57629009471d88c4289ec85d14822 |