Python interface to rasdaman
Project description
*RasdaPy is a client API for rasdaman that enables building and executing rasql queries with python.*
Requirements
numpy, grpcio, protobuf.
a running rasdaman instance, see http://rasdaman.org/wiki/Download
Installation
Make sure you have Python 2.7 or newer if using Python 2 and Python 3.4 or newer if using Python 3. If in doubt, run:
$ python –version
If you do not have setuptools, numpy, grpcio, and protobuf installed, note that they will be downloaded as dependencies of rasdapy with: pip install rasdapy.
Usage
A full client is available that demonstrates how to use rasdapy to send queries to rasdaman and handle the results: http://rasdaman.org/browser/applications/rasdapy/rasql.py
Import RasdaPy core API
$ from rasdapy.db_connector import DBConnector $ from rasdapy.query_executor import QueryExecutor
Connect to rasdaman
The DBConnector maintains the connection to rasdaman. In order to connect it is necessary to specify the host and port on which rasmgr is running, as well as valid rasdaman username and password.
$ db_connector = DBConnector("localhost", 7001, "rasadmin", "rasadmin")
Create the query executor
QueryExcutor is the interface through which rasql queries (create, insert, update, delete, etc.) are executed.
$ query_executor = QueryExecutor(db_connector)
Open the connection to rasdaman
$ db_connector.open()
Execute sample queries
The query below returns a list of all the collections available in rasdaman.
$ collection_list = query_executor.execute_read("select c from RAS_COLLECTIONNAMES as c") $ print(collection_list)
Calculate the average of all values in collection mr2.
$ result = query_executor.execute_read("select avg_cells(c) from mr2 as c") $ type(result)
Depending on the query the result will have a different type (e.g. scalar value, interval, array). Each data type is wrapped in a corresponding class: http://rasdaman.org/browser/applications/rasdapy/rasdapy/models
Select a particular subset of each array in collection mr2. This query will return raw array data that can be converted to a Numpy ndarray.
$ result = query_executor.execute_read("select m[0:10 ,0:10] from mr2 as m") $ numpy_array = result.to_array()
Encode array subset to PNG format and write the result to a file.
$ result = query_executor.execute_read("select encode(m[0:10 ,0:10], "png") from mr2 as m") $ with open("/tmp/output.png", "wb") as binary_file: $ binary_file.write(result.data)
Create a rasdaman collection. Note that you should be connected with a user that has write permission; by default this is rasadmin/rasadmin in rasdaman, but this can be managed by the administrator.
$ query_executor.execute_write("create collection test_rasdapy GreySet")
Insert data from a PNG image into the collection. Similarly you need to have write permissions for this operation.
$ query_executor.execute_write("insert into test_rasdapy values decode($1)", "your_path/rasdaman/systemtest/testcases_services/test_all_wcst_import/test_data/wcps_mr/mr_1.png")
Alternatively, you can import data from a raw binary file; in this case it is necessary to specify the spatial domain and array type.
$ query_executor.execute_update_from_file("insert into test_rasdapy values $1", "your_path/rasdaman/systemtest/testcases_mandatory/test_select/testdata/101.bin", "[0:100]", "GreyString")
Further example queries and a general guide for rasql can be found in the rasql Query Language guide (http://rasdaman.org/browser/manuals_and_examples/manuals/doc-guides).
Close the connection to rasdaman
$ db_connector.close()
Best practices:
It is recommended to follow this template in order to avoid problems with leaked transactions:
from rasdapy.db_connector import DBConnector from rasdapy.query_executor import QueryExecutor db_connector = DBConnector("localhost", 7001, "rasadmin", "rasadmin") query_executor = QueryExecutor(db_connector) db_connector.open() try: query_executor.execute_read("...") query_executor.execute_write("...") # ... more Python code finally: db_connector.close()
Development Warning
The Python implementation of Protocol Buffers is not as mature as the C++ and Java implementations. It may be more buggy, and it is known to be pretty slow at this time. Since this library relies heavily on Protocol Buffers and GRPC, it might be prone to occasional hiccups and unexpected behaviour.
Contributors
Bang Pham Huu
Siddharth Shukla
Dimitar Misev
Thanks also to
Alex Mircea Dumitru
Vlad Merticariu
George Merticariu
Alex Toader
Peter Baumann
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file rasdapy-1.1.0.tar.gz
.
File metadata
- Download URL: rasdapy-1.1.0.tar.gz
- Upload date:
- Size: 49.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/39.2.0 requests-toolbelt/0.8.0 tqdm/4.19.8 CPython/2.7.5
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5ad7a1bc63aaf176a9b26dc2267dd5eaf04413c591d86a2c18cf6ec085412f1b |
|
MD5 | 11aa6006fe347decdacd45200b00fd67 |
|
BLAKE2b-256 | c765dab81bafc97c0ea49e6cd0b99dcea3d03d32ba89d26ba4ea3a25eba20baa |
File details
Details for the file rasdapy-1.1.0-py2.py3-none-any.whl
.
File metadata
- Download URL: rasdapy-1.1.0-py2.py3-none-any.whl
- Upload date:
- Size: 66.4 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/39.2.0 requests-toolbelt/0.8.0 tqdm/4.19.8 CPython/2.7.5
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | eb9e799dc60b132363b4d7db17c3a6cd82262bbd5d29463b59a5edef9ec2b1f1 |
|
MD5 | 154bd74da07170f026ce578c6970303f |
|
BLAKE2b-256 | eade0ad4e016f9b3771a346188c0f5feac270f1c0367e3688a04c769fe51d1ff |