Skip to main content

Python interface to rasdaman

Project description

*RasdaPy is a client API for rasdaman that enables building and executing rasql queries with python.*

Requirements

Installation

  1. Make sure you have Python 2.7 or newer if using Python 2 and Python 3.4 or newer if using Python 3. If in doubt, run:

    $ python –version

  2. If you do not have setuptools, numpy, grpcio, and protobuf installed, note that they will be downloaded as dependencies of rasdapy with: pip install rasdapy.

Usage

A full client is available that demonstrates how to use rasdapy to send queries to rasdaman and handle the results: http://rasdaman.org/browser/applications/rasdapy/rasql.py

Import RasdaPy core API

$ from rasdapy.db_connector import DBConnector
$ from rasdapy.query_executor import QueryExecutor

Connect to rasdaman

The DBConnector maintains the connection to rasdaman. In order to connect it is necessary to specify the host and port on which rasmgr is running, as well as valid rasdaman username and password.

$ db_connector = DBConnector("localhost", 7001, "rasadmin", "rasadmin")

Create the query executor

QueryExcutor is the interface through which rasql queries (create, insert, update, delete, etc.) are executed.

$ query_executor = QueryExecutor(db_connector)

Open the connection to rasdaman

$ db_connector.open()

Execute sample queries

The query below returns a list of all the collections available in rasdaman.

$ collection_list = query_executor.execute_read("select c from RAS_COLLECTIONNAMES as c")
$ print(collection_list)

Calculate the average of all values in collection mr2.

$ result = query_executor.execute_read("select avg_cells(c) from mr2 as c")
$ type(result)

Depending on the query the result will have a different type (e.g. scalar value, interval, array). Each data type is wrapped in a corresponding class: http://rasdaman.org/browser/applications/rasdapy/rasdapy/models

Select a particular subset of each array in collection mr2. This query will return raw array data that can be converted to a Numpy ndarray.

$ result = query_executor.execute_read("select m[0:10 ,0:10] from mr2 as m")
$ numpy_array = result.to_array()

Encode array subset to PNG format and write the result to a file.

$ result = query_executor.execute_read("select encode(m[0:10 ,0:10], "png") from mr2 as m")
$ with open("/tmp/output.png", "wb") as binary_file:
$   binary_file.write(result.data)

Create a rasdaman collection. Note that you should be connected with a user that has write permission; by default this is rasadmin/rasadmin in rasdaman, but this can be managed by the administrator.

$ query_executor.execute_write("create collection test_rasdapy GreySet")

Insert data from a PNG image into the collection. Similarly you need to have write permissions for this operation.

$ query_executor.execute_write("insert into test_rasdapy values decode($1)", "your_path/rasdaman/systemtest/testcases_services/test_all_wcst_import/test_data/wcps_mr/mr_1.png")

Alternatively, you can import data from a raw binary file; in this case it is necessary to specify the spatial domain and array type.

$ query_executor.execute_update_from_file("insert into test_rasdapy values $1", "your_path/rasdaman/systemtest/testcases_mandatory/test_select/testdata/101.bin", "[0:100]", "GreyString")

Further example queries and a general guide for rasql can be found in the rasql Query Language guide (http://rasdaman.org/browser/manuals_and_examples/manuals/doc-guides).

Close the connection to rasdaman

$ db_connector.close()

Best practices:

It is recommended to follow this template in order to avoid problems with leaked transactions:

from rasdapy.db_connector import DBConnector
from rasdapy.query_executor import QueryExecutor

db_connector = DBConnector("localhost", 7001, "rasadmin", "rasadmin")
query_executor = QueryExecutor(db_connector)

db_connector.open()

try:
    query_executor.execute_read("...")
    query_executor.execute_write("...")
    # ... more Python code
finally:
    db_connector.close()

Development Warning

The Python implementation of Protocol Buffers is not as mature as the C++ and Java implementations. It may be more buggy, and it is known to be pretty slow at this time. Since this library relies heavily on Protocol Buffers and GRPC, it might be prone to occasional hiccups and unexpected behaviour.

Contributors

  • Bang Pham Huu

  • Siddharth Shukla

  • Dimitar Misev

Thanks also to

  • Alex Mircea Dumitru

  • Vlad Merticariu

  • George Merticariu

  • Alex Toader

  • Peter Baumann

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

rasdapy-1.1.0.tar.gz (49.9 kB view details)

Uploaded Source

Built Distribution

rasdapy-1.1.0-py2.py3-none-any.whl (66.4 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file rasdapy-1.1.0.tar.gz.

File metadata

  • Download URL: rasdapy-1.1.0.tar.gz
  • Upload date:
  • Size: 49.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/39.2.0 requests-toolbelt/0.8.0 tqdm/4.19.8 CPython/2.7.5

File hashes

Hashes for rasdapy-1.1.0.tar.gz
Algorithm Hash digest
SHA256 5ad7a1bc63aaf176a9b26dc2267dd5eaf04413c591d86a2c18cf6ec085412f1b
MD5 11aa6006fe347decdacd45200b00fd67
BLAKE2b-256 c765dab81bafc97c0ea49e6cd0b99dcea3d03d32ba89d26ba4ea3a25eba20baa

See more details on using hashes here.

File details

Details for the file rasdapy-1.1.0-py2.py3-none-any.whl.

File metadata

  • Download URL: rasdapy-1.1.0-py2.py3-none-any.whl
  • Upload date:
  • Size: 66.4 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/39.2.0 requests-toolbelt/0.8.0 tqdm/4.19.8 CPython/2.7.5

File hashes

Hashes for rasdapy-1.1.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 eb9e799dc60b132363b4d7db17c3a6cd82262bbd5d29463b59a5edef9ec2b1f1
MD5 154bd74da07170f026ce578c6970303f
BLAKE2b-256 eade0ad4e016f9b3771a346188c0f5feac270f1c0367e3688a04c769fe51d1ff

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page