Skip to main content

table-oriented abstraction layer over key-value stores

Project description

kvlayer
=======

Table-oriented abstraction layer over key-value stores, such as
Accumulo, Cassandra, Postgres. Provides get, put, range scans,
compound UUID keys.

Also contains thrift-based InstanceCollection for storing
self-describing data in a key-value store. See
[this test of InstanceCollection](src/tests/kvlayer/instance_collection/test_instance_blob_collection.py)
for details.

Accumulo tests
==============

If you run the application tests, a working Accumulo server is required. These
procedure helps you to launch single node and multi node clusters to run the
tests.

Only Accumulo on EC2 is supported right now. All this procedure was tested on
Ubuntu 12.04.

1. Create the file ~/.saltcloud-ec2.conf with your EC2 credentials:

```
my-amz-credentials:
provider: ec2
id: YOUR_EC2_ID
key: YOUR_EC2_KEY
private_key: /home/you/.accumulo-saltstack.pem
keyname: accumulo-saltstack
```

NOTE: Don't change the name "my-amz-credentials"!

2. Make sure that your ssh private_key is in the specified path with permissions
600.

3. Launch the cluster:

```
make CLUSTER_SIZE=3 cluster
```

CLUSTER_SIZE is the number of instances to launch. Default: 1.

4. Run the tests:

```
py.test -vv src/tests
```

5. Destroy the cluster:

```
make CLUSTER_SIZE=3 cluster-destroy
```

CLUSTER_SIZE *MUST* be the size used in step 3.

To cleanup cluster temporal files in the local machine:

```
make cluster-clean
```

TODO
====

- Modify tests to read the Accumulo cluster address and credentials from an external
file.
- Right now the tests point to test-accumulo-1.diffeo.com, update your
/etc/hosts after you launche the cluster.
- More testing and cleanup. DONE
- Improve documentation. DONE !?
- Cluster destroy. (Looks like there is a bug in salt-cloud when using include).
- Fixed with a workaround, waiting for the next version of salt which will
have salt-cloud merged in the Salt project. More information here:
https://github.com/saltstack/salt/issues/8605

Project details


Release history Release notifications

History Node

0.5.9

History Node

0.5.9.dev2

History Node

0.5.8

History Node

0.5.8.dev1

History Node

0.5.7

History Node

0.5.7.dev1

History Node

0.5.6

History Node

0.5.6.dev1

History Node

0.5.5

History Node

0.5.5.dev2

History Node

0.5.4

History Node

0.5.4.dev4

History Node

0.5.4.dev3

History Node

0.5.3

History Node

0.5.3.dev9

History Node

0.5.3.dev8

History Node

0.5.3.dev7

History Node

0.5.3.dev6

History Node

0.5.3.dev5

History Node

0.5.3.dev2

History Node

0.5.3.dev1

History Node

0.5.2

History Node

0.5.2.dev1

History Node

0.5.1

History Node

0.5.0

History Node

0.4.21

History Node

0.4.21.dev4

History Node

0.4.20

History Node

0.4.19

History Node

0.4.18

History Node

0.4.17

History Node

0.4.16

History Node

0.4.16.dev4

History Node

0.4.16.dev3

History Node

0.4.16.dev2

History Node

0.4.15

History Node

0.4.15.dev5

History Node

0.4.15.dev4

History Node

0.4.15.dev3

History Node

0.4.15.dev2

History Node

0.4.15.dev1

History Node

0.4.14

History Node

0.4.14.dev1

History Node

0.4.13

History Node

0.4.12

History Node

0.4.12.dev11

History Node

0.4.12.dev10

History Node

0.4.12.dev9

History Node

0.4.12.dev6

History Node

0.4.12.dev4

History Node

0.4.12.dev2

History Node

0.4.12.dev1

History Node

0.4.11

History Node

0.4.11.dev2

History Node

0.4.11.dev1

History Node

0.4.10

History Node

0.4.10.dev2

History Node

0.4.10.dev1

History Node

0.4.9

History Node

0.4.8.dev23

History Node

0.4.8.dev20

History Node

0.4.8.dev17

History Node

0.4.8.dev16

History Node

0.4.8.dev15

History Node

0.4.8.dev14

History Node

0.4.8.dev13

History Node

0.4.8.dev8

History Node

0.4.8.dev7

History Node

0.4.8.dev5

History Node

0.4.8.dev2

History Node

0.4.8.dev1

History Node

0.4.7.dev6

History Node

0.4.7.dev3

History Node

0.4.6

History Node

0.4.6.dev3

This version
History Node

0.4.5

History Node

0.4.2.dev1

History Node

0.4.1

History Node

0.3.2

History Node

0.2.20.dev2

History Node

0.2.16

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
kvlayer-0.4.5-py2.7.egg (135.6 kB) Copy SHA256 hash SHA256 Egg 2.7 Apr 21, 2014
kvlayer-0.4.5.tar.gz (47.5 kB) Copy SHA256 hash SHA256 Source None Apr 21, 2014

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging CloudAMQP CloudAMQP RabbitMQ AWS AWS Cloud computing Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page