Skip to main content

memcache fdw for postgresql

Project description

pymcache\_fdw
=============

Memcache foreign data wrapper for PostgreSQL written in python.

dependencies
------------

- [pymemcache](https://pypi.python.org/pypi/pymemcache)
- [multicorn](http://multicorn.org/#idinstallation)

installation
------------

1. install python module

```bash
$ cd /path/to/pymcache_fdw
$ python setup.py install
```

2. create extension "multicorn"

```sql
$$ create extension multicorn;
```

3. create foreign server in database

- foreign server to operate cache items

```sql
$$ CREATE SERVER pymcache_fdw
FOREIGN DATA WRAPPER multicorn
OPTIONS (
wrapper 'pymcache_fdw.PymcacheFDW'
);
```

- foreign server to show statistics

```sql
$$ CREATE SERVER pymcache_fdw_stat
FOREIGN DATA WRAPPER multicorn
OPTIONS (
wrapper 'pymcache_fdw.PymcacheFDWStats'
);
```

4. create foreign table

- foreign table to operate cache items

```sql
$$ CREATE FOREIGN TABLE pymcache_test (
key TEXT,
value TEXT,
expire TEXT -- optional
) SERVER pymcache_fdw OPTIONS (
host 'localhost',
port '11211',
row_id 'key',
expire '60' -- optional, default is 0 - never expire
);
```

- foreign table to show general-purpose statistics

```sql
$$ CREATE FOREIGN TABLE pymcache_stat_test (
stat_name TEXT,
stat_value TEXT
) SERVER pymcache_fdw_stat;
```

- foreign table to show current memcache settings

```sql
$$ CREATE FOREIGN TABLE pymcache_stat_settings_test (
stat_name TEXT,
stat_value TEXT
) SERVER pymcache_fdw_stat OPTIONS (
stats_cmd 'settings'
);
```

usage
-----

- set cache item

```sql
$$ insert into pymcache_test(key, value)
values('meaning_of_life', '42');
INSERT 0 1
```

- set cache item, that will expire after 10 seconds

```sql
$$ insert into pymcache_test(key, value, expire)
values('born_to_die', 'Lana Del Rey', 10);
INSERT 0 1
```

- update cache item with key `born_to_die`

```sql
$$ update pymcache_test
set value = 'Grand Funk Railroad', expire = 300
where key = 'born_to_die'
UPDATE 1
```

- get cache items with set of keys in "where" clause

```sql
$$ select key, value
from pymcache_test
where key in ('meaning_of_life', 'k1');

key | value
-----------------+-------
meaning_of_life | 42
(1 row)
```

- delete cache item with key `meaning_of_life`

```sql
$$ delete from pymcache_test
where key = 'meaning_of_life';
DELETE 1
```

- show general-purpose statistics related to connections

```sql
$$ select stat_name, stat_value
from pymcache_stat_test
where stat_name ~* 'connection';

WARNING: Using default host: localhost
WARNING: Using default port: 11211
stat_name | stat_value
-----------------------+------------
curr_connections | 6
total_connections | 31
connection_structures | 7
(3 rows)
```

- show "enabled" memcache settings

```sql
$$ select stat_name, stat_value
from pymcache_stat_settings_test
where stat_name ~* 'enabled';

stat_name | stat_value
-------------------+------------
cas_enabled | yes
auth_enabled_sasl | False
detail_enabled | no
flush_enabled | yes
(4 rows)
```

external links
--------------

- [PostgreSQL foreign data wrappers](https://wiki.postgresql.org/wiki/Foreign_data_wrappers) (postgres wiki)
- [Multicorn](http://multicorn.org) - postgres extension that allows to make FDW with python language
- [Memcached](https://memcached.org) - distributed memory object caching system
- [memcached protocol](https://github.com/memcached/memcached/blob/master/doc/protocol.txt)
- [Pymemcache](https://pymemcache.readthedocs.io/en/latest) python module documentation

todo
----

- [x] use "expire" parameter
- [x] use named parameters when calling pymemcache methods
- [x] add "update" query implementation
- [x] set proper PymcacheFDW -> pymemcache methods mapping
- [x] implement `stats items/settings/slabs/sizes/conns` commands
- [x] move `host` and `port` classes attributes to `__init__` as local variables
- [x] move connection procedure to separate method

license
-------

Copyright (c) 2016 Dmitriy Olshevskiy. MIT LICENSE.

See LICENSE.md for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pymcache_fdw-0.0.10.tar.gz (4.2 kB view hashes)

Uploaded Source

Built Distribution

pymcache_fdw-0.0.10-py2-none-any.whl (7.3 kB view hashes)

Uploaded Python 2

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page