Skip to main content

High-level ZooKeeper API

Project description

The zc.zk package provides some high-level interfaces to the low-level zookeeper extension. It’s not complete, in that it doesn’t try, at this time, to be a complete high-level interface. Rather, it provides facilities we need to use ZooKeeper to connect services:

  • ZODB database clients and servers

  • HTTP-based clients and services

  • Load balancers and HTTP application servers

The current (initial) use cases are:

  • Register a server providing a service.

  • Get the addresses of servers providing a service.

  • Get and set service configuration data.

  • Model system architecture as a tree.

This package makes no effort to support Windows. (Patches to support Windows might be accepted if they don’t add much complexity.)

Installation

You can install this as you would any other distribution. Note, however, that you must also install the Python ZooKeeper binding provided with ZooKeeper. Because this binding is packaged a number of different ways, it isn’t listed as a distribution requirement.

An easy way to get the Python zookeeper binding is by installing zc-zookeeper-static, which is a self-contained statically built distribution.

Instantiating a ZooKeeper helper

To use the helper API, create a ZooKeeper instance:

>>> import zc.zk
>>> zk = zc.zk.ZooKeeper('zookeeper.example.com:2181')

The ZooKeeper constructor takes a ZooKeeper connection string, which is a comma-separated list of addresses of the form HOST:PORT. It defaults to '127.0.0.1:2181', which is convenient during development.

Register a server providing a service

To register a server, use the register_server method, which takes a service path and the address a server is listing on:

>>> zk.register_server('/fooservice/providers', ('192.168.0.42', 8080))

register_server creates a read-only ephemeral ZooKeeper node as a child of the given service path. The name of the new node is (a string representation of) the given address. This allows clients to get the list of addresses by just getting the list of the names of children of the service path.

Ephemeral nodes have the useful property that they’re automatically removed when a ZooKeeper session is closed or when the process containing it dies. De-registration is automatic.

When registering a server, you can optionally provide server (node) data as additional keyword arguments to register_server. By default, the process id is set as the pid property. This is useful to tracking down the server process. In addition, an event is generated, providing subscribers to add properties as a server is being registered. (See Server-registration events.)

Get the addresses of service providers

Getting the addresses providing a service is accomplished by getting the children of a service node:

>>> addresses = zk.children('/fooservice/providers')
>>> sorted(addresses)
['192.168.0.42:8080']

The children method returns an iterable of names of child nodes of the node specified by the given path. The iterable is automatically updated when new providers are registered:

>>> zk.register_server('/fooservice/providers', ('192.168.0.42', 8081))
>>> sorted(addresses)
['192.168.0.42:8080', '192.168.0.42:8081']

You can also get the number of children with len:

>>> len(addresses)
2

You can call the iterable with a callback function that is called whenever the list of children changes:

>>> @zk.children('/fooservice/providers')
... def addresses_updated(addresses):
...     print 'addresses changed'
...     print sorted(addresses)
addresses changed
['192.168.0.42:8080', '192.168.0.42:8081']

The callback is called immediately with the children. When we add another child, it’ll be called again:

>>> zk.register_server('/fooservice/providers', ('192.168.0.42', 8082))
addresses changed
['192.168.0.42:8080', '192.168.0.42:8081', '192.168.0.42:8082']

Get service configuration data

You get service configuration data by getting properties associated with a ZooKeeper node. The interface for getting properties is similar to the interface for getting children:

>>> data = zk.properties('/fooservice')
>>> data['database']
u'/databases/foomain'
>>> data['threads']
1

The properties method returns a mapping object that provides access to node data. (ZooKeeper only stores string data for nodes. zc.zk provides a higher-level data interface by storing JSON strings.)

The properties objects can be called with callback functions and used as function decorators to get update notification:

>>> @zk.properties('/fooservice')
... def data_updated(data):
...     print 'data updated'
...     for item in sorted(data.items()):
...         print '%s: %r' % item
data updated
database: u'/databases/foomain'
favorite_color: u'red'
threads: 1

The callback is called immediately. It’ll also be called when data are updated.

Updating node properties

You can’t set properties, but you can update properties by calling the update method:

>>> thread_info = {'threads': 2}
>>> data.update(thread_info, secret='123')
data updated
database: u'/databases/foomain'
favorite_color: u'red'
secret: u'123'
threads: 2

or by calling the set method, which removes keys not listed:

>>> data.set(threads= 3, secret='1234')
data updated
secret: u'1234'
threads: 3

Both update and set can take data from a positional data argument, or from keyword parameters. Keyword parameters take precedent over the positional data argument.

Tree-definition format, import, and export

You can describe a ZooKeeper tree using a textual tree representation. You can then populate the tree by importing the representation. Heres an example:

/lb : ipvs
  /pools
    /cms
      # The address is fixed because it's
      # exposed externally
      address = '1.2.3.4:80'
      providers -> /cms/providers
    /retail
      address = '1.2.3.5:80'
      providers -> /cms/providers

/cms : z4m cms
  threads = 3
  /providers
  /databases
    /main
      /providers

/retail : z4m retail
  threads = 1
  /providers
  /databases
    main -> /cms/databases/main
    /ugc
      /providers

This example defines a tree with 3 top nodes, lb and cms, and retail. The retail node has two sub-nodes, providers and databases and a property threads.

The /retail/databases node has symbolic link, main and a ugc sub-node. The symbolic link is implemented as a property named `` We’ll say more about symbolic links in a later section.

The lb, cms and retail nodes have types. A type is indicated by following a node name with a colon and a string value. The string value is used to populate a type property. Types are useful to document the kinds of services provided at a node and can be used by deployment tools to deploy service providers.

You can import a tree definition with the import_tree method:

>>> zk.import_tree(tree_text)

This imports the tree at the top of the ZooKeeper tree.

We can also export a ZooKeeper tree:

>>> print zk.export_tree(),
/cms : z4m cms
  threads = 3
  /databases
    /main
      /providers
  /providers
/fooservice
  secret = u'1234'
  threads = 3
  /providers
/lb : ipvs
  /pools
    /cms
      address = u'1.2.3.4:80'
      providers -> /cms/providers
    /retail
      address = u'1.2.3.5:80'
      providers -> /cms/providers
/retail : z4m retail
  threads = 1
  /databases
    main -> /cms/databases/main
    /ugc
      /providers
  /providers

Note that when we export a tree:

  • The special reserved top-level zookeeper node is omitted.

  • Ephemeral nodes are omitted.

  • Each node’s information is sorted by type (properties, then links,

  • then sub-nodes) and then by name,

You can export just a portion of a tree:

>>> print zk.export_tree('/fooservice'),
/fooservice
  secret = u'1234'
  threads = 3
  /providers

You can optionally see ephemeral nodes:

>>> print zk.export_tree('/fooservice', ephemeral=True),
/fooservice
  secret = u'1234'
  threads = 3
  /providers
    /192.168.0.42:8080
      pid = 81176
    /192.168.0.42:8081
      pid = 81176
    /192.168.0.42:8082
      pid = 81176

We can import a tree over an existing tree and changes will be applied. Let’s update our textual description:

/lb : ipvs
  /pools
    /cms
      # The address is fixed because it's
      # exposed externally
      address = '1.2.3.4:80'
      providers -> /cms/providers

/cms : z4m cms
  threads = 4
  /providers
  /databases
    /main
      /providers

and re-import:

>>> zk.import_tree(tree_text)
extra path not trimmed: /lb/pools/retail

We got a warning about nodes left over from the old tree. We can see this if we look at the tree:

>>> print zk.export_tree(),
/cms : z4m cms
  threads = 4
  /databases
    /main
      /providers
  /providers
/fooservice
  secret = u'1234'
  threads = 3
  /providers
/lb : ipvs
  /pools
    /cms
      address = u'1.2.3.4:80'
      providers -> /cms/providers
    /retail
      address = u'1.2.3.5:80'
      providers -> /cms/providers
/retail : z4m retail
  threads = 1
  /databases
    main -> /cms/databases/main
    /ugc
      /providers
  /providers

If we want to trim these, we can add a trim option. This is a little scary, so we’ll use the dry-run option to see what it’s going to do:

>>> zk.import_tree(tree_text, trim=True, dry_run=True)
would delete /lb/pools/retail.

That’s what we’d expect, so we go ahead:

>>> zk.import_tree(tree_text, trim=True)
>>> print zk.export_tree(),
/cms : z4m cms
  threads = 4
  /databases
    /main
      /providers
  /providers
/fooservice
  secret = u'1234'
  threads = 3
  /providers
/lb : ipvs
  /pools
    /cms
      address = u'1.2.3.4:80'
      providers -> /cms/providers
/retail : z4m retail
  threads = 1
  /databases
    main -> /cms/databases/main
    /ugc
      /providers
  /providers

Note that nodes containing (directly or recursively) ephemeral nodes will never be trimmed. Also node that top-level nodes are never automatically trimmed. So we weren’t warned about the unreferenced top-level nodes in the import.

Recursive deletion

ZooKeeper only allows deletion of nodes without children. The delete_recursive method automates removing a node and all of it’s children.

If we want to remove the retail top-level node, we can use delete_recursive:

>>> zk.delete_recursive('/retail')
>>> print zk.export_tree(),
/cms : z4m cms
  threads = 4
  /databases
    /main
      /providers
  /providers
/fooservice
  secret = u'1234'
  threads = 3
  /providers
/lb : ipvs
  /pools
    /cms
      address = u'1.2.3.4:80'
      providers -> /cms/providers

Bt default, delete_recursive won’t delete ephemeral nodes, or nodes that contain them:

>>> zk.delete_recursive('/fooservice')
Not deleting /fooservice/providers/192.168.0.42:8080 because it's ephemeral.
Not deleting /fooservice/providers/192.168.0.42:8081 because it's ephemeral.
Not deleting /fooservice/providers/192.168.0.42:8082 because it's ephemeral.
/fooservice/providers not deleted due to ephemeral descendent.
/fooservice not deleted due to ephemeral descendent.

You can use the force option to force ephemeral nodes to be deleted.

Node deletion

If a node is deleted and Children or Properties instances have been created for it, and the paths they were created with can’t be resolved using symbolic links, then the instances’ data will be cleared. Attempts to update properties will fail. If callbacks have been registered, they will be called without arguments, if possible. It would be bad, in practice, to remove a node that processes are watching.

Registering a server with a blank hostname

It’s common to use an empty string for a host name when calling bind to listen on all IPv4 interfaces. If you pass an address with an empty host to register_server and netifaces is installed, then all of the IPv4 addresses [1] (for the given port) will be registered. If netifaces isn’t installed and you pass an empty host name, then the fully-qualified domain name, as returned by socket.getfqdn() will be used for the host.

Server-registration events

When register_server is called, a zc.zk.RegisteringServer event is emmitted with a properties attribute that can be updated by subscribers prior to creating the ZooKeeper ephemeral node. This allows third-party code to record extra server information.

Events are emitted by passing them to zc.zk.event.notify. If zope.event is installed, then zc.zk.event.notify is an alias for zope.event.notify, otherwise, zc.zk.event.notify is an empty function that can be replaced by applications.

ZooKeeper Session Management

zc.zk takes care of ZooKeeper session management for you. It establishes and, if necessary, reestablishes sessions for you. In particular, it takes care of reestablishing ZooKeeper watches and ephemeral nodes when a session is reestablished.

Note

To reestablish ephemeral nodes, it’s necessary for zc.zk to track node-moderation operations, so you have to access the ZooKeeper APIs through the zc.zk.ZooKeeper object, rather than using the low-level extension directly.

ZooKeeper logging

zc.zk bridges the low-level ZooKeeper logging API and the Python logging API. ZooKeeper log messages are forwarded to the Python 'ZooKeeper' logger.

zookeeper_export script

The zc.zk package provides a utility script for exporting a ZooKeeper tree:

$ zookeeper_export -e zookeeper.example.com:2181 /fooservice
/fooservice
  secret = u'1234'
  threads = 3
  /providers
    /192.168.0.42:8080
      pid = 7981
    /192.168.0.42:8081
      pid = 7981
    /192.168.0.42:8082
      pid = 7981

The export script provides the same features as the export_tree method. Use the --help option to see how to use it.

zookeeper_import script

The zc.zk package provides a utility script for importing a ZooKeeper tree. So, for example, given the tree:

/provision
  /node1
  /node2

In the file mytree.txt, we can import the file like this:

$ zookeeper_import zookeeper.example.com:2181 mytree.txt /fooservice

The import script provides the same features as the import_tree method, with the exception that it provides less flexibility for specifing access control lists. Use the --help option to see how to use it.

Graph analysis

The textual tree representation can be used to model and analyze a system architecturte. You can get a parsed representation of a tree using zc.zk.parse_tree to parse a text tree representation generated by hand for import, or using the export_tree method.

>>> tree = zc.zk.parse_tree(tree_text)
>>> sorted(tree.children)
['cms', 'lb']
>>> tree.children['lb'].properties
{'type': 'ipvs'}

The demo module, zc.zk.graphvis shows how you might generate system diagrams from tree models.

Reference

zc.zk.ZooKeeper

zc.zk.ZooKeeper([connection_string[, session_timeout[, timeout[, wait]]]])

Return a new instance given a ZooKeeper connection string.

The connection string defaults to ‘127.0.0.1:2181’.

If a session timeout (session_timeout) isn’t specified, the ZooKeeper server’s default session timeout is used. If the connection to ZooKeeper flaps, setting this to a higher value can avoid having clients think a server has gone away, when it hasn’t. The downside of setting this to a higher value is that if a server crashes, it will take longer for ZooKeeper to notice that it’s gone.

The wait flag indicates whether the constructor should wait for a connection to ZooKeeper. It defaults to False.

If a connection can’t be made, a zc.zk.FailedConnect exception is raised.

children(path)

Return a zc.zk.Children for the path.

Note that there is a fair bit of machinery in zc.zk.Children objects to support keeping them up to date, callbacks, and cleaning them up when they are no-longer used. If you only want to get the list of children once, use get_children.

close()

Close the ZooKeeper session.

This should be called when cleanly shutting down servers to more quickly remove ephemeral nodes.

delete_recursive(path[, dry_run[, force]])

Delete a node and all of it’s sub-nodes.

Ephemeral nodes or nodes containing them are not deleted by default. To force deletion of ephemeral nodes, supply the force option with a true value.

The dry_run option causes a summary of what would be deleted to be printed without actually deleting anything.

export_tree(path[, ephemeral[, name]])

Export a tree to a text representation.

path

The path to export.

ephemeral

Boolean, defaulting to false, indicating whether to include ephemeral nodes in the export. Including ephemeral nodes is mainly useful for visualizing the tree state.

name

The name to use for the top-level node.

This is useful when using export and import to copy a tree to a different location and name in the hierarchy.

Normally, when exporting the root node, /, the root isn’t included, but it is included if a name is given.

get_children(path)

Get a list of the names of the children the node at the given path.

This is more efficient than children when all you need is to read the list once, as it doesn’t create a zc.zk.Children object.

get_properties(path)

Get the properties for the node at the given path as a dictionary.

This is more efficient than properties when all you need is to read the properties once, as it doesn’t create a zc.zk.Properties object.

import_tree(text[, path='/'[, trim[, acl[, dry_run]]]])

Create tree nodes by importing a textual tree representation.

text

A textual representation of the tree.

path

The path at which to create the top-level nodes.

trim

Boolean, defaulting to false, indicating whether nodes not in the textual representation should be removed.

acl

An access control-list to use for imported nodes. If not specified, then full access is allowed to everyone.

dry_run

Boolean, defaulting to false, indicating whether to do a dry run of the import, without applying any changes.

ln(source, destination)

Create a symbolic link at the destination path pointing to the source path.

If the destination path ends with '/', then the source name is appended to the destination.

print_tree(path='/')

Print the tree at the given path.

This is just a short-hand for:

print zk.export_tree(path, ephemeral=True),
properties(path)

Return a zc.zk.Properties for the path.

Note that there is a fair bit of machinery in zc.zk.Properties objects to support keeping them up to date, callbacks, and cleaning them up when they are no-longer used. If you only want to get the properties once, use get_properties.

register_server(path, address, acl=zc.zk.READ_ACL_UNSAFE, **data)

Register a server at a path with the address.

An ephemeral child node of path will be created with name equal to the string representation (HOST:PORT) of the given address.

address must be a host and port tuple.

acl is a ZooKeeper access control list.

Optional node properties can be provided as keyword arguments.

resolve(path)

Find the real path for the given path.

In addition, ZooKeeper instances provide access to the following ZooKeeper functions as methods: acreate, add_auth, adelete, aexists, aget, aget_acl, aget_children, aset, aset_acl, async, create, delete, exists, get, get_acl, is_unrecoverable, recv_timeout, set, set2, set_acl, and set_watcher. When calling these as methods on ZooKeeper instances, it isn’t necessary to pass a handle, as that is provided automatically.

zc.zk.Children

__iter__()

Return an iterator over the child names.

__call__(callable)

Register a callback to be called whenever a child node is added or removed.

The callback is passed the children instance when a child node is added or removed.

The Children instance is returned.

zc.zk.Properties

Properties objects provide the usual read-only mapping methods, __getitem__, __len__, etc..

set(data=None, **properties)

Set the properties for the node, replacing existing data.

The data argument, if given, must be a dictionary or something that can be passed to the dict constructor. Items supplied as keywords take precedence over items supplied in the data argument.

update(data=None, **properties)

Update the properties for the node.

The data argument, if given, must be a dictionary or something that can be passed to a dictionary’s update method. Items supplied as keywords take precedence over items supplied in the data argument.

__call__(callable)

Register a callback to be called whenever a node’s properties are changed.

The callback is passed the properties instance when properties are changed.

The Properties instance is returned.

Other module attributes

zc.zk.ZK

A convenient aliad for zc.zk.ZooKeeper for people who hate to type.

zc.zk.OPEN_ACL_UNSAFE

An access control list that grants the world all rights.

zc.zk.READ_ACL_UNSAFE

An access control list that gives the world read access only.

Testing support

The zc.zk.testing module provides setUp and tearDown functions that can be used to emulate a ZooKeeper server. To find out more, use the help function:

>>> import zc.zk.testing
>>> help(zc.zk.testing)

Change History

0.6.0 (2012-01-25)

  • Improved register_server in the case when an empty host is passed. If netifaces is installed, register_server registers all of the IPv4 addresses [1].

  • Added zookeeper_import shell script for importing ZooKeeper trees.

  • delete_recursive now has a force argument to force deletion of ephemeral nodes.

  • Added zc.zk.ZK as an alias for zc.zk.ZooKeeper.

  • Documented pre-defined access control lists zc.zk.OPEN_ACL_UNSAFE and zc.zk.READ_ACL_UNSAFE

  • Fixed: the dry_run argument to delete_recursive didn’t work properly.

0.5.2 (2012-01-06)

  • ZooKeeper node data and child watchers are called on session expiry. This was unexpected. The data and child handler functions now handle these events more gracefully.

  • The ZooKeeper C library is excessively chatty about something that people don’t know how to care about it:

    https://issues.apache.org/jira/browse/ZOOKEEPER-642

    Until this is fixed, the log level for these messages is converted to DEBUG.

0.5.1 (2012-01-04)

  • Fixed incompatibilities with ZooKeeper 3.3.4

    • ZooKeeper raises a zookeeper.BadArgumentsException when an invalid path is passed to exists. Previously, returned False.

    • get_children no-longer returnes ordered values.

0.5.0 (2011-12-27)

  • Symbolic links can now be relative and use . and .. in the usual way.

  • Added property links.

  • Rearranged code internally to make certain experiments with the tree representation easier:

    • The link-resolution code is ow separated into a separate base class so it can be used with parse trees.

    • parse_tree now accepts an optional node class.

0.4.0 (2011-12-12)

  • Provided a command-line tool, zookeeper_export, to export/print trees.

  • If a server is registered with an empty host name, the hostname is changed to the result of socket.getfqdn()`.

  • Fixed a race that could cause ZooKeeper logging info to be output before zc.zk began redirecting it.

0.3.0 (2011-12-11)

  • Fixed bug: Ephemeral nodes weren’t recreated when sessions were reestablished.

  • zc.zk.RegisteringServer events are generated during server registration to allow third-party libraries to record additional properties on new server nodes.

  • Added a testing module that provides ZooKeeper emulation for testing complex interactions with zc.zk without needing a running ZooKeeper server.

  • zc.zk.Children objects now have a __len__, which is mainly useful for testing whether they are empty.

  • Separated parsing of tree representations into a separate fuction, parse_tree, to support analysis and added a graphvis demonstration module to show how one might use tree representations for system modeling.

  • Added a zc.zk.ZooKeeper wait constructor argument to wait indefinately for ZooKeeper to be available.

0.2.0 (2011-12-05)

  • Added tree import and export.

  • Added symbolic-links.

  • properties set and update methods now accept positional mapping objects (or iterables of items) as well as keyword arguments.

  • Added recursive node-deletion API.

  • Added get_properties to get properties without creating watches.

  • Added convenience access to low-level ZooKeeper APIs.

  • Added OPEN_ACL_UNSAFE and READ_ACL_UNSAFE (in zc.zk), which are mentioned by the ZooKeeper documentation. but not included in the zookeeper module.

  • Children and Properties objects are now cleaned up when no-longer used. Previously, they remained in memory for the life of the session.

0.1.0 (2011-11-27)

Initial release


Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

zc.zk-0.6.0.tar.gz (54.4 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page