A BTree based implementation for Zope 2's OFS.
BTreeFolder2 is a Zope product that acts like a Zope 2 OFS folder but can store many more items.
When you fill a Zope folder with too many items, both Zope and your browser get overwhelmed. Zope has to load and store a large folder object, and the browser has to render large HTML tables repeatedly. Zope can store a lot of objects, but it has trouble storing a lot of objects in a single standard folder.
Zope Corporation once had an extensive discussion on the subject. It was decided that we would expand standard folders to handle large numbers of objects gracefully. Unfortunately, Zope folders are used and extended in so many ways today that it would be difficult to modify standard folders in a way that would be compatible with all Zope products.
So the BTreeFolder product was born. It stored all subobjects in a ZODB BTree, a structure designed to allow many items without loading them all into memory. It also rendered the contents of the folder as a simple select list rather than a table. Most browsers have no trouble rendering large select lists.
But there was still one issue remaining. BTreeFolders still stored the ID of all subobjects in a single database record. If you put tens of thousands of items in a single BTreeFolder, you would still be loading and storing a multi-megabyte folder object. Zope can do this, but not quickly, and not without bloating the database.
BTreeFolder2 solves this issue. It stores not only the subobjects but also the IDs of the subobjects in a BTree. It also batches the list of items in the UI, showing only 1000 items at a time. So if you write your application carefully, you can use a BTreeFolder2 to store as many items as will fit in physical storage.
There are products that depend on the internal structure of the original BTreeFolder, however. So rather than risk breaking those products, the product has been renamed. You can have both products installed at the same time. If you’re developing new applications, you should use BTreeFolder2.
The BTreeFolder2 user interface shows a list of items rather than a series of checkboxes. To visit an item, select it in the list and click the “edit” button.
BTreeFolder2 objects provide Python dictionary-like methods to make them easier to use in Python code than standard folders:
has_key(key) keys() values() items() get(key, default=None) __len__()
keys(), values(), and items() return sequences, but not necessarily tuples or lists. Use len(folder) to call the __len__() method. The objects returned by values() and items() have acquisition wrappers.
BTreeFolder2 also provides a method for generating unique, non-overlapping IDs:
generateId(prefix='item', suffix='', rand_ceiling=999999999)
The ID returned by this method is guaranteed to not clash with any other ID in the folder. Use the returned value as the ID for new objects. The generated IDs tend to be sequential so that objects that are likely related in some way get loaded together.
BTreeFolder2 implements the full Folder interface, with the exception that the superValues() method does not return any items. To implement the method in the way the Zope codebase expects would undermine the performance benefits gained by using BTreeFolder2.
- added tox configuration
- Python 3 compatibility
- Update to require and be compatible with Zope 4.
- Update Dependencies (no ZODB, but BTrees)
- Require ExtensionClass >= 4.1a1 (Compatible w/ Zope 4).
- Added case for clean-up routine where the meta type index contains keys that are not in the tree.
- Provide security declaration for
- Add some tests for correct
itemsmethods are now exactly the same as
objectItems. They did the same before already but duplicated the code.
objectItemsno longer do a special handling when no special
specis requested as
objectIdsalready does the correct handling.
- Make sure that methods returning objects return them Acquisition wrapped.
- Be more careful in calling our own keys, values and items methods, as sub-classes might have overridden some of them.
- Changed the
objectValuesmethods to use the internal OOBTree methods directly if no
specargument is passed.
- Change implementation of
valuesmethod to access the
self._treeOOBTree methods directly. This avoids lookups in the meta_types structures.
- Implement the full dictionary protocol including
- Released as separate package.
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
|File Name & Checksum SHA256 Checksum Help||Version||File Type||Upload Date|
|Products.BTreeFolder2-4.0.0-py2.py3-none-any.whl (20.1 kB) Copy SHA256 Checksum SHA256||py2.py3||Wheel||May 28, 2017|
|Products.BTreeFolder2-4.0.0.tar.gz (17.3 kB) Copy SHA256 Checksum SHA256||–||Source||May 23, 2017|