Collective files
Project description
collective.zfile is a package for ZODB that allows you to manage files in a distributed way, using multiple storages.
It is still under development
It’s main features are the following:
- Multiple storage management The idea is to support a large amount of large files, so it is possible to manage multiple file storages.
- Revision control Using zc.vault it supports revisions, similar to SCM system, revisions are seen as transactions, each transaction you make will end up as a revision in the file system.
- Lock support Is is possible to lock files and folders in two ways: exclusive locks and shared locks, you can ask for any of this types of locks on any file, in a directory it can be recursive.
- Multiple mount points You can mount a zfolder in multiple ZODB mount points, using zc.mountpoint.using zc.mountpoint.
Usage:
In order to use collective.zfile there are four main objects to interact with:
- ZStorageManager
- ZBase
- ZFile
>>> from collective.zfile import ZStorageManager, ZBase >>> import transaction
You can create a storage this way
>>> storage = ZStorageManager()
>>> storage.add_storage('test_storage')
>>> app['storage'] = storage
Once you have at least one physical storage you can create a base, a base is similar to a complete filesystem.
>>> base = ZBase(storage)
It needs a connection to database so we save it AND commit.
>>> app['base'] = base >>> transaction.commit()
We are ready to go, we can now create a new ZRevision and use get our root folder
>>> revision = base.new_revision() >>> root = revision.root
Now we are good to go! we can keep working with this revision or just save it.
Let’s just save it for now
>>> revision.save_revision()
Let’s add a subdirectory called test
>>> test = root.newdir('test')
Traceback (most recent call last):
...
FrozenError
Oops!! Error #1, we cannot modify anything after saving a revision.
Lets try again
>>> revision = base.new_revision() >>> root = revision.root
Remember always to get the new root object when creating a revision
>>> test = root.newdir('test')
Newdir gives us a reference to the new created dir, but we could also do:
>>> test = root['test']
>>> test1 = test.newdir('test1')
And we can work with files as well
>>> file = test1.newfile("test.txt")
>>> f = file.open("w")
>>> f.write('Hello world')
>>> f.close()
And we can check it is ok!
>>> file.mimetype()
'text/plain'
>>> f = file.open('r')
>>> f.read()
'Hello world'
>>> f.close()
Let’s try all the process at once.
>>> html = test1.newfile("index.html")
>>> f = html.open("w")
>>> f.write("<html><head><title>Test</title><body>Hello Test</body></head></html>")
>>> f.close()
>>> html.mimetype() 'text/html'
>>> new_file = file.renew()
>>> f = new_file.open('a')
>>> f.write('\nHello newline')
>>> f.close()
>>> f = new_file.open('r')
>>> f.read()
'Hello world\nHello newline'
>>> f.close()
>>> revision.save_revision() >>> transaction.commit()
TODO: Lock doctests
TODO: Implement mountpoints
