Skip to main content

Python API to the filesystem for offline access to metadata

Project description

Pylesystem only works with the Linux Kernel 2.6.13 currently. It keeps track of filesystem events, for a directory and all subdirectories, and then make a real time index of the current full path into a SQLite database. Currently the script is hardcoded to run on /tmp.

After you install SQLAlchemy 0.5.x and Pyinotify 0.8.x, you can then run the script in one terminal, and then in a second terminal create files and delete files inside of the /tmp directory. These changes will be kept track of in real time using SQLAlchemy.

The eventual goal is to develop a robust Python API to the filesystem so that operations that would normally require walking the directory tree can be done by simply querying the full pathname and attributes in the database, and then performing actions based on those up to date records. This will lead to significant savings in CPU resources and time. One possible big user of Pylesystem is the entertainment industry, and specifically Animation Studios.

Acknowledgements: Thanks to Mike Bayer for a fix to the first alpha version.

Project details

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page