Skip to main content

Python API to the filesystem for offline access to metadata

Project description

Pylesystem only works with the Linux Kernel 2.6.13 currently. It keeps track of filesystem events, for a directory and all subdirectories, and then make a real time index of the current full path into a SQLite database. Currently the script is hardcoded to run on /tmp.

After you install SQLAlchemy 0.5.x and Pyinotify 0.8.x, you can then run the script in one terminal, and then in a second terminal create files and delete files inside of the /tmp directory. These changes will be kept track of in real time using SQLAlchemy.

The eventual goal is to develop a robust Python API to the filesystem so that operations that would normally require walking the directory tree can be done by simply querying the full pathname and attributes in the database, and then performing actions based on those up to date records. This will lead to significant savings in CPU resources and time. One possible big user of Pylesystem is the entertainment industry, and specifically Animation Studios.

Acknowledgements: Thanks to Mike Bayer for a fix to the first alpha version.

Project details


Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page