Skip to main content

Simple Python 3 library for file polling.

Project description

Simple Python framework for performing file polling.

It polls for files in the specified input directory and moves them to the output directory. Methods for checking the files (e.g., whether an image is valid) and processing them can be supplied to the poller instance. Optionally, the input files can be deleted rather than moved.

For more information and examples see:

https://github.com/waikato-datamining/simple-file-poller

Changelog

0.0.11 (2024-09-13)

  • using shutil.move instead of os.rename to work across file-system boundaries

0.0.10 (2021-03-18)

  • added the output_num_files boolean property to the Poller class, which extends the logging output by outputting a x/y string as well (x=current file index, y=total number of files in a batch)

0.0.9 (2021-01-05)

  • the Poller.logging property no longer returns the check_file method

0.0.8 (2020-12-11)

  • fixed high CPU usage (ie constant polling) when using unlimited files to list (max_files=0)

  • poll_wait and watchdog_check_interval are now float instead of int to allow for sub-second poll waits

  • internal delays when poller is busy have been dropped from 1s to 0.1s

0.0.7 (2020-12-10)

  • keyboard_interrupt method is now public

0.0.6 (2020-12-10)

  • fixed race condition between watchdog reacting to new files and watchdog checking for files at specific intervals

  • logging now distinguishes between DEBUG/INFO/ERROR levels

  • keyboard interrupts via CTRL+C are now handled correctly

  • in watchdog mode, an initial scan of the input directory is now performed, in case files were already present

0.0.5 (2020-12-10)

  • added params object to allow attaching of arbitrary parameters to be used by the check_file and process_file methods; this avoids accidentally overriding Poller attributes that were introduced in later versions.

0.0.4 (2020-12-10)

  • added support for using watchdog for reacting to file creation events, speeding up polling

0.0.3 (2020-12-04)

  • poll method now skips directories, which could be listed if no extensions are supplied to restrict the polling.

0.0.2 (2020-12-03)

  • added other_input_files glob list and delete_other_input_files to manage additional files that may reside in the input directory along side the actual files that are being processed.

0.0.1 (2020-12-02)

  • initial release

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

simple-file-poller-0.0.11.tar.gz (12.0 kB view details)

Uploaded Source

File details

Details for the file simple-file-poller-0.0.11.tar.gz.

File metadata

  • Download URL: simple-file-poller-0.0.11.tar.gz
  • Upload date:
  • Size: 12.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.4.2 requests/2.22.0 setuptools/45.2.0 requests-toolbelt/0.8.0 tqdm/4.30.0 CPython/3.8.10

File hashes

Hashes for simple-file-poller-0.0.11.tar.gz
Algorithm Hash digest
SHA256 9c0b1fa324e5e20e9cb23b02bb1a622bf8c230e7dbdad93764e33cf04757d2b4
MD5 3563a64b6aee760f6df51055466a1d26
BLAKE2b-256 d5a600d1c04dfb4c8393ce7d40ed4eb587ba9f90e6339e7901a93bfcca129ed9

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page