Skip to main content

Monitor a directory for new files

Project description

SpongeBot

Monitor a directory for new files

When instantiating a new SpongeBot, you need to provide it with a path to a directory and a callback function. The callback function is called each time a new file is added to the directory, passsing the name of the new file as the first parameter. SpongeBot will run as a thread, making it possible to run multiple SpongeBots simultaneously.

A typical usecase for SpongeBot would look like this:

from spongebot import SpongeBot

def my_callback_function(file_name):
	print('A new file was added to the directory!')

 sb = SpongeBot('./my_directory', my_callback_function)
 sb.start()

The following parameters can be passed to SpongeBot:

  • path: The path to the directory that needs to be monitored
  • callback: A callable that takes a filepath as the first parameter
  • interval: The interval length in seconds that determines how frequently SpongeBot checks for new files. Defaults to 2 seconds.
  • static_args: A list that will be unpacked and passed to the callback function
  • static_kwargs: A dictionary that will be unpacked and passed to the callback function
  • snapshot_file: A file that can be used by SpongeBot to keep track of the files tht are already in the directory. This is used to make SpongeBot more robust in the case of system crashes. Defaults to "./.spongeBot_snapshot.txt".

Another example that uses more features of SpongeBot:

from spongebot import SpongeBot
import pandas as pd


def my_callback_function(file_name, data_pool, verbose=False):
	if verbose:
		print('Processing file ' + file_name)
	df = pd.from_csv(file_name)
	with open(data_pool, 'a') as f:
		df.to_csv(f, index=False, header=False)

data_pool = pd.from_csv('')

sb = SpongeBot(
	'./file_pool/',
	my_callback_function,
	interval=30.0,
	static_args=['./big_data_pool.csv'],
	static_kwargs={'verbose': True},
	snapshot_file='./snapshot_spongeBot.txt')
sb.start()
print('SpongeBot is now running!')

Project details


Release history Release notifications

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for spongebot, version 0.1.0
Filename, size File type Python version Upload date Hashes
Filename, size spongebot-0.1.0-py3-none-any.whl (4.9 kB) File type Wheel Python version py3 Upload date Hashes View
Filename, size spongebot-0.1.0.tar.gz (3.8 kB) File type Source Python version None Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page