Skip to main content

Simple utilities for dev work.

Project description

BSD3 License
Build Status
Coverage Status
Issue Count 'Stories in Ready'


Utility functions, created by Drew, for Drew. Used in botskeleton (and all the bots that use it) and puckfetcher.


These are in the order defined in, which in turn is basically defined by order of creation. Not really organized nicely, sorry.



Create directory if it doesn’t exist.


Expand ~ to $HOME, and expand other environment variables to their values, in the provided path. Designed for UNIX-based platforms: unclear what will happen on others.

generate_downloader(headers, args, max_per_hour=30)

Produce a callable downloader. Provide headers for URL call, and provide some args (for the rate limiting (see that later in the document)), which will be used to identify this function in rate-limiting. max_per_hour is optional: use it to decide how many times per hour downloads can happen. The default is 30 times per hour. The returned downloader is called as follows:

downloader = generate_downloader({"foo": "bar"}, "an identifier string")
downloader(url=url, dest=dest)

where url is where to download FROM and dest is where to SAVE the file. It will make the directory for the file if it does not exist. A text progress bar is shown during download, and while rate limit is blocking.

max_clamp(val, limit)

Return val if it is less than limit, otherwise return limit.


Given a string like “1 23 4-8 32 1”, return a unique list of those integers in the string, and the integers in the ranges in the string. For this example, the output would be [1, 4, 5, 6, 7, 8, 23, 32]. Non-numbers ignored. Not necessarily sorted

rate_limited(max_per_hour, *args)

A decorator to rate-limit a function (ensures that it runs no more than max_per_hour times per hour by sleeping sometimes). Called like this:

@util.rate_limited(120, name)
def a_function(var1, var2="foo"):

sanitize(filename, platform=None)

Remove disallowed characters from potential filename. Provide platform to sanitize for that platform, otherwise current platform is found and used.

set_up_logging(log_filename="log", verbosity=0)

Set up a logger with reasonable settings. Return it for log calls.

random_line(file_path, encoding=FORCED_ENCODING)

At time of writing, FORCED_ENCODING is “UTF-8”. Refer to code for latest. Return a line from the provided file at random.

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

drewtilities-1.3.2.tar.gz (6.4 kB view hashes)

Uploaded source

Built Distribution

drewtilities-1.3.2-py3-none-any.whl (7.5 kB view hashes)

Uploaded py3

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page