A collection of shell utilities
Project description
A collection of shell utilities
Links
Project: https://github.com/dgilland/shelmet
Documentation: https://shelmet.readthedocs.io
Github Actions: https://github.com/dgilland/shelmet/actions
Features
Shell utilities like…
cp, mv, mkdir, touch
rm, rmfile, rmdir
ls, lsfiles, lsdirs
walk, walkfiles, walkdirs
cd, environ
and more!
100% test coverage
Fully type-annotated
Python 3.6+
Quickstart
Install using pip:
pip3 install shelmet
Import the sh module:
from shelmet import sh
Perform some file operations:
# Make directories and sub-directories. Behaves like "$ mkdir -p"
sh.mkdir("a", "b", "c", "d/e/f/g")
# Context-manager to change working directory temporarily. Behaves like "$ cd".
with sh.cd("d/e/f/g"):
sh.touch("1.txt", "2.txt", "3.txt")
# Move files or directories. Works across file-systems. Behaves like "$ mv".
sh.mv("1.txt", "11.txt")
# Copy files or directories. Behaves like "$ cp -r"
sh.cp("2.txt", "22.txt")
# List top-level directory contents.
# NOTE: sh.ls() and its siblings are generators.
list(sh.ls())
# Limit to files.
list(sh.lsfiles())
# Limit to directories.
list(sh.lsdirs())
# Remove files.
sh.rmfile("11.txt", "22.txt", "3.txt")
# Or use sh.rm which handles both files and directories.
sh.rm("11.txt", "22.txt", "3.txt")
# Recursively walk current directory.
# NOTE: sh.walk() and its siblings are generators.
list(sh.walk())
# Or just a specified directory.
list(sh.walk("d"))
# Or just it's files or directories.
list(sh.walkfiles())
list(sh.walkdirs())
# Remove directories.
sh.rmdir("a", "b", "c", "d")
# Or use sh.rm which handles both files and directories.
sh.rm("a", "b", "c", "d")
Run system commands:
# sh.run() is a wrapper around subprocess.run() that defaults to output capture, text-mode,
# exception raising on non-zero exit codes, environment variable extension instead of
# replacement, and support for passing command arguments as a variable number of strings instead
# of just a list of strings.
result = sh.run("ps", "aux")
print(result.stdout)
print(result.stderr)
# stdout and stderr can be combined with...
result = sh.run("some", "command", combine_output=True)
# or not captured at all...
sh.run(..., capture_output=False)
Create reusable run commands that support piping:
# sh.command() returns a sh.Command object that can be used to execute a fixed command.
ps_aux = sh.command("ps", "aux")
# And has the option to pipe it's output into another command automatically.
grep_ps = ps_aux.pipe("grep", "-i", check=False)
print(grep_ps.shell_cmd)
# ps aux | grep -i
search_result_1 = grep_ps.run("search term 1")
print(search_result_1.stdout)
search_result_2 = grep_ps.run("search term 2")
print(search_result_2.stdout)
Write to a new file atomically where content is written to a temporary file and then moved once finished:
import os
with sh.atomicfile("path/to/atomic.txt") as fp:
# Writes are sent to a temporary file in the same directory as the destination.
print(fp.name) # will be something like "path/to/.atomic.txt_XZKVqrlk.tmp"
fp.write("some text")
fp.write("some more text")
# File doesn't exist yet.
assert not os.path.exists("path/to/atomic.txt")
# Exiting context manager will result in the temporary file being atomically moved to destination.
# This will also result in a lower-level fsync on the destination file and directory.
assert os.path.exists("path/to/atomic.txt")
# File mode, sync skipping, and overwrite flag can be specified to change the default behavior which is...
with sh.atomicfile("file.txt", "w", skip_sync=False, overwrite=True): pass
# Additional parameters to open() can be passed as keyword arguments.
with sh.atomicfile("file.txt", "w", **open_kwargs): pass
Create a new directory atomically where its contents are written to a temporary directory and then moved once finished:
with sh.atomicdir("path/to/atomic_dir") as path:
# Yielded path is temporary directory within the same parent directory as the destination.
# path will be something like "path/to/.atomic_dir_QGLDfPwz_tmp"
some_file = path / "file.txt"
some_file.write_text("contents") # file written to "path/to/.atomic_dir_QGLDfPwz_tmp/file.txt"
some_dir = path / "dir"
some_dir.mkdir() # directory created at "path/to/.atomic_dir_QGLDfPwz_tmp/dir/"
# Directory doesn't exist yet.
assert not os.path.exists("path/to/atomic_dir")
# Exiting context manager will result in the temporary directory being atomically moved to destination.
assert os.path.exists("path/to/atomic_dir")
# Sync skipping and overwrite flag can be specified to change the default behavior which is...
with sh.atomicdir("atomic_dir", skip_sync=False, overwrite=True): pass
Temporarily change environment variables:
# Extend existing environment.
with sh.environ({"KEY1": "value1", "KEY2": "value2"}) as new_environ:
# Do something while environment changed.
# Environment variables include all previous ones and {"KEY1": "value1", "KEY2": "value2"}.
pass
# Replace the entire environment with a new one.
with sh.environ({"KEY": "value"}, replace=True):
# Environment variables are replaced and are now just {"KEY": "value"}.
pass
For more details, please see the full documentation at https://shelmet.readthedocs.io.
Changelog
v0.3.0 (2020-12-24)
Add to sh module:
Command
command
cwd
homedir
run
v0.2.0 (2020-11-30)
Add to sh module:
atomicdir
Rename atomic_write to atomicfile. breaking change
v0.1.0 (2020-11-16)
First release.
Add sh module:
atomic_write
cd
cp
dirsync
environ
fsync
getdirsize
ls
lsdirs
lsfiles
mkdir
mv
reljoin
rm
rmdir
rmfile
touch
umask
walk
walkdirs
walkfiles
MIT License
Copyright (c) 2020 Derrick Gilland
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the “Software”), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.