PyFilesystem2

Python’s Filesystem abstraction layer.

Documentation

Introduction

Think of PyFilesystem’s FS objects as the next logical step to Python’s file objects. In the same way that file objects abstract a single file, FS objects abstract an entire filesystem.

Let’s look at a simple piece of code as an example. The following function uses the PyFilesystem API to count the number of non-blank lines of Python code in a directory. It works recursively, so it will find .py files in all sub-directories.

def count_python_loc(fs):
    """Count non-blank lines of Python code."""
    count = 0
    for path in fs.walk.files(filter=['*.py']):
        with fs.open(path) as python_file:
            count += sum(1 for line in python_file if line.strip())
    return count

We can call count_python_loc as follows:

from fs import open_fs
projects_fs = open_fs('~/projects')
print(count_python_loc(projects_fs))

The line project_fs = open_fs('~/projects') opens an FS object that maps to the projects directory in your home folder. That object is used by count_python_loc when counting lines of code.

To count the lines of Python code in a zip file, we can make the following change:

projects_fs = open_fs('zip://projects.zip')

Or to count the Python lines on an FTP server:

projects_fs = open_fs('ftp://ftp.example.org/projects')

No changes to count_python_loc are necessary, because PyFileystem provides a simple consistent interface to anything that resembles a collection of files and directories. Essentially, it allows you to write code that is independent of where and how the files are physically stored.

Contrast that with a version that purely uses the standard library:

def count_py_loc(path):
    count = 0
    for root, dirs, files in os.walk(path):
        for name in files:
            if name.endswith('.py'):
                with open(os.path.join(root, name), 'rt') as python_file:
                    count += sum(1 for line in python_file if line.strip())

This version is similar to the PyFilesystem code above, but would only work with the OS filesystem. Any other filesystem would require an entirely different API, and you would likely have to re-implement the directory walking functionality of os.walk.

Credits

Will McGugan
Martin Larralde
Giampaolo for copy_if_newer and ftp fixes.

PyFilesystem2 owes a massive debt of gratitude to the following developers who contributed code and ideas to the original version.

Ryan Kelly
Andrew Scheller
Ben Timby

Apologies if I missed anyone, feel free to prompt me if your name is missing here.

Metadata

Release files for fs 2.0.21

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for fs 2.0.21
File	Size	Uploaded	Provenance
fs-2.0.21.tar.gz	115.8 kB	May 2, 2018	Without provenance	Details

Built distribution (wheel)

Table of built distributions (wheels) for fs 2.0.21
File	Interpreter	ABI	Platform	Reset
fs-2.0.21-py2.py3-none-any.whl 119.9 kB May 2, 2018 Without provenance	Python 2, Python 3	none	any	Details

Total release size: 235.8 kB

Release files / fs-2.0.21.tar.gz

Download URL	fs-2.0.21.tar.gz
Size	115.8 kB
Tags	Source
SHA-256 checksum How to use checksums	`729893ac1bb9be12af4952688f00e1d93ff0aaf6e2b2f0a10fd61864197e384a`
BLAKE2b-256 checksum How to use checksums	`d0031a49f61b1bac7486bbd0b1e6f7e558cd35354fc0d3ec1aa408e14f608dcf`
Upload date	May 2, 2018
Uploaded using Trusted Publishing? What is trusted publishing?	No

Release files / fs-2.0.21-py2.py3-none-any.whl

Download URL	fs-2.0.21-py2.py3-none-any.whl
Size	119.9 kB
Tags	Python 2 Python 3
SHA-256 checksum How to use checksums	`740026e2eec4e1992f2f9939528ee6e3da94250312e9a5fb8d7bd4bfda75982f`
BLAKE2b-256 checksum How to use checksums	`9fb87709a9719dbb2add1bc891216310db65df0abad67b0ba8abac96e3f52ffa`
Upload date	May 2, 2018
Uploaded using Trusted Publishing? What is trusted publishing?	No

Security for fs 2.0.21

Report project as malware

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.