Skip to main content

pathspec: Path Specification

pathspec is a utility library for pattern matching of file paths. So far this only includes Git’s wildmatch pattern matching which itself is derived from Rsync’s wildmatch. Git uses wildmatch for its gitignore files.

Tutorial

Say you have a “Projects” directory and you want to back it up, but only certain files, and ignore others depending on certain conditions:

>>> import pathspec
>>> # The gitignore-style patterns for files to select, but we're including
>>> # instead of ignoring.
>>> spec = """
...
... # This is a comment because the line begins with a hash: "#"
...
... # Include several project directories (and all descendants) relative to
... # the current directory. To reference a directory you must end with a
... # slash: "/"
... /project-a/
... /project-b/
... /project-c/
...
... # Patterns can be negated by prefixing with exclamation mark: "!"
...
... # Ignore temporary files beginning or ending with "~" and ending with
... # ".swp".
... !~*
... !*~
... !*.swp
...
... # These are python projects so ignore compiled python files from
... # testing.
... !*.pyc
...
... # Ignore the build directories but only directly under the project
... # directories.
... !/*/build/
...
... """

We want to use the GitWildMatchPattern class to compile our patterns. The PathSpec class provides an interface around pattern implementations:

>>> spec = pathspec.PathSpec.from_lines(pathspec.patterns.GitWildMatchPattern, spec.splitlines())

That may be a mouthful but it allows for additional patterns to be implemented in the future without them having to deal with anything but matching the paths sent to them. GitWildMatchPattern is the implementation of the actual pattern which internally gets converted into a regular expression. PathSpec is a simple wrapper around a list of compiled patterns.

To make things simpler, we can use the registered name for a pattern class instead of always having to provide a reference to the class itself. The GitWildMatchPattern class is registered as gitwildmatch:

>>> spec = pathspec.PathSpec.from_lines('gitwildmatch', spec.splitlines())

If we wanted to manually compile the patterns we can just do the following:

>>> patterns = map(pathspec.patterns.GitWildMatchPattern, spec.splitlines())
>>> spec = PathSpec(patterns)

PathSpec.from_lines() is simply a class method which does just that.

If you want to load the patterns from file, you can pass the file instance directly as well:

>>> with open('patterns.list', 'r') as fh:
>>>     spec = pathspec.PathSpec.from_lines('gitwildmatch', fh)

You can perform matching on a whole directory tree with:

>>> matches = spec.match_tree('path/to/directory')

Or you can perform matching on a specific set of file paths with:

>>> matches = spec.match_files(file_paths)

Or check to see if an individual file matches:

>>> is_matched = spec.match_file(file_path)

License

pathspec is licensed under the Mozilla Public License Version 2.0. See LICENSE or the FAQ for more information.

In summary, you may use pathspec with any closed or open source project without affecting the license of the larger work so long as you:

  • give credit where credit is due,

  • and release any custom changes made to pathspec.

Source

The source code for pathspec is available from the GitHub repo cpburnz/python-path-specification.

Installation

pathspec requires the following packages:

pathspec can be installed from source with:

python setup.py install

pathspec is also available for install through PyPI:

pip install pathspec

Documentation

Documentation for pathspec is available on Read the Docs.

Other Languages

pathspec is also available as a Ruby gem.

Change History

0.7.0 (2019-12-27)

  • Issue #28: Add support for Python 3.8, and drop Python 3.4.

  • Issue #29: Publish bdist wheel.

0.6.0 (2019-10-03)

0.5.9 (2018-09-15)

  • Fixed file system error handling.

0.5.8 (2018-09-15)

  • Improved type checking.

  • Created scripts to test Python 2.6 because Tox removed support for it.

  • Improved byte string handling in Python 3.

  • Issue #22: Handle dangling symlinks.

0.5.7 (2018-08-14)

  • Issue #21: Fix collections deprecation warning.

0.5.6 (2018-04-06)

  • Improved unit tests.

  • Improved type checking.

  • Issue #20: Support current directory prefix.

0.5.5 (2017-09-09)

  • Add documentation link to README.

0.5.4 (2017-09-09)

  • Issue #17: Add link to Ruby implementation of pathspec.

  • Add sphinx documentation.

0.5.3 (2017-07-01)

0.5.2 (2017-04-04)

  • Fixed change log.

0.5.1 (2017-04-04)

  • Issue #13: Add equality methods to PathSpec and RegexPattern.

0.5.0 (2016-08-22)

  • Issue #12: Add PathSpec.match_file().

  • Renamed gitignore.GitIgnorePattern to patterns.gitwildmatch.GitWildMatchPattern.

  • Deprecated gitignore.GitIgnorePattern.

0.4.0 (2016-07-15)

  • Issue #11: Support converting patterns into regular expressions without compiling them.

  • API change: Subclasses of RegexPattern should implement pattern_to_regex().

0.3.4 (2015-08-24)

  • Issue #7: Fixed non-recursive links.

  • Issue #8: Fixed edge cases in gitignore patterns.

  • Issue #9: Fixed minor usage documentation.

  • Fixed recursion detection.

  • Fixed trivial incompatibility with Python 3.2.

0.3.3 (2014-11-21)

  • Improved documentation.

0.3.2 (2014-11-08)

  • Issue #5: Use tox for testing.

  • Issue #6: Fixed matching Windows paths.

  • Improved documentation.

  • API change: spec.match_tree() and spec.match_files() now return iterators instead of sets.

0.3.1 (2014-09-17)

  • Updated README.

0.3.0 (2014-09-17)

  • Issue #3: Fixed trailing slash in gitignore patterns.

  • Issue #4: Fixed test for trailing slash in gitignore patterns.

  • Added registered patterns.

0.2.2 (2013-12-17)

  • Fixed setup.py.

0.2.1 (2013-12-17)

  • Added tests.

  • Fixed comment gitignore patterns.

  • Fixed relative path gitignore patterns.

0.2.0 (2013-12-07)

  • Initial release.

Metadata

Release files for pathspec 0.7.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for pathspec 0.7.0
File Size Uploaded
pathspec-0.7.0.tar.gz 24.3 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for pathspec 0.7.0
File Interpreter ABI Platform
pathspec-0.7.0-py2.py3-none-any.whl Python 2, Python 3 none any Details

Total release size: 49.4 kB

Release files / pathspec-0.7.0.tar.gz

Download URL pathspec-0.7.0.tar.gz
Size 24.3 kB
Tags Source
SHA-256 checksum
How to use checksums
562aa70af2e0d434367d9790ad37aed893de47f1693e4201fd1d3dca15d19b96
BLAKE2b-256 checksum
How to use checksums
cef2d35c292da8fbff725625a17ae40f48f933070acd5ccddb03d8c09d81758d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via Python-urllib/3.6

Release files / pathspec-0.7.0-py2.py3-none-any.whl

Download URL pathspec-0.7.0-py2.py3-none-any.whl
Size 25.1 kB
Tags Python 2 Python 3
SHA-256 checksum
How to use checksums
163b0632d4e31cef212976cf57b43d9fd6b0bac6e67c26015d611a647d5e7424
BLAKE2b-256 checksum
How to use checksums
34fac5cc4f796eb954b56fd1f6c7c315647b18b027e0736c9ae87b73bbb1f933
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via Python-urllib/3.6

Release history Release notifications | RSS feed

1.1.1

2 release files

1.1.0

2 release files

1.0.4

2 release files

1.0.3

2 release files

1.0.2

2 release files

1.0.1

2 release files

1.0.0

2 release files

0.12.1

2 release files

0.11.2

2 release files

0.11.1

2 release files

0.11.0

2 release files

0.10.3

2 release files

0.10.2

2 release files

0.10.0

2 release files

0.9.0

2 release files

0.8.1

2 release files

0.8.0

2 release files

This release

0.7.0 This release

2 release files

0.6.0

1 release file

0.5.9

1 release file

0.5.8

1 release file

0.5.7

1 release file

0.5.6

1 release file

0.5.5

1 release file

0.5.4

1 release file

0.5.3

1 release file

0.5.2

1 release file

0.5.1

1 release file

0.5.0

1 release file

0.4.0

1 release file

0.3.4

1 release file

0.3.3

1 release file

0.3.2

1 release file

0.3.1

1 release file

0.3.0

1 release file

0.2.2

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page