Skip to main content

More Itertools

https://readthedocs.org/projects/more-itertools/badge/?version=latest

Python’s itertools library is a gem - you can compose elegant solutions for a variety of problems with the functions it provides. In more-itertools we collect additional building blocks, recipes, and routines for working with Python iterables.

Grouping

chunked, ichunked, sliced, distribute, divide, split_at, split_before, split_after, split_into, split_when, bucket, unzip, grouper, partition

Lookahead and lookback

spy, peekable, seekable

Windowing

windowed, substrings, substrings_indexes, stagger, windowed_complete, pairwise

Augmenting

count_cycle, intersperse, padded, mark_ends, repeat_last, adjacent, groupby_transform, padnone, ncycles

Combining

collapse, sort_together, interleave, interleave_longest, zip_offset, zip_equal, dotproduct, convolve, flatten, roundrobin, prepend, value_chain

Summarizing

ilen, unique_to_each, sample, consecutive_groups, run_length, map_reduce, exactly_n, is_sorted, all_equal, all_unique, first_true, quantify

Selecting

islice_extended, first, last, one, only, strip, lstrip, rstrip, filter_except map_except nth_or_last, nth, take, tail, unique_everseen, unique_justseen

Combinatorics

distinct_permutations, distinct_combinations, circular_shifts, partitions, set_partitions, product_index, combination_index, permutation_index, powerset, random_product, random_permutation, random_combination, random_combination_with_replacement, nth_product nth_permutation nth_combination

Wrapping

always_iterable, always_reversible, countable, consumer, with_iter, iter_except

Others

locate, rlocate, replace, numeric_range, side_effect, iterate, difference, make_decorator, SequenceView, time_limited, consume, tabulate, repeatfunc

Getting started

To get started, install the library with pip:

pip install more-itertools

The recipes from the itertools docs are included in the top-level package:

>>> from more_itertools import flatten
>>> iterable = [(0, 1), (2, 3)]
>>> list(flatten(iterable))
[0, 1, 2, 3]

Several new recipes are available as well:

>>> from more_itertools import chunked
>>> iterable = [0, 1, 2, 3, 4, 5, 6, 7, 8]
>>> list(chunked(iterable, 3))
[[0, 1, 2], [3, 4, 5], [6, 7, 8]]

>>> from more_itertools import spy
>>> iterable = (x * x for x in range(1, 6))
>>> head, iterable = spy(iterable, n=3)
>>> list(head)
[1, 4, 9]
>>> list(iterable)
[1, 4, 9, 16, 25]

For the full listing of functions, see the API documentation.

Development

more-itertools is maintained by @erikrose and @bbayles, with help from many others. If you have a problem or suggestion, please file a bug or pull request in this repository. Thanks for contributing!

Version History

noindex:

8.8.0

  • New functions
    • countable (thanks to krzysieq)

  • Changes to existing functions
    • split_before was updated to handle empy collections (thanks to TiunovNN)

    • unique_everseen got a performance boost (thanks to Numerlor)

    • The type hint for value_chain was corrected (thanks to vr2262)

8.7.0

  • New functions
    • convolve (from the Python itertools docs)

    • product_index, combination_index, and permutation_index (thanks to N8Brooks)

    • value_chain (thanks to jenstroeger)

  • Changes to existing functions
    • distinct_combinations now uses a non-recursive algorithm (thanks to knutdrand)

    • pad_none is now the preferred name for padnone, though the latter remains available.

    • pairwise will now use the Python standard library implementation on Python 3.10+

    • sort_together now accepts a key argument (thanks to brianmaissy)

    • seekable now has a peek method, and can indicate whether the iterator it’s wrapping is exhausted (thanks to gsakkis)

    • time_limited can now indicate whether its iterator has expired (thanks to roysmith)

    • The implementation of unique_everseen was improved (thanks to plammens)

  • Other changes:
    • Various documentation updates (thanks to cthoyt, Evantm, and cyphase)

8.6.0

  • New itertools
    • all_unique (thanks to brianmaissy)

    • nth_product and nth_permutation (thanks to N8Brooks)

  • Changes to existing itertools
    • chunked and sliced now accept a strict parameter (thanks to shlomif and jtwool)

  • Other changes
    • Python 3.5 has reached its end of life and is no longer supported.

    • Python 3.9 is officially supported.

    • Various documentation fixes (thanks to timgates42)

8.5.0

  • New itertools
    • windowed_complete (thanks to MarcinKonowalczyk)

  • Changes to existing itertools:
    • The is_sorted implementation was improved (thanks to cool-RR)

    • The groupby_transform now accepts a reducefunc parameter.

    • The last implementation was improved (thanks to brianmaissy)

  • Other changes
    • Various documentation fixes (thanks to craigrosie, samuelstjean, PiCT0)

    • The tests for distinct_combinations were improved (thanks to Minabsapi)

    • Automated tests now run on GitHub Actions. All commits now check:
      • That unit tests pass

      • That the examples in docstrings work

      • That test coverage remains high (using coverage)

      • For linting errors (using flake8)

      • For consistent style (using black)

      • That the type stubs work (using mypy)

      • That the docs build correctly (using sphinx)

      • That packages build correctly (using twine)

8.4.0

  • New itertools
    • mark_ends (thanks to kalekundert)

    • is_sorted

  • Changes to existing itertools:
    • islice_extended can now be used with real slices (thanks to cool-RR)

    • The implementations for filter_except and map_except were improved (thanks to SergBobrovsky)

  • Other changes
    • Automated tests now enforce code style (using black)

    • The various signatures of islice_extended and numeric_range now appear in the docs (thanks to dsfulf)

    • The test configuration for mypy was updated (thanks to blueyed)

8.3.0

  • New itertools
    • zip_equal (thanks to frankier and alexmojaki)

  • Changes to existing itertools:
    • split_at, split_before, split_after, and split_when all got a maxsplit paramter (thanks to jferard and ilai-deutel)

    • split_at now accepts a keep_separator parameter (thanks to jferard)

    • distinct_permutations can now generate r-length permutations (thanks to SergBobrovsky and ilai-deutel)

    • The windowed implementation was improved (thanks to SergBobrovsky)

    • The spy implementation was improved (thanks to has2k1)

  • Other changes
    • Type stubs are now tested with stubtest (thanks to ilai-deutel)

    • Tests now run with python -m unittest instead of python setup.py test (thanks to jdufresne)

8.2.0

  • Bug fixes
    • The .pyi files for typing were updated. (thanks to blueyed and ilai-deutel)

  • Changes to existing itertools:
    • numeric_range now behaves more like the built-in range. (thanks to jferard)

    • bucket now allows for enumerating keys. (thanks to alexchandel)

    • sliced now should now work for numpy arrays. (thanks to sswingle)

    • seekable now has a maxlen parameter.

8.1.0

  • Bug fixes
    • partition works with pred=None again. (thanks to MSeifert04)

  • New itertools
    • sample (thanks to tommyod)

    • nth_or_last (thanks to d-ryzhikov)

  • Changes to existing itertools:
    • The implementation for divide was improved. (thanks to jferard)

8.0.2

  • Bug fixes
    • The type stub files are now part of the wheel distribution (thanks to keisheiled)

8.0.1

  • Bug fixes
    • The type stub files now work for functions imported from the root package (thanks to keisheiled)

8.0.0

  • New itertools and other additions
    • This library now ships type hints for use with mypy. (thanks to ilai-deutel for the implementation, and to gabbard and fmagin for assistance)

    • split_when (thanks to jferard)

    • repeat_last (thanks to d-ryzhikov)

  • Changes to existing itertools:
    • The implementation for set_partitions was improved. (thanks to jferard)

    • partition was optimized for expensive predicates. (thanks to stevecj)

    • unique_everseen and groupby_transform were re-factored. (thanks to SergBobrovsky)

    • The implementation for difference was improved. (thanks to Jabbey92)

  • Other changes
    • Python 3.4 has reached its end of life and is no longer supported.

    • Python 3.8 is officially supported. (thanks to jdufresne)

    • The collate function has been deprecated. It raises a DeprecationWarning if used, and will be removed in a future release.

    • one and only now provide more informative error messages. (thanks to gabbard)

    • Unit tests were moved outside of the main package (thanks to jdufresne)

    • Various documentation fixes (thanks to kriomant, gabbard, jdufresne)

7.2.0

  • New itertools
    • distinct_combinations

    • set_partitions (thanks to kbarrett)

    • filter_except

    • map_except

7.1.0

  • New itertools
    • ichunked (thanks davebelais and youtux)

    • only (thanks jaraco)

  • Changes to existing itertools:
    • numeric_range now supports ranges specified by datetime.datetime and datetime.timedelta objects (thanks to MSeifert04 for tests).

    • difference now supports an initial keyword argument.

  • Other changes
    • Various documentation fixes (thanks raimon49, pylang)

7.0.0

  • New itertools:
    • time_limited

    • partitions (thanks to rominf and Saluev)

    • substrings_indexes (thanks to rominf)

  • Changes to existing itertools:
    • collapse now treats bytes objects the same as str objects. (thanks to Sweenpet)

The major version update is due to the change in the default behavior of collapse. It now treats bytes objects the same as str objects. This aligns its behavior with always_iterable.

>>> from more_itertools import collapse
>>> iterable = [[1, 2], b'345', [6]]
>>> print(list(collapse(iterable)))
[1, 2, b'345', 6]

6.0.0

  • Major changes:
    • Python 2.7 is no longer supported. The 5.0.0 release will be the last version targeting Python 2.7.

    • All future releases will target the active versions of Python 3. As of 2019, those are Python 3.4 and above.

    • The six library is no longer a dependency.

    • The accumulate function is no longer part of this library. You may import a better version from the standard itertools module.

  • Changes to existing itertools:
    • The order of the parameters in grouper have changed to match the latest recipe in the itertools documentation. Use of the old order will be supported in this release, but emit a DeprecationWarning. The legacy behavior will be dropped in a future release. (thanks to jaraco)

    • distinct_permutations was improved (thanks to jferard - see also permutations with unique values at StackOverflow.)

    • An unused parameter was removed from substrings. (thanks to pylang)

  • Other changes:
    • The docs for unique_everseen were improved. (thanks to jferard and MSeifert04)

    • Several Python 2-isms were removed. (thanks to jaraco, MSeifert04, and hugovk)

Metadata

Release files for more-itertools 8.8.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for more-itertools 8.8.0
File Size Uploaded
more-itertools-8.8.0.tar.gz 93.7 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for more-itertools 8.8.0
File Interpreter ABI Platform
more_itertools-8.8.0-py3-none-any.whl Python 3 none any Details

Total release size: 142.4 kB

Release files / more-itertools-8.8.0.tar.gz

Download URL more-itertools-8.8.0.tar.gz
Size 93.7 kB
Tags Source
SHA-256 checksum
How to use checksums
83f0308e05477c68f56ea3a888172c78ed5d5b3c282addb67508e7ba6c8f813a
BLAKE2b-256 checksum
How to use checksums
030a4769cc0557fbe690f86bc4c183faa116f1050e5c9296f1b7b5806f063cdb
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.5.0.1 requests/2.23.0 requests-toolbelt/0.9.1 tqdm/4.46.0 CPython/3.8.5

Release files / more_itertools-8.8.0-py3-none-any.whl

Download URL more_itertools-8.8.0-py3-none-any.whl
Size 48.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
2cf89ec599962f2ddc4d568a05defc40e0a587fbc10d5989713638864c36be4d
BLAKE2b-256 checksum
How to use checksums
5f3ce3ee43177a86b448c3fea1d090238c365ea1a80f015836a8a18fbbaccd63
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.4.1 importlib_metadata/4.0.1 pkginfo/1.5.0.1 requests/2.23.0 requests-toolbelt/0.9.1 tqdm/4.46.0 CPython/3.8.5

Release history Release notifications | RSS feed

11.2.1

2 release files

11.2.0

2 release files

11.1.0

2 release files

10.7.0

2 release files

10.6.0

2 release files

10.3.0

2 release files

10.0.0

2 release files

9.1.0

2 release files

9.0.0

2 release files

8.12.0

2 release files

8.10.0

2 release files

8.9.0

2 release files

This release

8.8.0 This release

2 release files

8.7.0

2 release files

8.6.0

2 release files

8.5.0

2 release files

8.4.0

2 release files

8.3.0

2 release files

8.2.0

2 release files

8.1.0

2 release files

8.0.2

2 release files

8.0.1

2 release files

8.0.0

2 release files

7.2.0

2 release files

7.1.0

2 release files

7.0.0

2 release files

6.0.0

2 release files

5.0.0

3 release files

4.3.0

3 release files

4.2.0

3 release files

4.1.0

3 release files

4.0.1

3 release files

4.0.0

3 release files

3.2.0

3 release files

3.1.0

3 release files

3.0.0

3 release files

2.6.0

3 release files

2.5.0

3 release files

2.4.1

1 release file

2.4

1 release file

2.3

1 release file

2.2

1 release file

2.1

1 release file

2.0

1 release file

1.1

1 release file

1.0

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page