Skip to main content

Make any iterator a look-ahead iterator. Provides specialized look-ahead iterators for text files.

Project description

lookaheadtools

The lookaheadtools module extends generic iterators to support look-ahead, and also provides some convenient look-ahead iterators that are useful for processing text files.

Lookahead is implemented by extending iterators with support for __getitem__(). For example:

import lookaheadtools as la
looker = la.lookahead(iter([0,1,2,3,4]))
assert looker[3] == 3
assert looker[0] == 0
assert looker[1000] == None
assert looker[0:9:2] == [0,2,4]
assert next(looker) == 0
assert looker[0] == 1

As seen in the example, myLookaheadIter[0] returns the value that will be returned by next(myLookaheadIter) but without consuming it. Arbitrary lookahead distance is supported. Attempts to lookahead past the end of the iterator will return None. The look-ahead index can be any slice with positive indices.

Classes Provided

Lookahead(object) – Convert any iterator into a look-ahead iterator.

LinesOf(object) – Iterate line-by-line over a string, emulating text file iteration.

Lexpos (a named tuple) – Convenience class for capturing lexical tracking information.

FileLookahead(Lookahead) – FileLookahead() is a specialization of the Lookahead() class that iterates by characters over a text file with full lexical position tracking.

LexAhead(FileLookahead) – LexAhead() is a specialization of FileLookahead() that includes some simple tokenizing utilities, stopping short of being a full tokenizer. See tokenizertools for a module that builds a tokenizer on top of LexAhead().

lookaheadtools news

Update history.

15-Sep-2016

1.0 release. Tweaked setup.py to make it more robust.

16-June-2014

0.2b release.

Project details


Release history Release notifications

This version
History Node

1.0

History Node

0.2b

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
lookaheadtools-1.0.tar.gz (8.7 kB) Copy SHA256 hash SHA256 Source None Sep 16, 2016

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging CloudAMQP CloudAMQP RabbitMQ AWS AWS Cloud computing Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page