Scanner is like Ruby's StringScanner
Project description
# Scanner
[![Build Status](https://travis-ci.org/cuteio/scanner.png?branch=master)](https://travis-ci.org/cuteio/scanner)
Scanner provides for lexical scanning operations on a String. Clone of [Ruby's StringScanner](http://ruby-doc.org/stdlib-2.0.0/libdoc/strscan/rdoc/StringScanner.html).
Here is an example of its usage:
```
from scanner import StringScanner, StringRegexp
s = StringScanner('This is an example string')
s.is_eos # -> False
print s.scan(StringRegexp('\w+')) # -> "This"
print s.scan(StringRegexp('\w+')) # -> None
print s.scan(StringRegexp('\s+')) # -> " "
print s.scan(StringRegexp('\s+')) # -> None
print s.scan(StringRegexp('\w+')) # -> "is"
s.is_eos # -> False
print s.scan(StringRegexp('\s+')) # -> " "
print s.scan(StringRegexp('\w+')) # -> "an"
print s.scan(StringRegexp('\s+')) # -> " "
print s.scan(StringRegexp('\w+')) # -> "example"
print s.scan(StringRegexp('\s+')) # -> " "
print s.scan(StringRegexp('\w+')) # -> "string"
s.is_eos # -> True
print s.scan(StringRegexp('\s+')) # -> nil
print s.scan(StringRegexp('\w+')) # -> nil
```
Scanning a string means remembering the position of a scan pointer, which is just an index. The point of scanning is to move forward a bit at a time, so matches are sought after the scan pointer; usually immediately after it.
Given the string "test string", here are the pertinent scan pointer positions:
```
t e s t s t r i n g
0 1 2 ... 1
0
```
When you scan for a pattern (a regular expression), the match must occur at the character after the scan pointer. If you use scan_until, then the match can occur anywhere after the scan pointer. In both cases, the scan pointer moves just beyond the last character of the match, ready to scan again from the next character onwards. This is demonstrated by the example above.
There are other methods besides the plain scanners. You can look ahead in the string without actually scanning. You can access the most recent match. You can modify the string being scanned, reset or terminate the scanner, find out or change the position of the scan pointer, skip ahead, and so on.
#### Advancing the Scan Pointer
```
getch
get_byte
scan
scan_until
skip
skip_until
```
#### Looking Ahead
```
check
check_until
exists
peek
```
#### Finding Where we Are
```
is_bol (beginning_of_line?)
is_eos
is_rest
rest_size
pos
```
#### Setting Where we Are
```
reset
terminate
pos=
```
####Match Data
```
matched
is_matched
matched_size
pre_match
post_match
```
#### Miscellaneous
```
concat
string
string=
unscan
```
### Changelog
__v0.0.5[2014-02-07]__
* Fix the setter prototype and return value
__v0.0.4[2013-11-19]__
* Fix Python 2.7.3 `Segmentation fault`.
__v0.0.3[2013-11-17]__
__v0.0.2[2013-11-17]__
* It's worked.
[![Build Status](https://travis-ci.org/cuteio/scanner.png?branch=master)](https://travis-ci.org/cuteio/scanner)
Scanner provides for lexical scanning operations on a String. Clone of [Ruby's StringScanner](http://ruby-doc.org/stdlib-2.0.0/libdoc/strscan/rdoc/StringScanner.html).
Here is an example of its usage:
```
from scanner import StringScanner, StringRegexp
s = StringScanner('This is an example string')
s.is_eos # -> False
print s.scan(StringRegexp('\w+')) # -> "This"
print s.scan(StringRegexp('\w+')) # -> None
print s.scan(StringRegexp('\s+')) # -> " "
print s.scan(StringRegexp('\s+')) # -> None
print s.scan(StringRegexp('\w+')) # -> "is"
s.is_eos # -> False
print s.scan(StringRegexp('\s+')) # -> " "
print s.scan(StringRegexp('\w+')) # -> "an"
print s.scan(StringRegexp('\s+')) # -> " "
print s.scan(StringRegexp('\w+')) # -> "example"
print s.scan(StringRegexp('\s+')) # -> " "
print s.scan(StringRegexp('\w+')) # -> "string"
s.is_eos # -> True
print s.scan(StringRegexp('\s+')) # -> nil
print s.scan(StringRegexp('\w+')) # -> nil
```
Scanning a string means remembering the position of a scan pointer, which is just an index. The point of scanning is to move forward a bit at a time, so matches are sought after the scan pointer; usually immediately after it.
Given the string "test string", here are the pertinent scan pointer positions:
```
t e s t s t r i n g
0 1 2 ... 1
0
```
When you scan for a pattern (a regular expression), the match must occur at the character after the scan pointer. If you use scan_until, then the match can occur anywhere after the scan pointer. In both cases, the scan pointer moves just beyond the last character of the match, ready to scan again from the next character onwards. This is demonstrated by the example above.
There are other methods besides the plain scanners. You can look ahead in the string without actually scanning. You can access the most recent match. You can modify the string being scanned, reset or terminate the scanner, find out or change the position of the scan pointer, skip ahead, and so on.
#### Advancing the Scan Pointer
```
getch
get_byte
scan
scan_until
skip
skip_until
```
#### Looking Ahead
```
check
check_until
exists
peek
```
#### Finding Where we Are
```
is_bol (beginning_of_line?)
is_eos
is_rest
rest_size
pos
```
#### Setting Where we Are
```
reset
terminate
pos=
```
####Match Data
```
matched
is_matched
matched_size
pre_match
post_match
```
#### Miscellaneous
```
concat
string
string=
unscan
```
### Changelog
__v0.0.5[2014-02-07]__
* Fix the setter prototype and return value
__v0.0.4[2013-11-19]__
* Fix Python 2.7.3 `Segmentation fault`.
__v0.0.3[2013-11-17]__
__v0.0.2[2013-11-17]__
* It's worked.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
scanner-0.1.0.tar.gz
(575.6 kB
view details)
File details
Details for the file scanner-0.1.0.tar.gz
.
File metadata
- Download URL: scanner-0.1.0.tar.gz
- Upload date:
- Size: 575.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8bffaa1861c908d83728538cf00434c005c8bf36414ab708f3c822afd881bef7 |
|
MD5 | ccd1247cdbb088274a36e20100e9fb36 |
|
BLAKE2b-256 | 004c9b8810330fad60678944d73421ab6d476453fad105cce7570ceb1fbdc9e1 |