simple-alto-parser
This is a simple parser for ALTO XML files. It is designed to do three tasks separately:
1. Extract the text from the ALTO XML file with the AltoTextParser class.
The simple alto parser facilitates the extraction of text from ALTO XML files, specifically tailored for retrieving OCR-recognized texts (e.g. through “Transkribus” https://readcoop.eu/de/transkribus/). Defined or manipulated by the user, the simple alto parser organizes the extracted text alongside its pertinent meta-information. Including for example the year of publication, page number, and pre-defined image sections etc. This structuring ensured that each part of the text is associated with its corresponding image and meta-information, facilitating precise retrieval and display at a later stage.
2. Extract structured information from the text with different parsing methods.
There exist two fundamental parsing methods: 1. The extraction of relevant text segments through pattern recognition utilizing regular expressions (regex). 2. Matching based on predefined dictionaries. Whereby users can create their own dictionaries or utilize pre-existing ones (e.g. for country names etc.) Text segments recognized through these methods can be systematically categorized within the same function and subsequently omitted from the parsing process. This framework facilitates a multi-stage parsing approach with a low entry threshold, wherein uncategorized text segments remain visible following each parsing iteration. The simple alto parser also features a replace function, empowering the normalization of text segments during parsing. Simultaneously, irrelevant text segments can be removed from the structured text. A dedicated function for manual adjustments is also included, enabling modifications in cases where neither dictionary nor pattern matching proves sufficient. Employing these parsing methods enables comprehensive structuring of the text while preserving readability and retaining all meta-information. To maintain transparency and traceability, the original text is consistently preserved, ensuring visibility of all manipulations performed.
3. Export the structured text and information for further processing, analysis, publication etc.
The structured texts can be exported in various formats such as CSV, TSV, or JSON, with export parameters customizable to suit specific requirements. This allows tailored compilations of the structured texts. For example including all meta-information or solely the final structured texts. Allowing the data to be prepared directly for publication or for further analysis in the desired format and compilation. Further JSON files are generated for the dictionaries created during the parsing process. These files can also be exported in a structured manner, facilitating publication or utilization elsewhere.
Usage
from simple_alto_parser import AltoFileParser, AltoPatternParser, AltoFileExporter
# Create a parser instance and supply your data directory
alto_parser = AltoFileParser('data')
alto_parser.parse()
# Find and categorize by patterns
pattern_parser = AltoPatternParser(alto_parser)
pattern_parser.find(r'(^.*\& Cie\.$)').categorize('company_name').remove()
# Other options are: look up in dictionaries, perform spacy NER
# Export the data
alto_exporter = AltoFileExporter(alto_parser)
alto_exporter.save_csv('output/alto_test.csv', delimiter=',')
Metadata
Release files for simple-alto-parser 0.0.22
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| simple_alto_parser-0.0.22.tar.gz | 29.8 kB | Without provenance | Details for simple_alto_parser-0.0.22.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| simple_alto_parser-0.0.22-py3-none-any.whl | Python 3 | none | any | Details for simple_alto_parser-0.0.22-py3-none-any.whl |
Total release size: 61.2 kB
Release files / simple_alto_parser-0.0.22.tar.gz
| Download URL | simple_alto_parser-0.0.22.tar.gz |
|---|---|
| Size | 29.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
ef18e49ce340ff35027f684ea7740b666593a38d8874f302af9256dd06bf1801
|
|
BLAKE2b-256 checksum How to use checksums |
38d340b177a67fa5b3dda156daa98305fd4c3d17c64b582efb163150d64e102d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.9.25
|
Release files / simple_alto_parser-0.0.22-py3-none-any.whl
| Download URL | simple_alto_parser-0.0.22-py3-none-any.whl |
|---|---|
| Size | 31.4 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
2443127de702cfd9f906c29cb6569215d65fe5d3cf92dd1fd4a16383e9a0c926
|
|
BLAKE2b-256 checksum How to use checksums |
5d645b3f680015e69ef9ba5e62eed33b483f96a0a576a9ff51a3742d1dd02385
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.9.25
|
Security for simple-alto-parser 0.0.22
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.