No project description provided
This script converts PDF to txt using PDFMiner (http://www.unixuser.org/~euske/python/pdfminer/index.html).
PDFMiner is a pdf parsing library written in Python by Yusuke Shinyama.
In addition to the pdf2txt.py and dumppdf.py command line tools, there is a way of analyzing the content tree of each page programmatically.
This is a more complete example of programming with PDFMiner, which continues where the default documentation (http://www.unixuser.org/~euske/python/pdfminer/programming.html#layout) stops.
This code is still a work-in-progress, with room for improvement.
Since it's available on PyPI, it's super easy to instal.
pip3 install pdf_layout_scanner
Advantages over PDFMiner
This script will extract text from PDFs with multiple columns.
from pdf_layout_scanner import layout_scanner # get a list of the table of contents get_toc() # get the full text get_pages()
from pdf_layout_scanner import layout_scanner toc=layout_scanner.get_toc('/path/to/your/pdf-file.pdf') print(len(toc)) # the number of elements in the pdf document's table of contents print(toc) # a tuple containing the ordinal sequence and the title string, # for example: # (1, u'Introduction') pages=layout_scanner.get_pages('/path/to/your/pdf-file.pdf') print(len(pages)) # should return the number of pages in the pdf document print(pages) # a string of all the text on the first page
Room for Improvement
Column Merging - while the fuzzy heuristic I described works well for the pdf files I've parsed so far, I can imagine more complex documents where it would break-down (perhaps this is where the analysis should be more sophisticated, and not ignore so many types of pdfminer.layout.LT* objects).
Image Extraction - I'd like to be able to be at least as good as pdftoimages, and save every file in ppm or pnm default format, but I'm not sure what I could be doing differently
Title and Heading Capitalization - this seems to be an issue with PDFMiner, since I get similar results in using the command line tools, but it is annoying to have to go back and fix all the mis-capitalizations manually, particularly for larger documents.
Title and Heading Fonts and Spacing - a related issue, though probably something in my own code, is that those same title and paragraph headings aren't distinguished from the rest of the text. In many cases, I have to go back and add vertical spacing and font attributes for those manually.
Page Number Removal - originally, I thought I could just use a regex for an all-numeric value on a single physical line, but each document does page numbering slightly differently, and it's very difficult to get rid of these without manually proofreading each page.
Footnotes - handling these where the note and the reference both appear on the same page is hard enough, but doing it when they span different (even consecutive) pages is worse.
In this forked project, I made a bit changes into the original one.
- Added support for texts in LTFigures
- Optimized data manipulation and storage changed from simple dict to dataframe. This should make further contributions easier.
- Added Progressbar
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
|Filename, size||File type||Python version||Upload date||Hashes|
|Filename, size PDF_Layout_Scanner-1.3.3-py3-none-any.whl (8.1 kB)||File type Wheel||Python version py3||Upload date||Hashes View hashes|
|Filename, size PDF Layout Scanner-1.3.3.tar.gz (6.8 kB)||File type Source||Python version None||Upload date||Hashes View hashes|
Hashes for PDF_Layout_Scanner-1.3.3-py3-none-any.whl