A python library for extracting data from html table
Project description
HTML Table Extractor
HTML Table Extractor is a python library that uses Beautiful Soup to extract data from complicated and messy html table
Important links
- Repository: https://github.com/yuanxu-li/html-table-extractor
- Issues: https://github.com/yuanxu-li/html-table-extractor/issues
Installation
pip install 'beautifulsoup4==4.5.3'
pip install html-table-extractor
Usage
Example 1 - Simple
from html_table_extractor.extractor import Extractor table_doc = """ <table><tr><td>1</td><td>2</td></tr><tr><td>3</td><td>4</td></tr></table> """ extractor = Extractor(table_doc) extractor.parse() extractor.return_list()
It will print out:
[[u'1', u'2'], [u'3', u'4']]
Example 2 - Transformer
from html_table_extractor.extractor import Extractor table_doc = """ <table><tr><td>1</td><td>2</td></tr><tr><td>3</td><td>4</td></tr></table> """ extractor = Extractor(table_doc, transformer=int) extractor.parse() extractor.return_list()
It will print out:
[[1, 2], [3, 4]]
Example 3 - Pass BS4 Tag
from html_table_extractor.extractor import Extractor from bs4 import BeautifulSoup table_doc = """ <html><table id='wanted'><tr><td>1</td><td>2</td></tr><tr><td>3</td><td>4</td></tr></table><table id='unwanted'><tr><td>not wanted</td></tr></table></html> """ soup = BeautifulSoup(table_doc, 'html.parser') extractor = Extractor(soup, id_='wanted') extractor.parse() extractor.return_list()
It will print out:
[[u'1', u'2'], [u'3', u'4']]
Example 4 - Complex
from html_table_extractor.extractor import Extractor table_doc = """ <table> <tr> <td rowspan=2>1</td> <td>2</td> <td>3</td> </tr> <tr> <td colspan=2>4</td> </tr> <tr> <td colspan=3>5</td> </tr> </table> """ extractor = Extractor(table_doc) extractor.parse() extractor.return_list()
It will print out:
[[u'1', u'2', u'3'], [u'1', u'4', u'4'], [u'5', u'5', u'5']]
Example 5 - Conflicted
from html_table_extractor.extractor import Extractor table_doc = """ <table> <tr> <td rowspan=2>1</td> <td>2</td> <td rowspan=3>3</td> </tr> <tr> <td colspan=2>4</td> </tr> <tr> <td colspan=2>5</td> </tr> </table> """ extractor = Extractor(table_doc) extractor.parse() extractor.return_list()
It will print out:
[[u'1', u'2', u'3'], [u'1', u'4', u'3'], [u'5', u'5', u'3']]
Example 6 - Write to file
from html_table_extractor.extractor import Extractor table_doc = """ <table><tr><td>1</td><td>2</td></tr><tr><td>3</td><td>4</td></tr></table> """ extractor = Extractor(table_doc).parse() extractor.write_to_csv(path='.')
It will write to a given path and create a new csv file called output.csv:
1,2
3,4
Team
Errors/ Bugs
If something is not working correctly, or if you have any suggestion on improvements, report it here
Copyright
Copyright (c) 2017 Justin Li. Released under the MIT License
Third-party copyright in this distribution is noted where applicable.
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
| Filename, size | File type | Python version | Upload date | Hashes |
|---|---|---|---|---|
| Filename, size html_table_extractor-1.4.1-py2.py3-none-any.whl (4.8 kB) | File type Wheel | Python version py2.py3 | Upload date | Hashes View |
Close
Hashes for html_table_extractor-1.4.1-py2.py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 5f3ef41aee2f2bf46400c46227b2a1b553165fb7dea00c9c41ec82c27da28a48 |
|
| MD5 | 3df0563aa7d7b34a9a3c54028a508859 |
|
| BLAKE2-256 | 3b8a12d04fa841340b818b0ff9c1439789301c5abe7f9389c9584f912c1e95b4 |
