Constractor (derived from “Content Extractor’) allows one to use machine learning for web pages content extraction. Library provide following functionality:
Extendable features api.
Gui tools for simple train-set creation.
Simple training and testing process.
Simple usage of trained model.
Models dumping.
etc
Installation
NOTE: Project was developed and tested under Ubuntu 12.04. Other operation systems may require enhancements of library.
Ubuntu >=12.04 instructions:
Install apt dependecies: sudo apt-get install pip gcc g++ python-dev python-qt4
Install constractor: sudo pip install constractor
Usage
Following code will run gui train helper:
#!/usr/bin/env python
from constractor.train import GuiTrainer
if __name__ == '__main__':
GuiTrainer()
And following code will print html of predicted element in DOM:
#!/usr/bin/env python
from constractor.parser import Parser
if __name__ == '__main__':
predicted = Parser('https://pypi.python.org', model_file='model.txt').predicted
for element in predicted:
print unicode(element.toInnerXml()).encode('utf-8')
Contribution
Project is completely open for contribution. See more on bitbucket repo: https://bitbucket.org/dkuryakin/constractor
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file constractor-0.1.0.tar.gz.
File metadata
- Download URL: constractor-0.1.0.tar.gz
- Upload date:
- Size: 10.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
fc5ed87c49f9f334ffbe19f773881c919f8843dde9ce1e49a5d2d41b6ccec345
|
|
| MD5 |
76ad980092fc193de30eebff1975c3ac
|
|
| BLAKE2b-256 |
d6769ca8b9a73de04f0ec53cccff7e648df8186198e2f197bba04692e6052738
|
