Wikipedia NER
-------------
Tool to train and obtain named entity recognition labeled examples
from Wikipedia dumps.
Usage in [IPython notebook](http://nbviewer.ipython.org/github/JonathanRaiman/wikipedia_ner/blob/master/Wikipedia%20to%20Named%20Entity%20Recognition.ipynb) (*nbviewer* link).
## Usage
Here is an example usage with the first 200 articles from the english wikipedia dump (dated lated 2013):
parseresult = wikipedia_ner.parse_dump("enwiki.bz2",
max_articles = 200)
most_common_category = wikipedia_ner.ParsedPage.categories_counter.most_common(1)[0][0]
most_common_category_children = [
parseresult.index2target[child] for child in list(wikipedia_ner.ParsedPage.categories[most_common_category].children)
]
"In '%s' the children are %r" % (
most_common_category,
", ".join(most_common_category_children)
)
#=> "In 'Category : Member states of the United Nations' the children are 'Afghanistan, Algeria, Andorra, Antigua and Barbuda, Azerbaijan, Angola, Albania'"
-------------
Tool to train and obtain named entity recognition labeled examples
from Wikipedia dumps.
Usage in [IPython notebook](http://nbviewer.ipython.org/github/JonathanRaiman/wikipedia_ner/blob/master/Wikipedia%20to%20Named%20Entity%20Recognition.ipynb) (*nbviewer* link).
## Usage
Here is an example usage with the first 200 articles from the english wikipedia dump (dated lated 2013):
parseresult = wikipedia_ner.parse_dump("enwiki.bz2",
max_articles = 200)
most_common_category = wikipedia_ner.ParsedPage.categories_counter.most_common(1)[0][0]
most_common_category_children = [
parseresult.index2target[child] for child in list(wikipedia_ner.ParsedPage.categories[most_common_category].children)
]
"In '%s' the children are %r" % (
most_common_category,
", ".join(most_common_category_children)
)
#=> "In 'Category : Member states of the United Nations' the children are 'Afghanistan, Algeria, Andorra, Antigua and Barbuda, Azerbaijan, Angola, Albania'"
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
wikipedia-ner-0.0.24.tar.gz
(76.8 kB
view details)
File details
Details for the file wikipedia-ner-0.0.24.tar.gz.
File metadata
- Download URL: wikipedia-ner-0.0.24.tar.gz
- Upload date:
- Size: 76.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
1f6fc58a8dc82817458b4b890b3219f861e0bdd666e7a67f51758094f0b839a8
|
|
| MD5 |
d586e86f33203613956b3401bacca3b8
|
|
| BLAKE2b-256 |
c9eef46583a5a40ba93a5dd1ca7472542a76a477a8b9d5a2ec2362d123b37307
|
