Skip to main content

GFLM: mine implicit features using a generative feature language model

Description

This package implements a Generative Feature Language Models for Mining Implicit Features.

Given the following input:

  • a text dataset
  • a set of predefined features

Compute the following:

  • mapping of explicit and implicit features on the data
  • using both gflm_word and gflm_section algorithms

Install

pip install feature_mining

Sample Usage

Usage:
    from feature_mining import FeatureMining
    fm = FeatureMining()
    fm.load_ipod(full_set=False)
    fm.fit()
    fm.predict()

Results:
    - prediction using 'section': fm.gflm.gflm_section
    - prediction using 'word': fm.gflm.gflm_word

Display result:
    fm.section_features()
    print(fm.gflm_section_result.sort_values(by=['gflm_section'], ascending=False)[['feature', 'section_text']].head(20))

Package created based on the following paper

S. Karmaker Santu, P. Sondhi and C. Zhai, "Generative Feature Language Models for Mining Implicit Features from Customer Reviews", Proceedings of the 25th ACM International on Conference on Information and Knowledge Management - CIKM '16, 2016.

Pydocs (Code Documentation)

Accessible via this link: http://htmlpreview.github.io/?https://github.com/nfreundlich/CS410_CourseProject/blob/dev/docs/feature_mining.html

(Apologies for the color scheme - it was the default)

Tutorial

See Jupyter notebook tutorial https://github.com/nfreundlich/CS410_CourseProject/blob/dev/tutorial.ipynb

Video presentation and tutorial

Link to YouTube: https://www.youtube.com/watch?v=mjJHkyrkxHM

Package on PyPi

https://pypi.org/project/feature-mining/

Slides

https://github.com/nfreundlich/CS410_CourseProject/blob/dev/docs/CS_410_GFLM_Slides.pdf

Known Issues

Explicit feature mentions not removed from GFLM word/sentence: https://github.com/nfreundlich/CS410_CourseProject/issues/28

Release files for feature-mining 0.1.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for feature-mining 0.1.1
File Size Uploaded
feature_mining-0.1.1.tar.gz 296.8 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for feature-mining 0.1.1
File Interpreter ABI Platform
feature_mining-0.1.1-py3-none-any.whl Python 3 none any Details

Total release size: 878.1 kB

Release files / feature_mining-0.1.1.tar.gz

Download URL feature_mining-0.1.1.tar.gz
Size 296.8 kB
Tags Source
SHA-256 checksum
How to use checksums
d97c989e19b415067b83c6a19e36e2f4a26b6fc09b4760014b2dd92d73ecb4c3
BLAKE2b-256 checksum
How to use checksums
a7d35e36a8c49cf5890f8ad20deb036aef0c7edd669ebd0e0feda7db4ac967a6
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.12.1 pkginfo/1.4.2 requests/2.20.1 setuptools/40.6.2 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.7.1

Release files / feature_mining-0.1.1-py3-none-any.whl

Download URL feature_mining-0.1.1-py3-none-any.whl
Size 581.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
68e0e1ef6e4ac0dc18a4452ea4fa0ba6ed756f887bb2c7432a899ab620628acc
BLAKE2b-256 checksum
How to use checksums
6f7849a81e9bcb5cf69215c80e613851e3c863bc71f35d96ef395ea119353591
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/1.12.1 pkginfo/1.4.2 requests/2.20.1 setuptools/40.6.2 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.7.1

Release history Release notifications | RSS feed

This release

0.1.1 This release

2 release files

0.1.0

2 release files

0.0.25

2 release files

0.0.24

2 release files

0.0.23

2 release files

0.0.22

2 release files

0.0.21

2 release files

0.0.20

2 release files

0.0.19

2 release files

0.0.18

2 release files

0.0.17

2 release files

0.0.16

2 release files

0.0.15

2 release files

0.0.12

2 release files

0.0.11

2 release files

0.0.10

2 release files

0.0.9

2 release files

0.0.8

2 release files

0.0.7

2 release files

0.0.6

2 release files

0.0.5

2 release files

0.0.4

1 release file

0.0.3

2 release files

0.0.2

2 release files

0.0.1

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page