Vowpal Wabbit Python package
Project description
Vowpal Wabbit Python Wrapper
============================
.. image:: https://badge.fury.io/py/vowpalwabbit.svg
:alt: PyPI Package
:target: https://pypi.python.org/pypi/vowpalwabbit
.. image:: https://travis-ci.org/JohnLangford/vowpal_wabbit.png
:alt: Build Status
:target: https://travis-ci.org/JohnLangford/vowpal_wabbit
.. image:: https://ci.appveyor.com/api/projects/status/github/JohnLangford/vowpal_wabbit?branch=master&svg=true
:alt: Windows Build Status
:target: https://ci.appveyor.com/project/JohnLangford/vowpal-wabbit
.. image:: https://coveralls.io/repos/github/JohnLangford/vowpal_wabbit/badge.svg
:alt: Coverage
:target: https://coveralls.io/r/JohnLangford/vowpal_wabbit
Vowpal Wabbit is a fast machine learning library for online learning, and this is the python wrapper for the project.
Installing this package builds Vowpal Wabbit locally for explicit use within python, it will not create the command-line version
of the tool (or affect any previously existing command-line installations).
To install the command-line version see the main project page: https://github.com/JohnLangford/vowpal_wabbit
The version of the PyPI vowpalwabbit package corresponds to the tagged version of the code in the github repo that will be used
during building and installation.
If you need to make local changes to the code and rebuild the python binding be sure to pip uninstall vowpalwabbit then rebuild
using the local repo installation instructions below.
Installation
------------
From PyPI:
.. code-block:: bash
$ pip install vowpalwabbit
From local repo (useful when making modifications):
.. code-block::
$ cd python
$ pip install -e .
Usage
-----
You can use the python wrapper directly like this:
.. code-block:: python
>>> from vowpalwabbit import pyvw
>>> vw = pyvw.vw(quiet=True)
>>> ex = vw.example('1 | a b c')
>>> vw.learn(ex)
>>> vw.predict(ex)
Or you can use the included scikit-learn interface like this:
.. code-block:: python
>>> import numpy as np
>>> from sklearn import datasets
>>> from sklearn.model_selection import train_test_split
>>> from vowpalwabbit.sklearn_vw import VWClassifier
>>>
>>> # generate some data
>>> X, y = datasets.make_hastie_10_2(n_samples=10000, random_state=1)
>>> X = X.astype(np.float32)
>>>
>>> # split train and test set
>>> X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.2, random_state=256)
>>>
>>> # build model
>>> model = VWClassifier()
>>> model.fit(X_train, y_train)
>>>
>>> # predict model
>>> y_pred = model.predict(X_test)
>>>
>>> # evaluate model
>>> model.score(X_train, y_train)
>>> model.score(X_test, y_test)
Troubleshooting
---------------
Some common causes of failure for installation are due to missing or mis-matched dependencies when Vowpal Wabbit builds.
Make sure you have boost and boost-python installed on your system.
For Ubuntu/Debian/Mint
.. code-block:: bash
$ apt-get install libboost-program-options-dev zlib1g-dev libboost-python-dev
For Mac OSX
.. code-block:: bash
$ brew install libtool autoconf automake
$ brew install boost
$ brew install boost-python
# or for python3 (you may have to uninstall boost and reinstall to build python3 libs)
$ brew install boost-python --with-python3
Also, having Anaconda in your path can cause segmentation faults when importing the pyvw module. Providing Conda support
is an open issue and efforts are welcome, but in the meantime it is suggested to remove any conda bin directory from your path
prior to installing the vowpalwabbit package.
Development
-----------
Contributions are welcome for improving the python wrapper to Vowpal Wabbit.
1. Check for open issues_ or create one to discuss a feature idea or bug.
2. Fork the repo_ on Github and make changes to the master branch (or a new branch off of master).
3. Write a test in the python/tests folder showing the bug was fixed or feature works (recommend using pytest_).
4. Make sure package installs and tests pass under all supported environments (this calls tox_ automatically).
5. Send the pull request.
Tests can be run using setup.py:
.. code-block:: bash
$ python setup.py test
Directory Structure:
* python : this is where the c++ extension lives
* python/vowpalwabbit : this is then main directory for python wrapper code and utilities
* python/examples : example python code and jupyter notebooks to demonstrate functionality
* python/tests : contains all tests for python code
**Note:** neither examples nor tests directories are included in the distributed package, they are only for development purposes.
**Tips**
* python setup.py develop
* python setup.py build
* python setup.py install
* pip install dist/vowpalwabbit-8.5.0.tar.gz
* Documentation
** https://docs.python.org/3/distutils/apiref.html#distutils.core.Extension
** https://docs.python.org/3/distutils/setupscript.html
.. _issues: https://github.com/JohnLangford/vowpal_wabbit/issues
.. _repo: https://github.com/JohnLangford/vowpal_wabbit
.. _pytest: http://pytest.org/latest/getting-started.html
.. _tox: https://tox.readthedocs.io/en/latest/index.html
============================
.. image:: https://badge.fury.io/py/vowpalwabbit.svg
:alt: PyPI Package
:target: https://pypi.python.org/pypi/vowpalwabbit
.. image:: https://travis-ci.org/JohnLangford/vowpal_wabbit.png
:alt: Build Status
:target: https://travis-ci.org/JohnLangford/vowpal_wabbit
.. image:: https://ci.appveyor.com/api/projects/status/github/JohnLangford/vowpal_wabbit?branch=master&svg=true
:alt: Windows Build Status
:target: https://ci.appveyor.com/project/JohnLangford/vowpal-wabbit
.. image:: https://coveralls.io/repos/github/JohnLangford/vowpal_wabbit/badge.svg
:alt: Coverage
:target: https://coveralls.io/r/JohnLangford/vowpal_wabbit
Vowpal Wabbit is a fast machine learning library for online learning, and this is the python wrapper for the project.
Installing this package builds Vowpal Wabbit locally for explicit use within python, it will not create the command-line version
of the tool (or affect any previously existing command-line installations).
To install the command-line version see the main project page: https://github.com/JohnLangford/vowpal_wabbit
The version of the PyPI vowpalwabbit package corresponds to the tagged version of the code in the github repo that will be used
during building and installation.
If you need to make local changes to the code and rebuild the python binding be sure to pip uninstall vowpalwabbit then rebuild
using the local repo installation instructions below.
Installation
------------
From PyPI:
.. code-block:: bash
$ pip install vowpalwabbit
From local repo (useful when making modifications):
.. code-block::
$ cd python
$ pip install -e .
Usage
-----
You can use the python wrapper directly like this:
.. code-block:: python
>>> from vowpalwabbit import pyvw
>>> vw = pyvw.vw(quiet=True)
>>> ex = vw.example('1 | a b c')
>>> vw.learn(ex)
>>> vw.predict(ex)
Or you can use the included scikit-learn interface like this:
.. code-block:: python
>>> import numpy as np
>>> from sklearn import datasets
>>> from sklearn.model_selection import train_test_split
>>> from vowpalwabbit.sklearn_vw import VWClassifier
>>>
>>> # generate some data
>>> X, y = datasets.make_hastie_10_2(n_samples=10000, random_state=1)
>>> X = X.astype(np.float32)
>>>
>>> # split train and test set
>>> X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.2, random_state=256)
>>>
>>> # build model
>>> model = VWClassifier()
>>> model.fit(X_train, y_train)
>>>
>>> # predict model
>>> y_pred = model.predict(X_test)
>>>
>>> # evaluate model
>>> model.score(X_train, y_train)
>>> model.score(X_test, y_test)
Troubleshooting
---------------
Some common causes of failure for installation are due to missing or mis-matched dependencies when Vowpal Wabbit builds.
Make sure you have boost and boost-python installed on your system.
For Ubuntu/Debian/Mint
.. code-block:: bash
$ apt-get install libboost-program-options-dev zlib1g-dev libboost-python-dev
For Mac OSX
.. code-block:: bash
$ brew install libtool autoconf automake
$ brew install boost
$ brew install boost-python
# or for python3 (you may have to uninstall boost and reinstall to build python3 libs)
$ brew install boost-python --with-python3
Also, having Anaconda in your path can cause segmentation faults when importing the pyvw module. Providing Conda support
is an open issue and efforts are welcome, but in the meantime it is suggested to remove any conda bin directory from your path
prior to installing the vowpalwabbit package.
Development
-----------
Contributions are welcome for improving the python wrapper to Vowpal Wabbit.
1. Check for open issues_ or create one to discuss a feature idea or bug.
2. Fork the repo_ on Github and make changes to the master branch (or a new branch off of master).
3. Write a test in the python/tests folder showing the bug was fixed or feature works (recommend using pytest_).
4. Make sure package installs and tests pass under all supported environments (this calls tox_ automatically).
5. Send the pull request.
Tests can be run using setup.py:
.. code-block:: bash
$ python setup.py test
Directory Structure:
* python : this is where the c++ extension lives
* python/vowpalwabbit : this is then main directory for python wrapper code and utilities
* python/examples : example python code and jupyter notebooks to demonstrate functionality
* python/tests : contains all tests for python code
**Note:** neither examples nor tests directories are included in the distributed package, they are only for development purposes.
**Tips**
* python setup.py develop
* python setup.py build
* python setup.py install
* pip install dist/vowpalwabbit-8.5.0.tar.gz
* Documentation
** https://docs.python.org/3/distutils/apiref.html#distutils.core.Extension
** https://docs.python.org/3/distutils/setupscript.html
.. _issues: https://github.com/JohnLangford/vowpal_wabbit/issues
.. _repo: https://github.com/JohnLangford/vowpal_wabbit
.. _pytest: http://pytest.org/latest/getting-started.html
.. _tox: https://tox.readthedocs.io/en/latest/index.html
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
vowpalwabbitds-8.5.0.tar.gz
(912.3 kB
view details)
File details
Details for the file vowpalwabbitds-8.5.0.tar.gz
.
File metadata
- Download URL: vowpalwabbitds-8.5.0.tar.gz
- Upload date:
- Size: 912.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | cc6f6be7cdb15a2eb77354b0e961d69fe8d6a0364d18c57136386bb7e1443a38 |
|
MD5 | a3428ac40f04658968ac32ae447b87cd |
|
BLAKE2b-256 | 8c4e99993b56233de82f39c018cd99a1a12bfcbe96aa1ea5b2090126617460d1 |