Skip to main content

An end-to-end machine learning and data mining framework on Hadoop.

Project description

|Build Status|

pyshifu is a Python module for machine learning build on top of java version shifu, which provided large scalability of
build high accuracy models with TB level data set in hours.

More details about shifu, visit shifu's wiki page:
|Shifu Pipeline|

pyshifu provided the basic operations in the pipeline above, such as new, init, stats...



shifu requires:
- Python(>=2.7 or >=3.3)
- Java(>=7.0)

shifu Optional:
- Hadoop

Platform requirement:
- Mac
- Linux
- Windows(>=10586.1007)
As pyshifu currently depended on bash script to set environment, so windows without shell support could not work
correctly. In the future, we will remove all shell script.

User installation

The easiest way to install pyshifu is using pip::
pip install pyshifu

or use conda::
conda install pyshifu


We welcome new contributors of all experience levels. The shifu
community goals are to be helpful, welcoming, and effective. The
`Contribute Guide <http:"" project="" about="" #how-to-contribute="">`__
has detailed information about contributing code, documentation, tests,
and more. We've included some basic information in this README.

Important links

- Official source code repo:
- Download releases:
- Issue tracker:

Source code

You can check the latest sources with the command:

.. code::

git clone

Setting up a development environment

`Quick tutorial <doc developers="""">`__ on how to go about setting
up your environment to contribute to pyshifu.


This project intend to make the python code 100% test coverage. You can
test by tox.

.. code::

pip install -r requirements-build.txt
# run the python tests
tox -r

Submitting a Pull Request

Before opening a Pull Request, have a look at the full Contributing page
to make sure your code complies with our `Develop
guide <doc developers="""">`__. ## Project History This project is
started for help user using shifu in python environment.

Help and Support


- User guide: `User guide <doc users="""">`__
- Develop document: `Develop guide <doc developers="""">`__
- FAQ page:


You can leave your message here, `Message
Board <https:"" shifuml="" pyshifu="" wiki="" message-board="">`__.


If you use scikit-learn in a scientific publication, we would appreciate
`Citations <https:"" shifuml="" pyshifu="" wiki="" citations="">`__.


1, Thanks kyhau for python-repo-template project to create an empty
python module.

.. |Build Status| image:: :target:
.. |Shifu Pipeline| image:: doc/images/pipline/pipline.png

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for pyshifu, version 0.0.8
Filename, size File type Python version Upload date Hashes
Filename, size pyshifu-0.0.8-py2.py3-none-any.whl (34.2 MB) File type Wheel Python version py2.py3 Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page