Skip to main content

An end-to-end machine learning and data mining framework on Hadoop.

Project description

|Build Status|


pyshifu is a Python module for machine learning build on top of java
version shifu, which provided large scalability of build high accuracy
models with TB level data set in hours.

| More details about shifu, visit shifu's wiki page:
| |Shifu Pipeline|

pyshifu provided the basic operations in the pipeline above, such as
new, init, stats...



| shifu requires:
| \* Python(>=2.7 or >=3.3)
| \* Java(>=7.0)

| Shifu Optional:
| \* Hadoop

| Platform requirement:
| \* Mac
| \* Linux
| \* Windows(>=10586.1007) As pyshifu currently depended on bash script
to set environment, so windows without shell support could not work
correctly. In the future, we will remove all shell script.

User installation

The easiest way to install pyshifu is using pip:

.. code:: bazaar

pip install pyshifu

or use conda:

.. code:: bazaar

conda install pyshifu


We welcome new contributors of all experience levels. The shifu
community goals are to be helpful, welcoming, and effective. The
`Contribute Guide <>`__
has detailed information about contributing code, documentation, tests,
and more. We've included some basic information in this README.

Important links

- Official source code repo:
- Download releases:
- Issue tracker:

Source code

You can check the latest sources with the command:

.. code:: bazaar

git clone

Setting up a development environment

`Quick tutorial <doc/developers/>`__ on how to go about setting
up your environment to contribute to pyshifu.


This project intend to make the python code 100% test coverage. You can
test by tox.

.. code:: bazaar

pip install -r requirements-build.txt
# run the python tests
tox -r

Submitting a Pull Request

Before opening a Pull Request, have a look at the full Contributing page
to make sure your code complies with our `Develop
guide <doc/developers/>`__. ## Project History This project is
started for help user using shifu in python environment.

Help and Support


- User guide: `User guide <doc/users/>`__
- Develop document: `Develop guide <doc/developers/>`__
- FAQ page:


You can leave your message here, `Message
Board <>`__.


If you use scikit-learn in a scientific publication, we would appreciate
`Citations <>`__.


1, Thanks kyhau for python-repo-template project to create an empty
python module.

.. |Build Status| image::
.. |Shifu Pipeline| image:: doc/images/logo/pipline.png

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for pyshifu, version 0.0.2
Filename, size File type Python version Upload date Hashes
Filename, size pyshifu-0.0.2-py2.py3-none-any.whl (14.7 kB) File type Wheel Python version py2.py3 Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page