mindpandas platform: linux, cpu: x86_64, git version: [sha1]:650294f, [branch]: (HEAD -> master, origin/master, origin/HEAD)
Project description
WelCome to MindPandas
What Is MindPandas
Overview
MindPandas uses distributed computing engine to accelerate pandas operations, seamlessly integrated and compatible with existing pandas code. Using MindPandas for calculations can use all CPU cores on the computer, which makes MindPandas works especially well on larger datasets.
Architecture
MindPandas is implemented based on distribution, while native pandas is implemented based on single thread. This means that only one CPU core can be used at a time.
However, MindPandas can use more threads and cores on the machine, or all cores of the entire cluster.
Installation Methods
Pip mode method installation
Install pandas via PyPI:
pip install mindpandas
Installation by Source Code
Download source code.Build the whl package for installation, Enter the root directory of the source code, and execute the MindPandas compilation script in the build directory, then execute the command to install the whl package generated in the output directory.
git clone https://gitee.com/mindspore/mindpandas.git
cd mindpandas
bash build.sh
pip install output/mindpandas-0.1.0-cp38-cp38-linux_x86_64.whl
Installation Verification
Execute the following command on the Python interactive command line successfully, that is, the installation is successful.
python -c "import mindpandas"
Quickstart
First install the dependent libraries and packages: pandas, numpy. Then import MindPandas with the following command.
import mindpandas as pd
Set the running mode of MindPandas with the following command, which can speed up your pandas workflow.
pd.set_concurrency_mode('multithread')
The complete example is as follows:
>>> import mindpandas as pd
>>> pd.set_concurrency_mode('multithread')
>>> pd.set_partition_shape((16, 2))
>>> pd_df = pd.DataFrame([[1, 2, 3], [4, 5, 6]])
>>> sum = pd_df.sum()
>>> print(sum)
0 5
1 7
2 9
Name: sum, dtype: int64
Docs
More details about installation guide, tutorials and APIs, please see the User Documentation.
Contributing
Welcome contributions. See our Contributor Wiki for more details.
Release Notes
The release notes, see our RELEASE.
License
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
Hashes for mindpandas-0.1.0-cp38-cp38-manylinux1_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5db57598e0c73e7b02f0b8cdc5b054d66f8a6b021122243d09edee9ca6567f49 |
|
MD5 | 9663819181c927be7961f7509b5c3141 |
|
BLAKE2b-256 | 61b334882a04caac8b5b0e270dea63a6d9396bd506035de791ac97001444829f |