maxframe 0.1.0b3

MaxFrame operator-based data analyze framework

MaxFrame is a computational framework created by Alibaba Cloud to provide a way for Python developers to parallelize their code with MaxCompute. It creates a runnable computation graph locally, submits it to MaxCompute to execute and obtains results from MaxCompute.

MaxFrame client is the client of MaxFrame. Currently it provides a DataFrame-based SDK with compatible APIs for pandas. In future, other common Python libraries like numpy and scikit-learn will be added as well. Python 3.7 is recommended for MaxFrame client to enable all functionalities while supports for higher Python versions are on the way.

Installation

You may install MaxFrame client through PIP:

pip install maxframe

Latest beta version can be installed with --pre argument:

pip install --pre maxframe

You can also install MaxFrame client from source code:

pip install git+https://github.com/aliyun/alibabacloud-odps-maxframe-client.git

Getting started

We show a simple code example of MaxFrame client which read data from a MaxCompute table, performs some simple data transform and writes back into MaxCompute.

import maxframe.dataframe as md
import os
from maxframe import new_session
from odps import ODPS

o = ODPS(
    os.getenv('ALIBABA_CLOUD_ACCESS_KEY_ID'),
    os.getenv('ALIBABA_CLOUD_ACCESS_KEY_SECRET'),
    project='your-default-project',
    endpoint='your-end-point',
)
session = new_session(o)

df = md.read_odps_table("source_table")
df["A"] = "prefix_" + df["A"]
md.to_odps_table(df, "prefix_source_table")

Documentation

Detailed documentations can be found here.

License

Licensed under the Apache License 2.0.