Skip to main content

MaxFrame operator-based data analyze framework

Project description

MaxFrame is a computational framework created by Alibaba Cloud to provide a way for Python developers to parallelize their code with MaxCompute. It creates a runnable computation graph locally, submits it to MaxCompute to execute and obtains results from MaxCompute.

MaxFrame client is the client of MaxFrame. Currently it provides a DataFrame-based SDK with compatible APIs for pandas. In future, other common Python libraries like numpy and scikit-learn will be added as well. Python 3.7 is recommended for MaxFrame client to enable all functionalities while supports for higher Python versions are on the way.

Installation

You may install MaxFrame client through PIP:

pip install maxframe

Latest beta version can be installed with --pre argument:

pip install --pre maxframe

You can also install MaxFrame client from source code:

pip install git+https://github.com/aliyun/alibabacloud-odps-maxframe-client.git

Getting started

We show a simple code example of MaxFrame client which read data from a MaxCompute table, performs some simple data transform and writes back into MaxCompute.

import maxframe.dataframe as md
import os
from maxframe import new_session
from odps import ODPS

o = ODPS(
    os.getenv('ALIBABA_CLOUD_ACCESS_KEY_ID'),
    os.getenv('ALIBABA_CLOUD_ACCESS_KEY_SECRET'),
    project='your-default-project',
    endpoint='your-end-point',
)
session = new_session(o)

df = md.read_odps_table("source_table")
df["A"] = "prefix_" + df["A"]
md.to_odps_table(df, "prefix_source_table")

Documentation

Detailed documentations can be found here.

License

Licensed under the Apache License 2.0.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

maxframe-1.0.0.tar.gz (546.5 kB view hashes)

Uploaded Source

Built Distributions

maxframe-1.0.0-cp311-cp311-win_amd64.whl (1.6 MB view hashes)

Uploaded CPython 3.11 Windows x86-64

maxframe-1.0.0-cp311-cp311-win32.whl (1.5 MB view hashes)

Uploaded CPython 3.11 Windows x86

maxframe-1.0.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.3 MB view hashes)

Uploaded CPython 3.11 manylinux: glibc 2.17+ x86-64

maxframe-1.0.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (4.3 MB view hashes)

Uploaded CPython 3.11 manylinux: glibc 2.17+ ARM64

maxframe-1.0.0-cp311-cp311-macosx_10_9_x86_64.whl (1.7 MB view hashes)

Uploaded CPython 3.11 macOS 10.9+ x86-64

maxframe-1.0.0-cp311-cp311-macosx_10_9_universal2.whl (2.1 MB view hashes)

Uploaded CPython 3.11 macOS 10.9+ universal2 (ARM64, x86-64)

maxframe-1.0.0-cp310-cp310-win_amd64.whl (1.6 MB view hashes)

Uploaded CPython 3.10 Windows x86-64

maxframe-1.0.0-cp310-cp310-win32.whl (1.5 MB view hashes)

Uploaded CPython 3.10 Windows x86

maxframe-1.0.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.0 MB view hashes)

Uploaded CPython 3.10 manylinux: glibc 2.17+ x86-64

maxframe-1.0.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (4.0 MB view hashes)

Uploaded CPython 3.10 manylinux: glibc 2.17+ ARM64

maxframe-1.0.0-cp310-cp310-macosx_10_9_x86_64.whl (1.7 MB view hashes)

Uploaded CPython 3.10 macOS 10.9+ x86-64

maxframe-1.0.0-cp310-cp310-macosx_10_9_universal2.whl (2.1 MB view hashes)

Uploaded CPython 3.10 macOS 10.9+ universal2 (ARM64, x86-64)

maxframe-1.0.0-cp39-cp39-win_amd64.whl (1.6 MB view hashes)

Uploaded CPython 3.9 Windows x86-64

maxframe-1.0.0-cp39-cp39-win32.whl (1.5 MB view hashes)

Uploaded CPython 3.9 Windows x86

maxframe-1.0.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.0 MB view hashes)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

maxframe-1.0.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (4.0 MB view hashes)

Uploaded CPython 3.9 manylinux: glibc 2.17+ ARM64

maxframe-1.0.0-cp39-cp39-macosx_10_9_x86_64.whl (1.7 MB view hashes)

Uploaded CPython 3.9 macOS 10.9+ x86-64

maxframe-1.0.0-cp39-cp39-macosx_10_9_universal2.whl (2.1 MB view hashes)

Uploaded CPython 3.9 macOS 10.9+ universal2 (ARM64, x86-64)

maxframe-1.0.0-cp38-cp38-win_amd64.whl (1.6 MB view hashes)

Uploaded CPython 3.8 Windows x86-64

maxframe-1.0.0-cp38-cp38-win32.whl (1.5 MB view hashes)

Uploaded CPython 3.8 Windows x86

maxframe-1.0.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.1 MB view hashes)

Uploaded CPython 3.8 manylinux: glibc 2.17+ x86-64

maxframe-1.0.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (4.1 MB view hashes)

Uploaded CPython 3.8 manylinux: glibc 2.17+ ARM64

maxframe-1.0.0-cp38-cp38-macosx_10_9_x86_64.whl (1.7 MB view hashes)

Uploaded CPython 3.8 macOS 10.9+ x86-64

maxframe-1.0.0-cp38-cp38-macosx_10_9_universal2.whl (2.1 MB view hashes)

Uploaded CPython 3.8 macOS 10.9+ universal2 (ARM64, x86-64)

maxframe-1.0.0-cp37-cp37m-win_amd64.whl (1.6 MB view hashes)

Uploaded CPython 3.7m Windows x86-64

maxframe-1.0.0-cp37-cp37m-win32.whl (1.5 MB view hashes)

Uploaded CPython 3.7m Windows x86

maxframe-1.0.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.8 MB view hashes)

Uploaded CPython 3.7m manylinux: glibc 2.17+ x86-64

maxframe-1.0.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (3.7 MB view hashes)

Uploaded CPython 3.7m manylinux: glibc 2.17+ ARM64

maxframe-1.0.0-cp37-cp37m-macosx_10_9_x86_64.whl (1.6 MB view hashes)

Uploaded CPython 3.7m macOS 10.9+ x86-64

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page