Lablup Backend.AI Meta-package
Project description
Backend.AI is a streamlined backend service framework hosting heterogeneous programming languages and popular AI frameworks. It manages the underlying computing resources for multi-tenant computation sessions where such sessions are spawned and executed instantly on demand.
All sub-projects are licensed under LGPLv3+.
By installing this meta-package, you get the client with command-line interface by default and optionally you may add the manager and agent using pip extra tags.
$ pip install backend.ai
(installs the common and client libs which includes CLI)
$ pip install backend.ai[manager]
(installs the common and client libs with the manager/gateway daemon)
$ pip install backend.ai[agent]
(installs the common and client libs with the agent daemon)
Server-side Components
Manager with API Gateway
It routes external API requests from front-end services to individual agents. It also monitors and scales the cluster of multiple agents (a few tens to hundreds).
Package namespace: ai.backend.gateway and ai.backend.manager
Agent
It manages individual server instances and launches/destroys Docker containers where REPL daemons (kernels) run. Each agent on a new EC2 instance self-registers itself to the instance registry via heartbeats.
Package namespace: ai.backend.agent
Kernels
A set of small ZeroMQ-based REPL daemons in various programming languages and configurations.
Each daemon is a separate program, usually named “run.{lang-specific-extension}”.
Jail
A programmable sandbox implemented using ptrace-based sytem call filtering written in Go.
Hook
A set of libc overrides for resource control and web-based interactive stdin (paired with agents).
Commons
A collection of utility modules commonly shared throughout Backend.AI projects.
Package namespaces: ai.backend.common
Client-side Components
Client Libraries
A client library to access the Backend.AI API servers with ease.
- Python
pip install backend.ai-client
- Javascript (under preparation)
npm install backend.ai-client
- PHP (under preparation)
composer require lablup/backend.ai-client
Media
The front-end support libraries to handle multi-media outputs (e.g., SVG plots, animated vector graphics)
The Python package (lablup) is installed inside kernel containers.
To interpret and display media generated by the Python package, you need to load the Javascript part in the front-end.
Integrations with IDEs and Editors
Jupyter Kernel
Jupyter kernel integration of the Backend.AI Cloud API.
Package namespaces: backend.ai-integration
Visual Studio Code Extension
Extension for Visual Studio Code to run your code on the Lablup.AI clouds or your own Backend.AI servers.
Search ‘live code runner’ to VSCode extension search.
Atom Editor plugin
Atom Editor Plugin that allows running your code on the Lablup.AI clouds or your own Backend.AI servers.
Search ‘live code runner’ to Atom plugin search.
Installation
The Backend.AI project uses latest features in Python 3.6+ and Docker CE 17.05+.
To install the manager with API gateway, run:
pip install backend.ai[manager]
For each computing servers, install the agent using:
pip install backend.ai[agent]
NOTE: More details about configuration will be released soon.
Development
git flow
The Backend.AI repositories use git flow to streamline branching during development and deployment. We use the default configuration (master -> preparation for release, develop -> main development, feature/ -> features, etc.) as-is.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for backend.ai-1.0.2-py36-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | fefe83ae5820f88c4441b5dbbb40004a834bd14e6399d1d053c34f1185d8f5ef |
|
MD5 | 6f3afd2707850e7f76f23f14d209529b |
|
BLAKE2b-256 | 7a432ad424f0f5c7bdb3c3d815c2ed7d9601ba0652f600d4fed8934c0895bfc6 |