ML Inference 🥶
Project description
🧐 What is Nbox?
nbox
provides first class support API for all NimbleBox.ai infrastructure (NBX-Build, Jobs, Deploy) and services (NBX-Workspaces) components. Write jobs using nbox.Operators
🤷Why NimbleBox
- Write and execute code in Python
- Document your code that supports mathematical equations
- Create/Upload/Share notebooks
- Import notebooks from your local machine
- Import/Publish notebooks from/to GitHub
- Import external datasets (e.g. from Kaggle)
- Integrate PyTorch, TensorFlow, Keras, OpenCV
- Share your projects
- Collaborate with your team
🎚 Features
🏗️ Freedom To Build
🦾 Automate with Ease
🚀 Intuitive Dashboard
🏁 Get Started
Install the package from pipy:
pip install nbox
For convinience you should add nbox to your path by setting up an alias. Throughout the rest of the documentation we will be using nbx as the CLI:
alias nbx="python3 -m nbox"
When loading nbox for the first time, it will prompt you the username and password and create a secrets file at ~/.nbx/secrets.json.
This file then contains all the information that you don’t have to fetch manually again.
APIs
Our APIs are deep, user functions are kept to minimum and most relavant. This documentation contains the full spec of everything, but here’s all the APIs you need to know:
nbox
├── Model # Framework agnostic Model
│ ├── __call__
│ ├── deploy
│ ├── train_on_instance (WIP)
│ └── train_on_jobs (WIP)
├── Operators # How jobs are combinations of operators
│ ├── __call__
│ └── deploy
├── Jobs # For controlling all your jobs
│ ├── logs # stream logs right on your terminal
│ └── trigger # manually trigger a job
└── Instance
├── __call__ # Run any command on the instance
└── mv (WIP) # Move files to and from NBX-Build
NBX-Jobs and NBX-Deploy
Create a simple folder:
nbx jobs new moonshot
Run any Batch Process
Add the following code to foobar.py
:
from nbox import operator, Operator
from nbox.lib.shell import ShellCommand
# define your function and wrap it as an operator
@operator()
def foo(x: Dict):
return "bar"
# or use OOPs like torch, etc.
class MyJob(Operator):
def __init__(self):
super().__init__()
self.foo = foo
self.shell = ShellCommand("echo 'hello {text}'")
def forward(self):
text = self.foo()
self.shell(text = text)
How to get help?
Join our discord and someone from our community or engineering team will respond!
🔖Read our Blog.
🧩 License
The code in thist repo is licensed as Apache License 2.0. Please check for individual repositories for licenses.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.