No project description provided
Project description
deepepochs
Pytorch模型简易训练工具
使用
常规训练流程
from deepepochs import Trainer, Checker, rename
import torch
from torch import nn
from torch.nn import functional as F
from torchvision.datasets import MNIST
from torchvision import transforms
from torch.utils.data import DataLoader, random_split
from torchmetrics import functional as MF
# datasets
data_dir = './dataset'
transform = transforms.Compose([transforms.ToTensor(), transforms.Normalize((0.1307,), (0.3081,))])
mnist_full = MNIST(data_dir, train=True, transform=transform, download=True)
train_ds, val_ds, _ = random_split(mnist_full, [5000, 5000, 50000])
test_ds = MNIST(data_dir, train=False, transform=transform, download=True)
# dataloaders
train_dl = DataLoader(train_ds, batch_size=32)
val_dl = DataLoader(val_ds, batch_size=32)
test_dl = DataLoader(test_ds, batch_size=32)
# pytorch model
channels, width, height = (1, 28, 28)
model = nn.Sequential(
nn.Flatten(),
nn.Linear(channels * width * height, 64),
nn.ReLU(),
nn.Dropout(0.1),
nn.Linear(64, 64),
nn.ReLU(),
nn.Dropout(0.1),
nn.Linear(64, 10)
)
def acc(preds, targets):
return MF.accuracy(preds, targets, task='multiclass', num_classes=10)
@rename('')
def multi_metrics(preds, targets):
return {
'p': MF.precision(preds, targets, task='multiclass', num_classes=10),
'r': MF.recall(preds, targets, task='multiclass', num_classes=10)
}
checker = Checker('loss', mode='min', patience=2)
opt = torch.optim.Adam(model.parameters(), lr=2e-4)
trainer = Trainer(model, F.cross_entropy, opt=opt, epochs=100, checker=checker, metrics=[acc, multi_metrics])
progress = trainer.fit(train_dl, val_dl)
test_rst = trainer.test(test_dl)
非常规训练流程
- 方法1:
- 第1步:继承
deepepochs.TrainerBase
类,定制满足需要的Trainer
,实现train_step
方法和evaluate_step
方法 - 第2步:调用定制
Trainer
训练模型。
- 第1步:继承
- 方法2:
- 第1步:继承
deepepochs.Callback
类,定制满足需要的Callback - 第2步:使用
deepepochs.Learner
训练模型,将定制的Callback作为Learner
的参数 - 提示:
Learner
是具有Callback
功能的Trainer
- 第1步:继承
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
deepepochs-0.2.0.tar.gz
(16.7 kB
view hashes)
Built Distribution
deepepochs-0.2.0-py3-none-any.whl
(20.7 kB
view hashes)
Close
Hashes for deepepochs-0.2.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9e1e87707eea10e4859205856722bbe0eb47eba0b5a8fb65edddb034a47b02d1 |
|
MD5 | 829c4e7a22a477e07120b44083be0d6b |
|
BLAKE2b-256 | c6eb4eeeb727b1b8c63441934d26ec37689a1e1962dcbbd2835bf594e29fa711 |