Skip to main content

Writing a library entirely in notebooks

Project description

Welcome to nbdev

Create delightful python projects using Jupyter Notebooks

nbdev is a library that allows you to develop a python library in Jupyter Notebooks, putting all your code, tests and documentation in one place. That is: you now have a true literate programming environment, as envisioned by Donald Knuth back in 1983!

nbdev makes debugging and refactor your code much easier relative to traditional programming environments. Furthermore, using nbdev promotes software engineering best practices because tests and documentation are first class citizens.

The developers use this regularly on macOS and Linux. We have not tested it on Windows and not all features may work correctly.

Features of Nbdev

nbdev provides the following tools for developers:

  • Automatically generate docs from Jupyter notebooks. These docs are searchable and automatically hyperlinked to appropriate documentation pages by introspecting keywords you surround in backticks.
  • Utilities to automate the publishing of pypi and conda packages including version number management.
  • A robust, two-way sync between notebooks and source code, which allow you to use your IDE for code navigation or quick edits if desired.
  • Fine-grained control on hiding/showing cells: you can choose to hide entire cells, just the output, or just the input. Furthermore, you can embed cells in collapsible elements that are open or closed by default.
  • Ability to write tests directly in notebooks without having to learn special APIs. These tests get executed in parallel with a single CLI command. You can even define certain groups of tests such that you don't have to always run long-running tests.
  • Tools for merge/conflict resolution with notebooks in a human readable format.
  • Continuous integration (CI) comes setup for you with GitHub Actions out of the box, that will run tests automatically for you. Even if you are not familiar with CI or GitHub Actions, this starts working right away for you without any manual intervention.
  • Integration With GitHub Pages for docs hosting: nbdev allows you to easily host your documentation for free, using GitHub pages.
  • Create Python modules, following best practices such as automatically defining __all__ (more details) with your exported functions, classes, and variables.
  • Math equation support with LaTeX.
  • ... and much more! See the Getting Started section below for more information.

A Motivating Example

For example, lets define a class that represents a playing card, with associated docs and tests in a Jupyter Notebook:

image.png

In the above screenshot, we have code, tests and documentation in one context! nbdev renders this into searchable docs (which are optionally hosted for free on GitHub Pages). Below is an annotated screenshot of the generated docs for further explanation:

image.png

The above illustration is a subset of this nbdev tutorial with a minimal example, which uses code from Think Python 2 by Allen Downey.

Explanation of annotations:

  1. The heading Card corresponds to the first H1 heading in a notebook with a note block API Details as the summary.
  2. nbdev automatically renders a Table of Contents for you.
  3. nbdev automatically renders the signature of your class or function as a heading.
  4. The cells where your code is defined will be hidden and replaced by standardized documentation of your function, showing its name, arguments, docstring, and link to the source code on github.
  5. This part of docs is rendered automatically from the docstring.
  6. The rest of the notebook is rendered as usual. You can hide entire cells, hide only cell input or hide only output by using the flags described on this page.
  7. nbdev supports special block quotes that render as colored boxes in the documentation. You can read more about them here. In this specific example, we are using the Note block quote.
  8. Words you surround in backticks will be automatically hyperlinked to the associated documentation where appropriate. This is a trivial case where Card class is defined immediately above, however this works across pages and modules. We will see another example of this in later steps.

Installing

nbdev is on PyPI and conda so you can just run pip install nbdev or conda install -c fastai nbdev.

For an editable install, use the following:

git clone https://github.com/fastai/nbdev
pip install -e nbdev

Note that nbdev must be installed into the same python environment that you use for both your Jupyter Server and your workspace.

Getting Started

The following are helpful resources for getting started with nbdev:

If Someone Tells You That You Shouldn't Use Notebooks For Software Development

Watch this video.

Contributing

If you want to contribute to nbdev, be sure to review the contributions guidelines. This project adheres to fastai`s code of conduct. By participating, you are expected to uphold this code. In general, the fastai project strives to abide by generally accepted best practices in open-source software development.

Make sure you have the git hooks we use installed by running

nbdev_install_git_hooks

in the cloned repository folder.

Copyright

Copyright 2019 onwards, fast.ai, Inc. Licensed under the Apache License, Version 2.0 (the "License"); you may not use this project's files except in compliance with the License. A copy of the License is provided in the LICENSE file in this repository.

Appendix

nbdev and fastai

nbdev has been used to build innovative software used by many developers, such as fastai, a deep learning library which implements a unique layered api and callback system, and fastcore, an extension to the Python programming language. Furthermore, nbdev allows a very small number of developers to maintain and grow a large ecosystem of software engineering, data science, machine learning and devops tools.

Here, for instance, is how combined_cos is defined and documented in the fastai library:

Exporting from nbdev

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nbdev-1.1.12.tar.gz (4.3 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

nbdev-1.1.12-py3-none-any.whl (46.0 kB view details)

Uploaded Python 3

File details

Details for the file nbdev-1.1.12.tar.gz.

File metadata

  • Download URL: nbdev-1.1.12.tar.gz
  • Upload date:
  • Size: 4.3 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.6.1 requests/2.25.1 setuptools/49.6.0.post20201009 requests-toolbelt/0.9.1 tqdm/4.55.0 CPython/3.8.6

File hashes

Hashes for nbdev-1.1.12.tar.gz
Algorithm Hash digest
SHA256 1b28ba149f92d4162649bfea99a0a70a37b5626bab906c73461043ae917a0a75
MD5 4936e6c185abfa4da774eae503b35916
BLAKE2b-256 d221bd6ffbcd67e66faf6f77522666e483091f9be07e3f9e582c741db4f2ebae

See more details on using hashes here.

File details

Details for the file nbdev-1.1.12-py3-none-any.whl.

File metadata

  • Download URL: nbdev-1.1.12-py3-none-any.whl
  • Upload date:
  • Size: 46.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.3.0 pkginfo/1.6.1 requests/2.25.1 setuptools/49.6.0.post20201009 requests-toolbelt/0.9.1 tqdm/4.55.0 CPython/3.8.6

File hashes

Hashes for nbdev-1.1.12-py3-none-any.whl
Algorithm Hash digest
SHA256 d43b8144a37190fb86a1197d881e234036b03c51cc0dfb49f07a31d09f77ff24
MD5 dbbb089b06ee9c6ccd13e4cf93fefdc0
BLAKE2b-256 b7817ae0d7f03a69601943b7f77216f014f0668286cf67ac7780b2351a962291

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page