Skip to main content

No project description provided

Project description

Is Python an interpreted or compiled language? Trick question. It’s actually both. With tools like Cython, we can take the compilation step further and remove the interpreter loop almost entirely. Cython produces binaries much like C++, Go, and Rust do. Now with GitHub Actions the cross-platform build and release process can be automated for free for Open Source projects. This is an enormous opportunity to make the Python ecosystem 20-50% faster with a single pull request. This lightning talk walks through a GitHub workflow that publishes Cython-optimized wheels to PyPI. Discover how Cython can turbo-charge your Python code and GitHub Actions can simplify your cross-platform release process for free.

Is Python interpreted or compiled?

.
.
.
?
.
.
.
?
.
.
.
?

c2f.py

"Celsius to Fahrenheit Library"

def convert(celsius: float) -> float:
    "Convert Celsius to Fahrenheit"
    fahrenheit = celsius * 1.8 + 32
    return fahrenheit

c2f.cpython-38.pyc

>>> import c2f
>>> dis.dis(c2f.convert)
  6           0 LOAD_FAST                0 (celsius)
              2 LOAD_CONST               1 (1.8)
              4 BINARY_MULTIPLY
              6 LOAD_CONST               2 (32)
              8 BINARY_ADD
             10 STORE_FAST               1 (fahrenheit)
  7          12 LOAD_FAST                1 (fahrenheit)
             14 RETURN_VALUE

setup.py

from setuptools import setup
from Cython.Build import cythonize

setup(
    name='c2f',
    version='0.0.0',
    py_modules=['c2f'],
    ext_modules=cythonize('c2f.py'),
)

c2f.c

$ cython c2f.py
static PyObject * __pyx_convert(double __pyx_v_celsius)
{
  double __pyx_v_fahrenheit;
  PyObject *__pyx_r = NULL;
  __pyx_v_fahrenheit = ((__pyx_v_celsius * 1.8) + 32.0);
  __pyx_r = PyFloat_FromDouble(__pyx_v_fahrenheit);
  return __pyx_r;
}

c2f.so

$ python setup.py bdist_wheel
___pyx_convert:
push   rbp
mov    rbp, rsp
sub    rsp, 16
movsd  xmm0, qword ptr [rbp - 8]
mulsd  xmm0, qword ptr [rip + 1379]
addsd  xmm0, qword ptr [rip + 1379]
call   502 <PyFloat_FromDouble ...>
add    rsp, 16
pop    rbp
ret

.github/workflows/release.yml

name: release
on:
  push:
    tags:
      - v*
jobs:
  build-linux-cp38:
    runs-on: ubuntu-latest
    container: quay.io/pypa/manylinux2014_x86_64
    steps:
    ...

Matrix Build

build-macos:
  runs-on: macos-latest
  strategy:
    max-parallel: 4
    matrix:
      python-version: [3.5, 3.6, 3.7, 3.8]
  steps:
  ...

Mac Build Steps

- name: Set up Python ${{ matrix.python-version }} x64
  uses: actions/setup-python@v1
  with:
    python-version: ${{ matrix.python-version }}
    architecture: x64

- name: Install package dependencies
  run: pip install cython wheel

- name: Build binary wheel
  run: python setup.py bdist_wheel

Linux auditwheel Tool

- name: Build binary wheel
  run: /opt/python/cp38-cp38/bin/python setup.py bdist_wheel

- name: Apply auditwheel for manylinux wheel
  run: auditwheel repair -w dist dist/*

- name: Remove linux wheel
  run: rm dist/*-linux_x86_64.whl

Windows Build Steps

- name: Download Build Tools for Visual Studio 2019
  run: Invoke-WebRequest -Uri https://aka.ms/vs/16/rel...

- name: Run vs_buildtools.exe install
  run: ./vs_buildtools.exe --quiet --wait --norestart ...

Store Build Artifacts

- name: Archive dist artifacts
  uses: actions/upload-artifact@v1
  with:
    name: dist-macos-${{ matrix.python-version }}
    path: dist

Source Distribution

upload:
  needs: [build-linux-cp35, ...]
  runs-on: ubuntu-latest
  steps:
  ...
  - name: Install dependencies
    run: pip install -r requirements.txt

  - name: Create source dist
    run: python setup.py sdist

Stage Binary Wheels

- name: Stage linux 3.8
  uses: actions/download-artifact@v1
  with:
    name: dist-linux-3.8
- run: mv -v dist-linux-3.8/* dist/

- name: Stage macos 3.8
  uses: actions/download-artifact@v1
  with:
    name: dist-macos-3.8
- run: mv -v dist-macos-3.8/* dist/
...

Upload with Twine

- name: Upload with twine
  env:
    TWINE_USERNAME: ${{ secrets.TWINE_USERNAME }}
    TWINE_PASSWORD: ${{ secrets.TWINE_PASSWORD }}
  run: |
    ls -l dist/*
    pip install twine
    twine upload dist/*

Cythonize all the Things!

PLEASE STEAL THE CODE!

Cythonize all the Things!

Cythonize all the Things!

Cythonize all the Things!

Cythonize all the Things!

Cythonize all the Things!

Cythonize all the Things!

Appendix

Dumping Assembly

$ gcc -g -shared -pthread -fPIC -fwrapv -O2 -Wall -fno-strict-aliasing -I/Library/Frameworks/Python.framework/Versions/3.8/include/python3.8 -L/Library/Frameworks/Python.framework/Versions/3.8/lib -o c2f.so c2f.c -lpython3.8
$ objdump -S -df=___pyx_pw_3c2f_1convert c2f.so

Git Tagging

$ git tag -a v0.0.2 -m v0.0.2
$ git push
$ git push --tags

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for c2f, version 1.0.5
Filename, size File type Python version Upload date Hashes
Filename, size c2f-1.0.5-cp35-cp35m-macosx_10_13_x86_64.whl (13.5 kB) File type Wheel Python version cp35 Upload date Hashes View hashes
Filename, size c2f-1.0.5-cp35-cp35m-manylinux1_x86_64.whl (45.4 kB) File type Wheel Python version cp35 Upload date Hashes View hashes
Filename, size c2f-1.0.5-cp35-cp35m-manylinux2014_x86_64.whl (45.4 kB) File type Wheel Python version cp35 Upload date Hashes View hashes
Filename, size c2f-1.0.5-cp36-cp36m-macosx_10_13_x86_64.whl (13.6 kB) File type Wheel Python version cp36 Upload date Hashes View hashes
Filename, size c2f-1.0.5-cp36-cp36m-manylinux1_x86_64.whl (46.1 kB) File type Wheel Python version cp36 Upload date Hashes View hashes
Filename, size c2f-1.0.5-cp36-cp36m-manylinux2014_x86_64.whl (46.1 kB) File type Wheel Python version cp36 Upload date Hashes View hashes
Filename, size c2f-1.0.5-cp36-cp36m-win_amd64.whl (16.5 kB) File type Wheel Python version cp36 Upload date Hashes View hashes
Filename, size c2f-1.0.5-cp37-cp37m-macosx_10_13_x86_64.whl (13.7 kB) File type Wheel Python version cp37 Upload date Hashes View hashes
Filename, size c2f-1.0.5-cp37-cp37m-manylinux1_x86_64.whl (47.1 kB) File type Wheel Python version cp37 Upload date Hashes View hashes
Filename, size c2f-1.0.5-cp37-cp37m-manylinux2014_x86_64.whl (47.1 kB) File type Wheel Python version cp37 Upload date Hashes View hashes
Filename, size c2f-1.0.5-cp37-cp37m-win_amd64.whl (16.6 kB) File type Wheel Python version cp37 Upload date Hashes View hashes
Filename, size c2f-1.0.5-cp38-cp38-macosx_10_13_x86_64.whl (13.8 kB) File type Wheel Python version cp38 Upload date Hashes View hashes
Filename, size c2f-1.0.5-cp38-cp38-manylinux1_x86_64.whl (49.3 kB) File type Wheel Python version cp38 Upload date Hashes View hashes
Filename, size c2f-1.0.5-cp38-cp38-manylinux2014_x86_64.whl (49.3 kB) File type Wheel Python version cp38 Upload date Hashes View hashes
Filename, size c2f-1.0.5-cp38-cp38-win_amd64.whl (16.7 kB) File type Wheel Python version cp38 Upload date Hashes View hashes
Filename, size c2f-1.0.5.tar.gz (28.5 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page