Skip to main content

PyGlove: A library for manipulating Python objects.

Project description

logo

PyGlove: Manipulating Python Programs

PyPI version codecov pytest

Getting started | Installation | Examples | Reference docs

What is PyGlove

PyGlove is a general-purpose library for Python object manipulation. It introduces symbolic object-oriented programming to Python, allowing direct manipulation of objects that makes meta-programs much easier to write. It has been used to handle complex machine learning scenarios, such as AutoML, as well as facilitating daily programming tasks with extra flexibility.

PyGlove is lightweight and has very few dependencies beyond the Python interpreter. It provides:

  • A mutable symbolic object model for Python;
  • A rich set of operations for Python object manipulation;
  • A solution for automatic search of better Python programs, including:
    • An easy-to-use API for dropping search into an arbitrary pre-existing Python program;
    • A set of powerful search primitives for defining the search space;
    • A library of search algorithms ready to use, and a framework for developing new search algorithms;
    • An API to interface with any distributed infrastructure (e.g. Open Source Vizier) for such search.

It's commonly used in:

  • Automated machine learning (AutoML);
  • Evolutionary computing;
  • Machine learning for large teams (evolving and sharing ML code, reusing ML techniques, etc.);
  • Daily programming tasks in Python (advanced binding capabilities, mutability, etc.).

PyGlove has been published at NeurIPS 2020. It is widely used within Alphabet, including Google Research, Google Cloud, Youtube and Waymo.

PyGlove is developed by Daiyi Peng and colleagues in Google Brain Team.

Hello PyGlove

import pyglove as pg

@pg.symbolize
class Hello:
  def __init__(self, subject):
    self._greeting = f'Hello, {subject}!'

  def greet(self):
    print(self._greeting)


hello = Hello('World')
hello.greet()

Hello, World!

hello.rebind(subject='PyGlove')
hello.greet()

Hello, PyGlove!

hello.rebind(subject=pg.oneof(['World', 'PyGlove']))
for h in pg.iter(hello):
  h.greet()

Hello, World!
Hello, PyGlove!

Install

pip install pyglove

Or install nightly build with:

pip install pyglove --pre

Examples

Citing PyGlove

@inproceedings{peng2020pyglove,
  title={PyGlove: Symbolic programming for automated machine learning},
  author={Peng, Daiyi and Dong, Xuanyi and Real, Esteban and Tan, Mingxing and Lu, Yifeng and Bender, Gabriel and Liu, Hanxiao and Kraft, Adam and Liang, Chen and Le, Quoc},
  booktitle={Advances in Neural Information Processing Systems (NeurIPS)},
  volume={33},
  pages={96--108},
  year={2020}
}

Disclaimer: this is not an officially supported Google product.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pyglove-0.4.5.dev202409050808.tar.gz (443.7 kB view details)

Uploaded Source

Built Distribution

pyglove-0.4.5.dev202409050808-py3-none-any.whl (581.1 kB view details)

Uploaded Python 3

File details

Details for the file pyglove-0.4.5.dev202409050808.tar.gz.

File metadata

File hashes

Hashes for pyglove-0.4.5.dev202409050808.tar.gz
Algorithm Hash digest
SHA256 1a8a3b4d4b2cbd06e35a196e1558f9e6a281c7ea5aee469ab989e57a1daa8fe8
MD5 276031205966c8a72d0d4e1fa8b26162
BLAKE2b-256 ebe8506e27a8f97f2c060e8b1c7cf6b2cb2b9296b93b89596148d9b461a33805

See more details on using hashes here.

File details

Details for the file pyglove-0.4.5.dev202409050808-py3-none-any.whl.

File metadata

File hashes

Hashes for pyglove-0.4.5.dev202409050808-py3-none-any.whl
Algorithm Hash digest
SHA256 34f6fcf78e6c45ae651393400936b91b703b79027a040a786b1e810dc4bd9f27
MD5 2f77471fae4fbd7b1806c0735ad2f69c
BLAKE2b-256 20e86d43f916f870f9b32d47617b4e1a459816f2277c0baed67fcfc76b0c6cc7

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page