Skip to main content

Optimal compression-prediction tradeoffs for principled feature extraction

Project description

💰 Support This Research - Please Donate!

🙏 If this library helps your research or project, please consider donating to support continued development:

💳 DONATE VIA PAYPAL - CLICK HERE

CI PyPI version Python 3.9+ License


Information Bottleneck

🌟 Optimal compression-prediction tradeoffs for principled feature extraction

Tishby, N., Pereira, F. C., & Bialek, W. (1999) - "The Information Bottleneck Method"

📦 Installation

pip install information-bottleneck

🚀 Quick Start

import information_bottleneck
import numpy as np

# Create sample data
X = np.random.randn(1000, 20)  # Input data
Y = np.random.randint(0, 3, 1000)  # Target labels

# Create Information Bottleneck
ib = information_bottleneck.create_information_bottleneck(
    method='discrete',
    beta=1.0
)

# Fit the model
ib.fit(X, Y)

# Get compressed representations
compressed = ib.transform(X)
print(f"✅ Compressed {X.shape}{compressed.shape}")

🎓 About the Implementation

Implemented by Benedict Chen - bringing foundational AI research to modern Python.

📧 Contact: benedict@benedictchen.com

📖 Citation

If you use this implementation in your research, please cite the original paper:

Tishby, N., Pereira, F. C., & Bialek, W. (1999) - "The Information Bottleneck Method"

📜 License

Custom Non-Commercial License with Donation Requirements - See LICENSE file for details.


💰 Support This Work - Donation Appreciated!

This implementation represents hundreds of hours of research and development. If you find it valuable, please consider donating:

💳 DONATE VIA PAYPAL - CLICK HERE

Your support helps maintain and expand these research implementations! 🙏

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

information_bottleneck-1.1.0.tar.gz (53.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

information_bottleneck-1.1.0-py3-none-any.whl (6.9 kB view details)

Uploaded Python 3

File details

Details for the file information_bottleneck-1.1.0.tar.gz.

File metadata

  • Download URL: information_bottleneck-1.1.0.tar.gz
  • Upload date:
  • Size: 53.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.3+

File hashes

Hashes for information_bottleneck-1.1.0.tar.gz
Algorithm Hash digest
SHA256 029fe3610142197c9e4719fbd4d6a5a74c2ae2e61be5e87eae8552f28a85a0f6
MD5 6cdefa5b261e6391350b979d71ab0dbb
BLAKE2b-256 5e2e0ea08b79c8bd568d31bde6bc9eb08d8b2b4c5c9ca9270f05c2f71ec8d3ce

See more details on using hashes here.

File details

Details for the file information_bottleneck-1.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for information_bottleneck-1.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 6be5dfb21aead84476cc73fc772f5af0990607300b85a316757eb3a3fc564abc
MD5 ac933d5bd82382120a58aa0af36d3767
BLAKE2b-256 822bb2eb03d6508598903de49efec12fae9c8fa8453c11c086e83a2669b5638e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page