Skip to main content

A Python library for reinforcement learning algorithms

Project description

🎯 NeatRL

A clean, modern Python library for reinforcement learning algorithms

NeatRL provides high-quality implementations of popular RL algorithms with a focus on simplicity, performance, and ease of use. Built with PyTorch and designed for both research and production use.

✨ Features

  • 🚀 Fast & Efficient: Optimized implementations using PyTorch
  • 🎯 Production Ready: Clean APIs and comprehensive error handling
  • 📊 Experiment Tracking: Built-in support for Weights & Biases logging
  • 🎮 Gymnasium Compatible: Works with all Gymnasium environments
  • 🔧 Easy to Extend: Modular design for adding new algorithms
  • 📈 State-of-the-Art: Implements modern RL techniques and best practices

🏗️ Supported Algorithms

Current Implementations

  • DQN (Deep Q-Network) - Classic value-based RL algorithm
  • More algorithms coming soon...

📦 Installation

python -m venv neatrl-env
source neatrl-env/bin/activate  # On Windows use `neatrl-env\Scripts

pip install neatrl

🚀 Quick Start

Train a DQN agent on CartPole in 3 lines:

from neatrl import train_dqn

model = train_dqn(
    env_id="CartPole-v1",
    total_timesteps=10000,
    seed=42
)

📚 Documentation

📖 Complete Documentation

The docs include:

  • Detailed usage examples
  • Hyperparameter tuning guides
  • Environment compatibility
  • Experiment tracking setup
  • Troubleshooting tips

🤝 Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

Development Setup

git clone https://github.com/YuvrajSingh-mist/NeatRL.git
cd NeatRL
pip install -e .[dev]

📋 Changelog

[0.1.4] - 2025-12-13

  • Added: Custom agent support for DQN training
  • Added: Network architecture display using torchinfo
  • Improved: Error handling for custom agent constructors
  • Changed: Agent parameter now accepts nn.Module subclasses

[0.1.3] - 2025-12-01

  • Initial release with DQN implementation
  • Weights & Biases integration
  • Video recording capabilities
  • Comprehensive documentation

For the complete changelog, see CHANGELOG.md.

📄 License

This project is licensed under the MIT License - see the LICENSE file for details.


Made with ❤️ for the RL community

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

neatrl-0.1.5.tar.gz (9.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

neatrl-0.1.5-py3-none-any.whl (7.9 kB view details)

Uploaded Python 3

File details

Details for the file neatrl-0.1.5.tar.gz.

File metadata

  • Download URL: neatrl-0.1.5.tar.gz
  • Upload date:
  • Size: 9.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.2

File hashes

Hashes for neatrl-0.1.5.tar.gz
Algorithm Hash digest
SHA256 3ae96b6243629b21b259150d40af0098be101874894232160937c9adf796c0ae
MD5 e8d2ead6a98b9258c254315cd062f6af
BLAKE2b-256 98f959ebf988ef747d99dacee444241134143c45159913931a06ef1a694f9033

See more details on using hashes here.

File details

Details for the file neatrl-0.1.5-py3-none-any.whl.

File metadata

  • Download URL: neatrl-0.1.5-py3-none-any.whl
  • Upload date:
  • Size: 7.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.2

File hashes

Hashes for neatrl-0.1.5-py3-none-any.whl
Algorithm Hash digest
SHA256 1927007f496c0858e8dc0415e29f4d783cd9d7deae51cfb7327471be3dfd112d
MD5 97d3172cc4e2c568f307442fbca79bec
BLAKE2b-256 e5075005754201b0b630ee899bf8b772729888fa54ed4a65516e33b9de674804

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page