gridmind 0.0.1

No project description provided

GridMind 🧠

GridMind is a library of reinforcement learning (RL) algorithms, designed as a companion for readers of the book Reinforcement Learning: An Introduction (2nd ed.) by Richard S. Sutton and Andrew G. Barto. This library prioritizes tabular implementations to enhance understanding and facilitate hands-on experimentation with learning patterns in various RL algorithms. GridMind is compatible with gymnasium environments, making it easy to integrate with a wide range of standard RL environments.

Note: GridMind is a work in progress and will be updated with additional algorithms and features over time.

---

📜 Algorithms Included

1. Monte Carlo Methods

• Every-Visit MC: Prediction
• Exploring Starts: Prediction & Control
• Off-Policy MC: Prediction & Control

2. Temporal Difference (TD) Methods

• TD(0): Prediction
• SARSA: Control
• Q-Learning: Control

---

Getting Started 🚀

To use GridMind, you’ll need:

• Python (>= 3.8)

1. Installation: Clone the repository and install the package with the following commands:

   git clone https://github.com/shuvoxcd01/GridMind.git
   cd GridMind
   pip install .
   

2. Basic Usage:

   from gridmind.algorithms.temporal_difference.control.q_learning import QLearning
   import gymnasium as gym
   
   # Initialize the Taxi-v3 environment
   env = gym.make("Taxi-v3")
   agent = QLearning(env=env)
   
   # Train the agent
   agent.optimize_policy(num_episodes=10000)
   
   # Get the learned policy
   policy = agent.get_policy()
   
   # Close and re-open the environment for rendering
   env.close()
   env = gym.make("Taxi-v3", render_mode="human")
   
   # Demonstrate the policy
   obs, _ = env.reset()
   for step in range(100):
       action = policy.get_action_deterministic(state=obs)
       next_obs, reward, terminated, truncated, _ = env.step(action=action)
       print("Reward: ", reward)
       obs = next_obs
       env.render()
   
       if terminated or truncated:
           obs, _ = env.reset()
   
   env.close()
   

🌍 Contribution

Contributions are welcome! Whether it’s bug fixes, new features, or suggestions, feel free to open an issue or submit a pull request. We appreciate the community's input in making GridMind a valuable learning resource for all.