llama-github 0.1.4

Llama-github is an open-source Python library that empowers LLM Chatbots, AI Agents, and Auto-dev Agents to conduct Retrieval from actively selected GitHub public projects. It Augments through LLMs and Generates context for any coding question, in order to streamline the development of sophisticated AI-driven applications.

llama-github

Llama-github is a powerful tool that helps you retrieve the most relevant code snippets, issues, and repository information from GitHub based on your queries, transforming them into valuable knowledge context. It empowers LLM Chatbots, AI Agents, and Auto-dev Agents to solve complex coding tasks. Whether you're a developer looking for quick solutions or an engineer implementing advanced Auto Dev AI Agents, llama-github makes it easy and efficient.

If you like this project or believe it has potential, please give it a ⭐️. Your support is our greatest motivation!

Architecture

Installation

pip install llama-github

Usage

Here's a simple example of how to use llama-github:

from llama_github import GithubRAG

# Initialize GithubRAG with your credentials
github_rag = GithubRAG(
    github_access_token="your_github_access_token", 
    openai_api_key="your_openai_api_key", # Optional in Simple Mode
    jina_api_key="your_jina_api_key" # Optional - unless you want high concurrency production deployment (s.jina.ai API will be used in llama-github)
)

# Retrieve context for a coding question (simple_mode is default set to False)
query = "How to create a NumPy array in Python?"
context = github_rag.retrieve_context(
    query, # In professional mode, one query will take nearly 1 min to generate final contexts. You could set log level to INFO to monitor the retrieval progress
    # simple_mode = True
)

print(context)

For more advanced usage and examples, please refer to the documentation.

Key Features

• 🔍 Intelligent GitHub Retrieval: Harness the power of llama-github to retrieve highly relevant code snippets, issues, and repository information from GitHub based on user queries. Our advanced retrieval techniques ensure you find the most pertinent information quickly and efficiently.

• ⚡ Repository Pool Caching: Llama-github has an innovative repository pool caching mechanism. By caching repositories (including READMEs, structures, code, and issues) across threads, llama-github significantly accelerates GitHub search retrieval efficiency and minimizes the consumption of GitHub API tokens. Deploy llama-github in multi-threaded production environments with confidence, knowing that it will perform optimally and save you valuable resources.

• 🧠 LLM-Powered Question Analysis: Leverage state-of-the-art language models to analyze user questions and generate highly effective search strategies and criteria. Llama-github intelligently breaks down complex queries, ensuring that you retrieve the most relevant information from GitHub's vast repository network.

• 📚 Comprehensive Context Generation: Generate rich, contextually relevant answers by seamlessly combining information retrieved from GitHub with the reasoning capabilities of advanced language models. Llama-github excels at handling even the most complex and lengthy questions, providing comprehensive and insightful responses that include extensive context to support your development needs.

• 🚀 Asynchronous Processing Excellence: Llama-github is built from the ground up to leverage the full potential of asynchronous programming. With meticulously implemented asynchronous mechanisms woven throughout the codebase, llama-github can handle multiple requests concurrently, significantly boosting overall performance. Experience the difference as llama-github efficiently manages high-volume workloads without compromising on speed or quality.

• 🔧 Flexible LLM Integration: Easily integrate llama-github with various LLM providers, embedding models, and reranking models to tailor the library's capabilities to your specific requirements. Our extensible architecture allows you to customize and enhance llama-github's functionality, ensuring that it adapts seamlessly to your unique development environment.

• 🔒 Robust Authentication Options: Llama-github supports both personal access tokens and GitHub App authentication, providing you with the flexibility to integrate it into different development setups. Whether you're an individual developer or working within an organizational context, llama-github has you covered with secure and reliable authentication mechanisms.

• 🛠️ Logging and Error Handling: We understand the importance of smooth operations and easy troubleshooting. That's why llama-github comes equipped with comprehensive logging and error handling mechanisms. Gain deep insights into the library's behavior, quickly diagnose issues, and maintain a stable and reliable development workflow.

Vision and Roadmap

Vision

Our vision is to become a pivotal module in the future of AI-driven development solutions, seamlessly integrating with GitHub to empower LLMs in automatically resolving complex coding tasks.

Roadmap

For a detailed view of our project roadmap, please visit our Project Roadmap.

Acknowledgments

We would like to express our gratitude to the following open-source projects for their support and contributions:

• LangChain: For providing the foundational framework that empowers the LLM prompting and processing capabilities in llama-github.
• Jina.ai: For offering s.jina.ai API and open source reranker and embedding models that enhance the accuracy and relevance of the generated contexts in llama-github.

Their contributions have been instrumental in the development of llama-github, and we highly recommend checking out their projects for more innovative solutions.

Contributing

We welcome contributions to llama-github! Please see our contributing guidelines for more information.

License

This project is licensed under the terms of the Apache 2.0 license. See the LICENSE file for more details.

Contact

If you have any questions, suggestions, or feedback, please feel free to reach out to us at Jet Xu's email.

---

Thank you for choosing llama-github! We hope this library enhances your AI development experience and helps you build powerful applications with ease.

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

0.1.4 - 2024-10-14

Improved

• Optimized simple_mode:
  • Removed dependencies on Torch and Transformers libraries
  • Reduced memory footprint
  • Eliminated related imports
  • Enhanced compatibility with AWS Lambda environment

0.1.3 - 2024-10-14

Added

• Modified LLMManager class to skip loading embedding and reranker models when simple_mode is enabled
• Updated retrieve_context method to use instance's simple_mode by default, with option to override

Improved

• Faster initialization process when simple_mode is enabled, skipping embedding and reranker model loading
• More flexible usage of simple_mode in retrieve_context, allowing per-call customization

Developer Notes

• When using simple_mode=True during GithubRAG initialization, be aware that embedding and reranking functionalities will not be available
• The retrieve_context method now uses a late binding approach for simple_mode parameter

0.1.2 - 2024-10-09

Added

• New get_pr_content method in Repository class for comprehensive PR data retrieval
• Singleton pattern implementation for efficient PR data caching
• Support for LLM-assisted PR analysis and Q&A capabilities
• Automatic caching mechanism to reduce API calls and improve performance
• Threaded comment and review retrieval functionality

Changed

• Improved PR data fetching process to include metadata, file changes, and comments

Optimized

• Reduced API calls through intelligent caching of PR data

Developer Notes

• First call to get_pr_content fetches data from GitHub API, subsequent calls use cached data
• Cache automatically refreshes when PR is updated

0.1.1 - 2024-08-23

Added

• Implemented answer_with_context method for direct answer generation (closes #6)
• Added support for Mistral AI LLM provider
• Enhanced retrieve_context function to include metadata (e.g., URLs) with each context string (closes #2)

Changed

• Improved reranking with jina-reranker-v2 for better context retrieval
• Updated return type of retrieve_context to accommodate metadata

Fixed

• Resolved warning during context retrieval (closes #3)

Improved

• Enhanced overall context retrieval process
• Expanded LLM support for more versatile use cases

0.1.0 - 2024-08-15

Added

• Initial release of llama-github
• Basic functionality for retrieving context from GitHub repositories
• Integration with LLM for processing and generating responses