Search your code repository using GPT3.5 or GPT4.
Project description
Repo GPT
Repo-GPT is a Python CLI tool designed to utilize the power of OpenAI's GPT-3 model. It facilitates the process of code analysis and search within your repositories.
Features
- Code extraction and processing from your repositories.
- Semantic search within your codebase through natural language queries.
- Response generation to natural language queries about your code.
- Specific file analysis within your codebase.
Installation
Repo-GPT can be installed via pip:
pip install repo-gpt
Alternatively, you can clone and install from the source code:
git clone https://github.com/yourusername/repo-gpt.git
cd repo-gpt
poetry install
Setting Up
Before starting, make sure to set up your OpenAI key in your environment variables.
export OPENAI_API_KEY=<insert your openai key>
To set up Repo-GPT, run the following command at the root of the project you want to search. This will create a .repo_gpt
directory and store the code embeddings there:
repo-gpt setup
Repo-GPT will only add or update embeddings for new files or changed files. You can rerun the setup command as many times as needed.
Usage
After setup, you can perform various tasks:
-
Semantic Search: Find semantically similar code snippets in your codebase:
repo-gpt search <text/question>
-
Codebase Query: Ask questions about your codebase:
repo-gpt query <text/question>
-
File Analysis: Analyze a specific file:
repo-gpt analyze <file_path>
-
Help: Access the help guide:
repo-gpt help
-
Generate tests: Generate tests for a function: Note: this assumes the function name is unique in the codebase, otherwise, it will pick the first function it finds with that name.
repo-gpt add-test <unique function name> --test_save_file_path <absolute filepath to add tests to> --testing_package <testing package to use e.g. pytest>
Example:
repo-gpt setup --root_path ./my_project
repo-gpt search "extract handler"
repo-gpt query "What does the function `calculate_sum` do?"
repo-gpt analyze ./my_project/main.py
repo-gpt add-test function_name --test_save_file_path $PWD/test.py --testing_package pytest
Contributing
We welcome your contributions! Before starting, please make sure to install Python 3.11
and the latest version of poetry. Pyenv is a convenient tool to manage multiple Python versions on your computer.
Here are the steps to set up your development environment:
-
Export your OpenAI key to your environment variables:
export OPENAI_API_KEY=<insert your openai key>
-
Install dependencies:
poetry install --no-root
-
Install pre-commit hooks:
poetry run pre-commit install
-
Seed data:
poetry run python cli.py setup
-
Query data:
poetry run python cli.py search <text/question>
Debugging
You can view the output of the code_embeddings.pkl
using the following command:
pd.read_pickle('./.repo_gpt/code_embeddings.pkl', compression='infer')
Roadmap
Here are the improvements we are currently considering:
- Publishing to PyPi
- Test suite addition
- Add CI/CD
- Prettify output
- Add readme section about how folks can contribute parsers for their own languages
- Save # of tokens each code snippet has so we can ensure we don't pass too many tokens to GPT
- Add SQL file handler
- Add DBT file handler -- this may be a break in pattern as we'd want to use the manifest.json file
- Create VSCode extension
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file repo_gpt-0.1.2.tar.gz
.
File metadata
- Download URL: repo_gpt-0.1.2.tar.gz
- Upload date:
- Size: 20.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.6.1 CPython/3.11.4 Linux/5.15.0-1041-azure
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 426eb926b01cc94c43ce7ef98075b4b9a2de6a2568ef3056fdb09b6dae5d8278 |
|
MD5 | bd84688a08947f14838fabec86cf2b7a |
|
BLAKE2b-256 | 388e0cdb33affb10c50577b4393ad859823547be70418a35bc408e60fc4679a2 |
File details
Details for the file repo_gpt-0.1.2-py3-none-any.whl
.
File metadata
- Download URL: repo_gpt-0.1.2-py3-none-any.whl
- Upload date:
- Size: 24.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.6.1 CPython/3.11.4 Linux/5.15.0-1041-azure
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | c3c35add25d72a020017e56ef56e63970479351e39be6688df0cab966508dd3a |
|
MD5 | 4c89ea1239306936ff721ba9cf4d4fad |
|
BLAKE2b-256 | 0224b3750af19a571b6c89cdc51149e07b6fe9891be3633067afacc90ebcf47e |