llama-index readers box integration
Project description
LlamaIndex: Box Readers
This open-source integration brings the capabilities of Box.com to the LLama-Index, empowering developers building Retrieval Augmented Generation (RAG) and other LLM applications.
This README will guide you through installation, usage, and explore the functionalities of each reader.
Installation
pip install llama-index-readers-box
Available readers
We provide multiple readers, including:
- Box Reader - Implementation of the SimpleReader interface to read files from Box.
- Box Text Extraction - Uses Box text representation to extract text from document.
- Box AI Prompt - Uses Box AI to extract context from documents
- Box AI Extraction - Uses Box AI to extract structured data from documents
[!IMPORTANT] Box AI features are only available to E+ customers.
Authentication
Client credential gran (CCG)
Create a new application in the Box Developer Console and generate a new client ID and client secret. Create a .env file with the following content:
# CCG settings
BOX_CLIENT_ID = YOUR_CLIENT_ID
BOX_CLIENT_SECRET = YOUR_CLIENT_SECRET
# Common Settings
BOX_ENTERPRISE_ID = YOUR_BOX_ENTERPRISE_ID
BOX_USER_ID = YOUR_BOX_USER_ID (optional)
By default the CCG client will use a service account associated with the application. Depending on how the files are shared, the service account may not have access to all the files.
If you want to use a different user, you can specify the user ID in the .env file. In this case make sure your application can impersonate and/or generate user tokens in the scope.
Checkout this guide for more information on how to setup the CCG: Box CCG Guide
JSON web tokens (JWT)
Create a new application in the Box Developer Console and generate a new .config.json
file.
Create a .env file with the following content:
# Common settings
BOX_ENTERPRISE_ID = 877840855
BOX_USER_ID = 18622116055
# JWT Settings
JWT_CONFIG_PATH = /path/to/your/.config.json
By default the JWT client will use a service account associated with the application. Depending on how the files are shared, the service account may not have access to all the files.
If you want to use a different user, you can specify the user ID in the .env file. In this case make sure your application can impersonate and/or generate user tokens in the scope.
Checkout this guide for more information on how to setup the JWT: Box JWT Guide
[!WARNING] The JWT authentication requires extra dependencies in the SDK. You can install them by running:
pip install "box-sdk-gen[jwt]"
Box Client
To work with the box readers, you will need to provide a Box Client. The Box Client can be created using either the Client Credential Grant (CCG), JSON Web Tokens (JWT), OAuth 2.0, and developer token.
Using CCG authentication
from box_sdk_gen import CCGConfig, BoxCCGAuth, BoxClient
config = CCGConfig(
client_id="your_client_id",
client_secret="your_client_secret",
enterprise_id="your_enterprise_id",
user_id="your_ccg_user_id", # Optional
)
auth = BoxCCGAuth(config)
if config.user_id:
auth.with_user_subject(config.user_id)
client = BoxClient(auth)
reader = BoxReader(box_client=client)
Using JWT authentication
from box_sdk_gen import JWTConfig, BoxJWTAuth, BoxClient
# Using manual configuration
config = JWTConfig(
client_id="YOUR_BOX_CLIENT_ID",
client_secret="YOUR_BOX_CLIENT_SECRET",
jwt_key_id="YOUR_BOX_JWT_KEY_ID",
private_key="YOUR_BOX_PRIVATE_KEY",
private_key_passphrase="YOUR_BOX_PRIVATE_KEY_PASSPHRASE",
enterprise_id="YOUR_BOX_ENTERPRISE_ID",
user_id="YOUR_BOX_USER_ID",
)
# Using configuration file
config = JWTConfig.from_config_file("path/to/your/.config.json")
user_id = "1234"
if user_id:
config.user_id = user_id
config.enterprise_id = None
auth = BoxJWTAuth(config)
client = BoxClient(auth)
reader = BoxReader(box_client=client)
Author
Box-Community This is an open source reader, contributions are welcome.
This loader is designed to be used as a way to load data into LlamaIndex.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file llama_index_readers_box-0.3.0.tar.gz
.
File metadata
- Download URL: llama_index_readers_box-0.3.0.tar.gz
- Upload date:
- Size: 16.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.3 CPython/3.11.10 Darwin/22.3.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6f097a275b83e5fbf4f34fcdb856ab67df2ddc02a4bf7e4eacff94ceabeab988 |
|
MD5 | 3caccc8adc83c6adb6cc296aaaac95a0 |
|
BLAKE2b-256 | d3b8fc6f5f5a940415e943ea65f758500ec0c25faf73072b7b3dc364e8d9aea6 |
File details
Details for the file llama_index_readers_box-0.3.0-py3-none-any.whl
.
File metadata
- Download URL: llama_index_readers_box-0.3.0-py3-none-any.whl
- Upload date:
- Size: 27.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.3 CPython/3.11.10 Darwin/22.3.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6e58180e6ab3003da9c46d03350b358c304b8a214976e2260aab2615c3cdbd7d |
|
MD5 | 84906793a0039150bd0f94d6e61fef9c |
|
BLAKE2b-256 | a11ea8544ffee667935701f4c64d41eaaa487b279937437917c6080bc27d9dc5 |