llama-index readers dashscope integration
Project description
LlamaIndex Readers Integration: Dashscope
Installation
pip install llama-index-readers-dashscope
Usage
from llama_index.readers.dashscope.base import DashScopeParse
from llama_index.readers.dashscope.utils import ResultType
file_list = [
# your files (accept doc, docx, pdf)
]
parse = DashScopeParse(result_type=ResultType.DASHCOPE_DOCMIND)
documents = parse.load_data(file_path=file_list)
Reader Setting:
A full list of retriever settings/kwargs is below:
- api_key: Optional[str] -- Your dashscope API key, which can be passed in through environment variables or parameters. The parameter settings will override the results from the environment variables
- workspace_id: Optional[str] -- Your dashscope workspace_id, which can be passed in through environment variables or parameters. The parameter settings will override the results from the environment variables
- base_url: Optional[str] -- The base url for the Dashscope API. The default value is "https://dashscope.aliyuncs.com". The parameter settings will override the results from the environment variables.
- result_type: Optional[ResultType] -- The result type for the parser. The default value is ResultType.DASHCOPE_DOCMIND.
- num_workers: Optional[int] -- The number of workers to use sending API requests for parsing. The default value is 4, greater than 0, less than 10.
- check_interval: Optional[int] -- The interval in seconds to check if the parsing is done. The default value is 5.
- max_timeout: Optional[int] -- The maximum timeout in seconds to wait for the parsing to finish. The default value is 3600.
- verbose: Optional[bool] -- Whether to print the progress of the parsing. The default value is True.
- show_progress: Optional[bool] -- Show progress when parsing multiple files. The default value is True.
- ignore_errors: Optional[bool] -- Whether or not to ignore and skip errors raised during parsing. The default value is True.
Reader Input:
- file_path: Union[str, List[str]] -- The file path or list of file paths to parse.
Reader Output:
- List[llama_index.core.schema.Document] -- The list of documents parsed from the file.
- text: str -- The text of the document from DASHCOPE_DOCMIND.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for llama_index_readers_dashscope-0.2.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4ea69e2f5ec9d4bf816512f096f1c613e4d56d437f39e32008495e40465e6ec3 |
|
MD5 | 4d3a7a4fc6019c5cdba0a5b849b9780f |
|
BLAKE2b-256 | 657fe1c164b6183c9d13ac24d580eefe5a6545588d50cfe0cdddbb364132f688 |
Close
Hashes for llama_index_readers_dashscope-0.2.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 02ec2a7ce719e9c9d5b69fe429851230c71befac7131c540edd6ae16f10a2d27 |
|
MD5 | c426635ce6d40e58cc8a9b190734c0ad |
|
BLAKE2b-256 | b63ef940aecf2f6f76705c71135203c322f32d98ddd643f9893c6b8cfb448d77 |