llama-index readers openalex integration
Project description
OpenAlex Reader
pip install llama-index-readers-openalex
This loader will search for papers in OpenAlex and load them in llama-index. The main advantage of using OpenAlex is that you can search the full-text for Open Access papers as well.
Usage
from llama_index.readers.openalex import OpenAlexReader
openalex_reader = OpenAlexReader(email="shauryr@gmail.com")
query = "biases in large language models"
# changing this to full_text=True will let you search full-text
documents = openalex_reader.load_data(query, full_text=False)
What can it do?
As shown in demo.ipynb we can get answers with citations.
query = "biases in large language models"
response = query_engine.query(
"list the biases in large language models in a markdown table"
)
Output
| Source | Biases |
|---|---|
| Source 1 | Data selection bias, social bias (gender, age, sexual orientation, ethnicity, religion, culture) |
| Source 2 | Biases of what is right and wrong to do, reflecting ethical and moral norms of society |
| Source 3 | Anti-Muslim bias |
| Source 6 | Gender bias |
| Source 9 | Anti-LGBTQ+ bias |
| Source 10 | Potential bias in the output |
Credits
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file llama_index_readers_openalex-0.5.0.tar.gz.
File metadata
- Download URL: llama_index_readers_openalex-0.5.0.tar.gz
- Upload date:
- Size: 4.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.10.9 {"installer":{"name":"uv","version":"0.10.9","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3c32dfac8b00f391d4f4dde49df60d72ddda5a08f28420e66c161903d1d844da
|
|
| MD5 |
824f80b83f88a4a8959bf8a22ccfe257
|
|
| BLAKE2b-256 |
25c9675a5ed58dd27bcc2ad71cb7f0f0f108bfb2925b0088d31087b543a62025
|
File details
Details for the file llama_index_readers_openalex-0.5.0-py3-none-any.whl.
File metadata
- Download URL: llama_index_readers_openalex-0.5.0-py3-none-any.whl
- Upload date:
- Size: 4.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: uv/0.10.9 {"installer":{"name":"uv","version":"0.10.9","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
663ae67ff59db44f1f7d4b5e8427665c34f5de7578eda9befe13846299cbced6
|
|
| MD5 |
0862933a2590a7f4330e074e7724ac12
|
|
| BLAKE2b-256 |
0cae1a0d4c919943fc8d1a725e4e7e085cf425605c95c3944e525b30c4c62096
|
