OpenAlex Reader
pip install llama-index-readers-openalex
This loader will search for papers in OpenAlex and load them in llama-index. The main advantage of using OpenAlex is that you can search the full-text for Open Access papers as well.
Usage
from llama_index.readers.openalex import OpenAlexReader
openalex_reader = OpenAlexReader(email="shauryr@gmail.com")
query = "biases in large language models"
# changing this to full_text=True will let you search full-text
documents = openalex_reader.load_data(query, full_text=False)
What can it do?
As shown in demo.ipynb we can get answers with citations.
query = "biases in large language models"
response = query_engine.query(
"list the biases in large language models in a markdown table"
)
Output
| Source | Biases |
|---|---|
| Source 1 | Data selection bias, social bias (gender, age, sexual orientation, ethnicity, religion, culture) |
| Source 2 | Biases of what is right and wrong to do, reflecting ethical and moral norms of society |
| Source 3 | Anti-Muslim bias |
| Source 6 | Gender bias |
| Source 9 | Anti-LGBTQ+ bias |
| Source 10 | Potential bias in the output |
Credits
1 maintainer
Release files for llama-index-readers-openalex 0.6.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| llama_index_readers_openalex-0.6.0.tar.gz | 4.8 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| llama_index_readers_openalex-0.6.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 9.3 kB
Release files / llama_index_readers_openalex-0.6.0.tar.gz
| Download URL | llama_index_readers_openalex-0.6.0.tar.gz |
|---|---|
| Size | 4.8 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
406931bd0836bda25e9d21aa1f6cf05477192ab8a980cadede85709f4e72e89a
|
|
BLAKE2b-256 checksum How to use checksums |
d7f5de415c6a49a5d67d4d8b44893a15dec9811ded5313f0a8e86b6d01d5789d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.12.7 {"installer":{"name":"uv","version":"0.12.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / llama_index_readers_openalex-0.6.0-py3-none-any.whl
| Download URL | llama_index_readers_openalex-0.6.0-py3-none-any.whl |
|---|---|
| Size | 4.4 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
916cbdb5c245a4ca315a00c18c5208a513201a8a764d526ab81303c479235d23
|
|
BLAKE2b-256 checksum How to use checksums |
1aefdec9e7155418d6e6beca1ed39f4aa98cf4f534df1752e002b8f0955bb38b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.12.7 {"installer":{"name":"uv","version":"0.12.7","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
