Software name disambiguation pipeline
Project description
SONAD: Software Name Disambiguation
SONAD (Software Name Disambiguation) is a command-line tool and Python package that links software mentions in scientific papers to their corresponding repository URLs. It leverages NLP, third-party tools like SOMEF, and metadata to resolve software names accurately. It is limited to fetching URLs from GitHub, PyPI and CRAN.
Installation
Install using pip:
pip install sonad
For development mode (auto-refreshes when you edit the code):
pip install sonad -e .
Initial Configuration
Before using SONAD, you must install and configure SOMEF
(https://github.com/KnowledgeCaptureAndDiscovery/somef/?tab=readme-ov-file),
which is used for software metadata extraction.
Follow their installation instructions to make sure somef runs correctly on your system.
It is also strongly recommended to provide a GitHub API token to avoid rate limits when querying GitHub. You can configure this once using:
sonad configure
Your token will be saved for future runs.
Requirements
SONAD requires Python 3.9. All dependencies are installed automatically.
Some key libraries:
- pandas
- scikit-learn
- xgboost
- sentence-transformers
- beautifulsoup4
- requests
- SPARQLWrapper
- somef
- textdistance
- lxml
- cloudpickle
Usage
After installation, you can run the main command:
sonad process -i <input_file.csv> -o <output_file.csv> [-t <temp_folder>]
Parameters
-i,--input(required): Path to the input CSV file.-o,--output(required): Path where the output CSV will be saved.-t,--temp(optional): Folder where temporary files will be written it the folder is provided.
Input Format
The input CSV must contain the following columns:
name: The software name mentioned in the paper.doi: The DOI of the paper.paragraph: The paragraph in which the software is mentioned.
Optionally, it can include:
candidate_urls: A comma-separated list of candidate software URLs that might correspond to the software.
Example:
name,doi,paragraph,candidate_urls
Scikit-learn,10.1000/xyz123,"We used Scikit-learn for classification.","https://github.com/scikit-learn/scikit-learn"
License
MIT License © Jelena Djuric
https://github.com/jelenadjuric01
Contributions
Feel free to submit issues or pull requests on the GitHub repository:
https://github.com/jelenadjuric01/Software-Disambiguation
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file sonad-0.1.0.tar.gz.
File metadata
- Download URL: sonad-0.1.0.tar.gz
- Upload date:
- Size: 91.6 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.9.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
400bfcc387d7c9841a8f0fd27e34adae80c1555b6e003bf4b895939344ad085d
|
|
| MD5 |
2a3b08a896daea22d34cb65f0d15c33c
|
|
| BLAKE2b-256 |
c8ffe213394993c12d295fa68ba2ac677db9385cf283db26dbb094b7474a67e4
|
File details
Details for the file sonad-0.1.0-py3-none-any.whl.
File metadata
- Download URL: sonad-0.1.0-py3-none-any.whl
- Upload date:
- Size: 95.1 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.9.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3d301eca64813a3391ab6990d2711ea97158cc03e749ea61ad5c89f9573e4346
|
|
| MD5 |
5287cff857879c624fb72fad8e90db4a
|
|
| BLAKE2b-256 |
d29ed9077cf119590282d53a2d3e06fa9d2faca9ad1797c7e7e41ec4e1729dc2
|