Skip to main content

Software name disambiguation pipeline

Project description

SONAD: Software Name Disambiguation

License
Python

SONAD (Software Name Disambiguation) is a command-line tool and Python package that links software mentions in scientific papers to their corresponding repository URLs. It leverages NLP, third-party tools like SOMEF, and metadata to resolve software names accurately. It is limited to fetching URLs from GitHub, PyPI and CRAN.


Installation

Install using pip:

pip install sonad

For development mode (auto-refreshes when you edit the code):

pip install sonad -e .

Initial Configuration

Before using SONAD, you must install and configure SOMEF
(https://github.com/KnowledgeCaptureAndDiscovery/somef/?tab=readme-ov-file),
which is used for software metadata extraction.

Follow their installation instructions to make sure somef runs correctly on your system.

It is also strongly recommended to provide a GitHub API token to avoid rate limits when querying GitHub. You can configure this once using:

sonad configure

Your token will be saved for future runs.


Requirements

SONAD requires Python 3.9. All dependencies are installed automatically.

Some key libraries:

  • pandas
  • scikit-learn
  • xgboost
  • sentence-transformers
  • beautifulsoup4
  • requests
  • SPARQLWrapper
  • somef
  • textdistance
  • lxml
  • cloudpickle

Usage

After installation, you can run the main command:

sonad process -i <input_file.csv> -o <output_file.csv> [-t <temp_folder>] 

Parameters

  • -i, --input (required): Path to the input CSV file.
  • -o, --output (required): Path where the output CSV will be saved.
  • -t, --temp (optional): Folder where temporary files will be written it the folder is provided.

Input Format

The input CSV must contain the following columns:

  • name: The software name mentioned in the paper.
  • doi: The DOI of the paper.
  • paragraph: The paragraph in which the software is mentioned.

Optionally, it can include:

  • candidate_urls: A comma-separated list of candidate software URLs that might correspond to the software.

Example:

name,doi,paragraph,candidate_urls
Scikit-learn,10.1000/xyz123,"We used Scikit-learn for classification.","https://github.com/scikit-learn/scikit-learn"

License

MIT License © Jelena Djuric
https://github.com/jelenadjuric01


Contributions

Feel free to submit issues or pull requests on the GitHub repository:
https://github.com/jelenadjuric01/Software-Disambiguation

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sonad-0.1.0.tar.gz (91.6 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sonad-0.1.0-py3-none-any.whl (95.1 MB view details)

Uploaded Python 3

File details

Details for the file sonad-0.1.0.tar.gz.

File metadata

  • Download URL: sonad-0.1.0.tar.gz
  • Upload date:
  • Size: 91.6 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.9.0

File hashes

Hashes for sonad-0.1.0.tar.gz
Algorithm Hash digest
SHA256 400bfcc387d7c9841a8f0fd27e34adae80c1555b6e003bf4b895939344ad085d
MD5 2a3b08a896daea22d34cb65f0d15c33c
BLAKE2b-256 c8ffe213394993c12d295fa68ba2ac677db9385cf283db26dbb094b7474a67e4

See more details on using hashes here.

File details

Details for the file sonad-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: sonad-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 95.1 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.9.0

File hashes

Hashes for sonad-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 3d301eca64813a3391ab6990d2711ea97158cc03e749ea61ad5c89f9573e4346
MD5 5287cff857879c624fb72fad8e90db4a
BLAKE2b-256 d29ed9077cf119590282d53a2d3e06fa9d2faca9ad1797c7e7e41ec4e1729dc2

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page