Skip to main content

Software name disambiguation pipeline

Project description

SONAD: Software Name Disambiguation

License
Python

SONAD (Software Name Disambiguation) is a command-line tool and Python package that links software mentions in scientific papers to their corresponding repository URLs. It leverages NLP, third-party tools like SOMEF, and metadata to resolve software names accurately. It is limited to fetching URLs from GitHub, PyPI and CRAN.


Installation

Install using pip:

pip install sonad

Initial Configuration

Before using SONAD, you must install and configure SOMEF
(https://github.com/KnowledgeCaptureAndDiscovery/somef/?tab=readme-ov-file),
which is used for software metadata extraction.

Follow their installation instructions to make sure somef runs correctly on your system.

It is also strongly recommended to provide a GitHub API token to avoid rate limits when querying GitHub. You can configure this once using:

sonad configure

Your token will be saved for future runs.


Requirements

SONAD requires Python 3.9. All dependencies are installed automatically.

Some key libraries:

  • pandas
  • scikit-learn
  • xgboost
  • sentence-transformers
  • beautifulsoup4
  • requests
  • SPARQLWrapper
  • somef
  • textdistance
  • lxml
  • cloudpickle

Usage

After installation, you can run the main command:

sonad process -i <input_file.csv> -o <output_file.csv> [-t <temp_folder>] 

Parameters

  • -i, --input (required): Path to the input CSV file.
  • -o, --output (required): Path where the output CSV will be saved.
  • -t, --temp (optional): Folder where temporary files will be written it the folder is provided.

Input Format

The input CSV must contain the following columns:

  • name: The software name mentioned in the paper.
  • doi: The DOI of the paper.
  • paragraph: The paragraph in which the software is mentioned.

Optionally, it can include:

  • candidate_urls: A comma-separated list of candidate software URLs that might correspond to the software.

Example:

name,doi,paragraph,candidate_urls
Scikit-learn,10.1000/xyz123,"We used Scikit-learn for classification.","https://github.com/scikit-learn/scikit-learn"

License

MIT License © Jelena Djuric
https://github.com/jelenadjuric01


Contributions

Feel free to submit issues or pull requests on the GitHub repository:
https://github.com/jelenadjuric01/Software-Disambiguation

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sonad-0.1.1.tar.gz (91.6 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sonad-0.1.1-py3-none-any.whl (95.1 MB view details)

Uploaded Python 3

File details

Details for the file sonad-0.1.1.tar.gz.

File metadata

  • Download URL: sonad-0.1.1.tar.gz
  • Upload date:
  • Size: 91.6 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.9.0

File hashes

Hashes for sonad-0.1.1.tar.gz
Algorithm Hash digest
SHA256 67f6b2d22a331928648d48bd7f89ba2274f41f146611f6d8dc0898010fe9668b
MD5 db80ba2405a3f50ab5631be4b65c6e33
BLAKE2b-256 c77bc3f095d05b2d8d660d098a1798d6aa411b285b280f7422e432b635dae543

See more details on using hashes here.

File details

Details for the file sonad-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: sonad-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 95.1 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.9.0

File hashes

Hashes for sonad-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 a1281a65c390ceb977b8289b95981f6019b43c986b0e3b2051a33ce43d03f2c9
MD5 9befa29d61fc0e633417261b6c86fa39
BLAKE2b-256 dbf5be63ad4dfbc9160006ef5f5bfb463cb8b725213ab6d40bca7a582527cc59

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page