Skip to main content

A module for processing user data to NN input

Project description

Neural Network inputs maker

The comprehensive documentation and installation instructions, please visit the Link.

Description

This python package will detect the output of other codes (still Quantum Espresso) and create a json file (called data.json) that can be used as the raw input for Neural Networks.

Prerequisite

The python libraries which are needed to install:

numpy,
pandas,
json2,
collection,
collections.abc,
glob2

Other codes and necessary files:

QE output (mandetory) User have to provide a Quantum ESPRESSO output (PWSCF) as a necessary ingredient for this package! The folder that includes this file, should be specify with argument --folder [directory] in runtime!

Platform or supercomputer (mandetory) Supercomputer should be identified with argument --platform [supercompure name] in runtime too!

There is no other necessary inputs, but optional one!

SYSINFO.JSON (optional!) The user can improve the hardware information from the utilized flatform or supercomputer. This information can be provided as a JSON file with this keywords: "Platform": platform, "CPU": cpu_model, "Node": node_info, "Memory": f"{total_memory_gb:.2f} GB DDR4 RAM" Although in order to avoid error, we recommend to use IDENTIKEEP plugin for generating the JSON file. This JSON file sould be named sysinfo.json (default name for IDENTIKEEP output) and placed in the same directory as of QE output.

How to install

Method 1:

Installation is based on Python Package Index (PyPI) repository.

pip install NNimaker

Method 2:

However, if you prefer to create the wheel of package on your laptop, you just need to download the source code from the origin repository . Then follow the path below to create the wheel on your system and then install it. (Note that you may need use virtual environment to install the necessary packages)

pip install setuptools wheel
python setup.py sdist bdist_wheel
pip install dist/NNimaker-<VERSION>-py3-none-any.whl 

How to USE

It is possible to use terminal commands ( The console point is provided). Since it supports just Quantum Espresso output (till this moment), the command is:

NNimake_QE  --folder [DIRECTORY] --outname [OUTPUT] --platform [SUPERCOMPUTER] --algname [ALGORITHM]

All of the arguments have default values. Default for directory is ./ , Default for output name is data.json, Default for platform is Leonardo-booster and Default for algorithm name is davidson. For example, I put the sysinfo.json and output file of QE in ../work/ directory. The command line would be:

NNimake_QE --folder ../work/ --platform "Leonardo-booster"

You can import the package in your python code directly:

from NNimaker import create_json

create_json("../work", outname="data.json", platform="Leonardo-booster", algoname='davidson')

Then you can find the created JSON file (data.json) in the directory that you specified with flag outname.

You can help us to grow our NN model with your data, if you willing to do so please share your results with us through this google form.

Good luck!

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

NNimaker-4.0.tar.gz (8.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

NNimaker-4.0-py3-none-any.whl (8.6 kB view details)

Uploaded Python 3

File details

Details for the file NNimaker-4.0.tar.gz.

File metadata

  • Download URL: NNimaker-4.0.tar.gz
  • Upload date:
  • Size: 8.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.12

File hashes

Hashes for NNimaker-4.0.tar.gz
Algorithm Hash digest
SHA256 3b8f96059c162708968f3b98b19006b5336dbe5eb0f81082a46a2f609c895f67
MD5 cde8312b702a595661a2713c8d7791ec
BLAKE2b-256 460d820051277f102111dc818c35299b225733afa4798ad9a04a0a877156c559

See more details on using hashes here.

File details

Details for the file NNimaker-4.0-py3-none-any.whl.

File metadata

  • Download URL: NNimaker-4.0-py3-none-any.whl
  • Upload date:
  • Size: 8.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.10.12

File hashes

Hashes for NNimaker-4.0-py3-none-any.whl
Algorithm Hash digest
SHA256 68e87f0948acfcb8220675abfc1378638b793888c7956021d665100d902489b0
MD5 7c4f637700a246ccc9b5532050d365bf
BLAKE2b-256 9ae5800023c992417b00208fb6c87ba5b8627788baa410a49230a671d6ca7b93

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page