DMT-HI: MOE-based Hyperbolic Interpretable Deep Manifold Transformation for Unspervised Dimensional Reduction
(Our Paper)[https://arxiv.org/abs/2410.19504]
The code includes the following modules:
- Datasets (Mnist, CIFAR-10, HCL, 20newsgroups)
- Training for DMT-HI
- Evaluation metrics
- Visualisation
- Explainable Analyses
Configurating python environment
We recommend using conda for configuration. You can refer to our install-env.sh to configure the environment.
conda create -n nml python=3.9
conda activate nml
bash install_env.sh
Dataset
This project utilizes several datasets, including 20NG, HCL, MNIST, and CIFAR-10. Please follow the instructions below to understand the dataset structure and usage.
1. 20NG Dataset
The 20NG dataset is already included in this GitHub repository.
2. HCL Dataset
The HCL dataset must be manually downloaded from the following link: Download HCL Dataset. Once downloaded, please place the file HCL60kafter-elis-all.h5ad into the data_path/ directory.
3. MNIST and CIFAR-10 Datasets
The MNIST and CIFAR-10 datasets do not require manual download. These datasets will be automatically downloaded upon the first execution of the project.
Please ensure that you have a stable internet connection during the first run to automatically download these datasets.
Run DMT-HI
You can run DMT-HI with a single line of code to get latent embedding.
Minimun replication
Running minimal replication can be done with the following command:
python main.py fit -c=conf_new/nml4/mnist.yaml
Analyses
After successfully running DMT-HI for the first time, you can use the built-in analyzer to further explore the results. Follow the steps below to configure and run the analyzer.
Steps to Use the Analyzer
-
Open
dash_main.pyFile:
Navigate to the filedash_main.pyin the project directory. -
Modify the Model and Image Paths:
Indash_main.py, update the following lines to match the model and image outputs generated by DMT-HI:- Line 14: Set the path to the saved model generated by DMT-HI.
- Line 17: Set the path to the saved images generated during the model run.
-
Run the Analyzer:
After making the necessary changes, run the following command to start the analyzer:python dash_main.py -
Access the Analyzer:
Once the script is running, it will return a local URL. Open the URL in your web browser to access the DMT-HI Analyzer.
Through this web-based interface, you can visualize latent embeddings.
Release files for dmt-learn 0.0.81
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| dmt_learn-0.0.81.tar.gz | 66.7 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| dmt_learn-0.0.81-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 138.5 kB
Release files / dmt_learn-0.0.81.tar.gz
| Download URL | dmt_learn-0.0.81.tar.gz |
|---|---|
| Size | 66.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
280a2b5410b7c3f5057b26452b2a8ca614b9d492cd2355a3e806d897f851f290
|
|
BLAKE2b-256 checksum How to use checksums |
ca19d67bbb0ece0c9f2025fe1b3e5fd948c3efc556e68a55261ed2423e8f70d6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.11.7
|
Release files / dmt_learn-0.0.81-py3-none-any.whl
| Download URL | dmt_learn-0.0.81-py3-none-any.whl |
|---|---|
| Size | 71.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
daf9e42ed694128385f36a4becd5c0e97d8a47d726243084dde7b1ffd9ff1ec7
|
|
BLAKE2b-256 checksum How to use checksums |
f89e8cdc83e06d281e34f1dd16dc4c3ae0eb53f69c0d23329cb4265802cf5738
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.11.7
|
