Skip to main content

Download and load Houston 2013 Dataset

Project description

Remote Sensing Fusion Datasets

PyPI - Version PyPI - Downloads PyPI - Python Version GitHub Created At GitHub License

Download and load remote sensing datasets easily and swiftly. rs-fusion-datasets (formerly known as fetch_houston2013) is:

  1. A fast houston2013 muufl and trento dataset fetcher that automatically downloads all data
  2. A ready-to-use torch dataloader for houston2013 muufl and trento dataset
  3. A toolbox for visualizing the datasets

screenshot

Supported Datasets

  1. Houston 2013
  2. Trento
  3. Muufl

Quick Start

  1. install this package
pip install fetch_houston2013
# will soon migrate to pip install rs-fusion-datasets
  1. import and get the dataset
from fetch_houston2013 import fetch_houston2013, fetch_muufl, fetch_trento, split_spmatrix
# For Houston 2013
hsi, dsm, train_label, test_label, info = fetch_houston2013()
# For Muufl
casi, lidar, truth, info = fetch_muufl()
train_label, test_label = split_spmatrix(truth, 20)
# For Trento
casi, lidar, truth, info = fetch_trento()
train_label, test_label = split_spmatrix(truth, 20)
  1. Tips: train_label and test_label are sparse matrix, you can either convert them to np.array easily by
train_label=train_label.todense()
test_label =test_label.todense()

or directly use them for getting the value in a very fast way:

    def __getitem__(self, index):
      i = self.truth.row[index]
      j = self.truth.col[index]
      label = self.truth.data[index].item()
      x_hsi = self.hsi[:, i, j]
      x_dsm = self.dsm[:, i, j]
      return x_hsi, x_dsm, label

torch

A standard ready-to-use Torch vison dataset.

from fetch_houston2013 import Houston2013, Trento, Muufl
dataset = Muufl(subset='train', patch_size=11)
x_h, x_l, y, extras = dataset[0]

utils

  1. lbl2rgb: convert the label dataset to rgb image
  2. read_roi: read exported .txt file of ENVI roi to sparse matrix
  3. split_spmatrix: split a sparse to get the train dataset and test dataset

Help

Star History

Star History Chart

Contribution

We welcome all contributions, including issues, pull requests, feature requests and discussions.

Credits

Houston2013 dataset: https://machinelearning.ee.uh.edu/?page_id=459
paperswithcode: https://paperswithcode.com/dataset/houston
Muufl dataset: https://github.com/GatorSense/MUUFLGulfport
Dafault url of Trento dataset is https://github.com/tyust-dayu/Trento/tree/b4afc449ce5d6936ddc04fe267d86f9f35536afd
The 2013_IEEE_GRSS_DF_Contest_Samples_VA.txt in this repo is exported from original 2013_IEEE_GRSS_DF_Contest_Samples_VA.roi.
Note: If this data is used in any publication or presentation the following reference must be cited:
P. Gader, A. Zare, R. Close, J. Aitken, G. Tuell, “MUUFL Gulfport Hyperspectral and LiDAR Airborne Data Set,” University of Florida, Gainesville, FL, Tech. Rep. REP-2013-570, Oct. 2013.
If the scene labels are used in any publication or presentation, the following reference must be cited:
X. Du and A. Zare, “Technical Report: Scene Label Ground Truth Map for MUUFL Gulfport Data Set,” University of Florida, Gainesville, FL, Tech. Rep. 20170417, Apr. 2017. Available: http://ufdc.ufl.edu/IR00009711/00001.
If any of this scoring or detection code is used in any publication or presentation, the following reference must be cited:
T. Glenn, A. Zare, P. Gader, D. Dranishnikov. (2016). Bullwinkle: Scoring Code for Sub-pixel Targets (Version 1.0) [Software]. Available from https://github.com/GatorSense/MUUFLGulfport/.

License

Copyright 2025 songyz2023

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

rs_fusion_datasets-0.8.1.dev1.tar.gz (286.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

rs_fusion_datasets-0.8.1.dev1-py3-none-any.whl (30.1 kB view details)

Uploaded Python 3

File details

Details for the file rs_fusion_datasets-0.8.1.dev1.tar.gz.

File metadata

File hashes

Hashes for rs_fusion_datasets-0.8.1.dev1.tar.gz
Algorithm Hash digest
SHA256 90b97729ec1d10d959ccd54d9328c963f2277e8b5e2ed3b3005f6bc1e50047ad
MD5 1599e995c42d0b78c17da5eff87ea2f6
BLAKE2b-256 cae17e833287c3b78f2ce740776178ca35616a260c54cf23e9b1753d38d41b1c

See more details on using hashes here.

File details

Details for the file rs_fusion_datasets-0.8.1.dev1-py3-none-any.whl.

File metadata

File hashes

Hashes for rs_fusion_datasets-0.8.1.dev1-py3-none-any.whl
Algorithm Hash digest
SHA256 2deb1f9a912dbd716be2d7f95f815443b2df10205194b4d1b4a297af9f872ba0
MD5 a3576c660f2d0a8f28ffbb89a26f3d0a
BLAKE2b-256 d22b32b4f1a068c6987231159a929dd2d30a0c94eed8960cb624aeac95cc1946

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page