SWIFTsim (swift.dur.ac.uk) i/o routines for python.
Project description
SWIFTsimIO
The SWIFT astrophysical simulation code (http://swift.dur.ac.uk) is used widely. There
exists many ways of reading the data from SWIFT, which outputs HDF5 files. These range
from reading directly using h5py
to using a complex system such as yt
; however these
either are unsatisfactory (e.g. a lack of unit information in reading HDF5), or too
complex for most use-cases. This (thin) wrapper provides an object-oriented API to read
(dynamically) data from SWIFT.
Requirements
This requires python3.6.0
or higher. No effort will be made to support python versions
below this. Please update your systems.
Python packages
h5py
unyt
Usage
Example usage is shown below, which plots a density-temperature phase diagram, with density and temperature given in CGS units:
import swiftsimio as sw
# This loads all metadata but explicitly does _not_ read any particle data yet
data = sw.load("/path/to/swift/output")
import matplotlib.pyplot as plt
data.gas.density.convert_to_cgs()
data.gas.temperature.convert_to_cgs()
plt.loglog()
plt.scatter(
data.gas.density,
data.gas.temperature,
s=1
)
plt.xlabel(fr"Gas density $\left[{data.gas.density.units.latex_repr}\right]$")
plt.ylabel(fr"Gas temperature $\left[{data.gas.temperature.units.latex_repr}\right]$")
plt.tight_layout()
plt.savefig("test_plot.png", dpi=300)
In the above it's important to note the following:
- All metadata is read in when the
load
function is called. - Only the density and temperature (corresponding to the
PartType0/Density
andPartType0/Temperature
) datasets are read in. - That data is only read in once the
convert_to_cgs
method is called. convert_to_cgs
converts data in-place; i.e. it returnsNone
.- The data is cached and not re-read in when
plt.scatter
is called.
Writing datasets
Writing datasets that are valid for consumption for cosmological codes can be
difficult, especially when considering how to best use units. SWIFT uses a different
set of internal units (specified in your parameter file) that does not necessarily need
to be the same set of units that initial conditions are specified in. Nevertheless,
it is important to ensure that units in the initial conditions are all consistent
with each other. To facilitate this, we use unyt
arrays. The below example generates
randomly placed gas particles with uniform densities.
from swiftsimio import Writer
from swiftsimio.units import cosmo_units
import unyt
import numpy as np
# Box is 100 Mpc
boxsize = 100 * unyt.Mpc
# Generate object. cosmo_units corresponds to default Gadget-oid units
# of 10^10 Msun, Mpc, and km/s
x = Writer(cosmo_units, boxsize)
# 32^3 particles.
n_p = 32**3
# Randomly spaced coordinates from 0, 100 Mpc in each direction
x.gas.coordinates = np.random.rand(n_p, 3) * (100 * unyt.Mpc)
# Random velocities from 0 to 1 km/s
x.gas.velocities = np.random.rand(n_p, 3) * (unyt.km / unyt.s)
# Generate uniform masses as 10^6 solar masses for each particle
x.gas.masses = np.ones(n_p, dtype=float) * (1e6 * unyt.msun)
# Generate internal energy corresponding to 10^4 K
x.gas.internal_energy = np.ones(n_p, dtype=float) * (1e4 * unyt.kb * unyt.K) / (1e6 * unyt.msun)
# Generate initial guess for smoothing lengths based on MIPS
x.gas.generate_smoothing_lengths(boxsize=boxsize, dimension=3)
# If IDs are not present, this automatically generates
x.write("test.hdf5")
Then, running h5glance
on the resulting test.hdf5
produces:
test.hdf5
├Header
│ └5 attributes:
│ ├BoxSize: 100.0
│ ├Dimension: array [int64: 1]
│ ├Flag_Entropy_ICs: 0
│ ├NumPart_Total: array [int64: 6]
│ └NumPart_Total_HighWord: array [int64: 6]
├PartType0
│ ├Coordinates [float64: 32768 × 3]
│ ├InternalEnergy [float64: 32768]
│ ├Masses [float64: 32768]
│ ├ParticleIDs [float64: 32768]
│ ├SmoothingLength [float64: 32768]
│ └Velocities [float64: 32768 × 3]
└Units
└5 attributes:
├Unit current in cgs (U_I): array [float64: 1]
├Unit length in cgs (U_L): array [float64: 1]
├Unit mass in cgs (U_M): array [float64: 1]
├Unit temperature in cgs (U_T): array [float64: 1]
└Unit time in cgs (U_t): array [float64: 1]
Note you do need to be careful that your choice of unit system does not allow values over 2^31, i.e. you need to ensure that your provided values (with units) when written to the file are safe to be interpreted as (single-precision) floats. The only exception to this is coordinates which are stored in double precision.
Ahead-of-time Masking
SWIFT snapshots contain cell metadata that allow us to spatially mask the
data ahead of time. swiftsimio
provides a number of objects that help with
this. See the example below.
import swiftsimio as sw
# This creates and sets up the masking object.
mask = sw.mask("/path/to/swift/snapshot")
# This ahead-of-time creates a spatial mask based on the cell metadata.
mask.constrain_spatial([[0.2 * mask.metadata.boxsize[0], 0.7 * mask.metadata.boxsize[0]], None, None])
# Now, just for fun, we also constrain the density between 0.4 g/cm^3 and 0.8. This reads in
# the relevant data in the region, and tests it element-by-element.
density_units = mask.units.mass / mask.units.length**3
mask.constrain_mask("gas", "density", 0.4 * density_units, 0.8 * density_units)
# Now we can grab the actual data object. This includes the mask as a parameter.
data = sw.load("/Users/josh/Documents/swiftsim-add-anarchy/examples/SodShock_3D/sodShock_0001.hdf5", mask=mask)
When the attributes of this data object are accessed, transparently only the ones that belong to the masked region (in both density and spatial) are read. I.e. if I ask for the temperature of particles, it will recieve an array containing temperatures of particles that lie in the region [0.2, 0.7] and have a density between 0.4 and 0.8 g/cm^3.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file swiftsimio-0.3.5.tar.gz
.
File metadata
- Download URL: swiftsimio-0.3.5.tar.gz
- Upload date:
- Size: 22.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.2
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9ca908bfbf4845b3a71d21c914910af9f5c972c1c6ac16e93441ee11b3e54c6f |
|
MD5 | 6eb09e408394604f06f35bf48646d1de |
|
BLAKE2b-256 | 14091f1dcc238ae21f58f0b14e25a7f1ab1bb39276b7c9242fd03e2a492672b5 |
File details
Details for the file swiftsimio-0.3.5-py3-none-any.whl
.
File metadata
- Download URL: swiftsimio-0.3.5-py3-none-any.whl
- Upload date:
- Size: 29.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.2
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3eef8ab91538186b2939119522d88da5a65d6d248d76828793ece88cd168c5af |
|
MD5 | 8044ae7e0b7e2762a243114a173f37f6 |
|
BLAKE2b-256 | 18795087ad35ba0193509fb03c7c87dcd2fe0768fd6cf3e32d51c55b70565ce5 |