Lipid Traffic Analysis
Project description
Lipid Traffic Analysis
aka LTA, aka LipidTA
A python commandline interface for analysing lipidomics data.
The source code lives on github.
The documentation lives at ReadTheDocs.
The project can be installed from PyPI.
Abstract
Lipid Traffic Analysis (LTA) is a tool for using lipidomics data to test hypotheses about how metabolism is controlled. Lipidomics data from several, metabolically connected tissues from control and experimental groups can be used to plot the spatial or temporal distribution of lipids. These distributions identify where changes in lipid metabolism occur and in which lipid pathways, indicating the locus and biochemical alterations that occur in a given group. LTA was conceived in two parts. One is an Abundance Analysis, in which the error-normalised fold change (ENFC) for the control and given group group is calculated. Because the ratio of the control and experimental values is scaled by the error, the ENFCs are easy to plot and compare between compartments. The second part is a Switch Analysis. This computes the presence of variables across the network. Current development is focused on developing the technique for complex networks and on the rate of lipid transport.
On Version Numbers
Prior to version 3,
the Python implementation version **does not** correlate to the academic versions.
From version 3,
the Python and academic versions are the same.
LTA was developed initially in R, producing LTA v1.0. This was used for the LTA in the first study to use the analysis, based on the hypothesis that differing carbohydrate intakes by fathers influenced their children's and grandchildren's lipid metabolism. See Furse et al 2021. The code was developed further in R to improve convenience for the user, and features such as the 0s threshold (the number of samples in which there is a non-zero value for abundance for it to count as present) was added for LTA v2.3. This version has been used in three subsequent studies. Please see here, here, and here. A desire to add more features and move to a more stable platform led us to move to Python for LTA v3.0.
The Python implementation of LTA has strictly used automated semantic versioning over the course of its development. Thus, prior to version 3, the version numbers of the Python inplementation and past R implementations have no correlation. By convenient coincidence, the semantic versioning release of LipidTA v3 brings the python versioning and the academic versioning in-line.
Using LTA from the command line
Installation
Any installation of this tool requires Python. How to install Python correctly is beyond this scope, but there are some excellent resources available here and here. If you are planning to have multiple versions of python installed, you might want to consider pyenv.
We only support Python {math}`>=` 3.7.1
Installing from PyPI
This is the most straightforward way to set up the tool. When installing from PyPI, we strongly reccomend using a virtual environment. There are many ways to do this! If you already have a preferred method - I use pipx for command line tools - feel free to use that. Otherwise, use the builtin Python module venv. The exact instructions are OS-specific and detailed at the above link. Instructions for installing the most recent version of LTA on MacOS are given below:
# Make a directory for the project
mkdir lta && cd lta
# Create the virtual environment
python3 -m venv .venv
# Activate the environment
source .venv/bin/activate
# Install lta
pip install -U LipidTA
Our pip package is `LipidTA`.
Unfortunately,
`lta` was "too similar to existing package names",
so PyPi wouldn't let us use it.
If you want to install a specific version, then change the last line in the previous code block to:
pip install LipidTA==1.0.0
replacing the version number with the version number you want. A list of all released versions can be found at our tags.
Installing from Source
Most users **will not need** these instructions.
If you need to customise the code in some manner, you'll need to install from source. To do that, either clone the repository from github, or download one of our releases. For full instructions, please see our guide on contributing.
(data)=
The Data
The input should be a csv containing the lipidomics results. Though we strive to be as flexible as possible, we must make some assumptions about the data to be able to use it. Firstly, the first 3 columns must be the multiindex for the lipids, and include the lipid name, category, and m/z, respectively. Secondly, the values must be numeric.
The analysis depends on a number of key metadata variables, namely:
- Mode: the lipidomics mode
- Sample ID: a unique sample identifier
- Group: the experimental condition
- Compartment: the comartment of origin for the sample
These rows should be in the first {math}n
rows of your data file,
where n is specified with the option --n-rows-metadata
.
You can name these metadata rows whatever you want in the data file,
and tell lta
where to find them with the appropriate flags.
We've done our best to choose sane defaults
(please see the section on default values),
and you can see the section on customising your run
for more details.
However,
if these data are not present,
the tool will not run,
as the analysis only makes sense in the context of these variables.
Should we make any changes to data format expectations,
it will be well documented and will only occur in a major/breaking releas.
Running the analysis
Once you've installed the tool and activated your virtual environment, running the analysis can be as simple as:
lta data.csv results
The first argument is path to the combined input file. If the file doesn't exist, is a directory, or doesn't contain any data files, the command will error with an apropriate message. The secont argument identifies a folder in which the results will be saved. It will be created if it doesn't exist.
To help get you up and running,
a minimum dataset and configuration file are provided [here][examples].
(defaults)=
The Defaults
To keep it as simple as above, you will need to use the defaults, outlined in the below table:
Parameter | Description | Default |
---|---|---|
threshold | The fraction of samples in which a lipid is 0 before it is dropped | 0.3 |
boot-reps | The number of bootstrap repetitions used to calculate probability | 1000 |
n-rows-metadata | The number of rows of metadata at the beginning of the data file | 11 |
group | The metadata row containing experimental conditions | Group |
control | The "control" condition, used as reference for fold change | control |
comartment | The metadata row containing the compartment of origin for each sample | Compartment |
mode | The metadata row containing the lipidomics mode | Mode |
sample-id | The metadata ro containing unique sample identifiers | SampleID |
Don't worry if it looks intimidating! You can check out the section on customising your run for further details, and help can always be found at our documentation or from the command line with:
lta -h
(customising)=
Customising
While it can be that simple, you'll likely have to customise some options for your run. In that case, it will likely look a bit more like:
lta --n-rows-metadata 11 \
--group Group \
--control lean \
--compartment Compartment \
--sample-id mouse
Alternatively, you might prefer to use a configuration file to keep things simple. In that case, see the section on configuration for more information.
There are a few options that can be customised for any given run.
The statistics are calculated using a bootstrapping approach,
which (by definition) involves repeated replicates.
To control the number of replicates,
pass the -b/--boot-reps
flag with a number.
Generally, more reps improves the accuracy of the estimates,
though I find little improvement beyond 20,000 reps.
1000 (the default number) seems to provide a good balance between speed and accuracy.
A critical step of the analysis is binarizing the lipid expression.
A lipid is classed as 0 in a compartment/condition if
the lipid is not detected in more than a particular fraction of samples.
The default values is 0.2 (one-fifth of the samples).
If you want to change it,
pass the -t/--threshold
flag with a decimal between 0 and 1.
This value can have a significant impact on the analysis,
so explore how it impacts your data!
Many calculations are dependent on knowing where certain metadata is stored.
Namely, the experimental conditions (specified with --group
)
the compartment of origin (specified with --compartment
),
the sample ID (specified with --sample-id
),
and the lipidomics mode (specified with --mode
).
If these are not passed,
then they default to "Group", "Compartment", "SampleID", and "Mode" respectively.
To find these rows,
we also need to know the number of lines in your column metadata.
This is specified with --n-rows-metadata
.
Please the section on expected data file structure for more information.
The error-normalised fold change (ENFC) calculation must know the labels for
experimental and control group.
Without this knowledge,
the concept of fold change is meaningless.
To specify, pass --control control
.
Every condition specified in Group
will then be divided by control
to calculate the ENFC for all conditions.
lta data results --control lean
(configuration)=
Configuration files
If you find yourself regularly passing arguments via the CLI, you might want to try a configuration file! This is a simple text file that stores options in a simple format:
option=value
By default,
LTA looks for lta_conf.txt
in your current directory.
However,
you can name this file whatever you want,
and let LTA know where to find it,
by passing the config flag like so:
lta -c path/to/your/config.txt data results
If you specify an option in the configuration file, that will override LTA's defaults, and specifying an option at the command line will override the configuration file! The config file doesn't need do exist, however, and is just a bit of sugar.
The Output
Re-running the analysis overwrites existing results,
so be sure to either back up your data,
or pass a different output folder!
The output folder will contain 2 files and 2 directories. For each type of lipid, you should see the following:
switch_individual_lipid.csv
- a table of lipids and their A/B/U/N classification.switch_lipid_classes.csv
- a table counting the frequency of each lipid class within the A/B/U/N classification.jaccard
- the Jaccard similarity and p-value for each lipid class.enfc
- a folder containing the ENFC results.
Within the ENFC folder, you should see 2 files per group:
GROUP_by_CONTROL_individual_lipids.csv
- the ENFC results for each lipid.GROUP_by_CONTROL_lipid_classes.csv
- the mean and St.Dev. of ENFC, grouped by lipid class.
Withing the Jaccard folder, you should see 1 file per group:
GROUP_by_CONTROL_jaccard_similarity.csv
- the Jaccard similarity and p-value for each lipid class
A few notes!
Fold change will always be {math}group / control
.
The Jaccard similarities are calculated between conditions specified in --group
across both compartments and lipid classes.
The p-values for these similarities are calculated using the method outlined by
N. Chung, et. al..
For ENFC,
fold change is only meaningful if both values are non-0.
Where this is not true,
NaN has been substituted,
leaving an empty cell in the output.
Contributing
Open-source software is only open-source becaues of the excellent community, so we welcome any and all contributions! If you think you have found a bug, please log a report in our issues. If you think you can fix a bug, or have an idea for a new feature, please see our guide on contributing for more information on how to get started! While here, we request that you follow our code of conduct to help maintain a welcoming, respectful environment.
Future Developments
- Improve Github actions to use caching for poetry and Nox
- Allow for multiple ENFC calculations in 1 run
- Provide example configuration and data
- Increase test coverage
- Automate plotting
Citations
If you use LTA in your work, please cite the following manuscripts:
- Furse, S., et al. Lipid Traffic Analysis reveals the impact of high paternal carbohydrate intake on offsprings’ lipid metabolism. Commun Biol 4, 163 (2021). https://doi.org/10.1038/s42003-021-01686-1
- Furse, S.[^eq], Fernandez-Twinn, D.S.[^eq], et al. Lipid metabolism is dysregulated before, during and after pregnancy in a mouse model of gestational diabetes. Int. J. Mol. Sci. 22, 7452 (2021). https://doi.org/10.3390/ijms22147452
- Furse, S., et al. Paternal nutritional programming of lipid metabolism is propagated by sperm and seminal plasma. Metabolomics 2022, https://doi.org/10.17863/CAM.79565
- Furse, S., et al. A mouse model of gestational diabetes shows dysregulated lipid metabolism post-weaning, after return to euglycaemia. Nutrition & Diabetes 2022, In Press
[^eq]: These authors contributed equally to this work.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file LipidTA-3.0.1.tar.gz
.
File metadata
- Download URL: LipidTA-3.0.1.tar.gz
- Upload date:
- Size: 27.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.62.3 importlib-metadata/4.11.1 keyring/21.8.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 269b1bbe36a208a0f2839bca4e99b8fa21a91aa76e4addd59bc006e7e03bc7c6 |
|
MD5 | e10eaf5272ae6f6634223594e3f06cb4 |
|
BLAKE2b-256 | 3fec3a475fdd7038f500b6e6f85f5df1a01906052bf3afc259eb0df7a2d93732 |
File details
Details for the file LipidTA-3.0.1-py3-none-any.whl
.
File metadata
- Download URL: LipidTA-3.0.1-py3-none-any.whl
- Upload date:
- Size: 22.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.62.3 importlib-metadata/4.11.1 keyring/21.8.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3136e208e46ef00246da73019d8affc98d40f6e4ef1600c1f70123bd65985518 |
|
MD5 | de364a248c9dce0302ce70288c910cbc |
|
BLAKE2b-256 | fa5ecc6703b7fe80978c8e4e83849853921427aa81170a34a48d744ed087844f |