Skip to main content

Lipid Traffic Analysis

Project description

Lipid Traffic Analysis

MIT License PyPI Version Python Versions CI/CD codecov Documentation Status Project Status: Active Codestyle: Black Imports: isort

aka LTA, aka LipidTA

A python commandline interface for analysing lipidomics data.

The source code lives on github.

The documentation lives at ReadTheDocs.

The project can be installed from PyPI.

Abstract

Lipid Traffic Analysis (LTA) is a tool for using lipidomics data to test hypotheses about how metabolism is controlled. Lipidomics data from several, metabolically connected tissues from control and experimental groups can be used to plot the spatial or temporal distribution of lipids. These distributions identify where changes in lipid metabolism occur and in which lipid pathways, indicating the locus and biochemical alterations that occur in a given group. LTA was conceived in two parts. One is an Abundance Analysis, in which the error-normalised fold change (ENFC) for the control and given group group is calculated. Because the ratio of the control and experimental values is scaled by the error, the ENFCs are easy to plot and compare between compartments. The second part is a Switch Analysis. This computes the presence of variables across the network. Current development is focused on developing the technique for complex networks and on the rate of lipid transport.

On Version Numbers

Prior to version 3,
the Python implementation version **does not** correlate to the academic versions.
From version 3,
the Python and academic versions are the same.

LTA was developed initially in R, producing LTA v1.0. This was used for the LTA in the first study to use the analysis, based on the hypothesis that differing carbohydrate intakes by fathers influenced their children's and grandchildren's lipid metabolism. See Furse et al 2021. The code was developed further in R to improve convenience for the user, and features such as the 0s threshold (the number of samples in which there is a non-zero value for abundance for it to count as present) was added for LTA v2.3. This version has been used in three subsequent studies. Please see here, here, and here. A desire to add more features and move to a more stable platform led us to move to Python for LTA v3.0.

The Python implementation of LTA has strictly used automated semantic versioning over the course of its development. Thus, prior to version 3, the version numbers of the Python inplementation and past R implementations have no correlation. By convenient coincidence, the semantic versioning release of LipidTA v3 brings the python versioning and the academic versioning in-line.

Using LTA from the command line

Installation

Any installation of this tool requires Python. How to install Python correctly is beyond this scope, but there are some excellent resources available here and here. If you are planning to have multiple versions of python installed, you might want to consider pyenv.

We only support Python {math}`>=` 3.7.1

Installing from PyPI

This is the most straightforward way to set up the tool. When installing from PyPI, we strongly reccomend using a virtual environment. There are many ways to do this! If you already have a preferred method - I use pipx for command line tools - feel free to use that. Otherwise, use the builtin Python module venv. The exact instructions are OS-specific and detailed at the above link. Instructions for installing the most recent version of LTA on MacOS are given below:

# Make a directory for the project
mkdir lta && cd lta
# Create the virtual environment
python3 -m venv .venv
# Activate the environment
source .venv/bin/activate
# Install lta
pip install -U LipidTA
Our pip package is `LipidTA`.
Unfortunately,
`lta` was "too similar to existing package names",
so PyPi wouldn't let us use it.

If you want to install a specific version, then change the last line in the previous code block to:

pip install LipidTA==1.0.0

replacing the version number with the version number you want. A list of all released versions can be found at our tags.

Installing from Source

Most users **will not need** these instructions.

If you need to customise the code in some manner, you'll need to install from source. To do that, either clone the repository from github, or download one of our releases. For full instructions, please see our guide on contributing.

(data)=

The Data

The input should be a csv containing the lipidomics results. Though we strive to be as flexible as possible, we must make some assumptions about the data to be able to use it. Firstly, the first 3 columns must be the multiindex for the lipids, and include the lipid name, category, and m/z, respectively. Secondly, the values must be numeric.

The analysis depends on a number of key metadata variables, namely:

  • Mode: the lipidomics mode
  • Sample ID: a unique sample identifier
  • Group: the experimental condition
  • Compartment: the comartment of origin for the sample

These rows should be in the first {math}n rows of your data file, where n is specified with the option --n-rows-metadata. You can name these metadata rows whatever you want in the data file, and tell lta where to find them with the appropriate flags. We've done our best to choose sane defaults (please see the section on default values), and you can see the section on customising your run for more details. However, if these data are not present, the tool will not run, as the analysis only makes sense in the context of these variables.

Should we make any changes to data format expectations,
it will be well documented and will only occur in a major/breaking releas.

Running the analysis

Once you've installed the tool and activated your virtual environment, running the analysis can be as simple as:

lta data.csv results

The first argument is path to the combined input file. If the file doesn't exist, is a directory, or doesn't contain any data files, the command will error with an apropriate message. The secont argument identifies a folder in which the results will be saved. It will be created if it doesn't exist.

To help get you up and running,
a minimum dataset and configuration file are provided [here][examples].

(defaults)=

The Defaults

To keep it as simple as above, you will need to use the defaults, outlined in the below table:

Parameter Description Default
threshold The fraction of samples in which a lipid is 0 before it is dropped 0.3
boot-reps The number of bootstrap repetitions used to calculate probability 1000
n-rows-metadata The number of rows of metadata at the beginning of the data file 11
group The metadata row containing experimental conditions Group
control The "control" condition, used as reference for fold change control
comartment The metadata row containing the compartment of origin for each sample Compartment
mode The metadata row containing the lipidomics mode Mode
sample-id The metadata ro containing unique sample identifiers SampleID

Don't worry if it looks intimidating! You can check out the section on customising your run for further details, and help can always be found at our documentation or from the command line with:

lta -h

(customising)=

Customising

While it can be that simple, you'll likely have to customise some options for your run. In that case, it will likely look a bit more like:

lta --n-rows-metadata 11 \
--group Group \
--control lean \
--compartment Compartment \
--sample-id mouse

Alternatively, you might prefer to use a configuration file to keep things simple. In that case, see the section on configuration for more information.

There are a few options that can be customised for any given run. The statistics are calculated using a bootstrapping approach, which (by definition) involves repeated replicates. To control the number of replicates, pass the -b/--boot-reps flag with a number. Generally, more reps improves the accuracy of the estimates, though I find little improvement beyond 20,000 reps. 1000 (the default number) seems to provide a good balance between speed and accuracy.

A critical step of the analysis is binarizing the lipid expression. A lipid is classed as 0 in a compartment/condition if the lipid is not detected in more than a particular fraction of samples. The default values is 0.2 (one-fifth of the samples). If you want to change it, pass the -t/--threshold flag with a decimal between 0 and 1. This value can have a significant impact on the analysis, so explore how it impacts your data!

Many calculations are dependent on knowing where certain metadata is stored. Namely, the experimental conditions (specified with --group) the compartment of origin (specified with --compartment), the sample ID (specified with --sample-id), and the lipidomics mode (specified with --mode). If these are not passed, then they default to "Group", "Compartment", "SampleID", and "Mode" respectively. To find these rows, we also need to know the number of lines in your column metadata. This is specified with --n-rows-metadata. Please the section on expected data file structure for more information.

The error-normalised fold change (ENFC) calculation must know the labels for experimental and control group. Without this knowledge, the concept of fold change is meaningless. To specify, pass --control control. Every condition specified in Group will then be divided by control to calculate the ENFC for all conditions.

lta data results --control lean

(configuration)=

Configuration files

If you find yourself regularly passing arguments via the CLI, you might want to try a configuration file! This is a simple text file that stores options in a simple format:

option=value

By default, LTA looks for lta_conf.txt in your current directory. However, you can name this file whatever you want, and let LTA know where to find it, by passing the config flag like so:

lta -c path/to/your/config.txt data results

If you specify an option in the configuration file, that will override LTA's defaults, and specifying an option at the command line will override the configuration file! The config file doesn't need do exist, however, and is just a bit of sugar.

The Output

Re-running the analysis overwrites existing results,
so be sure to either back up your data,
or pass a different output folder!

The output folder will contain 2 files and 2 directories. For each type of lipid, you should see the following:

  1. switch_individual_lipid.csv - a table of lipids and their A/B/U/N classification.
  2. switch_lipid_classes.csv - a table counting the frequency of each lipid class within the A/B/U/N classification.
  3. jaccard - the Jaccard similarity and p-value for each lipid class.
  4. enfc - a folder containing the ENFC results.

Within the ENFC folder, you should see 2 files per group:

  1. GROUP_by_CONTROL_individual_lipids.csv - the ENFC results for each lipid.
  2. GROUP_by_CONTROL_lipid_classes.csv - the mean and St.Dev. of ENFC, grouped by lipid class.

Withing the Jaccard folder, you should see 1 file per group:

  1. GROUP_by_CONTROL_jaccard_similarity.csv - the Jaccard similarity and p-value for each lipid class

A few notes! Fold change will always be {math}group / control. The Jaccard similarities are calculated between conditions specified in --group across both compartments and lipid classes. The p-values for these similarities are calculated using the method outlined by N. Chung, et. al.. For ENFC, fold change is only meaningful if both values are non-0. Where this is not true, NaN has been substituted, leaving an empty cell in the output.

Contributing

Open-source software is only open-source becaues of the excellent community, so we welcome any and all contributions! If you think you have found a bug, please log a report in our issues. If you think you can fix a bug, or have an idea for a new feature, please see our guide on contributing for more information on how to get started! While here, we request that you follow our code of conduct to help maintain a welcoming, respectful environment.

Future Developments

  • Improve Github actions to use caching for poetry and Nox
  • Allow for multiple ENFC calculations in 1 run
  • Provide example configuration and data
  • Increase test coverage
  • Automate plotting

Citations

If you use LTA in your work, please cite the following manuscripts:

  1. Furse, S., et al. Lipid Traffic Analysis reveals the impact of high paternal carbohydrate intake on offsprings’ lipid metabolism. Commun Biol 4, 163 (2021). https://doi.org/10.1038/s42003-021-01686-1
  2. Furse, S.[^eq], Fernandez-Twinn, D.S.[^eq], et al. Lipid metabolism is dysregulated before, during and after pregnancy in a mouse model of gestational diabetes. Int. J. Mol. Sci. 22, 7452 (2021). https://doi.org/10.3390/ijms22147452
  3. Furse, S., et al. Paternal nutritional programming of lipid metabolism is propagated by sperm and seminal plasma. Metabolomics 2022, https://doi.org/10.17863/CAM.79565
  4. Furse, S., et al. A mouse model of gestational diabetes shows dysregulated lipid metabolism post-weaning, after return to euglycaemia. Nutrition & Diabetes 2022, In Press

[^eq]: These authors contributed equally to this work.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

LipidTA-3.0.1.tar.gz (27.2 kB view details)

Uploaded Source

Built Distribution

LipidTA-3.0.1-py3-none-any.whl (22.5 kB view details)

Uploaded Python 3

File details

Details for the file LipidTA-3.0.1.tar.gz.

File metadata

  • Download URL: LipidTA-3.0.1.tar.gz
  • Upload date:
  • Size: 27.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.62.3 importlib-metadata/4.11.1 keyring/21.8.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10

File hashes

Hashes for LipidTA-3.0.1.tar.gz
Algorithm Hash digest
SHA256 269b1bbe36a208a0f2839bca4e99b8fa21a91aa76e4addd59bc006e7e03bc7c6
MD5 e10eaf5272ae6f6634223594e3f06cb4
BLAKE2b-256 3fec3a475fdd7038f500b6e6f85f5df1a01906052bf3afc259eb0df7a2d93732

See more details on using hashes here.

File details

Details for the file LipidTA-3.0.1-py3-none-any.whl.

File metadata

  • Download URL: LipidTA-3.0.1-py3-none-any.whl
  • Upload date:
  • Size: 22.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.62.3 importlib-metadata/4.11.1 keyring/21.8.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10

File hashes

Hashes for LipidTA-3.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 3136e208e46ef00246da73019d8affc98d40f6e4ef1600c1f70123bd65985518
MD5 de364a248c9dce0302ce70288c910cbc
BLAKE2b-256 fa5ecc6703b7fe80978c8e4e83849853921427aa81170a34a48d744ed087844f

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page