Skip to main content

TimeSide is a python framework enabling low and high level audio analysis, imaging, transcoding, streaming and labelling. Its high-level API is designed to enable complex processing on very large datasets of any audio or video assets with a plug-in architecture, a secure scalable backend and an extensible dynamic web frontend.

Use cases

  • Scaled audio computing (filtering, machine learning, etc)

  • Web audio visualization

  • Audio process prototyping

  • Realtime and on-demand transcoding and streaming over the web

  • Automatic segmentation and labelling synchronized with audio events

Goals

  • Do asynchronous and fast audio processing with Python,

  • Decode audio frames from any audio or video media format into numpy arrays,

  • Analyze audio content with some state-of-the-art audio feature extraction libraries like Aubio, Yaafe and VAMP as well as some pure python processors

  • Visualize sounds with various fancy waveforms, spectrograms and other cool graphers,

  • Transcode audio data in various media formats and stream them through web apps,

  • Serialize feature analysis data through various portable formats,

  • Provide audio sources from plateform like YouTube or Deezer

  • Deliver analysis and transcode on provided or uploaded tracks over the web through a REST API

  • Playback and interact on demand through a smart high-level HTML5 extensible player,

  • Index, tag and annotate audio archives with semantic metadata (see Telemeta which embed TimeSide).

  • Deploy and scale your own audio processing engine through any infrastructure

Funding and support

To fund the project and continue our fast development process, we need your explicit support. So if you use TimeSide in production or even in a development or experimental setup, please let us know by:

Thanks for your help!

News

0.9

  • Upgrade all python dependencies

  • Add Vamp, Essentia, Yaafe, librosa, PyTorch, Tensorflow libs and wrappers

  • Add a few analyzing plugins (Essentia Dissonance, Vamp Constant Q, Vamp Tempo, Vamp general wrapper, Yaafe general wrapper)

  • Add processor parameter management

  • Add processor inheritance

  • Improve HTML5 player with clever data streaming

  • Improve REST API and various serialzers

  • Improve unit testing

  • Various bug fixes

0.8

  • Add Docker support for instant installation. This allows to run TimeSide now on any OS platform!

  • Add Jupyter Notebook support for easy prototyping, experimenting and sharing (see the examples in the doc).

  • Add an experimental web server and REST API based on Django REST Framework, Redis and Celery. This now provides a real web audio processing server with high scaling capabilities thanks to Docker (clustering) and Celery (multiprocessing).

  • Start the development of a new player interface thanks to Angular and WavesJS.

  • Huge cleanup of JS files. Please now use bower to get all JS dependencies as listed in settings.

  • Add metadata export to Elan annotation files.

  • Fix and improve some data structures in analyzer result containers.

  • Many various bugfixes.

0.7.1

  • fix django version to 1.6.10 (sync with Telemeta 1.5)

0.7

  • Code refactoring:

    • Create a new module timeside.plugins and move processors therein: timeside.plugins.decoder,analyzer, timeside.plugins.encoder, timeside.plugins.fx

    • WARNING: to properly manage the namespace packages structure, the TimeSide main module is now timeside.core and code should now be initialized with import timeside.core

    • timeside.plugins is now a namespace package enabling external plugins to be automatically plugged into TimeSide (see for example timeside-diadems). This now makes TimeSide a real plugin host, yeah!

    • A dummy timeside plugin will soon be provided for easy development start.

  • Move all analyzers developped by the partners of the Diadems project to a new repository: timeside-diadems

  • Many fixes for a better processing by Travis-CI

  • Add a dox file to test the docker building continously on various distributions

For older news, please visit: https://github.com/Parisson/TimeSide/blob/master/NEWS.rst

Documentation

Install

Thanks to Docker, Timeside is now fully available as a docker composition ready to work. The docker based composition bundles some powerfull applications and modern frameworks out-of-the-box like: Python, Conda, Numpy, Jupyter, Gstreamer, Django, Celery, Haystack, ElasticSearch, MySQL, Redis, uWSGI, Nginx and many more.

First, install Docker and docker-compose

Then clone TimeSide:

git clone --recursive https://github.com/Parisson/TimeSide.git
cd TimeSide
docker-compose pull

That’s it! Now please go to the documentation to see how to use it.

Sponsors and Partners

  • Parisson

  • CNRS: National Center of Science Research (France)

  • Huma-Num: big data equipment for digital humanities (CNRS, France)

  • CREM: French National Center of Ethomusicology Research (France)

  • Université Pierre et Marie Curie (UPMC Paris, France)

  • ANR: Agence Nationale de la Recherche (France)

  • MNHN : Museum National d’Histoire Naturelle (Paris, France)

  • C4DM : Center for Digital Music, Queen Mary University (London, United Kingdom)

  • NYU Steinhardt : Music and Performing Arts Professions, New York University (New York, USA)

  • IRCAM : IRCAM (Paris, France)

Copyrights

  • Copyright (c) 2019, 2020 IRCAM

  • Copyright (c) 2006, 2020 Guillaume Pellerin

  • Copyright (c) 2010, 2020 Paul Brossier

  • Copyright (c) 2019, 2020 Antoine Grandry

  • Copyright (c) 2006, 2019 Parisson SARL

  • Copyright (c) 2013, 2017 Thomas Fillon

  • Copyright (c) 2016, 2017 Eric Debeir

  • Copyright (c) 2013, 2014 Maxime Lecoz

  • Copyright (c) 2013, 2014 David Doukhan

  • Copyright (c) 2006, 2010 Olivier Guilyardi

License

TimeSide is free software: you can redistribute it and/or modify it under the terms of the GNU Affero General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.

TimeSide is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU Affero General Public License for more details.

Read the LICENSE.txt file for more details.

Metadata

Release files for TimeSide 0.9.6

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for TimeSide 0.9.6
File Size Uploaded Provenance
TimeSide-0.9.6.tar.gz 25.2 MB Without provenance Details

Release files / TimeSide-0.9.6.tar.gz

Download URL TimeSide-0.9.6.tar.gz
Size 25.2 MB
Tags Source
SHA-256 checksum
How to use checksums
442c52ac0b6eb0d929a1d4cce94f8213e62da3957635f0ff5270121f4524edc0
BLAKE2b-256 checksum
How to use checksums
1fa884028a44989ab26f681cd7463072b25c3e3ef71e77066bcabccf23053144
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.1.1 pkginfo/1.5.0.1 requests/2.21.0 setuptools/47.1.1 requests-toolbelt/0.9.1 tqdm/4.41.0 CPython/3.7.3

Security for TimeSide 0.9.6

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page