Skip to main content

Contributors Forks Stargazers Issues

GPL v3 PyPI DOI

Nemobi

A tool to standardize French mobility survey datasets (EMC², EGT, EMP, etc.) into a unified format.

📚 Documentation

🇫🇷 Version française

Table of Contents

Introduction

Nemobi (Normalisation des enquêtes mobilités, i.e., standardization of mobility surveys) is an easy-to-use Python command line interface to convert many French mobility surveys (EMC², EGT, EMP, etc.) to a unique standardized and clean format.


Mobility Surveys in France

In France, despite recent efforts by CEREMA to create a standard format for mobility surveys – with the EMC² surveys – various formats co-exist:

  • EMC² (Enquête mobilité certifiée CEREMA): mobility surveys for many French territories (since 2018);
  • EGT H2020 (Enquête Globale Transport, Île-de-France Mobilités): mobility survey for Île-de-France (2018–2020; incomplete due to COVID-19);
  • EMP (Enquête mobilité des personnes, SDES): national mobility survey (2019).
  • EMG (Enquête Mobilité par GPS, Institut Paris Région): mobility survey for Île-de-France (2022-2023) with individuals tracked over several days through GPS.

Also surveys based on previous formats are still in use today:

  • EDVM (Enquêtes Déplacements Villes Moyennes, CEREMA): mobility surveys for medium-size cities (until 2018);
  • EDGT (Enquêtes Déplacements Grands Territoires, CEREMA): mobility surveys for periphery areas (until 2018);
  • EMD (Enquêtes Ménages Déplacements, CEREMA): other mobility surveys from CEREMA (until 2018);
  • EGT 2010 (Enquête Globale Transport, Île-de-France Mobilités): previous version of the Île-de-France mobility survey;
  • ENTD (Enquête nationale transports et déplacements, SDES): former national mobility survey (2008).

Why Nemobi?

The existing formats all have the same drawbacks:

  • Data are sorted in CSV files which are not always straightforward to read (Which separator? Which encoding? What are the variable datatypes?).
  • Variable names and modalities are not always clear (e.g., in the EMC² format, variable "P2" represents the gender of the person, with modality 1 for a man and 2 for a woman).
  • Joining two datasets is hard and not well documented (e.g., in the EMC² format, to join the persons with their household, the variables to use are "METH", "ZFM" and "ECH" for the households and "DMET", "ZFD" and "ECH" for the persons).

Additionally, when working with different territories / periods, it is often necessary to write a similar code multiple times due to the existence of different formats.

Nemobi solves all these issues by being able to convert all survey formats to a well-defined Parquet format.

See this example to understand how Nemobi can simplify your workflow.


Installation

Install the library with

pip install nemobi

Getting Started

Download the EMP 2019 survey (Données individuelles anonymisées (fichiers au format CSV)), then run the following command:

nemobi emp_2019_donnees_individuelles_anonymisees_novembre2024.zip standardized_emp2019

It will standardize the EMP 2019 survey and save the resulting Parquet files in the standardized_emp2019 directory. These Parquet files can then be analyzed using e.g., polars or pandas in Python or arrow in R.

Note: During standardization, Nemobi may issue warnings when certain variable guarantees are not initially satisfied but are automatically fixed. These warnings can usually be safely ignored, unless they pertain to a large number of observations.

A detailed definition of the Parquet format used by Nemobi is available here.

You can also standardize surveys programmatically in Python with the standardize function:

import nemobi
nemobi.standardize(
    "emp_2019_donnees_individuelles_anonymisees_novembre2024.zip",
    "standardized_emp2019",
)

For more, check the User Guide.

Citing Nemobi

If you use Nemobi in a publication or project, please include the following citation:

Javaudin, L. (2025). Nemobi. Zenodo. https://doi.org/10.5281/zenodo.17710203

A CITATION.bib is also available.


Case Study: Bicycle Use

The following graph represents the share of bicycle trips for EMC², EDGT, EDVM, EMD, and EGT surveys. The circle colors represent the average number of bicycles in the surveyed households. The circle sizes represent the expected number of trips in the surveyed area.

The graph has been generated from the code in analyses/bicycle_shares.py.

Graph of bicycle share by survey

The following map represents the share of bicycle trips within INSEE municipalities. Only municipalities with more than 30 surveyed trips are shown.

The map has been generated from the code in analyses/bicycle_shares_by_insee.py.

Map of bicycle share by INSEE municipality


Supported Surveys

Currently, Nemobi supports the following survey types:

See Survey Types for more.

Map of all local surveys tested with Nemobi

Other survey types that are planned to be integrated are: entd. If you know another survey format that could be integrated, feel free to open an issue on GitHub.

Nemobi covers only French mobility survey formats. If other countries have similar survey formats, they might be easily integrated into Nemobi (or a variant of it).


⚠️ Nemobi does not anonymize the data. If you are working with confidential datasets (e.g., EMC² or EGT surveys), you must apply the same confidentiality rules to the standardized data as to the original data. In particular, you must not share the standardized data if your confidentiality agreement prohibits sharing the original data.

Contributing

If you think you found a bug, if you have a suggestion, or if you want to integrate a new format, feel free to open an issue on GitHub or to create a Pull Request.

Metadata

Release files for nemobi 2.0.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for nemobi 2.0.0
File Size Uploaded Provenance Actions
nemobi-2.0.0.tar.gz 151.0 kB Without provenance Details for nemobi-2.0.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for nemobi 2.0.0
File Interpreter ABI Platform Actions
nemobi-2.0.0-py3-none-any.whl Python 3 none any Details for nemobi-2.0.0-py3-none-any.whl

Total release size: 332.6 kB

Release files / nemobi-2.0.0.tar.gz

Download URL nemobi-2.0.0.tar.gz
Size 151.0 kB
Tags Source
SHA-256 checksum
How to use checksums
349fd6c7ceb67e299cff626f322a8bc037850e070db00260e53840cd91dad62c
BLAKE2b-256 checksum
How to use checksums
9771fec3fc871a33246425dc98e4941957ec985c659864a7e1c28e74ac11a109
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via uv/0.13.9 {"installer":{"name":"uv","version":"0.13.9","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"26.04","id":"resolute","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / nemobi-2.0.0-py3-none-any.whl

Download URL nemobi-2.0.0-py3-none-any.whl
Size 181.7 kB
Tags Python 3
SHA-256 checksum
How to use checksums
7b0b15112600e967effbfb85f3460ea7aef1dc78c0f75a7a60261d7ceb4f3e4c
BLAKE2b-256 checksum
How to use checksums
852f3b1781c892fa6ad94817ebde8a00c38bdaf254dde0216c5256ec1292fb44
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via uv/0.13.9 {"installer":{"name":"uv","version":"0.13.9","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"26.04","id":"resolute","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Security for nemobi 2.0.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

2.0.0 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page