Skip to main content

Archive user data from Mapillary

Project description

🗺️ Mapillary Downloader

Download your Mapillary data before it's gone.

Installation

Installation is optional, you can prefix the command with uvx or pipx to download and run it. Or if you're oldskool you can do:

pip install mapillary-downloader

Usage

First, get your Mapillary API access token from the developer dashboard

# Set token via environment variable (recommended)
export MAPILLARY_TOKEN=YOUR_TOKEN
mapillary-downloader USERNAME1 USERNAME2 USERNAME3

# Or pass token directly, and have it in your shell history 💩👀
mapillary-downloader --token YOUR_TOKEN USERNAME1 USERNAME2

# Download to specific directory
mapillary-downloader --output ./downloads USERNAME1
option because default
usernames One or more Mapillary usernames (required)
--token Mapillary API token (or env var) $MAPILLARY_TOKEN
--output Output directory ./mapillary_data
--quality 256, 1024, 2048 or original original
--bbox west,south,east,north None
--no-webp Don't convert to WebP False
--max-workers Maximum number of parallel download workers CPU count
--no-tar Don't tar bucket directories False
--no-check-ia Don't check if exists on Internet Archive False

The downloader will:

  • 🏛️ Check Internet Archive to avoid duplicate downloads
  • 📷 Download multiple users' images organized by sequence
  • 📜 Inject EXIF metadata (GPS coordinates, camera info, timestamps, compass direction)
  • 🗜️ Convert to WebP (by default) to save ~70% disk space
  • 🛟 Save progress so you can safely resume if interrupted
  • 📦 Tar sequence directories (by default) for faster uploads to Internet Archive

WebP Conversion

You'll need the cwebp binary installed:

# Debian/Ubuntu
sudo apt install webp

# macOS
brew install webp

To disable WebP conversion and keep original JPEGs, use --no-webp:

mapillary-downloader --no-webp USERNAME

Tarballs

Images are organized by capture date (YYYY-MM-DD) for incremental archiving:

mapillary-username-quality/
  2024-01-15/
    abc123/
      image1.webp
      image2.webp
    bcd456/
      image3.webp
  2024-01-16/
    def789/
      image4.webp

By default, these date directories are automatically tarred after download (resulting in 2024-01-15.tar, 2024-01-16.tar, etc.). This date-based organization enables:

  • Incremental uploads - Upload each day's tar as soon as it's ready
  • Manageable file counts - ~365 days/year × 10 years = 3,650 tars max
  • Chronological organization - Natural sorting and progress tracking

To keep individual files instead of creating tars, use the --no-tar flag.

Internet Archive upload

I've written a bash tool to rip media then tag, queue, and upload to The Internet Archive. The metadata is in the same format. If you symlink your ./mapillary_data dir to rip's 4.ship dir, they'll be queued for upload.

See inlay for details:

📊 Stats

To see overall project progress, or an estimate, use --stats

mapillary-downloader --stats

🚧 Development

make dev      # Setup dev environment
make test     # Run tests
make dist     # Build the distribution
make help     # See other make options

🔗 Links

License

WTFPL with one additional clause

  1. Don't blame me

Do wtf you want, but don't blame me if it makes jokes about the size of your disk drive.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mapillary_downloader-0.7.8.tar.gz (27.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mapillary_downloader-0.7.8-py3-none-any.whl (32.9 kB view details)

Uploaded Python 3

File details

Details for the file mapillary_downloader-0.7.8.tar.gz.

File metadata

  • Download URL: mapillary_downloader-0.7.8.tar.gz
  • Upload date:
  • Size: 27.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.7

File hashes

Hashes for mapillary_downloader-0.7.8.tar.gz
Algorithm Hash digest
SHA256 34b3e291dd410191cdcec114755f6b7c2fba54f556cfd2214361fb34179518a5
MD5 d600487201c2df75ff06edb39f2b85bc
BLAKE2b-256 6c477a58473d95565e0e88738e126b9f7320eb417b5fa72250d8c39f2a28d0db

See more details on using hashes here.

File details

Details for the file mapillary_downloader-0.7.8-py3-none-any.whl.

File metadata

File hashes

Hashes for mapillary_downloader-0.7.8-py3-none-any.whl
Algorithm Hash digest
SHA256 3f5d12b97138c9bb4706c406b81c8084afa5d8a55ec923b4718e5280c7ffd5ba
MD5 e14aff0c4c6b4e4702d70168848a5680
BLAKE2b-256 52a058267a8352ad3a436fe876ff03838fc2d8b00125f006591056dd3befa398

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page