mediapipe

MediaPipe is the simplest way for researchers and developers to build world-class ML solutions and applications for mobile, edge, cloud and the web.

Project description

layout: default title: Home nav_order: 1

MediaPipe

Cross-platform ML solutions made simple

MediaPipe is the simplest way for researchers and developers to build world-class ML solutions and applications for mobile, desktop/cloud, web and IoT devices.


End-to-End acceleration: built-in fast ML inference and processing accelerated even on common hardware	Build one, deploy anywhere: Unified solution works across Android, iOS, desktop/cloud, web and IoT

Ready-to-use solutions: Cutting-edge ML solutions demonstrating full power of the framework	Free and open source: Framework and solutions both under Apache 2.0, fully extensible and customizable

ML solutions in MediaPipe

Face Detection	Face Mesh	Iris	Hands	Pose	Hair Segmentation

Object Detection	Box Tracking	Instant Motion Tracking	Objectron	KNIFT

	Android	iOS	Desktop	Python	Web	Coral
Face Detection	✅	✅	✅		✅	✅
Face Mesh	✅	✅	✅
Iris	✅	✅	✅		✅
Hands	✅	✅	✅		✅
Pose	✅	✅	✅	✅	✅
Hair Segmentation	✅		✅		✅
Object Detection	✅	✅	✅			✅
Box Tracking	✅	✅	✅
Instant Motion Tracking	✅
Objectron	✅
KNIFT	✅
AutoFlip			✅
MediaSequence			✅
YouTube 8M			✅

MediaPipe on the Web

MediaPipe on the Web is an effort to run the same ML solutions built for mobile and desktop also in web browsers. The official API is under construction, but the core technology has been proven effective. Please see MediaPipe on the Web in Google Developers Blog for details.

You can use the following links to load a demo in the MediaPipe Visualizer, and over there click the "Runner" icon in the top bar like shown below. The demos use your webcam video as input, which is processed all locally in real-time and never leaves your device.

visualizer_runner

Getting started

Learn how to install MediaPipe and build example applications, and start exploring our ready-to-use solutions that you can further extend and customize.

The source code is hosted in the MediaPipe Github repository, and you can run code search using Google Open Source Code Search.

Publications

Instant Motion Tracking With MediaPipe in Google Developers Blog
BlazePose - On-device Real-time Body Pose Tracking in Google AI Blog
MediaPipe Iris: Real-time Eye Tracking and Depth Estimation in Google AI Blog
MediaPipe KNIFT: Template-based feature matching in Google Developers Blog
Alfred Camera: Smart camera features using MediaPipe in Google Developers Blog
Real-Time 3D Object Detection on Mobile Devices with MediaPipe in Google AI Blog
AutoFlip: An Open Source Framework for Intelligent Video Reframing in Google AI Blog
MediaPipe on the Web in Google Developers Blog
Object Detection and Tracking using MediaPipe in Google Developers Blog
On-Device, Real-Time Hand Tracking with MediaPipe in Google AI Blog
MediaPipe: A Framework for Building Perception Pipelines

Videos

YouTube Channel

Events

Community

Awesome MediaPipe - A curated list of awesome MediaPipe related frameworks, libraries and software
Slack community for MediaPipe users
Discuss - General community discussion around MediaPipe

Alpha disclaimer

MediaPipe is currently in alpha at v0.7. We may be still making breaking API changes and expect to get to stable APIs by v1.0.

Contributing

We welcome contributions. Please follow these guidelines.

We use GitHub issues for tracking requests and bugs. Please post questions to the MediaPipe Stack Overflow with a mediapipe tag.

Project details

Release history Release notifications | RSS feed

This version

0.7.10

Aug 28, 2020

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for mediapipe, version 0.7.10
Filename, size	File type	Python version	Upload date	Hashes
Filename, size mediapipe-0.7.10-cp36-cp36m-macosx_10_15_intel.whl (27.0 MB)	File type Wheel	Python version cp36	Upload date Aug 28, 2020	Hashes View
Filename, size mediapipe-0.7.10-cp36-cp36m-manylinux2014_x86_64.whl (26.8 MB)	File type Wheel	Python version cp36	Upload date Aug 28, 2020	Hashes View
Filename, size mediapipe-0.7.10-cp37-cp37m-macosx_10_15_x86_64.whl (27.0 MB)	File type Wheel	Python version cp37	Upload date Aug 28, 2020	Hashes View
Filename, size mediapipe-0.7.10-cp37-cp37m-manylinux2014_x86_64.whl (26.8 MB)	File type Wheel	Python version cp37	Upload date Aug 28, 2020	Hashes View
Filename, size mediapipe-0.7.10-cp38-cp38-macosx_10_15_x86_64.whl (27.0 MB)	File type Wheel	Python version cp38	Upload date Aug 28, 2020	Hashes View
Filename, size mediapipe-0.7.10-cp38-cp38-manylinux2014_x86_64.whl (26.8 MB)	File type Wheel	Python version cp38	Upload date Aug 28, 2020	Hashes View

Hashes for mediapipe-0.7.10-cp36-cp36m-macosx_10_15_intel.whl

Hashes for mediapipe-0.7.10-cp36-cp36m-macosx_10_15_intel.whl
Algorithm	Hash digest
SHA256	`abd3b04a890f629f6426d20a43d18237d3a87ce79cf5083fae8f061710aa4435`
MD5	`4667aacc75d396f66b70348d731aff31`
BLAKE2-256	`7471dd40b4a0b0026924131f8321537663f3ac6835bb9e46cb9edd6e7e94b457`

Hashes for mediapipe-0.7.10-cp36-cp36m-manylinux2014_x86_64.whl

Hashes for mediapipe-0.7.10-cp36-cp36m-manylinux2014_x86_64.whl
Algorithm	Hash digest
SHA256	`d683584863a0686d4bef517481fd093a49ecccce31cd1cb090bd1cd7cf85a0ff`
MD5	`4c4bb2b955ce00538e35e373f94d38cd`
BLAKE2-256	`a699b4e02afad367d6c4b548b63e94fb6c5168458fc1d44a5fa178a928177199`

Hashes for mediapipe-0.7.10-cp37-cp37m-macosx_10_15_x86_64.whl

Hashes for mediapipe-0.7.10-cp37-cp37m-macosx_10_15_x86_64.whl
Algorithm	Hash digest
SHA256	`1e8dfdf5c2c8af32808eb229506821a694da92f5ce56e66dc12c78cc01f155f7`
MD5	`a241d19e37eef54b956f8dbb51f46211`
BLAKE2-256	`12533fd81eecfdd58d2734c0099af21a816c5acf0b541df1f8e20ea7642c511a`

Hashes for mediapipe-0.7.10-cp37-cp37m-manylinux2014_x86_64.whl

Hashes for mediapipe-0.7.10-cp37-cp37m-manylinux2014_x86_64.whl
Algorithm	Hash digest
SHA256	`840e4fae6442aecd66821d818fbc2e1bd0a3009debf29b6f448ec1b210b35566`
MD5	`68fcadd4a88253ee6f32dcbcb91ccade`
BLAKE2-256	`954ae1a78a80e743cb0ece2c00d4686d6e823dc7e5df1b9f03bc1937bd96cab5`

Hashes for mediapipe-0.7.10-cp38-cp38-macosx_10_15_x86_64.whl

Hashes for mediapipe-0.7.10-cp38-cp38-macosx_10_15_x86_64.whl
Algorithm	Hash digest
SHA256	`9dd1d266c3ab42d91c813a3bfd10894509dc10fbb625c5e96bc2e1c133366019`
MD5	`43ed05814038ea9c7bc491b0ad850bca`
BLAKE2-256	`43bc1a1081eb6c316369de144713bd82630dc5e16748aa9b869073b8eb527c41`

Hashes for mediapipe-0.7.10-cp38-cp38-manylinux2014_x86_64.whl

Hashes for mediapipe-0.7.10-cp38-cp38-manylinux2014_x86_64.whl
Algorithm	Hash digest
SHA256	`29fa79190249515e355d487ba8e238c761ffb9e5ba72a33651cf6b66d1ae7199`
MD5	`68f1b57d5ee39d3280c542cfc493dd7e`
BLAKE2-256	`91f52fff965ac1a7e0fb7490823771b2c24a8ba12590f4da54deb924ad77bb4d`