FoxyFace

FoxyFace allows you to use your real face to control your avatar's face in VRChat using any camera that is connected to your computer. You can also use the camera of an Android device, iOS device or another computer, but this will require you to download additional programs, here are instructions on how to do it.

FoxyFace uses the MediaPipe Face landmark detection neural network bundle and the neural network from Project Babble.

FoxyFace is a good starting point as it doesn't require you to invest any money if you have a computer and a camera on "any" of your devices.

Almost complete facial tracking

_{^{Face is taken from FreePik, and Yeenie avatar is made by SMU}}

The FoxyFace is currently tracking 83 parameters out of 102 parameters supported by VRCFT, which is 81%. That's taking into account the Blended Shapes.

Supported parameters

BrowInnerUpLeft, BrowInnerUpRight, BrowLowererLeft, BrowLowererRight, BrowOuterUpLeft, BrowOuterUpRight, BrowPinchLeft, BrowPinchRight, CheekPuffLeft, CheekPuffRight, CheekSquintLeft, CheekSquintRight, CheekSuckLeft, CheekSuckRight, EyeOpennessLeft, EyeOpennessRight, EyeSquintLeft, EyeSquintRight, EyeWideLeft, EyeWideRight, EyeXLeft, EyeXRight, EyeYLeft, EyeYRight, HeadPitch, HeadRoll, HeadX, HeadY, HeadYaw, HeadZ, JawForward, JawLeft, JawOpen, JawRight, LipFunnelLowerLeft, LipFunnelLowerRight, LipFunnelUpperLeft, LipFunnelUpperRight, LipPuckerLowerLeft, LipPuckerLowerRight, LipPuckerUpperLeft, LipPuckerUpperRight, LipSuckLowerLeft, LipSuckLowerRight, LipSuckUpperLeft, LipSuckUpperRight, MouthClosed, MouthCornerPullLeft, MouthCornerPullRight, MouthCornerSlantLeft, MouthCornerSlantRight, MouthDimpleLeft, MouthDimpleRight, MouthFrownLeft, MouthFrownRight, MouthLowerDownLeft, MouthLowerDownRight, MouthLowerLeft, MouthLowerRight, MouthPressLeft, MouthPressRight, MouthRaiserLower, MouthRaiserUpper, MouthStretchLeft, MouthStretchRight, MouthUpperLeft, MouthUpperRight, MouthUpperUpLeft, MouthUpperUpRight, NoseSneerLeft, NoseSneerRight, TongueBendDown, TongueCurlUp, TongueDown, TongueFlat, TongueLeft, TongueOut, TongueRight, TongueRoll, TongueSquish, TongueTwistLeft, TongueTwistRight, TongueUp

Unsupported parameters

EyePupilDiameterMMLeft, EyePupilDiameterMMRight, JawBackward, JawClench, JawMandibleRaise, LipSuckCornerLeft, LipSuckCornerRight, MouthTightenerLeft, MouthTightenerRight, MouthUpperDeepenLeft, MouthUpperDeepenRight, NasalConstrictLeft, NasalConstrictRight, NasalDilationLeft, NasalDilationRight, NeckFlexLeft, NeckFlexRight, SoftPalateClose, ThroatSwallow

Step 0

1. Make sure you've installed VRCFaceTracking.
2. Make sure you find an avatar that supports face tracking or head movement. You won't be able to check if it works without this/third-party module enabled. Here's a video tutorial: link
3. The most important step is to make sure that you have enabled OSC in the avatar settings and enabled tracking of individual parts of the face/head; by default, this is all turned off.

Installation

1. Pre-compiled Binaries (Windows)

For Windows users, it is recommended to use the pre-compiled standalone executable from GitHub Releases:

• Download Latest Release

---

2. Python Package (pip)

If you want to install and run FoxyFace as a Python package, it is recommended to set up a virtual environment first.

Create and Activate Virtual Environment

Windows:

python -m venv venv
venv\Scripts\activate

Linux / macOS:

python3 -m venv venv
source venv/bin/activate

---

Install and Run

Windows

pip install "foxyface[default]"

Note: If you are running a Windows 10 version older than 10.0.19041 (20H1), you need to install the CPU-only version instead:

pip install "foxyface[cpu]"

Run the application:

venv\Scripts\foxyface.exe

(or just foxyface if the virtual environment is activated)

---

Linux

Choose the appropriate command based on your hardware/GPU:

• NVIDIA:

  pip install "foxyface[nvidia]" -f https://download.pytorch.org/whl/cu126
  

• AMD:

  pip install "foxyface[rocm]" -f https://repo.radeon.com/rocm/manylinux/rocm-rel-6.4.3/
  

• CPU only:

  pip install "foxyface[cpu]"
  

Run the application:

venv/bin/foxyface

(or just foxyface if the virtual environment is activated)

---

macOS

pip install "foxyface[default]"

Run the application:

venv/bin/foxyface

(or just foxyface if the virtual environment is activated)

3. Development / From Source

If you want to contribute or modify the source code:

1. Clone the repository

Make sure to include submodules during cloning:

git clone --recurse-submodules https://github.com/Jeka8833/FoxyFace.git
cd FoxyFace/FoxyFace

2. Set up a virtual environment

You can let your IDE (e.g., PyCharm, VS Code) automatically create and manage the virtual environment, or create one manually:

Windows:

python -m venv venv
venv\Scripts\activate

Linux / macOS:

python3 -m venv venv
source venv/bin/activate

3. Install in editable mode

pip install -e ".[default,build]"