Introduction

What is faceshift studio?

Faceshift studio is a facial motion capture software solution which revolutionizes facial animation, making it possible at every desk. The software analyzes the facial movements of an actor and describes them as a mixture of basic expressions, plus head orientation, and eye gaze. This description is then used to animate virtual characters for use in any situation where facial animation is required, such as movie and game production.

Faceshift studio’s animation pipeline is comprised of three intuitive steps:

  • Scan a set of expressions to train your personalized avatar for tracking.
  • Capture a performance with real-time feedback, and optionally improve the accuracy in a post-processing stage.
  • Animate virtual avatars in faceshift and export the animation to your favorite 3D animation software, or connect to your existing animation pipeline.

In order to get faceshift studio, please visit our website www.faceshift.com or contact us at support@faceshift.com.

Prerequisites

Faceshift studio combines astonishing real-time tracking and high quality offline post-processing in a single, convenient application. There is no need for expensive motion capture setups, all you need is a consumer depth camera and a standard computer. If you need a sensor, please contact us at support@faceshift.com.

Supported 3D Sensors

Camera OS Quality
Intel RealSense Windows 8.1 onwards Best quality
PrimeSense Carmine 1.09 Mac OS X, Windows (OpenNI), Linux (OpenNI) Best quality
Asus Xtion Pro Live Mac OS X, Windows (OpenNI), Linux (OpenNI) Best quality
Microsoft Kinect for Xbox 360 Mac OS X, Windows (MS Kinect SDK, OpenNI*), Linux (OpenNI*) Good quality
Microsoft Kinect for Windows Windows (MS Kinect SDK), Linux (OpenNI*) Good quality

*The Kinect is supported only via the unofficial drivers at https://github.com/avin2/SensorKinect. For installing these drivers on Windows 8.1, see Known Issues.

Driver Downloads

OSX drivers come pre-installed. For Windows, choose your sensor below, download, and install drivers.

Firmware Downloads

In most cases you do not need to upgrade your sensor’s firmware. However, if you are having problems with the OpenNI 2 Exposure and Gain settings, an upgrade may help. Be sure to choose the firmware matching your device!

Intel RealSense Installation

  • Download the SDK and the DCM (Depth Camera Manager).
  • Install the SDK first. Note that for using the Intel RealSense camera with faceshift studio, you don’t need all the modules selected for installation by default, but only those selected in the screenshot below.
  • Make sure that your Intel RealSense camera is plugged into a USB 3 port and install the DCM.

Installation

Windows

  • Install the drivers for your 3D sensor (see Supported 3D Sensors)
  • Download faceshift studio (you will find the link either on the invoice you received after a purchase, or in the email you received after requesting a trial)
  • Install the software
  • Start faceshift studio
  • Enter the activation code you received when you purchased faceshift studio (read more in License Activation)

Mac

  • Download faceshift studio (you will find the link either on the invoice you received after a purchase, or in the email you received after requesting a trial)
  • Install the software (no need to install any driver)
  • Start faceshift studio
  • Enter the activation code you received when you purchased faceshift studio (read more in section License Activation)

Check the list of supported cameras for this OS in the Prerequisites.

Ubuntu

First add the faceshift public key to your list of trusted keys:

wget -O - http://download.faceshift.com/dists/faceshift.pub | sudo apt-key add -

then add the faceshift repository to your list of repositories:

echo 'deb http://download.faceshift.com/ ubuntu amd64' | \
  sudo tee -a /etc/apt/sources.list.d/faceshift.list

Update the list of available software and install faceshift:

sudo apt-get update
sudo apt-get install fs-studio

Check the list of supported cameras for this OS in the Prerequisites.

CentOS 7

Faceshift requires the EPEL (Extra Packages for Enterprise Linux) repository for its dependencies. Enable it like this:

sudo yum install epel-release

Then download the faceshift package:

wget http://download.faceshift.com/rpm/x86_64/fs-studio-2015.1.01-0.x86_64.rpm

And install:

sudo yum install fs-studio-2015.1.01-0.x86_64.rpm

Check the list of supported cameras for this OS in the Prerequisites.

License Activation

Your faceshift studio license needs to be activated via our Internet activation server. Enter or paste the activation code you received when you purchased faceshift studio. If you have entered a valid activation code, hitting the Activate button will generate a message window acknowledging the successful activation of the software.

License activation dialog

Advanced Options

Hitting the Advanced button, more options appear (see figure Advanced Options), allowing you to activate faceshift studio also in the following cases:

  • Your computer is not connected to the internet: Check the Offline Activation checkbox and send the generated file (located in the faceshift studio workspace directory) to support@faceshift.com.
  • Your computer is behind a proxy server: Enter the proxy address and optionally the credentials

Rehosting your License

In the Preferences, you will find a “License” tab with some additional information about your license like the remaining days before expiration. You also have the possibility to rehost your license if you want to use faceshift on another computer. If your computer is not connected to the internet, check the Offline checkbox and send the generated file (located in the faceshift studio workspace directory) to support@faceshift.com.

Please note that the rehosting only works for a limited number of activations (5 by default).

Warning

This feature is not available in the Trial version of faceshift studio.

Advanced Options

License Rehosting Dialog

Troubleshooting

In case activation fails, faceshift studio will display an error message with the failure reason.

  • Error -134: This error might occur when Avast antivirus is running. Please disable Avast for the duration of the activation and enable it again afterwards.

For any other errors, please contact us at support@faceshift.com.

Start faceshift studio

The first time you run faceshift studio, you have to choose the location of the faceshift studio workspace data. Workspace data includes actor profiles and recorded clips, but also the faceshift studio license and log data. The default path is $Home/Documents/faceshift. Click “Browse” to change the location of the folder. If you want to change the location later, go to Preferences and change the workspace in the “General” tab (see section General Preferences).

Choosing your workspace

Faceshift studio is now correctly installed on your system and your 3D sensor is correctly plugged-in. You can now start using faceshift studio after selecting the right driver for your sensor.

Select the sensor driver

Starting faceshift studio

Faceshift studio is divided into three different modes: Setup, Training, and Tracking. The modes can be activated via the menu or the buttons at the left of the screen (see figure The 3 different modes).

Setup is used to check that the camera works and the data is good. Training is needed once for each new user to build their personalized template. Tracking is what faceshift studio is for.

The 3 different modes

Check out this first tutorial for a general overview of the faceshift application and features: