Developer postOriginal post (opens in a new tab)

FaceRig v1.565 - nextversion only + MultiSensor Update

Awesome people,

[ EDIT 7.06.2016] MultiSensor Update is now available on all branches.

MultiSensor Update takes FaceRig to the next level. Two tracking sensors = double the fun.
You can now use the Intel® RealSense™ Camera and the Leap Motion™ Controller with FaceRig!
Note: You need to have the RealSense™ Camera and the Leap Motion™ Controller in order to be able to benefit of the MultiSensor Update.

FaceRig support for Intel® RealSense™ Camera
http://store.steampowered.com/app/420824/

FaceRig support for Leap Motion™ Controller
http://store.steampowered.com/app/420825/

https://www.youtube.com/watch?v=t84XuR_A6YE&feature=youtu.be

Once you have these DLCs installed, you will find the MultiSensor Update in Facerig by switching to Advanced UI then choose Advanced Tracking Configuration (4th option from the top right menu)

Here the complete Change log:

  • Added multi sensor/tracker support. FaceRig can now run multiple trackers at the same time( ex. you can run the ULSee Facial Tracker with a hands tracker ). Each sensor is usually used in conjunction with a different SDK provided by the vendors, which means that for each tracker there will be additional prerequisites installed on the system. Each sensor support is available as separate DLC (for now we have the RealSense Camera and the Leap Motion *free* DLCs), please read the minimum requirements of each dlc/sensor before trying to install on your system. As of now FaceRig has support for 4 different trackers:
    ULSee (base app) - Rigid Head and Face Expression Tracking working on any RGB camera
    Voice Tracker (base app) - Audio based lips tracker working with audio input
    RealSense (dlc) - Hands, Rigid Head and Face Tracking (note that it also detects puffed cheeks and tongue out expressions) working only with the RealSense Camera
    Leap Motion (dlc) - Hands tracking that works only with the Leap Motion Sensor

    We are planning to release support for Kinect 2 in the near feature (we are hoping late July or early August), at first only with upper body tracking.

  • Running multiple trackers at the same time will drastically impact CPU usage, this is mainly due to running several independent trackers at the same time.
  • Added a new tab for Trackers management. In the Advanced UI, go to Advanced Tracking Configuration then to Trackers Tab. Features:
    - overall stats: number of running trackers, total cpu usage, maximum time spent on CPU by a tracker.
    - "Add Tracker" drop down. The drop down will be populated only if the DLCs are installed.
    - the list of currently running trackers that you can Pause/Play and Remove.
    - each tracker has a set of modules that influence the avatar's animations. The modules are the tracking info that make it to the avatar.
    - you can view each sensor feed (either transfer it to the main feed, either add another)
  • the webcam device can now be changed only from the Trackers tab
  • the Expressions tab from the Advanced Tracking Configuration dialog only affects the ULSee tracker values. We are considering in adding extra tracking configuration options for the other trackers too.

  • Fixed Overlay Editor Shadow Spread load issue
  • Added opacity feature to text and images in the Overlay Editor
  • The Performance Save and Load have been reworked to support the multi-sensor/multi-tracker, old performance files will not work in the newer versions. The good news is that the performance loading was significantly optimized.
  • Various UI fixes
  • MultiSensor Update localization is currently English only

    Let the Fun begin!
    FaceRig Team