PDA

View Full Version : Real Time face swapping software



Celtic Rogue
20th September 2011, 12:26 PM
http://vimeo.com/29279198


It is a technical demo for face swapping technique. The application works in real time and it's developed using the opensource framework for creative coding openFrameworks: openFrameworks.cc (http://openframeworks.cc/)

Most of the "magic" happens thanks to Jason Saragih's c++ library for face tracking web.mac.com/​jsaragih/​FaceTracker/​FaceTracker.html (http://web.mac.com/jsaragih/FaceTracker/FaceTracker.html). The face tracking library returns a mesh that matches the contour of the eyes, nose, mouth and other facial features.

That way the mesh obtained from a photo is matched to my own face in the video. Applying some color interpolation algorithms from Kevin Atkinson's image clone code: methodart.blogspot.com/​ (http://methodart.blogspot.com/) gives it the blending effect that can be seen in the final footage.

I'm also using Kyle McDonald's ofxFaceTracker addon for openframeworks github.com/​kylemcdonald/​ofxFaceTracker (https://github.com/kylemcdonald/ofxFaceTracker) which wraps Jason's library for easier use.

k-os
20th September 2011, 04:07 PM
Very creepy. It still needs some fine tuning, but it's creepy nonetheless.

Joe King
20th September 2011, 04:51 PM
Did you see this one?

http://vimeo.com/26193010 Facial pupperty