|
visageSDK
|
visage|SDK provides two APIs: the native C++ API, and the C# API implemented through a wrapper. Both APIs include following main functionalities:
All listed APIs use neural networks to process and analyze facial images.
Additional configuration file NeuralNet.cfg is provided in Samples/data folder. It allows for specifying the number of threads that the runner will use for inference. Currently, only one runner per platform is available. If NeuralNet.cfg is not found, neural network runner will use 1 thread.
More information about configuring neural network runners can be found in VisageTracker Configuration Manual, chapter 3. Configuring neural network runners.
For the NeuralNet.cfg configuration file to be successfully loaded, Samples/data folder, including its subfolders and files, should keep the same hierarchy as it is in distributed visage|SDK package. Specifically, API expects that the file will be in the same folder as vfa, vfr and vft folders within users' applications.
The following sections provide an overview of the APIs and give links to most important classes, as well as to sample projects demonstrating particular functions.
The C++ API contains vision-based algorithms for detecting and tracking facial features in images/videos as well as face analysis (gender, age and emotion estimation) and face recognition. It is implemented in three separate libraries in order to optimize the size of specific applications (listed with their dependencies):
NOTE: libVisageVision64.dll and its dependencies are expected to be at the same location
Visage tracker tracks multiple faces and facial features in video sequences and outputs 3D head pose, facial expressions, gaze information, eye closure, facial feature points and full 3D face model. Tracker is fully configurable in terms of performance, quality, as well as other options. Common configurations are delivered. Details about configuring the tracker can be found in the VisageTracker Configuration Manual.
Face tracking is demonstrated in FaceTracker2 and VisageTrackerUnityDemo sample projects.
Main classes
The class VisageFeaturesDetector detects faces and facial features in input images. The results are, for each detected face, the 3D head pose, gaze direction, eye closure, the coordinates of facial feature points, e.g. chin tip, nose tip, lip corners etc. and 3D face model fitted to the face. The results are returned in one or more FaceData objects, one for each detected face.
The ShowcaseDemo sample demonstrates facial feature detection.
Main classes
The class VisageFaceAnalyser contains face analysis algorithms capable of estimating gender, age and emotion from facial images.
The ShowcaseDemo sample demonstrates gender, age and emotion estimation.
Main classes
The class VisageFaceRecognition contains a face recognition algorithm capable of measuring similarity between human faces and recognizing a person's identity from frontal facial image (yaw angle approximately from -20 to 20 degrees) by comparing it to previously stored faces.
The ShowcaseDemo sample demonstrates face recognition.
Main classes
Liveness system is used to differentiate between a live person in the live video stream, as opposed to a still image. It is used in combination with face recognition to verify that the person is actually in front of the camera. This is accomplished by prompting a person to perform a specific set of facial actions and verifying that the actions have actually been performed. System allows you to use already implemented actions (eyebrows raise, blink, smile), as well as implement your own actions using VisageLivenessAction interface.
Liveness verification is demonstrated in FaceTracker2 sample application.
Main classes
The C# API provides access to vision-based algorithms for detecting and tracking facial features in images/videos as well as face analysis (gender, age and emotion estimation) and face recognition in C#. It is implemented in libVisageCSWrapper.dll library, and requires all basic C++ libraries for running (libVisageVision, libVisageGaze and libVisageAnalyser).
NOTE: libVisageVision64.dll dependencies are expected to be at the same location as libVisageVision64.dll
Visage tracker tracks multiple faces and facial features in video sequences and outputs 3D head pose, facial expressions, gaze information, eye closure, facial feature points and full 3D face model. Tracker is fully configurable in terms of performance, quality, as well as other options. Common configurations are delivered. Details about configuring the tracker can be found in the VisageTracker Configuration Manual.
Face tracking is demonstrated in ShowcaseDemo sample project.
Main classes
The class VisageFeaturesDetector detects faces and facial features in input images. The results are, for each detected face, the 3D head pose, gaze direction, eye closure, the coordinates of facial feature points, e.g. chin tip, nose tip, lip corners etc. and 3D face model fitted to the face. The results are returned in one or more FaceData objects, one for each detected face.
ShowcaseDemo sample project demonstrates facial feature detection.
Main classes
The class VisageFaceAnalyser contains face analysis algorithms capable of estimating gender, age and emotion from facial images. For age estimation it returns estimated age, for gender estimation it returns estimated gender and for emotions estimation it returns the probability of each of estimated facial emotions: anger, disgust, fear, happiness, sadness, surprise and neutral.
ShowcaseDemo sample project demonstrates gender, age and emotion estimation.
Main classes
The class VisageFaceRecognition contains a face recognition algorithm capable of measuring similarity between human faces and recognizing a person's identity from frontal facial image (yaw angle approximately from -20 to 20 degrees) by comparing it to previously stored faces.
ShowcaseDemo sample demonstrates face recognition.
Main classes
1.8.10