OpenFace代码阅读笔记(1) ------FeatureExtraction的程序流程

OpenFace代码阅读笔记 ------FeatureExtraction的程序流程

1. Init

1.1 解析main函数的输入参数

1.2 读取txt文件中的配置参数

1.3 load models

1.4 读取图片

 

2. Detect Landmark

detection_success = LandmarkDetector::DetectLandmarksInVideo(grayscale_image, face_model, det_parameters);

3. Estimate Gaze

FaceAnalysis::EstimateGaze(face_model, gazeDirection0, fx, fy, cx, cy, true);

 

4. Align Face

face_analyser.GetLatestAlignedFace(sim_warped_img);

5. Estimate Pose

pose_estimate = LandmarkDetector::GetCorrectedPoseWorld(face_model, fx, fy, cx, cy);

6.  Output landmarks, pose, gaze, parameters and AUs

// Output the landmarks, pose, gaze, parameters and AUs
outputAllFeatures(&output_file, output_2D_landmarks, output_3D_landmarks, output_model_params, output_pose, output_AUs, output_gaze,
face_model, frame_count, time_stamp, detection_success, gazeDirection0, gazeDirection1,
pose_estimate, fx, fy, cx, cy, face_analyser);

 

question: how to calc AU?