LiveLinkFce的Arkit与Character Creator动画曲线的对接

1.LiveLinkFce利用了苹果的ARKit和iPhone的TrueDepth前置摄像头,共有61种动画曲线,全部名称如下:
BrowDownLeft; BrowDownRight; BrowInnerUp; BrowOuterUpLeft; BrowOuterUpRight; CheekPuff; CheekSquintLeft; CheekSquintRight;EyeBlinkLeft; EyeBlinkRight; EyeLookDownLeft; EyeLookDownRight; EyeLookInLeft; EyeLookInRight; EyeLookOutLeft; EyeLookOutRight; EyeLookUpLeft; EyeLookUpRight; EyeSquintLeft; EyeSquintRight; EyeWideLeft; EyeWideRight; HeadPitch; HeadRoll; HeadYaw; JawForward; JawLeft; JawOpen; JawRight; LeftEyePitch; LeftEyeRoll; LeftEyeYaw; MouthClose; MouthDimpleLeft; MouthDimpleRight; MouthFrownLeft; MouthFrownRight; MouthFunnel; MouthLeft; MouthLowerDownLeft; MouthLowerDownRight; MouthPressLeft; MouthPressRight; MouthPucker; MouthRight; MouthRollLower; MouthRollUpper; MouthShrugLower; MouthShrugUpper; MouthSmileLeft; MouthSmileRight; MouthStretchLeft; MouthStretchRight; MouthUpperUpLeft; MouthUpperUpRight; NoseSneerLeft; NoseSneerRight; RightEyePitch; RightEyeRoll; RightEyeYaw; TongueOut;
其中:
Brow:5种(额头)
Cheek:3种(脸颊)
Eye:14种(眼睛)
Head:3种(头)
Jaw:4种(下把)
Mouth:23种(嘴)
Nose:2种(鼻子)
Tongue:1种(舌头)
每种动画曲线的解释,详见官方文档:ARFaceAnchor

2.Character Creator共有595种曲线动画,全部名称如下:
Brow_Compress_L; Brow_Compress_R; Brow_Drop_L; Brow_Drop_R; Brow_Raise_Inner_L; Brow_Raise_Inner_R; Brow_Raise_Outer_L; Brow_Raise_Outer_R; Cheek_Puff_L; Cheek_Puff_R; Cheek_Raise_L; Cheek_Raise_R; Cheek_Suck_L; Cheek_Suck_R; Ear_Down_L; Ear_Down_R; Ear_Out_L; Ear_Out_R; Ear_Up_L; Ear_Up_R; EO Bulge L; EO Bulge R; EO Center Lower Depth L; EO Center Lower Depth R; EO Center Lower Height L; EO Center Lower Height R; EO Center Upper Depth L; EO Center Upper Depth R; EO Center Upper Height L; EO Center Upper Height R; EO Depth L; EO Depth R; EO Duct Depth L; EO Duct Depth R; EO Inner Depth L; EO Inner Depth R; EO Inner Height L; EO Inner Height R; EO Inner Lower Depth L; EO Inner Lower Depth R; EO Inner Lower Height L; EO Inner Lower Height R; EO Inner Upper Depth L; EO Inner Upper Depth R; EO Inner Upper Height L; EO Inner Upper Height R; EO Inner Width L; EO Inner Width R; EO Lower Depth L; EO Lower Depth R; EO Outer Depth L; EO Outer Depth R; EO Outer Height L; EO Outer Height R; EO Outer Lower Depth L; EO Outer Lower Depth R; EO Outer Lower Height L; EO Outer Lower Height R; EO Outer Upper Depth L; EO Outer Upper Depth R; EO Outer Upper Height L; EO Outer Upper Height R; EO Outer Width L; EO Outer Width R; EO Upper Depth L; EO Upper Depth R; Eye_Blink_L; Eye_Blink_R; Eye_L_Look_Down; Eye_L_Look_L; Eye_L_Look_R; Eye_L_Look_Up; Eye_Pupil_Contract; Eye_Pupil_Dilate; Eye_R_Look_Down; Eye_R_Look_L; Eye_R_Look_R; Eye_R_Look_Up; Eye_Squint_L; Eye_Squint_R; Eye_Wide_L; Eye_Wide_R; Eyelash_Lower_Down_L; Eyelash_Lower_Down_R; Eyelash_Lower_Up_L; Eyelash_Lower_Up_R; Eyelash_Upper_Down_L; Eyelash_Upper_Down_R; Eyelash_Upper_Up_L; Eyelash_Upper_Up_R; Eyelid_Inner_Down_L; Eyelid_Inner_Down_R; Eyelid_Outer_Down_L; Eyelid_Outer_Down_R; Fluffy_Bottom_ALL; Fluffy_Right; Hairline_High_ALL; Hairline_High_M; Hairline_High_R; Hairline_Low_ALL; Hairline_Low_M; Hairline_Low_R; Hairline_Out_All; Head_Backward; Head_Forward; Head_L; Head_R; Head_Tilt_L; Head_Tilt_R; Head_Turn_Down; Head_Turn_L; Head_Turn_R; Head_Turn_Up; Jaw_Backward; Jaw_Down; Jaw_Forward; Jaw_L; Jaw_Open; Jaw_R; Jaw_Up; L_Hair_Front; L_Hair_Left; L_Hair_Right; Length_Long; Length_Short; Mouth_Blow_L; Mouth_Blow_R; Mouth_Chin_Up; Mouth_Close; Mouth_Contract; Mouth_Dimple_L; Mouth_Dimple_R; Mouth_Down; Mouth_Down_Lower_L; Mouth_Down_Lower_R; Mouth_Drop_Lower; Mouth_Drop_Upper; Mouth_Frown_L; Mouth_Frown_R; Mouth_Funnel_Down_L; Mouth_Funnel_Down_R; Mouth_Funnel_Up_L; Mouth_Funnel_Up_R; Mouth_L; Mouth_Lower_L; Mouth_Lower_R; Mouth_Press_L; Mouth_Press_R; Mouth_Pucker_Down_L; Mouth_Pucker_Down_R; Mouth_Pucker_Up_L; Mouth_Pucker_Up_R; Mouth_Pull_Lower_L; Mouth_Pull_Lower_R; Mouth_Pull_Upper_L; Mouth_Pull_Upper_R; Mouth_Push_Lower_L; Mouth_Push_Lower_R; Mouth_Push_Upper_L; Mouth_Push_Upper_R; Mouth_R; Mouth_Roll_In_Lower_L; Mouth_Roll_In_Lower_R; Mouth_Roll_In_Upper_L; Mouth_Roll_In_Upper_R; Mouth_Roll_Out_Lower_L; Mouth_Roll_Out_Lower_R; Mouth_Roll_Out_Upper_L; Mouth_Roll_Out_Upper_R; Mouth_Shrug_Lower; Mouth_Shrug_Upper; Mouth_Smile_L; Mouth_Smile_R; Mouth_Smile_Sharp_L; Mouth_Smile_Sharp_R; Mouth_Stretch_L; Mouth_Stretch_R; Mouth_Tighten_L; Mouth_Tighten_R; Mouth_Up; Mouth_Up_Upper_L; Mouth_Up_Upper_R; Mouth_Upper_L; Mouth_Upper_R; Neck_Swallow_Down; Neck_Swallow_Up; Neck_Tighten_L; Neck_Tighten_R; Nose_Crease_L; Nose_Crease_R; Nose_Nostril_Dilate_L; Nose_Nostril_Dilate_R; Nose_Nostril_Down_L; Nose_Nostril_Down_R; Nose_Nostril_In_L; Nose_Nostril_In_R; Nose_Nostril_Raise_L; Nose_Nostril_Raise_R; Nose_Sneer_L; Nose_Sneer_R; Nose_Tip_Down; Nose_Tip_L; Nose_Tip_R; Nose_Tip_Up; TL Center Lower Depth L; TL Center Lower Depth R; TL Center Lower Height L; TL Center Lower Height R; TL Center Upper Depth L; TL Center Upper Depth R; TL Center Upper Height L; TL Center Upper Height R; TL Depth L; TL Depth R; TL Duct Depth L; TL Duct Depth R; TL Inner Depth L; TL Inner Depth R; TL Inner Height L; TL Inner Height R; TL Inner Lower Depth L; TL Inner Lower Depth R; TL Inner Lower Height L; TL Inner Lower Height R; TL Inner Upper Depth L; TL Inner Upper Depth R; TL Inner Upper Height L; TL Inner Upper Height R; TL Inner Width L; TL Inner Width R; TL Lower Depth L; TL Lower Depth R; TL Outer Depth L; TL Outer Depth R; TL Outer Height L; TL Outer Height R; TL Outer Lower Depth L; TL Outer Lower Depth R; TL Outer Lower Height L; TL Outer Lower Height R; TL Outer Upper Depth L; TL Outer Upper Depth R; TL Outer Upper Height L; TL Outer Upper Height R; TL Outer Width L; TL Outer Width R; TL Upper Depth L; TL Upper Depth R; Tongue_Bulge_L; Tongue_Bulge_R; Tongue_Down; Tongue_Enlarge; Tongue_Extend; Tongue_In; Tongue_L; Tongue_Mid_Up; Tongue_Narrow; Tongue_Out; Tongue_R; Tongue_Roll; Tongue_Tip_Down; Tongue_Tip_L; Tongue_Tip_R; Tongue_Tip_Up; Tongue_Twist_L; Tongue_Twist_R; Tongue_Up; Tongue_Wide; V_Affricate; V_Dental_Lip; V_Explosive; V_Lip_Open;V_Open; V_Tight; V_Tight_O; V_Tongue_Curl_D; V_Tongue_Curl_U; V_Tongue_Lower; V_Tongue_Narrow; V_Tongue_Out; V_Tongue_Raise; V_Tongue_up; V_Wide;
其中:
Brow:8种(额头)
Cheek:6种(脸颊)
Ear:6种(耳朵)
EO:46种(眼角膜)
Eye:28种(眼睛)
Fluffy:2种(毛茸茸?)
Hairline:7种(发际线)
Head:10种(头)
Jaw:7种(下巴)
Hair:10种(头发)
Length:2种(发长?)
Mouth:59种(嘴)
Neck:4种(颈部)
Nose:16种(鼻子)
TL:44种(未知)
Tongue:20种(舌头)
V:15种(嘴部其他动画曲线)

3.对接办法
3.1 创建remap资产,对参数进行重命名(也可以在LIveLink提供的remap模板上进行修改),这样就对接了大部分主要的动画曲线,注意填写名称的时候务必要正确,避免有多余的空格等问题,否则会修改失败
LiveLinkFce的Arkit与Character Creator动画曲线的对接_第1张图片LiveLinkFce的Arkit与Character Creator动画曲线的对接_第2张图片LiveLinkFce的Arkit与Character Creator动画曲线的对接_第3张图片
LiveLinkFce的Arkit与Character Creator动画曲线的对接_第4张图片

3.2 其他动画曲线的对接和调整

【头部/颈部】
设置头部骨骼角度值,限定值根据实际效果调整
LiveLinkFce的Arkit与Character Creator动画曲线的对接_第5张图片
颈部骨骼跟随头部骨骼转动,这里设置为0.5倍头部骨骼角度
LiveLinkFce的Arkit与Character Creator动画曲线的对接_第6张图片
添加一个“修改曲线”节点
LiveLinkFce的Arkit与Character Creator动画曲线的对接_第7张图片
考虑颈部旋转的同时,颈部肌肉也会变形(Arkit没有对颈部肌肉运动进行捕捉)
LiveLinkFce的Arkit与Character Creator动画曲线的对接_第8张图片
Arkit与CC缺少的【头部/颈部】对接参数:Head_Backward、Head_Forward、Head_L、Head_R(无法捕捉新疆脖子舞)、Neck_Tighten(颈部紧绷)、Neck_Swallow(颈部吞咽)

【眼睛/睫毛】
注意:
LiveLinkFce的Arkit与Character Creator动画曲线的对接_第9张图片
设置眼球骨骼的角度值,正常的眼球只能Yaw/Pitch旋转,这里举左眼为例,右眼同理
LiveLinkFce的Arkit与Character Creator动画曲线的对接_第10张图片
LiveLinkFce的Arkit与Character Creator动画曲线的对接_第11张图片
Arkit没有Eyelash(睫毛)、Eyelid(眼睑)、Eye_Pupil(瞳孔)的动画曲线,但可以自行发挥,比如Eyelash(睫毛)、Eyelid(眼睑)与Eye_Blink等参数相关联,Eye_Pupil(瞳孔)与场景的实际光照相关联。如果要与现实的光照相关联,就要用到其他的动捕软件,有兴趣可阅读相关文章 https://zhuanlan.zhihu.com/p/280746366

LiveLinkFce的Arkit与Character Creator动画曲线的对接_第12张图片
Arkit与CC缺少的【眼睛/睫毛】对接参数:Eyelash(睫毛)、Eyelid(眼睑)、Eye_Pupil(瞳孔)

【下巴】
设置下巴骨骼的角度值,正常的下巴只能Yaw/Pitch旋转
LiveLinkFce的Arkit与Character Creator动画曲线的对接_第13张图片
LiveLinkFce的Arkit与Character Creator动画曲线的对接_第14张图片
Arkit与CC缺少的【下巴】对接参数:Jaw_Down、Jaw_Backward

【额头】
注意:
LiveLinkFce的Arkit与Character Creator动画曲线的对接_第15张图片
由于Arkit没有把browInnerUp(眉内向上)分成左、右眼,需要在动画图表去设置

LiveLinkFce的Arkit与Character Creator动画曲线的对接_第16张图片
Arkit与CC缺少的对接参数:Brow_Compress_L、Brow_Compress_R
LiveLinkFce的Arkit与Character Creator动画曲线的对接_第17张图片

【嘴】
嘴是五官动作类型最多的部位,CC定义了多达59种嘴部动画曲线。嘴分为上下两半,除了能上下左右移动,还有噘嘴、抿嘴、歪嘴、含嘴、O型嘴、亲亲嘴、鼓腮嘴等嘴型,还会与脸部同时肌肉运动
LiveLinkFce的Arkit与Character Creator动画曲线的对接_第18张图片
Arkit与CC缺少的对接参数:Mouth_Contract(鸭子嘴?)、Mouth_Blow(口吹嘴型)、Mouth_Tighten(抿嘴)、Mouth_Push(亲亲嘴)、Mouth_Pull(内收嘴)、Mouth_Up/Down/L/R(嘴整体上下左右)、Mouth_Down_Lower(下嘴唇向下)、Mouth_Chin_Up(下嘴唇向上)。此处比较多就不截图了

【脸颊】
注意:
LiveLinkFce的Arkit与Character Creator动画曲线的对接_第19张图片

由于Arkit没有把cheekPuff(充气脸)分成左右,需要在动画图表去设置
LiveLinkFce的Arkit与Character Creator动画曲线的对接_第20张图片
Arkit与CC缺少的对接参数:Cheek_Suck(吸气脸)

【鼻子】
除了Nose_Sneer(嘲笑鼻),Arkit都没有其他的对接参数
LiveLinkFce的Arkit与Character Creator动画曲线的对接_第21张图片

【舌头】
除了Tongue_Out(伸出舌头),Arkit都没有其他的对接参数LiveLinkFce的Arkit与Character Creator动画曲线的对接_第22张图片

【耳朵】
Arkit都没有对接参数
LiveLinkFce的Arkit与Character Creator动画曲线的对接_第23张图片
【其他】有时间再研究。。

你可能感兴趣的:(UE4,蓝图,动画,ue4,虚幻)