目标:

  • 医生透过电 脑仿真技术,基于MRI扫描数据来建立虚拟的乳腺及病症模型。然后,标示出手术的计划和应变设想。经由一群医师会诊后,以更高质量、更低风险的途径来执行全新的手术计划。

  • 例如,我在进行的内容开发时,就透过精密的医疗MRI扫描真实乳房线体(含肿瘤),取得MRI产出的DICOM三维模型作为我的<乳腺素材>,再经过3D Slicer等工具准确转换成为Unity 3D能接受的,才能制作出一个几可乱真,但又不失真的VR应用(App),来精确地引导医生的手术进行。

      

认识MRI医疗素材:

  • 素材就是从真实(珍珠)加以萃取出来的要素。要素就是必要的、本质性(Essential) 的元素或材料。

  • 根据牛津字典的解释,"Essential" 这个字的涵义是:不可或缺的。也就是,我们常说的:本质的。

  • 所以VR内容开发即是:从真实(TR)中萃取本质性的素材,以此素材为中心,发挥想象力,创作一个精彩耀眼的非实(VR)来激励人心,启迪心灵,寓教于乐。

  • 例如,我在进行的内容开发时,就透过精密的医疗MRI扫描真实乳房线体(含肿瘤),取得MRI产出的DICOM三维模型作为我的<乳腺素材>,再经过3D Slicer等工具准确转换成为Unity 3D能接受的,才能制作出一个几可乱真,但又不失真的VR应用(App),来精确地引导医生的手术进行。

基本制作途径: 

  • MRI(DICOM)>解析并迭加信息一>医师判读并迭加信息一>VR素材(例如U3D可演示渲染)。 

  • 例如,可参考:

        https://www.youtube.com/watch?v=1grpd8HASMU

        https://www.youtube.com/watch?v=DH34mASfbTo

        https://www.youtube.com/watch?v=tsgGOlGYf6Q

 

范例观摩(1):3D Printing from MRI data in 5 steps 

  • Software Needed (free):
    Step-1、OsiriX (Mac only), Invesalius, 3D Slicer, Seg3D, or ImageVis3D - To get the MRI data into a mode
    Step-2、Meshlab, Netfabb, or MeshMixer- To fix the Model so that it can print

  • MRI--->VR, 只需要上面的Step-1即可,不需要Step-2(专为3D Printing)。

  • 参考:http://www.instructables.com/id/3D-Printing-from-MRI-data-in-5-steps/

 

范例观摩(2):Look into your brain with VR - Visualizing MRI with Oculus Rift and Razer Hydra

  • This is awesome! Arguably the best MRI visualisation method using VR I have seen so far and interesting for research. 

  • How do you get the MRI p_w_picpathry organized into slices in unity?

  • "I plan to ask author of Inside Insides if I can use his scans and bundle them with the demo, but I'll definitely release the functionality where you can take any GIF or list of p_w_picpaths and it'll make a 3D texture out of it for visualization using my volume rendering shader."

  • "I didn't get it organized into slices, that's not how it works. I create a 3D texture from the slices and then I sample it using a volume sampling method in the fragment shader."

  • "It's not your classical voxel rendering (where you can see little cubes), it essentially ray-marches through the 3D texture, accumulating color at each point of the volume along the direction from the camera for each fragment."

  •  参考:https://www.reddit.com/r/oculus/comments/3g7cnc/look_into_your_brain_with_vr_visualizing_mri_with/

 

~ End ~