Student creates VR experience to interrogate the human brain

Biomedical Engineering student from Portugal, Filipe Rodrigues has combined the Unity game engine, a Leap Motion and an Oculus Rift for one amazing experience. It’s part of a master’s...

image

Biomedical Engineering student from Portugal, Filipe Rodrigues has combined the Unity game engine, a Leap Motion and an Oculus Rift for one amazing experience. It’s part of a master’s thesis and called Brain Connectivity.

The app allows you to interact with a 3D Reconstruction of an actual human Brain and its underlying Network of Connectivity Graphs. You can “disturb” the human Connectome either as a whole, or as a set of structural and functional segments.

  • Actual Reconstructions: Both the Brain mesh and the Network of Connectivity Graphs were calculated using real medical images and the Multimodal Brain Connectivity Analysis (MIBCA) toolbox. The brain model was reconstructed from Magnetic Resonance Images processed using MIBCA-pipelined Freesurfer and the graphs were computed from Diffusion Tensor Imaging based tractography data processed using MIBCA-pipelined Diffusion Toolkit / Trackvis and Brain Connectivity Toolbox;
  • Gesture Recognition: Allows for a pretty reliable recognition of the Trigger (thumb tip touching index base while index is extended) and Pinch (thumb tip touching index tip while middle and ring finger are extended);
  • Widgets: Sliders & Scrollers from the standard core assets. Can be hidden / displayed at run time;
  • Leap Interaction: One & Two Handed Interaction;
  • Custom made Affordances for most of the implemented features;
  • VR Support: Though this is not as tested as the non-VR version;

image

If you have the hardware, this project is available to download and try for yourself from Leap Motion’s developer portal.

More information at Leap Motion.

Categories
ARVR