Student creates VR experience to interrogate the human brain


Biomedical Engineering student from Portugal, Filipe Rodrigues has combined the Unity game engine, a Leap Motion and an Oculus Rift for one amazing experience. It’s part of a master’s thesis and called Brain Connectivity.

The app allows you to interact with a 3D Reconstruction of an actual human Brain and its underlying Network of Connectivity Graphs. You can “disturb” the human Connectome either as a whole, or as a set of structural and functional segments.

  • Actual Reconstructions: Both the Brain mesh and the Network of Connectivity Graphs were calculated using real medical images and the Multimodal Brain Connectivity Analysis (MIBCA) toolbox. The brain model was reconstructed from Magnetic Resonance Images processed using MIBCA-pipelined Freesurfer and the graphs were computed from Diffusion Tensor Imaging based tractography data processed using MIBCA-pipelined Diffusion Toolkit / Trackvis and Brain Connectivity Toolbox;
  • Gesture Recognition: Allows for a pretty reliable recognition of the Trigger (thumb tip touching index base while index is extended) and Pinch (thumb tip touching index tip while middle and ring finger are extended);
  • Widgets: Sliders & Scrollers from the standard core assets. Can be hidden / displayed at run time;
  • Leap Interaction: One & Two Handed Interaction;
  • Custom made Affordances for most of the implemented features;
  • VR Support: Though this is not as tested as the non-VR version;


If you have the hardware, this project is available to download and try for yourself from Leap Motion’s developer portal.

More information at Leap Motion.

Posted in:
This post is authored by techAU staffers. Used rarely and sparingly when the source decided to keep their identity secret, or a guest author who isn't seeking credit.

Leave a Reply


Must Read

Latest Reviews