Virtual Reality (VR) Collaboration Study
A learning community (LC) is a group of people who share common academic goals and attitudes, who meet semi-regularly to collaborate on classwork. These groups are documented to provide significant positive impact on the participating students’ academic performance. Virtualizing LCs has the potential to expand and supplement existing learning structures, and create new ones where they were not previously available. Our project will evaluate the impact that virtualization has on LCs. This research will lead to a better understanding of the strengths and limitation of introducing VR technologies in higher education. Presenting institutions with data about virtualization technologies that have their impact and benefits well-researched will ease the reservations that administrators and other stakeholders might have.
We are currently developing the VR and physical collaboration curriculum for public release and working on the paper.
High School VR Computer Science Curriculum
We are currently funded by NJ Department of Education for development of secondary VR curriculum for national release. Curriculum will be developed for the Elizabeth, NJ, and through Oculus Education, the Seattle, WA school systems. Curriculum will be publicly released for any school system to incorporate and any educator to add new curriculum. We are currently focused on 3D and VR development with C# in the Unity game engine. We have just started to develop the curriculum and test it in class before handing the material to the high school curriculum developers to refine for their educational needs. The first three weeks of curriculum is to build a painting application. The demo WebGL build for this sprint is below, the code is here on GitHub, and the lecture videos are here on YouTube.
Unity Emulation Environment for Mobile VR
Unity editor emulation environment for developers to test out mobile VR experiences quickly on editor play mode without having to use a desktop VR headset to try out the experience. Its an early work in progress. Goal is to decouple the scripts from Oculus SDK scripts to make it a plug and play Unity package, and make it easy to build for both Mobile VR applications and WebGL demos. WebGL build is below.
Mobile VR Open House Demo
GitHub Repo | WebGL demo March 2019
GearVR experience for NJIT College of Computing open houses. Its meant to demonstrate aspects of programmatic thinking to prospective programming students and their parents in a gamified manner. Experience is 3 levels of controlling a space exploration vessel through the solar system to Mars.
VR User Experience (UX) Investigation Tool
A reasonably self-contained, extensible Unity package that can be brought into Unity-developed, Android-deployed virtual reality applications for the purposes of investigating Human Computer Interaction through time-stamped records of user activity, visually recorded samples of the interaction and audio recordings of any comments the user may have made during the application usage. Meant to solve the following problem:
When users attempt to examine our virtual reality applications, they are limited by the inherent constraints of virtual reality, and the difficulty of gathering time-sensitive perceptions. Within the controlled environment of the lab there are techniques and technologies which can catch these perceptions, but in the field, it is not possible to gather the depth of information required to examine the user experience at a later time. Additionally, it can be difficult to determine what analytics ultimately need to be accounted for (and therefore which records need to be retained) during the virtual reality application experience.
VR Eye Tracking Therapy Game
GitHub repo and WebGL playable demo ETA March 2019
Haunted Seas is a VR vision therapy game, designed to enhance patient compliance in young patients when undergoing therapy for a condition called Convergence Insufficiency Syndrome. I designed the requirements for implementing the analog vision therapy into a VR vision therapy game, developed the application with C# in Unity, and conducted user testing for iterative sprint development. The game mechanics were designed to use eye tracking in VR using the Fove headset, and was designed to engage the patient with repeated eye rotations. The VR therapy was tested at the Philadelphia Children’s Hospital and was proven to be effective in improving both the therapy experience and recover rate for patients. It has recently won the European Auggie Award for “Most Innovative Breakthrough” at the 2018 AWE (Augmented World Expo) EU conference.
Research award video including some explanation of my role on the project.
Demo video of the VR vision therapy game with eye tracking disabled. Game mechanics are simplified and sped up to demo one hour therapy in a few minutes. Audio is placeholder and was replaced in final version.
VR User Interface and Experience (UI/UX) Prototyping
GitHub repo and WebGL demo ETA March 2019
Prototyped 3D UI/UX concepts communicating product team wireframes to development team at YouVisit LLC
Developed interactive VR experiences with C# in Unity for Daydream, GearVR, and Cardboard
Designed 3D content for mixing CG and video content into interactive VR experiences