3D Érzékelés és Mobilrobotika Kutatócsoport

Virtuális valóság rendszerek

One of our principal research areas is the creation of Virtual and Augmented Reality systems (VR/AR). These systems offer completely new modes of man-machine interaction, allowing for the creation of a great variety of ergonomic interfaces. VR and AR systems employ results from a versatile set of research areas, including the research of input and display devices, sensor technologies and computer vision. Our lab has several research projects, including a VR computer control framework that allows the users to control VR or Ar applications, using different input devices, such as the Kinect, Leap Motion or a VR pen. We are also researching Adaptive Tangible Augmented Reality (ATAR) for automatic virtual scene setup.

Tangible Augmented Reality - Our main research goal is to create an automatic object pairing for TAR systems based on shape information. The idea is to pair real and virtual objects that are similar in shape, since this way the visual and tangible experience will be as similar as possible. The pairing method uses only natural visual features, no artificial markers are required. Moreover, our algorithm is also able to take scene-level requirements into account. These requirements are usually unique to the TAR environment (such as the required number of certain virtual objects, or some objects being complimentary/exclusive).

Virtual Reality Interfaces - In the last few decades computers have become an integral part of our work and lives. For this reason, the development of new, more powerful and ergonomic man-machine interfaces is incredibly important. With the recent advances in sensor technology and computation, we have seen an increase of refined input devices for Virtual Reality systems, which can be used for computer control. In our lab, we have a VR system that allows users to interact with desktop applications using several different input sensors. Our system uses a Christie DHD550-G 3D projector to create a spatial user experience.

Mobile VR Controller - In the recent years several different concepts were established for creating virtual reality controllers and frameworks, many of which are available as a commercial product, such as the HTC Vive or the Oculus Rift. The former uses the approach called inside-out, where cameras integrated into the HMD (Head Mounted Display) are responsible for position and orientation estimation whilst in the case of the Oculus Rift a separate camera unit serves these purposes, which is called outside-in.