- 标题
- 摘要
- 关键词
- 实验方案
- 产品
-
Assessing hands-free interactions for VR using eye gaze and electromyography
摘要： With the increasing popularity of virtual reality (VR) technologies, more efforts have been going into developing new input methods. While physical controllers are widely used, more novel techniques, such as eye tracking, are now commercially available. In our work, we investigate the use of physiological signals as input to enhance VR experiences. We present a system using gaze tracking and electromyography on a user’s forearm to make selection tasks in virtual spaces more efficient. In a study with 16 participants, we compared five different input techniques using a Fitts’ law task: Using gaze tracking for cursor movement in combination with forearm contractions for making selections was superior to using an HTC Vive controller, Xbox gamepad, dwelling time, and eye-gaze dwelling time. To explore application scenarios and collect qualitative feedback, we further developed and evaluated a game with our input technique. Our findings inform the design of applications that use eye-gaze tracking and forearm muscle movements for effective user input in VR.
关键词： Eye gaze,Electromyography,Virtual reality,Physiological sensing
更新于2025-09-10 09:29:36
-
[ACM Press the 3rd International Workshop - Seoul, Republic of Korea (2018.10.22-2018.10.22)] Proceedings of the 3rd International Workshop on Multimedia Alternate Realities - AltMM'18 - Refocusing Supports of Panorama Light-Field Images in Head-Mounted Virtual Reality
摘要： Virtual Reality (VR) has been deeply researched in recent years, although the novel technology delivers some astonishing experience, it may also cause people the sense of imbalance, dizziness, and vomiting when wearing head-mounted displays (HMDs) after a long period of time. In this paper, we combine the light field technology into a novel panorama viewing system implemented on Unity to provide dynamic depth of field and natural focus effect for better user experience. The system is also coped with FOVE, an HMD with eye-tracking technology, to better track the eye movements and collect the gazing parameters, e.g., gazing point, for better user experience. With such a design, a more immersive panorama image/video viewing experience is delivered. An evaluation is held for the user experience, which shows that our proposed system reduces the refocusing time by up to 319 times and increases the subjective Mean Opinion Score (MOS) by 19%.
关键词： eye-tracker,Virtual reality,head-mounted displays,light field
更新于2025-09-10 09:29:36
-
Real-time body tracking in virtual reality using a Vive tracker
摘要： Due to recent improvements in virtual reality (VR) technology, the number of novel applications for entertainment, education, and rehabilitation has increased. The primary goal of these applications is to enhance the sense of belief that the user is “present” in the virtual environment. By tracking the user’s skeleton in real-time, it is possible to synchronize the avatar’s motions with the user’s motions. Although current common devices implement body tracking to a certain degree, most approaches are limited by either high latency or insufficient accuracy. Due to the lack of positional and rotation data, the current VR applications typically do not represent the user’s motions. In this paper, we present an accurate, low-latency body tracking approach for VR-based applications using Vive Trackers. Using a HTC Vive headset and Vive Trackers, we have been able to create an immersive VR experience, by animating the motions of the avatar as smoothly, rapidly and as accurately as possible. An evaluation showed our solution is capable of tracking both joint rotation and position with reasonable accuracy and a very low end-to-latency of 6.71 ± 0.80 ms . Due to this merely imperceptible delay and precise tracking, our solution can show the movements of the user in real-time in order to create deeper immersion.
关键词： Full-body avatar,Real-time tracking,Inverse kinematics,Low-latency,Virtual reality,HTC Vive tracker
更新于2025-09-10 09:29:36
-
Research and Implementation of Instrument System on a Light-Duty Electric Aircraft Simulator
摘要： Considering the demands of the instrument system on a light-duty electric aircraft simulator, a semi-physical simulation instrument system, which is based on virtual reality and microcontroller technologies, is designed and implemented. Meanwhile, some key technologies are discussed and a general development method is put forward in this paper. After being completed, this simulated instrument system is connected with the flight-computing system to test its performances. The results show that it has real effect, stable operation and real time response. In practice, the instrument system not only meets the demands of the light-duty electric aircraft simulator, but also can be seen as a certain reference to develop the instrument system of other aircraft simulators.
关键词： instrument system,semi-physical simulation,light-duty electric aircraft simulator,virtual reality,microcontroller technologies
更新于2025-09-10 09:29:36
-
Augmented Reality to Localize Individual Organ in Surgical Procedure
摘要： Objectives: Augmented reality (AR) technology has become rapidly available and is suitable for various medical applications since it can provide effective visualization of intricate anatomical structures inside the human body. This paper describes the procedure to develop an AR app with Unity3D and Vuforia software development kit and publish it to a smartphone for the localization of critical tissues or organs that cannot be seen easily by the naked eye during surgery. Methods: In this study, Vuforia version 6.5 integrated with the Unity Editor was installed on a desktop computer and configured to develop the Android AR app for the visualization of internal organs. Three-dimensional segmented human organs were extracted from a computerized tomography file using Seg3D software, and overlaid on a target body surface through the developed app with an artificial marker. Results: To aid beginners in using the AR technology for medical applications, a 3D model of the thyroid and surrounding structures was created from a thyroid cancer patient’s DICOM file, and was visualized on the neck of a medical training mannequin through the developed AR app. The individual organs, including the thyroid, trachea, carotid artery, jugular vein, and esophagus were localized by the surgeon’s Android smartphone. Conclusions: Vuforia software can help even researchers, students, or surgeons who do not possess computer vision expertise to easily develop an AR app in a user-friendly manner and use it to visualize and localize critical internal organs without incision. It could allow AR technology to be extensively utilized for various medical applications.
关键词： Thyroidectomy,Augmented Reality,Three-Dimensional Imaging,Virtual Reality,Medical Education
更新于2025-09-09 09:28:46
-
[IEEE 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) - Tuebingen/Reutlingen, Germany (2018.3.18-2018.3.22)] 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) - Evaluating the Effectiveness of Head-Mounted Display Virtual Reality (HMD VR) Environment on Students' Learning for a Virtual Collaborative Engineering Assembly Task
摘要： The emerging VR social networks (e.g., Facebook Spaces, Rec Room) provide opportunities for engineering faculties to design collaborative virtual engineering their classroom instruction with HMD VR system. However, we do not how this capacity will affect students’ learning and their professional skills (e.g., communication and collaboration). The proposed study is expected to fill this research gap and will use a mixed-methods design to explore students’ performance and learning outcomes in a virtual collaborative automotive assembly task. The quantitative data will be collected from the pre-and-post task survey and the task itself. This data will be used to analyze the differences among experiment and control groups. Students’ responses to the open questions in the post-task survey will serve as triangulation and provide deep insight for the quantitative results. The study is expected to not only contribute to the research field but also benefit different stakeholders in the engineering education systems.
关键词： collaborative learning,engineering education,virtual reality,head-mounted display
更新于2025-09-09 09:28:46
-
[ACM Press SIGGRAPH Asia 2018 Virtual & Augmented Reality - Tokyo, Japan (2018.12.04-2018.12.07)] SIGGRAPH Asia 2018 Virtual & Augmented Reality on - SA '18 - Flow zone
摘要： Many people want to live a happy and fulfilling life, yet finding this positive sense of well-being is often quite a challenge. Flow is a wonderfully powerful experience that not only feels amazing in the moment but actually improves a person’s general sense of well-being as well. It seems like a great answer to this problem, but unfortunately the complex concoction of parameters necessary to enter flow prevent the experience from occurring regularly. Flow Zone aims to lower the barrier to entry with its sophisticated design tailored to maximize potential for flow. VR was used as the medium to create an immersive environment that simultaneously removes distractions and focuses the player’s attention on the task at hand. The enhanced immersiveness of cross-modality combined with game design elements centered around creative expression through music creates a streamlined pathway to the flow state.
关键词： Immersion,Cross-Modality,Music,Positive Technology,Flow,Virtual Reality,Well-Being
更新于2025-09-09 09:28:46