- 标题
- 摘要
- 关键词
- 实验方案
- 产品
-
Pictorial AR Tag with Hidden Multi-Level Bar-Code and Its Potential Applications
摘要： For decades, researchers have been trying to create intuitive virtual environments by blending reality and virtual reality, thus enabling general users to interact with the digital domain as easily as with the real world. The result is “augmented reality” (AR). AR seamlessly superimposes virtual objects on to a real environment in three dimensions (3D) and in real time. One of the most important parts that helps close the gap between virtuality and reality is the marker used in the AR system. While pictorial marker and bar-code marker are the two most commonly used marker types in the market, they have some disadvantages in visual and processing performance. In this paper, we present a novelty method that combines the bar-code with the original feature of a colour picture (e.g., photos, trading cards, advertisement’s ?gure). Our method decorates on top of the original pictorial images additional features with a single stereogram image that optically conceals a multi-level (3D) bar-code. Thus, it has a larger capability of storing data compared to the general 1D barcode. This new type of marker has the potential of addressing the issues that the current types of marker are facing. It not only keeps the original information of the picture but also contains encoded numeric information. In our limited evaluation, this pictorial bar-code shows a relatively robust performance under various conditions and scaling; thus, it provides a promising AR approach to be used in many applications such as trading card games, educations, and advertisements.
关键词： augmented reality,image processing,computer vision
更新于2025-09-10 09:29:36
-
[IEEE 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) - Tuebingen/Reutlingen, Germany (2018.3.18-2018.3.22)] 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) - BrightView: Increasing Perceived Brightness of Optical See-Through Head-Mounted Displays Through Unnoticeable Incident Light Reduction
摘要： Optical See-Through Head-Mounted Displays (OST-HMDs) lose the visibility of virtual contents under bright environment illumination due to their see-through nature. We demonstrate how a liquid crystal (LC) ?lter attached to an OST-HMD can be used to dynamically increase the perceived brightness of virtual content without impacting the perceived brightness of the real scene. We present a prototype OST-HMD that continuously adjusts the opacity of the LC ?lter to attenuate the environment light without users becoming aware of the change. Consequently, virtual content appears to be brighter. The proposed approach is evaluated in psychophysical experiments in three scenes, with 16, 31, and 31 participants, respectively. The participants were asked to compare the magnitude of brightness changes of both real and virtual objects, before and after dimming the LC ?lter over a period of 5, 10, and 20 seconds. The results showed that the participants felt increases in the brightness of virtual objects while they were less conscious of reductions of the real scene luminance. These results provide evidence for the effectiveness of our display design. Our design can be applied to a wide range of OST-HMDs to improve the brightness and hence realism of virtual content in augmented reality applications.
关键词： Interaction paradigms,Interaction devices,Human-centered computing,Mixed/augmented reality,Human computer interaction (HCI),Displays and imagers
更新于2025-09-10 09:29:36
-
41.5: Head-mounted Display Based on Surface Relief Grating for Augmented Reality
摘要： A see-through head-mounted display (HMD) is demonstrated in the paper, which can present the user with information such as virtual symbols or images superimposed over real-world image. To meet the human eyes’ visual requirements under different situations, a large exit pupil of 2 to 5 times of the pupil size (about 2.4 mm) is required. To solve the problem, the HMD presented in the paper is a combination of micro-display of LCoS, imaging eyepiece and an exit pupil expander based on planar waveguide with slanted surface relief grating. Both transmission and reflection gratings are applied in the HMD design. Two system schemes are presented which expand the light only along one direction and two orthogonal directions, respectively. The system configuration and principle of operation are described in the paper.
关键词： exit pupil expander,augmented reality,surface relief grating,head-mounted display
更新于2025-09-10 09:29:36
-
A Geometry-Based Point Cloud Reduction Method for Mobile Augmented Reality System
摘要： In this paper, a geometry-based point cloud reduction method is proposed, and a real-time mobile augmented reality system is explored for applications in urban environments. We formulate a new objective function which combines the point reconstruction errors and constraints on spatial point distribution. Based on this formulation, a mixed integer programming scheme is utilized to solve the points reduction problem. The mobile augmented reality system explored in this paper is composed of the offline and online stages. At the offline stage, we build up the localization database using structure from motion and compress the point cloud by the proposed point cloud reduction method. While at the online stage, we compute the camera pose in real time by combining an image-based localization algorithm and a continuous pose tracking algorithm. Experimental results on benchmark and real data show that compared with the existing methods, this geometry-based point cloud reduction method selects a point cloud subset which helps the image-based localization method to achieve higher success rate. Also, the experiments conducted on a mobile platform show that the reduced point cloud not only reduces the time consuming for initialization and re-initialization, but also makes the memory footprint small, resulting a scalable and real-time mobile augmented reality system.
关键词： augmented reality,point cloud reduction,structure from motion,mobile platform
更新于2025-09-10 09:29:36
-
Augmented Reality to Localize Individual Organ in Surgical Procedure
摘要： Objectives: Augmented reality (AR) technology has become rapidly available and is suitable for various medical applications since it can provide effective visualization of intricate anatomical structures inside the human body. This paper describes the procedure to develop an AR app with Unity3D and Vuforia software development kit and publish it to a smartphone for the localization of critical tissues or organs that cannot be seen easily by the naked eye during surgery. Methods: In this study, Vuforia version 6.5 integrated with the Unity Editor was installed on a desktop computer and configured to develop the Android AR app for the visualization of internal organs. Three-dimensional segmented human organs were extracted from a computerized tomography file using Seg3D software, and overlaid on a target body surface through the developed app with an artificial marker. Results: To aid beginners in using the AR technology for medical applications, a 3D model of the thyroid and surrounding structures was created from a thyroid cancer patient’s DICOM file, and was visualized on the neck of a medical training mannequin through the developed AR app. The individual organs, including the thyroid, trachea, carotid artery, jugular vein, and esophagus were localized by the surgeon’s Android smartphone. Conclusions: Vuforia software can help even researchers, students, or surgeons who do not possess computer vision expertise to easily develop an AR app in a user-friendly manner and use it to visualize and localize critical internal organs without incision. It could allow AR technology to be extensively utilized for various medical applications.
关键词： Thyroidectomy,Augmented Reality,Three-Dimensional Imaging,Virtual Reality,Medical Education
更新于2025-09-09 09:28:46
-
Real World Usability Analysis of two Augmented Reality Headsets in Visceral Surgery
摘要： Background: Recent developments in the field of augmented reality (AR) have enabled new use cases in surgery. Initial set-up of an appropriate infrastructure for maintaining an AR surgical workflow requires investment in appropriate hardware. Methods: We compared the usability of the Microsoft HoloLens and Meta 2 head mounted displays (HMDs). Fifteen medicine students tested each device and were questioned with a variant of the System Usability Scale (SUS). Two surgeons independently tested the devices in an intraoperative setting. Results: In our adapted SUS, ergonomics, ease of use and visual clarity of the display did not differ significantly between HMD groups. The field of view (FOV) was smaller in the Microsoft HoloLens than the Meta 2 and significantly more study subjects (80% vs. 13.3%; p < 0.001) felt limited through the FOV. Intraoperatively, decreased mobility due to the necessity of an AC adapter and additional computing device for the Meta 2 proved to be limiting. Object stability was rated superior in the Microsoft HoloLens than the Meta 2 by our surgeons and lead to increased use. Conclusions: We examined the Meta 2 and the Microsoft HoloLens and found key advantages in the Microsoft HoloLens which provided palpable benefits in a surgical setting.
关键词： augmented reality,visceral surgery,usability,mixed reality,image-assisted surgery
更新于2025-09-09 09:28:46
-
Intraarterial indocyanine green (ICG) fluorescence augmentation by marking embryonal resection areas in colorectal surgery: a feasibility study in a porcine model
摘要： Aim: In this pilot animal study we examined whether it is possible to visualize the embryonal resection layers by using intraarterial indocyanine green (ICG) staining when performing total mesorectal excision (TME) for carcinoma of the rectum. Material and methods: We injected ICG into the inferior mesenteric artery (AMI) of four swines to see whether the watershed area of the arterial supply zone can be sufficiently visualized by fluorescence imaging in order to mark the right dissection area along the fascia parietalis before and during resection. Results: We observed a fluorescence signal in all the supplied areas of AMI but not in other parts of the abdominal cavity or other organs. Additionally, the mesorectum also showed a sharp border between colored and non-colored tissue. Conclusion: In this study we present that resection borders may be determined before resection based on ICG-perfusion and we showed that intra-operative exclusive coloring of the rectum including the mesorectum is possible. Visualizing resection borders based on ICG-perfusion before settling the first cut may be a new approach in oncological surgery.
关键词： CRC,endoscopic surgery,augmented reality,guided surgery,minimal invasive surgery,ICG,TME,colorectal cancer
更新于2025-09-09 09:28:46
-
Integrating Google Glass into simulation-based training: experiences and future directions
摘要： Background: Education experts are starting to explore the potential uses of wearable technology and augmented reality in simulation-based training. In this article, we summarize our experiences with using Google Glass in simulation-based training and discuss potential future directions with this advanced technology. Methods: Emergency medicine residents and medical students participated in a pilot study where each team captain was asked to wear Google Glass during 15 separate simulation-based training sessions. Video obtained from Google Glass was analyzed and utilized during debriefing sessions for the residents and medical students. Results: We were able to successfully integrate Google Glass into simulation-based training and debriefing. During the analysis of each recording, observations were noted about the events that transpired and this data was used to provide instructional feedback to the residents and medical students for self-reflection and appraisal. Post-exercise surveys were conducted after each simulation session and all participants noted that Google Glass did not interfere with their simulation experience. Google Glass enabled the observers to analyze the team captain’s primary visual focus during the entire simulation scenario and feedback was provided based on the data recorded. Conclusions: Wearable technologies such as Google Glass can be successfully integrated into simulation-based training exercises without disrupting the learners’ experience. Data obtained from this integration can be utilized to improve debriefing sessions and self-reflection. Future research is underway and required to evaluate other potential uses for wearable technology in simulation-based training.
关键词： Medical education,Augmented reality,Google Glass,Wearable technology,Simulation-based training
更新于2025-09-09 09:28:46
-
[IEEE 2018 IEEE International Conference on RFID Technology & Application (RFID-TA) - Macau, Macao (2018.9.26-2018.9.28)] 2018 IEEE International Conference on RFID Technology & Application (RFID-TA) - X-Vision: An Augmented Vision Tool with Real-Time Sensing Ability in Tagged Environments
摘要： We present the concept of X-Vision, an enhanced Augmented Reality (AR)-based visualization tool, with the real-time sensing capability in a tagged environment. We envision that this type of a tool will enhance the user-environment interaction and improve the productivity in factories, smart-spaces, home & office environments, maintenance/facility rooms and operation theatres, etc. In this paper, we describe the design of this visualization system built upon combining the object’s pose information estimated by the depth camera and the object’s ID & physical attributes captured by the RFID tags. We built a physical prototype of the system demonstrating the projection of 3D holograms of the objects encoded with sensed information like water-level and temperature of common office/household objects. The paper also discusses the quality metrics used to compare the pose estimation algorithms for robust reconstruction of the object’s 3D data.
关键词： Augmented Reality,real-time sensing,pose estimation,3D holograms,RFID
更新于2025-09-09 09:28:46
-
Model-Based Coarse-Fine Virtual Calibration and Visual Servo for Augmented Reality-Assisted Peg-in-Hole Microassembly
摘要： A three-dimensional (3D)-virtual calibration and visual servo are implemented for augmented reality (AR)-assisted peg-in-hole microassembly operations. By employing 3D model and ray casting, the 3D coordinates on virtual mating rod correspondent to the two-dimensional (2D) virtual image points are extracted. The detecting and tracking of image feature points for calibration is carried out by the proposed algorithm of regional template matching (TM) and scanning with edge ?tting (RTM-SEF). For achieving sub-pixel error between the feature points in real and virtual images, a coarse-?ne virtual calibration method is proposed. In regard to the image viewed by the real and virtual cameras, a calibrated virtual camera is utilized to track the mating rod. A visual servo control law including coarse and ?ne tuning is proposed to ensure sub-pixel error between the most important feature point in the real and virtual images. The AR technology is mainly employed in the alignment between micropeg and mating hole for inserting a micropeg of diameter 80 lm with length 1–1.4 mm into a mating rod with 100 lm hole.
关键词： microassembly,visual servo,augmented reality,peg-in-hole,3D-virtual calibration
更新于2025-09-09 09:28:46