- 标题
- 摘要
- 关键词
- 实验方案
- 产品
-
[IEEE 2019 International Conference on Optical MEMS and Nanophotonics (OMN) - Daejeon, Korea (South) (2019.7.28-2019.8.1)] 2019 International Conference on Optical MEMS and Nanophotonics (OMN) - Metasurfaces for Display and Imaging Applications
摘要： Metasurfaces composed of subwavelength nanostructures have shown unprecedented abilities to control electromagnetic waves, and have been expected to be applied for the next generation imaging devices. In this keynote talk, general introduction of optical metasurfaces will be introduced with their physical instruments and applications. Then, we will discuss recent advances on metasurface applications for holography and augmented reality. In particular, full complex-amplitude modulated holograms and ultra-wide augmented reality imaging will be mainly discussed with our theoretical and experimental demonstrations. Our perspectives for the future of this area will also be discussed.
关键词： Metasurface,Augmented Reality,Optical display,Holography
更新于2025-09-16 10:30:52
-
AR Enabled IoT for a Smart and Interactive Environment: A Survey and Future Directions
摘要： Accompanying the advent of wireless networking and the Internet of Things (IoT), traditional augmented reality (AR) systems to visualize virtual 3D models of the real world are evolving into smart and interactive AR related to the context of things for physical objects. We propose the integration of AR and IoT in a complementary way, making AR scalable to cover objects everywhere with an acceptable level of performance and interacting with IoT in a more intuitive manner. We identify three key components for realizing such a synergistic integration: (1) distributed and object-centric data management (including for AR services); (2) IoT object-guided tracking; (3) seamless interaction and content interoperability. We survey the current state of these respective areas and herein discuss research on issues about realizing a future smart and interactive living environment.
关键词： augmented reality,Internet of Things,interaction,IoT,markerless,tracking,AR,marker
更新于2025-09-16 10:30:52
-
AR HMD Guidance for Controlled Hand-Held 3D Acquisition
摘要： Photogrammetry is a popular method of 3D reconstruction that uses conventional photos as input. This method can achieve high quality reconstructions so long as the scene is densely acquired from multiple views with sufficient overlap between nearby images. However, it is challenging for a human operator to know during acquisition if sufficient coverage has been achieved. Insufficient coverage of the scene can result in holes, missing regions, or even a complete failure of reconstruction. These errors require manually repairing the model or returning to the scene to acquire additional views, which is time-consuming and often infeasible. We present a novel approach to photogrammetric acquisition that uses an AR HMD to predict a set of covering views and to interactively guide an operator to capture imagery from each view. The operator wears an AR HMD and uses a hand held camera rig that is tracked relative to the AR HMD with a fiducial marker. The AR HMD tracks its pose relative to the environment and automatically generates a coarse geometric model of the scene, which our approach analyzes at run time to generate a set of human-reachable acquisition views covering the scene with consistent camera-to-scene distance and image overlap. The generated view locations are rendered to the operator on the AR HMD. Interactive visual feedback informs the operator how to align the camera to assume each suggested pose. When the camera is in range, an image is automatically captured. In this way, a set of images suitable for 3D reconstruction can be captured in a matter of minutes. In a user study, participants who were novices at photogrammetry were tasked with acquiring a challenging and complex scene either without guidance or with our AR HMD based guidance. Participants using our guidance achieved improved reconstructions without cases of reconstruction failure as in the control condition. Our AR HMD based approach is self-contained, portable, and provides specific acquisition guidance tailored to the geometry of the scene being captured.
关键词： Augmented reality,photogrammetry,3D reconstruction,head-mounted display
更新于2025-09-16 10:30:52
-
Transparent multispectral photodetectors mimicking the human visual system
摘要： Compact and lightweight photodetection elements play a critical role in the newly emerging augmented reality, wearable and sensing technologies. In these technologies, devices are preferred to be transparent to form an optical interface between a viewer and the outside world. For this reason, it is of great value to create detection platforms that are imperceptible to the human eye directly onto transparent substrates. Semiconductor nanowires (NWs) make ideal photodetectors as their optical resonances enable parsing of the multi-dimensional information carried by light. Unfortunately, these optical resonances also give rise to strong, undesired light scattering. In this work, we illustrate how a new optical resonance arising from the radiative coupling between arrayed silicon NWs can be harnessed to remove reflections from dielectric interfaces while affording spectro-polarimetric detection. The demonstrated transparent photodetector concept opens up promising platforms for transparent substrates as the base for opto-electronic devices and in situ optical measurement systems.
关键词： augmented reality,wearable technologies,transparent photodetectors,silicon nanowires,spectro-polarimetric detection
更新于2025-09-12 10:27:22
-
Study on Compact Head-Mounted Display System Using Electro-Holography for Augmented Reality
摘要： Head-mounted displays (HMDs) and augmented reality (AR) are actively being studied. However, ordinary AR HMDs for visual assistance have a problem in which users have di?culty simultaneously focusing their eyes on both the real target object and the displayed image because the image can only be displayed at a ?xed distance from an user’s eyes in contrast to where the real object three-dimensionally exists. Therefore, we considered incorporating a holographic technology, an ideal three-dimensional (3D) display technology, into an AR HMD system. A few studies on holographic HMDs have had technical problems, and they have faults in size and weight. This paper proposes a compact holographic AR HMD system with the purpose of enabling an ideal 3D AR HMD system which can correctly reconstruct the image at any depth. In this paper, a Fourier transform optical system (FTOS) was implemented using only one lens in order to achieve a compact and lightweight structure, and a compact holographic AR HMD system was constructed. The experimental results showed that the proposed system can reconstruct sharp images at the cor- rect depth for a wide depth range. This study enabled an ideal 3D AR HMD system that enables simultaneous viewing of both the real target object and the reconstructed image without feeling visual fatigue.
关键词： augmented reality,electro-holography,head-mounted display,computer-generated hologram
更新于2025-09-12 10:27:22
-
46.2: <i>Invited Paper:</i> The Development of Grating Waveguide Technology for Near‐Eye Display in Augmented Reality
摘要： Augmented Reality (AR) is generally considered as the next generation computing platform after PC and smart phones, with extensive applications and colossal market capacity. As the most essential hardware of AR wearables, the Near-Eye Display (NED) system determines the final pattern of the product. In this paper, the NED solutions of mainstream AR eyewares are discussed, and the advantages and disadvantages of prism, freeform, arrayed waveguide and grating waveguide, the four popular technologies in NED of AR, are compared. Based on above information, the strengths of grating waveguide in AR products are analyzed, the principles and processing technology are introduced, and the prospect of grating waveguide to be the future of NED in AR is proposed.
关键词： grating waveguide,augmented reality,near-eye display
更新于2025-09-12 10:27:22
-
3.1: <i>Invited Paper:</i> OLED Micro‐displays for VR/AR Applications
摘要： OLED Micro-displays with single crystal silicon (CMOS) backplane for VR and AR applications will be discussed. An overview of the OLED micro-display market size and requirements followed by the fabrication process, as it exists today, will be first discussed. The requirement of high brightness micro-displays for both VR and AR applications will be discussed. Recent development of a high brightness (greater than 7,000 cd/m2) full color 1920x1200 and 2Kx2K resolution OLED micro-displays at eMagin Corporation will be discussed. The performance details of this high resolution high brightness OLED micro-display will be presented.
关键词： high resolution,virtual reality,AMOLED,microdisplay,head-mounted display,augmented reality,OLED
更新于2025-09-11 14:15:04
-
Augmented Reality (Reflections on Its Contribution to Knowledge Formation) || Augmented Reality and Augmented Perception
摘要： In this paper I argue that the term ‘Augmented Reality’ as a description of technologies that informationally augment our perception is misleading and possibly harmful. The paper begins with a characterization of the concept of ‘reality’ and describes three different philosophical phenomena that could be accurately described as ‘Augmented Reality’. The first section discusses the poet Wallace Stevens’ notion of how the poetic imagination can enrich our reality. The second section looks at the “sensibility theory” of moral and aesthetic value associated with McDowell and Wiggins, which is meant to explain how anthropocentric but objectively real values can enter into a naturalistic world. The third section examines Wittgenstein’s notion that someone who ceases laying down conditions upon the world and learns to accept it has enriched their reality. A fourth section then examines the claim of Augmented Reality technologies to be an ‘augmentation of reality’. I argue that the term reflects a dangerous confusion. When we see these technologies in contrast with the three different notions of what ‘augmenting reality’ discussed in the first three sections, we see that while Augmented Reality technologies can be incredibly useful and to that extent valuable, they also threaten to diminish our reality. The conflation of truly Augmented Reality with a technological augmentation of our perception is a moral temptation that we should avoid.
关键词： Wiggins,Wallace Stevens,McDowell,Augmented Reality,minimalist theory of truth,Wittgenstein,sensibility theory
更新于2025-09-11 14:15:04
-
CIGuide: in situ augmented reality laser guidance
摘要： Purpose A robotic intraoperative laser guidance system with hybrid optic-magnetic tracking for skull base surgery is presented. It provides in situ augmented reality guidance for microscopic interventions at the lateral skull base with minimal mental and workload overhead on surgeons working without a monitor and dedicated pointing tools. Methods Three components were developed: a registration tool (Rhinospider), a hybrid magneto-optic-tracked robotic feedback control scheme and a modi?ed robotic end-effector. Rhinospider optimizes registration of patient and preoperative CT data by excluding user errors in ?ducial localization with magnetic tracking. The hybrid controller uses an integrated microscope HD camera for robotic control with a guidance beam shining on a dual plate setup avoiding magnetic ?eld distortions. A robotic needle insertion platform (iSYS Medizintechnik GmbH, Austria) was modi?ed to position a laser beam with high precision in a surgical scene compatible to microscopic surgery. Results System accuracy was evaluated quantitatively at various target positions on a phantom. The accuracy found is 1.2 mm ± 0.5 mm. Errors are primarily due to magnetic tracking. This application accuracy seems suitable for most surgical procedures in the lateral skull base. The system was evaluated quantitatively during a mastoidectomy of an anatomic head specimen and was judged useful by the surgeon. Conclusion A hybrid robotic laser guidance system with direct visual feedback is proposed for navigated drilling and intraoperative structure localization. The system provides visual cues directly on/in the patient anatomy, reducing the standard limitations of AR visualizations like depth perception. The custom- built end-effector for the iSYS robot is transparent to using surgical microscopes and compatible with magnetic tracking. The cadaver experiment showed that guidance was accurate and that the end-effector is unobtrusive. This laser guidance has potential to aid the surgeon in ?nding the optimal mastoidectomy trajectory in more dif?cult interventions.
关键词： Optical tracking,Magnetic tracking,Augmented reality,Navigated surgery,Laser guidance,Robotic control,Microscope
更新于2025-09-11 14:15:04
-
Surface Light Field Compression using a Point Cloud Codec
摘要： Light ?eld (LF) representations aim to provide photo-realistic, free-viewpoint viewing experiences. However, the most popular LF representations are images from multiple views. Multi-view image-based representations generally need to restrict the range or degrees of freedom of the viewing experience to what can be interpolated in the image domain, essentially because they lack explicit geometry information. We present a new surface light ?eld (SLF) representation based on explicit geometry, and a method for SLF compression. First, we map the multi-view images of a scene onto a 3D geometric point cloud. The color of each point in the point cloud is a function of viewing direction known as a view map. We represent each view map ef?ciently in a B-Spline wavelet basis. This representation is capable of modeling diverse surface materials and complex lighting conditions in a highly scalable and adaptive manner. The coef?cients of the B-Spline wavelet representation are then compressed spatially. To increase the spatial correlation and thus improve compression ef?ciency, we introduce a smoothing term to make the coef?cients more similar across 3D space. We compress the coef?cients spatially using existing point cloud compression (PCC) methods. On the decoder side, the scene is rendered ef?ciently from any viewing direction by reconstructing the view map at each point. In contrast to multi-view image-based LF approaches, our method supports photo-realistic rendering of real-world scenes from arbitrary viewpoints, i.e., with an unlimited six degrees of freedom (6DOF). In terms of rate and distortion, experimental results show that our method achieves superior performance with lighter decoder complexity compared with a reference image-plus-geometry compression (IGC) scheme, indicating its potential in practical virtual and augmented reality applications.
关键词： point cloud compression,free-viewpoint,full 6DoF,augmented reality,Surface light ?eld,virtual reality
更新于2025-09-10 09:29:36