论文标题
保持真实：虚拟现实中真实现实的窗口
Keep It Real: a Window to Real Reality in Virtual Reality
论文作者
论文摘要
本文在虚拟现实（VR）环境中提出了一个新的交互范式，该范式由投影到虚拟表面上的虚拟镜像或窗口组成，代表反映现实世界的镜像或窗口的正确透视几何形状。该技术可以应用于各种视频，实时流媒体应用程序，增强和虚拟现实设置，以提供交互式和沉浸式的用户体验。为了支持这种透视图准确的表示形式，我们实现了计算机视觉算法，以进行功能检测和对应关系匹配。为了限制解决方案，我们将一个自动调整缩放因子纳入了临时矩阵上，以使每个图像框架都遵循与用户的平稳过渡。该系统是一个实时渲染框架，用户可以在虚拟空间中与现实生活中的存在相关。
This paper proposed a new interaction paradigm in the virtual reality (VR) environments, which consists of a virtual mirror or window projected onto a virtual surface, representing the correct perspective geometry of a mirror or window reflecting the real world. This technique can be applied to various videos, live streaming apps, augmented and virtual reality settings to provide an interactive and immersive user experience. To support such a perspective-accurate representation, we implemented computer vision algorithms for feature detection and correspondence matching. To constrain the solutions, we incorporated an automatically tuning scaling factor upon the homography transform matrix such that each image frame follows a smooth transition with the user in sight. The system is a real-time rendering framework where users can engage their real-life presence with the virtual space.
