论文标题
Gesturelens:演示视频中手势的视觉分析
GestureLens: Visual Analysis of Gestures in Presentation Videos
论文作者
论文摘要
适当的手势可以增强信息传递和在日常沟通和公开演示中的受众参与。在本文中,我们贡献了一种视觉分析方法,该方法通过分析演示视频来帮助专业公开演讲教练改善其手势训练的实践。演示视频中手动检查和探索手势使用通常很乏味且耗时。缺乏一种有效的方法来帮助用户进行手势探索,这是由于手势的内在时间演变及其与语音内容的复杂相关性而具有挑战性的。在本文中,我们提出了一种视觉分析系统Gesturelens,以促进演示视频中基于手势和基于内容的手势使用的探索。具体而言,探索视图使用户可以快速概述手势的空间和时间分布。首先通过手势空间中的热图聚集了动态手机,以揭示空间模式,然后分解为两个相互垂直的时间表,以揭示时间模式。关系视图允许用户通过启用链接的分析和直观的字形设计来明确探索语音内容和手势之间的相关性。视频视图和动态视图分别显示了所选手势的上下文和整体动态运动。对专业演示教练的两种用法场景和专家访谈表明,姿态和有用性在促进示意视频的手势探索和分析中的有效性和实用性。
Appropriate gestures can enhance message delivery and audience engagement in both daily communication and public presentations. In this paper, we contribute a visual analytic approach that assists professional public speaking coaches in improving their practice of gesture training through analyzing presentation videos. Manually checking and exploring gesture usage in the presentation videos is often tedious and time-consuming. There lacks an efficient method to help users conduct gesture exploration, which is challenging due to the intrinsically temporal evolution of gestures and their complex correlation to speech content. In this paper, we propose GestureLens, a visual analytics system to facilitate gesture-based and content-based exploration of gesture usage in presentation videos. Specifically, the exploration view enables users to obtain a quick overview of the spatial and temporal distributions of gestures. The dynamic hand movements are firstly aggregated through a heatmap in the gesture space for uncovering spatial patterns, and then decomposed into two mutually perpendicular timelines for revealing temporal patterns. The relation view allows users to explicitly explore the correlation between speech content and gestures by enabling linked analysis and intuitive glyph designs. The video view and dynamic view show the context and overall dynamic movement of the selected gestures, respectively. Two usage scenarios and expert interviews with professional presentation coaches demonstrate the effectiveness and usefulness of GestureLens in facilitating gesture exploration and analysis of presentation videos.