论文标题
增强的原型学习,用于激光雷达语义分割中无监督的域的适应性
Enhanced Prototypical Learning for Unsupervised Domain Adaptation in LiDAR Semantic Segmentation
论文作者
论文摘要
尽管它很重要,但无监督的域适应性(UDA)对LIDAR语义细分是一项任务,但并未受到研究界的关注。直到最近,已经提出了一种基于完成的3D方法来解决该问题并正式设置自适应方案。但是,所提出的管道是复杂的,基于体素的,需要多阶段的推断,这抑制了实时推断。我们提出了一种基于图像的,有效且有效的方法,用于求解LiDAR分割的UDA。该方法利用类原型从源域到伪标签目标域像素,这是一个研究方向,显示了自然图像语义分割的UDA良好性能。由于在激光雷达分割设置中无法使用的严重域移动和缺乏预训练的特征提取器,因此未考虑将这种方法应用于LiDAR扫描。但是,我们表明,基于与原型距离的距离,包括基于重建的预训练,增强的原型和选择性的伪标记,足以实现原型方法的使用,适当的策略。我们在最近提出的激光雷达分段UDA方案上评估了方法的性能。我们的方法在当代方法中取得了显着的性能。
Despite its importance, unsupervised domain adaptation (UDA) on LiDAR semantic segmentation is a task that has not received much attention from the research community. Only recently, a completion-based 3D method has been proposed to tackle the problem and formally set up the adaptive scenarios. However, the proposed pipeline is complex, voxel-based and requires multi-stage inference, which inhibits it for real-time inference. We propose a range image-based, effective and efficient method for solving UDA on LiDAR segmentation. The method exploits class prototypes from the source domain to pseudo label target domain pixels, which is a research direction showing good performance in UDA for natural image semantic segmentation. Applying such approaches to LiDAR scans has not been considered because of the severe domain shift and lack of pre-trained feature extractor that is unavailable in the LiDAR segmentation setup. However, we show that proper strategies, including reconstruction-based pre-training, enhanced prototypes, and selective pseudo labeling based on distance to prototypes, is sufficient enough to enable the use of prototypical approaches. We evaluate the performance of our method on the recently proposed LiDAR segmentation UDA scenarios. Our method achieves remarkable performance among contemporary methods.