论文标题
CASNET:图像实例和全景分割的常见属性支持网络
CASNet: Common Attribute Support Network for image instance and panoptic segmentation
论文作者
论文摘要
近年来,实例细分和全景细分被越来越关注。与基于边界框的对象检测和语义分割相比,实例分割可以在像素级别提供更多的分析结果。考虑到属于一个实例的像素具有当前实例的一个或多个常见属性的见解,我们提出了一个名为COONLIBET属性支持网络(CASNET)的一个阶段实例分割网络,该网络通过预测和群集共同属性来实现实例分割。 Casnet以完全卷积的方式设计,可以从头到尾实施培训和推断。 CASNET管理没有重叠和孔的实例,这在当前实例分割算法中存在问题。此外,通过很少的计算开销,可以轻松地将其扩展到泛滥分割。 Casnet在语义和实例分段之间建立了一个桥梁,从查找像素类ID到通过对公共属性的操作获取类和实例ID。通过实验和全景分割,Casnet通过联合培训获得了CASNET在CityScapes验证数据集上获得32.8%和PQ 59.0%,并通过分离训练模式获得36.3%和PQ 66.1%。对于全景细分,CASNET在CityScapes验证数据集上获得最先进的性能。
Instance segmentation and panoptic segmentation is being paid more and more attention in recent years. In comparison with bounding box based object detection and semantic segmentation, instance segmentation can provide more analytical results at pixel level. Given the insight that pixels belonging to one instance have one or more common attributes of current instance, we bring up an one-stage instance segmentation network named Common Attribute Support Network (CASNet), which realizes instance segmentation by predicting and clustering common attributes. CASNet is designed in the manner of fully convolutional and can implement training and inference from end to end. And CASNet manages predicting the instance without overlaps and holes, which problem exists in most of current instance segmentation algorithms. Furthermore, it can be easily extended to panoptic segmentation through minor modifications with little computation overhead. CASNet builds a bridge between semantic and instance segmentation from finding pixel class ID to obtaining class and instance ID by operations on common attribute. Through experiment for instance and panoptic segmentation, CASNet gets mAP 32.8% and PQ 59.0% on Cityscapes validation dataset by joint training, and mAP 36.3% and PQ 66.1% by separated training mode. For panoptic segmentation, CASNet gets state-of-the-art performance on the Cityscapes validation dataset.