论文标题
深层融合暹罗网络用于自动亲属验证
Deep Fusion Siamese Network for Automatic Kinship Verification
论文作者
论文摘要
自动亲属验证旨在确定某些人是否属于同一家庭。帮助失踪者与家人团聚是很大的研究意义。在这项工作中,具有挑战性的问题在两个方面逐渐解决。首先,我们提出了一个深厚的暹罗网络,以量化两个个体之间的相对相似性。当给定两个输入面图像时,深暹罗网络会从中提取特征,并通过组合和串联来融合这些特征。然后,将融合的功能馈入完全连接的网络,以获得两个面之间的相似性得分,该面孔用于验证亲属关系。为了提高绩效,还采用了陪审团进行多模型融合。其次,将两个深层的暹罗网络集成到一个深层三重态网络中,以用于三个主体(即父亲,母亲和子女)亲属验证,该验证旨在决定孩子是否与一对父母有关。具体而言,将获得的父子和母子的相似性得分加权以产生亲属验证的亲子相似性评分。认识野外家庭(RFIW)是一项具有挑战性的亲属识别任务,该任务具有多个曲目,该曲目基于野外(FIW)的家庭(FIW),这是一个自动亲属识别的大规模且全面的图像数据库。在正在进行的RFIW2020挑战期间,支持亲属验证(轨道I)和TRI对象验证(轨道II)。我们的团队(USTC-NELSLIP)在赛道II中排名第一,在轨道I中排名第三。
Automatic kinship verification aims to determine whether some individuals belong to the same family. It is of great research significance to help missing persons reunite with their families. In this work, the challenging problem is progressively addressed in two respects. First, we propose a deep siamese network to quantify the relative similarity between two individuals. When given two input face images, the deep siamese network extracts the features from them and fuses these features by combining and concatenating. Then, the fused features are fed into a fully-connected network to obtain the similarity score between two faces, which is used to verify the kinship. To improve the performance, a jury system is also employed for multi-model fusion. Second, two deep siamese networks are integrated into a deep triplet network for tri-subject (i.e., father, mother and child) kinship verification, which is intended to decide whether a child is related to a pair of parents or not. Specifically, the obtained similarity scores of father-child and mother-child are weighted to generate the parent-child similarity score for kinship verification. Recognizing Families In the Wild (RFIW) is a challenging kinship recognition task with multiple tracks, which is based on Families in the Wild (FIW), a large-scale and comprehensive image database for automatic kinship recognition. The Kinship Verification (track I) and Tri-Subject Verification (track II) are supported during the ongoing RFIW2020 Challenge. Our team (ustc-nelslip) ranked 1st in track II, and 3rd in track I. The code is available at https://github.com/gniknoil/FG2020-kinship.