论文标题

时尚推荐和使用关系网络的兼容性预测

Fashion Recommendation and Compatibility Prediction Using Relational Network

论文作者

Moosaei, Maryam, Lin, Yusan, Yang, Hao

论文摘要

时尚是一种固有的视觉概念,计算机视觉和人工智能(AI)在塑造该领域的未来方面起着越来越重要的作用。已经对基于学习的用户偏好推荐时尚产品进行了许多研究。但是,除了推荐单个物品外,AI还可以帮助用户从已经拥有的物品中创建时尚的服装,或者购买与当前衣柜相适应的其他物品。兼容性是从单个项目中创建时尚服装的关键因素。先前的研究主要集中在对成对的兼容性上进行建模。有几种考虑整个服装的方法,但是这些方法具有限制,例如需要丰富的语义信息,类别标签和固定的项目顺序。因此,当没有可用的信息时,他们无法有效确定兼容性。在这项工作中,我们采用关系网络(RN)来开发新的兼容性学习模型,时尚RN和FashionRN-VSE,以解决现有方法的局限性。 FashionRn以任意顺序了解整个服装的兼容性,并与任意数量的项目一起。我们使用从Polyvore网站收集的49,740种服装的大型数据集评估了我们的模型。从数量上讲,我们的实验结果证明了与兼容性预测和填空测试中文献中的替代方法相比,与文献中的替代方法相比。从定性上讲,我们还表明,嵌入了时尚Rn所学的项目表明时尚项目之间的兼容性。

Fashion is an inherently visual concept and computer vision and artificial intelligence (AI) are playing an increasingly important role in shaping the future of this domain. Many research has been done on recommending fashion products based on the learned user preferences. However, in addition to recommending single items, AI can also help users create stylish outfits from items they already have, or purchase additional items that go well with their current wardrobe. Compatibility is the key factor in creating stylish outfits from single items. Previous studies have mostly focused on modeling pair-wise compatibility. There are a few approaches that consider an entire outfit, but these approaches have limitations such as requiring rich semantic information, category labels, and fixed order of items. Thus, they fail to effectively determine compatibility when such information is not available. In this work, we adopt a Relation Network (RN) to develop new compatibility learning models, Fashion RN and FashionRN-VSE, that addresses the limitations of existing approaches. FashionRN learns the compatibility of an entire outfit, with an arbitrary number of items, in an arbitrary order. We evaluated our model using a large dataset of 49,740 outfits that we collected from Polyvore website. Quantitatively, our experimental results demonstrate state of the art performance compared with alternative methods in the literature in both compatibility prediction and fill-in-the-blank test. Qualitatively, we also show that the item embedding learned by FashionRN indicate the compatibility among fashion items.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源