论文标题
DeepWritesSyn:在线手写合成通过深度短期表示
DeepWriteSYN: On-Line Handwriting Synthesis via Deep Short-Term Representations
论文作者
论文摘要
这项研究提出了DeepWritesSyn,这是一种新型的在线手写合成方法,通过深层短期表示。它包括两个模块:i)可选的和可互换的时间分割,将笔迹分为由个体或多个串联笔触组成的短时段; ii)那些短期手写片段的在线合成,该片段基于序列到序列变化自动编码器(VAE)。提出方法的主要优点是合成是在短期段(可以从字符分数到完整字符的)进行的,并且可以在可配置的手写数据集中训练VAE。这两个属性为我们的合成器提供了很大的灵活性,例如,如我们的实验所示,deepwritessyn可以生成与给定种群或给定主题中自然变化相对应的给定手写结构的真实手写变化。这两种情况是针对单个数字和手写标志的实验开发的,在这两种情况下都取得了显着的结果。 此外,我们为在线签名验证的任务提供了实验结果,该任务表明DeepWritesSyn具有显着一击学习方案的高潜力。据我们所知,这是第一种能够通过深度学习在短期内(包括手写签名)生成现实的在线笔迹的方法。这对于长期逼真的笔迹产生的模块可能非常有用,要么是完全合成的,要么是给定笔迹样本的自然变化。
This study proposes DeepWriteSYN, a novel on-line handwriting synthesis approach via deep short-term representations. It comprises two modules: i) an optional and interchangeable temporal segmentation, which divides the handwriting into short-time segments consisting of individual or multiple concatenated strokes; and ii) the on-line synthesis of those short-time handwriting segments, which is based on a sequence-to-sequence Variational Autoencoder (VAE). The main advantages of the proposed approach are that the synthesis is carried out in short-time segments (that can run from a character fraction to full characters) and that the VAE can be trained on a configurable handwriting dataset. These two properties give a lot of flexibility to our synthesiser, e.g., as shown in our experiments, DeepWriteSYN can generate realistic handwriting variations of a given handwritten structure corresponding to the natural variation within a given population or a given subject. These two cases are developed experimentally for individual digits and handwriting signatures, respectively, achieving in both cases remarkable results. Also, we provide experimental results for the task of on-line signature verification showing the high potential of DeepWriteSYN to improve significantly one-shot learning scenarios. To the best of our knowledge, this is the first synthesis approach capable of generating realistic on-line handwriting in the short term (including handwritten signatures) via deep learning. This can be very useful as a module toward long-term realistic handwriting generation either completely synthetic or as natural variation of given handwriting samples.