论文标题

衍射深神经网络中的光相位辍学

Optical Phase Dropout in Diffractive Deep Neural Network

论文作者

Xiao, Yong-Liang

论文摘要

统一学习是一种反向传播,可在具有完整连接的深层复杂评估的神经网络中进行单一权重更新,并符合衍射深神经网络([DN] 2)的物理统一之前。但是,单位权重的平方矩阵特性会导致该函数信号具有有限的维度,无法很好地概括。为了解决来自加载到[DN] 2的小样本的过度拟合问题,实现了光学相位辍学技巧。首次制定了从复杂的辍学演变并具有统计推断的单一空间中的相位辍学。从随机相位转移的随机点孔中重新创建的合成掩模,其窒息的调制器通过不完全采样每个衍射层的输入光场来量身定制冗余链接。详细阐明了使用不同非线性激活的合成面膜的物理特征。数字模型和衍射模型之间的等效性决定了可以成功规避[DN] 2中实际实现的非线性激活的复合调制。数值实验验证了[DN] 2中光相位辍学的优势,以提高2D分类和面向识别任务的准确性。

Unitary learning is a backpropagation that serves to unitary weights update in deep complex-valued neural network with full connections, meeting a physical unitary prior in diffractive deep neural network ([DN]2). However, the square matrix property of unitary weights induces that the function signal has a limited dimension that could not generalize well. To address the overfitting problem that comes from the small samples loaded to [DN]2, an optical phase dropout trick is implemented. Phase dropout in unitary space that is evolved from a complex dropout and has a statistical inference is formulated for the first time. A synthetic mask recreated from random point apertures with random phase-shifting and its smothered modulation tailors the redundant links through incompletely sampling the input optical field at each diffractive layer. The physical features about the synthetic mask using different nonlinear activations are elucidated in detail. The equivalence between digital and diffractive model determines compound modulations that could successfully circumvent the nonlinear activations physically implemented in [DN]2. The numerical experiments verify the superiority of optical phase dropout in [DN]2 to enhance accuracy in 2D classification and recognition tasks-oriented.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源