论文标题

通过深度学习:输入或梯度扰动,差异私有的多元时间序列预测人类流动性?

Differentially Private Multivariate Time Series Forecasting of Aggregated Human Mobility With Deep Learning: Input or Gradient Perturbation?

论文作者

Arcolezi, Héber H., Couchot, Jean-François, Renaud, Denis, Bouna, Bechara Al, Xiao, Xiaokui

论文摘要

本文研究了预测多元汇总人类流动性的问题,同时保留有关个人的隐私。差异隐私是一种最先进的形式概念,在训练深度学习模型时,已在两个不同且独立的步骤中用作隐私保证。一方面,我们考虑了\ textIt {梯度扰动},该}使用差异化的随机梯度下降算法来保证学习阶段每个时间序列样本的隐私。另一方面,我们考虑了\ textIt {input扰动},在应用任何学习之前,它在系列的每个样本中都会在每个样本中添加差异隐私。我们比较了四个最新的经常性神经网络:长短期记忆,门控复发单元及其双向体系结构,即双向LSTM和双向 - 格鲁。使用现实世界中的多元移动数据集进行了广泛的实验,我们与本文公开发表。如结果所示,在梯度或输入扰动下训练的差异私人深度学习模型的表现几乎与非私人深度学习模型相同,绩效损失在$ 0.57 \%\%\%至2.8美元之间。本文的贡献对于参与城市规划和决策的人来说是重要的,它通过差异私人深度学习模型为人类流动性多元预测问题提供了解决方案。

This paper investigates the problem of forecasting multivariate aggregated human mobility while preserving the privacy of the individuals concerned. Differential privacy, a state-of-the-art formal notion, has been used as the privacy guarantee in two different and independent steps when training deep learning models. On one hand, we considered \textit{gradient perturbation}, which uses the differentially private stochastic gradient descent algorithm to guarantee the privacy of each time series sample in the learning stage. On the other hand, we considered \textit{input perturbation}, which adds differential privacy guarantees in each sample of the series before applying any learning. We compared four state-of-the-art recurrent neural networks: Long Short-Term Memory, Gated Recurrent Unit, and their Bidirectional architectures, i.e., Bidirectional-LSTM and Bidirectional-GRU. Extensive experiments were conducted with a real-world multivariate mobility dataset, which we published openly along with this paper. As shown in the results, differentially private deep learning models trained under gradient or input perturbation achieve nearly the same performance as non-private deep learning models, with loss in performance varying between $0.57\%$ to $2.8\%$. The contribution of this paper is significant for those involved in urban planning and decision-making, providing a solution to the human mobility multivariate forecast problem through differentially private deep learning models.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源