论文标题

Infinicache:利用短暂的无服务器功能来构建具有成本效益的内存缓存

InfiniCache: Exploiting Ephemeral Serverless Functions to Build a Cost-Effective Memory Cache

论文作者

Wang, Ao, Zhang, Jingyuan, Ma, Xiaolong, Anwar, Ali, Rupprecht, Lukas, Skourtis, Dimitrios, Tarasov, Vasily, Yan, Feng, Cheng, Yue

论文摘要

Internet规模的Web应用程序正在越来越多地存储密集型,并且严重依赖内存对象缓存以实现所需的I/O性能。我们认为,新兴的无服务器计算范式为对象缓存提供了一个非常合适的,具有成本效益的平台。我们提出Infinicache,这是一种最初的内存中对象缓存系统,完全构建和部署在短暂的无服务器功能上。 Infinicache漏洞利用并协调无服务器功能的内存资源,以启用弹性付费按使用缓存。 Infinicache的设计结合了擦除编码,智能计费持续时间控制以及有效的数据备份机制,以最大程度地提高数据可用性和成本效益,同时平衡失去缓存状态和性能的风险。我们在AWS lambda上实施Infinicache,并表明它:(1)与AWS Elasticache相比,仅在大型生产工作量的AWS Elasticache上节省了31-96倍的租户端成本,(2)可以有效地为一个小时的窗口提供95.4%的数据可用性,并且(3)在典型的典型性能中可以看到比较性能。

Internet-scale web applications are becoming increasingly storage-intensive and rely heavily on in-memory object caching to attain required I/O performance. We argue that the emerging serverless computing paradigm provides a well-suited, cost-effective platform for object caching. We present InfiniCache, a first-of-its-kind in-memory object caching system that is completely built and deployed atop ephemeral serverless functions. InfiniCache exploits and orchestrates serverless functions' memory resources to enable elastic pay-per-use caching. InfiniCache's design combines erasure coding, intelligent billed duration control, and an efficient data backup mechanism to maximize data availability and cost-effectiveness while balancing the risk of losing cached state and performance. We implement InfiniCache on AWS Lambda and show that it: (1) achieves 31 -- 96X tenant-side cost savings compared to AWS ElastiCache for a large-object-only production workload, (2) can effectively provide 95.4% data availability for each one hour window, and (3) enables comparative performance seen in a typical in-memory cache.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源