Spark has been accepted at NSDI’2012

Our paper "Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing" has been accepted at NSDI'2012. This is Matei's brainchild and a joint work of a lot of people including, but not limited to, TD, Ankur, Justin, Murphy, and professors Ion Stoica, Scott Shenker, and Michael Franklin. Unlike many other systems papers, Spark is … Continue Reading ››

Memory Management in the Cloud

Stanford, "The Case for RAMClouds: Scalable High-Performance Storage Entirely in DRAM," SIGOPS Operating Systems Review, Vol. 43, No. 4, December 2009, pp. 92-105. [PDF]

AMP Lab, "PACMan: Coordinated Memory Caching for Parallel Jobs," Secret Draft.

Update: PACMan has been accepted at NSDI'2012. Secret draft won't remain secret anymore :)

Summary

Cloud applications require storage systems … Continue Reading ››