Research
Spark has been accepted at NSDI’2012
Our paper “Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing” has been accepted at NSDI’2012. This is Matei‘s brainchild and a joint work of a lot of people including, but not limited to, TD, Ankur, Justin, Murphy, and professors Ion Stoica, Scott Shenker, and Michael Franklin. Unlike many other systems papers, Spark is ...
Continue reading →
Distributed in-memory datasets
AMPLab, “Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing,” UCB/EECS-2011-82, 2011. [PDF] Russell Power, Jinyang Li, “Piccolo: Building Fast, Distributed Programs with Partitioned Tables,” OSDI, 2010. [PDF] Summary MapReduce and similar frameworks, while widely applicable, are limited to directed acyclic data flow models, do not expose global states, and generally slow due to ...
Continue reading →
Technical report on Spark is available Online
A technical report describing the key concepts behind Spark is available online. The abstract goes below: We present Resilient Distributed Datasets (RDDs), a distributed memory abstraction that allows programmers to perform in-memory computations on large clusters while retaining the fault tolerance of data flow models like MapReduce. RDDs are motivated by two types of applications ...
Continue reading →
Extended version of ViNEYard has been accepted in IEEE/ACM ToN
An extended, updated, and emended version of our ViNEYard paper in INFOCOM’09 has been accepted for publication in IEEE/ACM Transactions on Networking after yearlong multiple rounds of reviews. Since there is normally a long queue for actually getting an accepted ToN paper printed, its hard to tell when ours will officially be out there. I’d ...
Continue reading →
Orchestra has been accepted at SIGCOMM’2011
Update: Camera-ready version of the paper should be can be found in the publications page very soon! Our paper “Managing Data Transfers in Computer Clusters with Orchestra” has been accepted at SIGCOMM’2011. This is a joint work with Matei, Justin, and professors Mike Jordan and Ion Stoica. The project started as part of Spark and ...
Continue reading →
PolyViNE has been accepted at VISA’2010
Our paper, “PolyViNE: Policy-based Virtual Network Embedding Across Multiple Domains” is set to appear in VISA’2010 workshop (with SIGCOMM’2010) in New Delhi. I worked on it during my last few months in Waterloo (circa Winter/Spring 2009), and it has been lying around ever since because everyone had been busy. Finally, its going to wake up ...
Continue reading →
Spark short paper has been accepted at HotCloud’10
An initial overview of our ongoing work on Spark, an iterative and interactive framework for cluster computing, has been accepted at HotCloud’10. I’ve been joined the project last February, while Matei has been working on it since last Fall. I will have uploaded the paper in the publications page. once we have taken care of ...
Continue reading →
Feature Article on Network Virtualization in IEEE ComMag
“Network Virtualization: State of the Art and Research Challenges” has been featured in the IEEE Communications Magazine‘s July 2009 issue in its Network and Service Management Series. This one is a quick overview of a lot of things related to network virtualization: its past, present, and possible future. The main objective is to let the huge readership ...
Continue reading →
Signed, sealed, delivered I’m done (with Master’s)
After 633 days, reading few hundred papers, writing a few, watching 100+ movies, reading 30+ fictions, eating lots of food, and doing many other things, my Master’s is over :D . I successfully presented/defended my thesis on 21st Jan 2009, and my thesis committee have approved it without any changes (there were 3 typos :( ...
Continue reading →
ViNE-Yard has been accepted at INFOCOM’2009
Just in. Our paper “Virtual Network Embedding with Coordinated Node and Link Mapping”, which presents D-ViNE and R-ViNE algorithms, has been accepted at INFOCOM’2009. Apparently, I have overtaken myself and will be presenting my first paper in Rio de Janeiro, Brazil next April. :D Here goes the abstract: Recently network virtualization has been proposed as ...
Continue reading →