Sector and Sphere: Towards Simplified Storage and Processing of Large Scale Distributed Data - Computer Science > Distributed, Parallel, and Cluster ComputingReportar como inadecuado




Sector and Sphere: Towards Simplified Storage and Processing of Large Scale Distributed Data - Computer Science > Distributed, Parallel, and Cluster Computing - Descarga este documento en PDF. Documentación en PDF para descargar gratis. Disponible también para leer online.

Abstract: Cloud computing has demonstrated that processing very large datasets overcommodity clusters can be done simply given the right programming model andinfrastructure. In this paper, we describe the design and implementation of theSector storage cloud and the Sphere compute cloud. In contrast to existingstorage and compute clouds, Sector can manage data not only within a datacenter, but also across geographically distributed data centers. Similarly, theSphere compute cloud supports User Defined Functions UDF over data bothwithin a data center and across data centers. As a special case, MapReducestyle programming can be implemented in Sphere by using a Map UDF followed by aReduce UDF. We describe some experimental studies comparing Sector-Sphere andHadoop using the Terasort Benchmark. In these studies, Sector is about twice asfast as Hadoop. Sector-Sphere is open source.



Autor: Yunhong Gu, Robert L Grossman

Fuente: https://arxiv.org/







Documentos relacionados