Title

CLASH: A Protocol for Internet-Scale Utility-Oriented Distributed Computing

Publication Type

Conference Proceeding Article

Publication Date

3-2004

Abstract

Distributed hash table (DHT) overlay networks offer an efficient and robust technique for wire-area data storage and queries. Workload from real applications that use DHT networks will likely exhibit significant skews that can result in bottlenecks and failures that limit the overall scalability of the DHT approach. We present the content and load-aware scalable hashing (CLASH) protocol that can enhance the load distribution behavior of a DHT. CLASH relies on a variable-length identifier key scheme, where the length of any individual key is a function of load. CLASH uses variable-length keys to cluster content-related objects on single nodes to achieve processing efficiencies, and minimally disperse objects across multiple servers when hotspots occur. We demonstrate the performance benefits of CLASH through analysis and simulation.

Discipline

Software Engineering

Research Areas

Software Systems

Publication

IEEE International Conference on Distributed Computing Systems (ICDCS)

Identifier

10.1109/ICDCS.2004.1281592

Publisher

IEEE

Additional URL

http://doi.ieeecomputersociety.org/10.1109/ICDCS.2004.1281592

This document is currently not available here.

Share

COinS