The IRMA Community
Newsletters
Research IRM
Click a keyword to search titles using our InfoSci-OnDemand powered search:
|
Data Intensive Computing with Clustered Chirp Servers
|
|
Author(s): Douglas Thain (University of Notre Dame, USA), Michael Albrecht (University of Notre Dame, USA), Hoang Bui (University of Notre Dame, USA), Peter Bui (University of Notre Dame, USA), Rory Carmichael (University of Notre Dame, USA), Scott Emrich (University of Notre Dame, USA)and Patrick Flynn (University of Notre Dame, USA)
Copyright: 2012
Pages: 15
Source title:
Data Intensive Distributed Computing: Challenges and Solutions for Large-scale Information Management
Source Author(s)/Editor(s): Tevfik Kosar (University at Buffalo, USA)
DOI: 10.4018/978-1-61520-971-2.ch006
Purchase
|
Abstract
Over the last few decades, computing performance, memory capacity, and disk storage have all increased by many orders of magnitude. However, I/O performance has not increased at nearly the same pace: a disk arm movement is still measured in milliseconds, and disk I/O throughput is still measured in megabytes per second. If one wishes to build computer systems that can store and process petabytes of data, they must have large numbers of disks and the corresponding I/O paths and memory capacity to support the desired data rate. A cost efficient way to accomplish this is by clustering large numbers of commodity machines together. This chapter presents Chirp as a building block for clustered data intensive scientific computing. Chirp was originally designed as a lightweight file server for grid computing and was used as a “personal” file server. The authors explore building systems with very high I/O capacity using commodity storage devices by tying together multiple Chirp servers. Several real-life applications such as the GRAND Data Analysis Grid, the Biometrics Research Grid, and the Biocompute Facility use Chirp as their fundamental building block, but provide different services and interfaces appropriate to their target communities.
Related Content
|
Radhika Kavuri, Satya kiranmai Tadepalli.
© 2024.
19 pages.
|
|
Ramu Kuchipudi, Ramesh Babu Palamakula, T. Satyanarayana Murthy.
© 2024.
10 pages.
|
|
Nidhi Niraj Worah, Megharani Patil.
© 2024.
21 pages.
|
|
Vishal Goar, Nagendra Singh Yadav.
© 2024.
23 pages.
|
|
S. Boopathi.
© 2024.
24 pages.
|
|
Sai Samin Varma Pusapati.
© 2024.
25 pages.
|
|
Swapna Mudrakola, Krishna Keerthi Chennam, Shitharth Selvarajan.
© 2024.
11 pages.
|
|
|