The IRMA Community
Newsletters
Research IRM
Click a keyword to search titles using our InfoSci-OnDemand powered search:
|
End-to-End Dataflow Parallelism for Transfer Throughput Optimization
Abstract
The emerging petascale increase in the data produced by large-scale scientific applications necessitates innovative solutions for efficient transfer of data through the advanced infrastructure provided by today’s high-speed networks and complex computer-architectures (e.g. supercomputers, parallel storage systems). Although the current optical networking technology reached transport speeds of 100Gbps, the applications still suffer from the inadequate transport protocols and end-system bottlenecks such as processor speed, disk I/O speed and network interface card limits that cause underutilization of the existing network infrastructure and let the application achieve only a small portion of the theoretical performance. Fortunately, with the parallelism provided by usage of multiple CPUs/nodes and multiple disks present in today’s systems, these bottlenecks could be eliminated. However it is necessary to understand the characteristics of the end-systems and the transport protocol used. In this book chapter, we analyze methodologies that will improve the data transfer speed of applications and provide maximal speeds that could be obtained from the available end-system resources and high-speed networks through usage of end-to-end dataflow parallelism.
Related Content
|
Nithin Kalorth, Vidya Deshpande.
© 2024.
7 pages.
|
|
Nitesh Behare, Vinayak Chandrakant Shitole, Shubhada Nitesh Behare, Shrikant Ganpatrao Waghulkar, Tabrej Mulla, Suraj Ashok Sonawane.
© 2024.
24 pages.
|
|
T.S. Sujith.
© 2024.
13 pages.
|
|
C. Suganya, M. Vijayakumar.
© 2024.
11 pages.
|
|
B. Harry, Vijayakumar Muthusamy.
© 2024.
19 pages.
|
|
Munise Hayrun Sağlam, Ibrahim Kirçova.
© 2024.
19 pages.
|
|
Elif Karakoç Keskin.
© 2024.
19 pages.
|
|
|