SC is the International Conference for
 High Performnance Computing, Networking, Storage and Analysis

SCHEDULE: NOV 13-19, 2010

Power-Aware Consolidation of Scientific Workflows in Virtualized Environments

SESSION: HPC on Clouds

EVENT TYPE: Paper

TIME: 2:30PM - 3:00PM

SESSION CHAIR: David Abramson

AUTHOR(S):Qian Zhu, Jiedan Zhu, Gagan Agrawal

ROOM:393

ABSTRACT:
The recent emergence of clouds with large, virtualized pools of compute and storage resources raises the possibility of a new compute paradigm for scientific research. With virtualization technologies, consolidation of scientific workflows presents a promising opportunity for energy and resource cost optimization, while achieving high performance. We have developed {em pSciMapper}, a power-aware consolidation framework for scientific workflows. We view consolidation as a hierarchical clustering problem, and introduce a distance metric that is based on interference between resource requirements. A dimensionality reduction method (KCCA) is used to relate the resource requirements to performance and power consumption. We have evaluated pSciMapper with both real-world and synthetic scientific workflows, and demonstrated that it is able to reduce power consumption by up to 56%, with less than 15% slowdown. Our experiments also show that scheduling overheads of pSciMapper are low, and it can scale well for workflows with hundreds of tasks.

Chair/Author Details:

David Abramson (Chair) - Monash University

Qian Zhu - Ohio State University

Jiedan Zhu - Ohio State University

Gagan Agrawal - Ohio State University

Add to iCal  Click here to download .ics calendar file

Add to Outlook  Click here to download .vcs calendar file

Add to Google Calendarss  Click here to add event to your Google Calendar

The full paper can be found in the ACM Digital Library and IEEE Computer Society

   Sponsors    IEEE    ACM