1 Lizhe Wang, Gregor von Laszewski, Jai Dayal, Thomas R. FurlaniThermal Aware Workload Scheduling with Backfilling for Green Data Centers Lizhe Wang, Gregor von Laszewski, Jai Dayal, Thomas R. Furlani RIT . IU. UB
2 Outline Background and related work Models Research problem definitionScheduling algorithm Performance study Conclusion
3 Context Cyberaide A project that aims to make advanced cyberinfrastructure easier to use GreenIT & Cyberaide How do we use advanced cyberinfrastructure in an efficient way Future Grid A newly NSF funded project to provide a testbed that integrates the ability of dynamic provisioning of resources. (Geoffrey C. Fox is PI) GPGPU’s Application use of special purpose hardware as part of the cyberinfrastructure
4 FutureGrid The goal of FutureGrid is to support the research that will invent the future of distributed, grid, and cloud computing. FutureGrid will build a robustly managed simulation environment or testbed to support the development and early use in science of new technologies at all levels of the software stack: from networking to middleware to scientific applications. The environment will mimic TeraGrid and/or general parallel and distributed systems This test-bed will enable dramatic advances in science and engineering through collaborative evolution of science applications and related software.
5 Other Participant SitesUniversity of Virginia (UV) Technical University Dresden GWT-TUD GmbH, Germany University of Tennessee – Knoxville (UTK)
6 FutureGrid Hardware
7 FutureGrid Partners Indiana University Purdue UniversitySan Diego Supercomputer Center at University of California San Diego University of Chicago/Argonne National Labs University of Florida University of Southern California Information Sciences Institute, University of Tennessee Knoxville University of Texas at Austin/Texas Advanced Computing Center University of Virginia Center for Information Services and GWT-TUD from Technische Universtität Dresden.
8 Green computing a study and practice of using computing resources in an efficient manner such that its impact on the environment is as less hazardous as possible. least amount of hazardous materials are used computing resources are used efficiently in terms of energy and to promote recyclability
9 Cyberaide Project A middleware for Clusters, Grids and CloudsA collaboration between IU, RIT, KIT, … Project led by Dr. Gregor von Laszewski
10 Objective Towards next generation cyberinfrastructureMiddleware for data centers, grids and clouds Environment respect To reduce temperatures of computing resources in a data center, thus reduce cooling system cost and improve system reliability Methodology: thermal aware workload distribution
11 Model Data center Workload Node:
12 Thermal model t RC-thermal model Online task-temperature Nodei.Temp(t)Temp(Nodei.
13 Research issue definitionGiven a data center, workload, maximum temperature permitted of the data center Min Tresponse Min Temperature
14 Cooling system controlConcept framework Data center model Workload model input Workload placement schedule TASA-B input input online task-temperature Cooling system control
15 Concept framework Data center model Workload model inputWorkload placement schedule TASA-B input input RC-thermal model online task-temperature Cooling system control calculation task-temperature profile Thermal map
16 Concept framework Data center model Workload model inputWorkload placement schedule TASA-B input input RC-thermal model online task-temperature Cooling system control calculation task-temperature profile Thermal map Control
17 Concept framework Data center model Workload model inputWorkload placement schedule TASA-B input input RC-thermal model online task-temperature Cooling system control calculation task-temperature profile Thermal map Control profiling Profiling tool
18 Concept framework Data center model Workload model inputWorkload placement schedule TASA-B input input RC-thermal model online task-temperature Cooling system control calculation task-temperature profile Thermal map Control profiling provide information Calculate thermal map Profiling tool monitoring service CFD model
19 Scheduling framework Jobs Job queue Job submission Data centerJob scheduling TASA-B Rack Update data center Information periodically
20 Task scheduling algorithm with backfilling (TASA-B)Sort all jobs with decreased order of task-temperature profile Sort all resource with increased order of predicted temperature Hot jobs are allocated to cool resources Predict resource temperature based on online-task temperature Backfill possible jobs
21 Backfilling nodek.tbfend , Time backfilling holesend time for backfilling Time backfilling holes Available time t0 nodemax1 nodemax2 Node nodek.tbfsta , backfilling start time of nodek
22 Backfilling nodek.Tempbfend, end temperature for backfillingTemperature backfilling holes Tempbfmax nodemax2 nodemax1 Node nodek.Tempbfsta, start temperature for backfilling of nodek
23 Simulation Data center: Workload:Computational Center for Research at UB Dell x86 64 Linux cluster consisting 1056 nodes 13 Tflop/s Workload: 20 Feb 2009 – 22 Mar. 2009 22385 jobs
24 Simulation result Metrics TASA Reduced average temperature 16.1 FReduced maximum temperature 6.1 F Increase job response time 13.9% Saved power 5000 kW Reduced CO2 emission 1900kg /hour
25 Simulation result Metrics TASA-B Reduced average temperature 14.6 FReduced maximum temperature 4.1 F Increase job response time 11% Saved power 4000 kW Reduced CO2 emission 1600kg /hour
26 Our work on Green data center computingPower aware virtual machine scheduling (cluster’09) Power aware parallel task scheduling (submitted) TASA (i-SPAN’09) TASA-B (ipccc’09) ANN based temperature prediction and task scheduling (submitted)
27 Final remark Green computing Thermal aware data center computingTASA-B Justification with a simulation study