Page Banner

United States Department of Agriculture

Agricultural Research Service

Research Project: Spatial Modeling of Agricultural Watersheds: Water and Nutrient Management and Targeted Conservation Effects at Field to Watershed Scales

Location: Agricultural Systems Research Unit

Title: The virtual machine (VM) scaler: an infrastructure manager supporting environmental modeling on IaaS clouds

Authors
item Lloyd, Wes -
item David, Olaf -
item Arabi, Mazdak -
item Ascough, James
item Green, Timothy
item Carlson, Jack -
item Rojas, Ken -

Submitted to: Environmental Modeling International Conference Proceedings
Publication Type: Proceedings
Publication Acceptance Date: June 18, 2014
Publication Date: June 21, 2014
Citation: Lloyd, W., David, O., Arabi, M., Ascough II, J.C., Green, T.R., Carlson, J.R., Rojas, K.W. 2014. The virtual machine (VM) scaler: an infrastructure manager supporting environmental modeling on IaaS clouds. Environmental Modeling International Conference Proceedings. Available: http://www.iemss.org/sites/iemss2014/papers/iemss2014_submission_329.pdf.

Interpretive Summary: Infrastructure-as-a-service (IaaS) clouds provide a new medium for deployment of environmental modeling applications. Harnessing advancements in virtualization, IaaS clouds can provide dynamic scalable infrastructure to better support scientific modeling computational demands. Providing scientific modeling "as-a-service" requires dynamic scaling of server infrastructure to adapt to changing user workloads. This paper presents the Virtual Machine (VM) Scaler, an autonomic resource manager for IaaS Clouds. VM-Scaler is a REST/JSON-based web services application which supports infrastructure provisioning and management to support scientific modeling for the Cloud Services Innovation Platform (CSIP) [Lloyd et al. 2012]. VM-Scaler harnesses the Amazon Elastic Compute Cloud (EC2) application programming interface to support model service scalability, cloud management, and infrastructure configuration for supporting modeling workloads. VM-Scaler provides "cloud control" while abstracting the underlying IaaS cloud from the end user. VM-Scaler provides a platform to improve scientific model deployment by supporting experimentation with VM management and placement approaches, and model job scheduling/proxy services.

Technical Abstract: Infrastructure-as-a-service (IaaS) clouds provide a new medium for deployment of environmental modeling applications. Harnessing advancements in virtualization, IaaS clouds can provide dynamic scalable infrastructure to better support scientific modeling computational demands. Providing scientific modeling "as-a-service" requires dynamic scaling of server infrastructure to adapt to changing user workloads. This paper presents the Virtual Machine (VM) Scaler, an autonomic resource manager for IaaS Clouds. We have developed VM-Scaler, a REST/JSON-based web services application which supports infrastructure provisioning and management to support scientific modeling for the Cloud Services Innovation Platform (CSIP) [Lloyd et al. 2012]. VM-Scaler harnesses the Amazon Elastic Compute Cloud (EC2) application programming interface to support model service scalability, cloud management, and infrastructure configuration for supporting modeling workloads. VM-Scaler provides "cloud control" while abstracting the underlying IaaS cloud from the end user. VM-Scaler is extensible to support any EC2 compatible cloud and currently supports the Amazon public cloud and Eucalyptus private clouds versions 3.1 and 3.3. VM-Scaler provides a platform to improve scientific model deployment by supporting experimentation with: hot spot detection schemes, VM management and placement approaches, and model job scheduling/proxy services.

Last Modified: 10/24/2014
Footer Content Back to Top of Page