Influence of Virtualization on Process of Grid Application Deployment

1
Influence of Virtualization on Process of Grid
Application Deployment
Jacek Cala comments ON
CCM case study

• Distributed Systems Research Group
• Department of Computer Science AGH-UST
• Cracow, Poland
• Jacek Cala, Krzysztof Zielinski

2
Background

• Virtualization is about creating illusions
• there are many CPUs on my one-CPU desktop,
• there is more memory in my system than physical
  RAM,
• a device is available here while in reality it is
  100 km away,
• there is more than one machine in my box.

3
Background

• Virtualization is the process of presenting
  computing resources in a way which gives benefit
  over the original configuration
• Virtualization describes the separation of a
  resource or request for a service from the
  underlying physical delivery of that service

4
Key Features of Virtualization

• Consolidation
• more resources perceived as one e.g. many hard
  disk drives creating one storage space
• Partitioning
• huge resources dedicated for particular users
  e.g. one server machine divided on many virtual
  servers
• isolation, security, etc.
• Containment
• different resources perceived in the same way
  e.g. video cards from different vendors available
  with the same programming interface

5
Techniques of Virtualization

• Machine Virtualization
• Hardware-level virtualization
• Hosted virtualization
• Hypervisor virtualization
• CPU
• HyperThreading, TSS, FSS
• Storage virtualization
• NAS, SAN
• Memory
• Virtual Memory
• Language
• Virtual machines Java VM, .NET CLR

6
Deployment Process
Requirements
Resources
Repository Manager
Target Manager
Software package
Target
Installation tool
1
Planning tool
Configuration tool
2
3
Deployment plan
Execution Manager
Preparation tool
Application Manager
4
Lunching tool
5
Node Manager
7
Matching an Application to Resources
Application
Target Domain
Virtualization decisions
8
DC Specification

• Deployment and Configuration of Component-based
  Distributed Applications Specification
• Defined by OMG
• first adopted version April 2006
• Allows describing both resource properties an
  application requirements
• Platform Independent Model
• PSM ? CCM

9
DC Target Domain
infoProperty
Property
Domain

1..
interconnect
bridge

node

connect
Bridge
Interconnect
Node
Node
connection
1..
1..
resource

sharedResource
SharedResource
resource
resource



Resource
SatisfierProperty
10
What is a NODE?

• Most obviously
• a computer system
• But may be something smaller
• an OS on virtual machine
• a Solaris project
• a process in case of CCM a ComponentServer
• a thread
• And why not something larger
• a cluster

11
Node as a Computer System

• Computer System/OS in VM
• resources
• CPU, memory, storage, NIC,
• interconnect
• computer network
• bridge
• switch, router

Node

• name hare.ics.agh.edu.pl
• label hare

Resource

• name Hares HDD
• resourceType Storage

Resource

• name Hares CPU
• resourceType CPU

Resource

• name Hares Memory
• resourceType Memory

SatisfierProperty
SatisfierProperty

• name throughput
• kind Maximum
• dynamic false
• value 10000

SatisfierProperty

• name speed
• kind Maximum
• dynamic true
• value 2673

SatisfierProperty

• name size
• kind Capacity
• dynamic true
• value 1048576

SatisfierProperty

• name model
• kind Attribute
• dynamic false
• value Intel Pentium 4

• name latency
• kind Minimum
• dynamic false
• value 10

12
Node as a Process

• CCM Component Server
• resources
• heap, stack, threads, priority, CPU usage, start
  time
• JVM GC algorithm, vendor
• interconnect
• IPC shared memory, pipes, signals
• socket (unix, tcp, etc.)
• bridge
• proxy, gateway

Node

• name CompServer1
• label CS1

Resource

• name CS1 Load
• resourceType CPUUsage

Resource

• name CS1 Debug
• resourceType ProcessAttributes

Resource

• name CS1 Memory
• resourceType Memory

SatisfierProperty
SatisfierProperty

• name debugMode
• kind Attribute
• dynamic false
• value false

SatisfierProperty
SatisfierProperty

• name stackSize
• kind Capacity
• dynamic true
• value 1048576

• name niceLevel
• kind Attribute
• dynamic false
• value 32

• name heapSize
• kind Capacity
• dynamic true
• value 20970520

13
Domain Description Techniques

• Common Information Model (CIM)
• Directory Enabled Networking (DEN)
• DEN ng
• WS-Management

14
DC App. Requirements
Component Implementation Description
xor
Named Implementation Artifact
Monolithic Implementation Description
1..
Component Assembly Description
primaryArtifact
referencedArtifact
1
deployRequirement

Implementation Artifact Description
Implementation Requirement

deployRequirement
Requirement
15
Deployment Process
The same, selected, virtualization layer
The same description language
Requirements
Resources
Repository Manager
Target Manager
Software package
Target
Installation tool
1
Planning tool
Configuration tool
2
3
Deployment plan
Execution Manager
Preparation tool
Application Manager
4
Lunching tool
5
Node Manager
16
Definition of DC Domain
infoProperty
Property
Domain

1..
interconnect
bridge

node

connect
Bridge
Interconnect
Node
connection
1..
1..
resource

SharedResource
resource
resource


sharedResource

Resource
property

SatisfierProperty
17
DC App. Requirements
Component Implementation Description
xor
Named Implementation Artifact
Monolithic Implementation Description
1..
Component Assembly Description
primaryArtifact
referencedArtifact
1
Implementation Artifact Description

deployRequirement
Requirement
18
Matching an Application to Resources
Application
Target Domain
19
Thank you!

• Any questions?