SODA:

1

• SODA
• a Service-On-Demand Architecture
• An Utility Computing Perspective
• Xuxian Jiang
• Purdue University
• 04/10/2003

2
Introduction

• Essential Idea
• Provide computation as utility, just as water and
  power etc.
• Utility Computing has been widely recognized and
  adopted by industry and academia
• IBM Oceano
• HP Utility Data Center
• PlanetLab
• Opus

3
Todays Talk

• Application Service Hosting from Utility
  Computing Perspective

4

• Challenges ?

5

• On-demand creation of services

• Virtualization of services

• Isolation between services

Physical node
Physical Link
Virtual node
Virtual Link
Utility demand
Shared Utility Infrastructure
6

• Solution ?

7
Outline

• System Overview
• Related/Previous Work
• On-Demand Service Creation
• Service Isolation/Virtualization
• Conclusion

8
System Overview

• Node Deployment (CODA)
• Dynamic Node Membership
• Node Priming

• Service Deployment
• Service On-Demand Instantiation
• Service Activation
• Service Teardown

9
Related Work

• Node Deployment (CODA)

Oceano
Utility OS for hosted Web services with dynamic
load.
Dynamic clusters
OS-Agnostic
CODA
Similar to COD
Beowulf
Emulab
Flexible configuration
Config tools for Linux computing clusters
Configures static sub-clusters for emulation
experiments.
Douglas E. Comer and Xuxian Jiang Running Linux
On Back-end Computers In the Xinu Lab Technical
Report, Department of Computer Sciences, Purdue
University, West Lafayette, IN, 2003
10
Related Work (contd)

• Service Deployment (SODA)

Denali
Scalable isolation kernel
Clusters of Slices
Service-Agnostic
SODA
PlanetLab
Opus
Infrastructure Deployment
Internet-scale testbed
Overlay Peering Utility Services
Xuxian Jiang and Dongyan Xu SODA a
Service-On-Demand Architecture for Application
Service Hosting Utility Platforms to appear in
Proceedings of The 12th IEEE International
Symposium on High Performance Distributed
Computing (HPDC-12), Seattle, WA, June, 2003
11
Outline

• SODA Overview
• Related/Previous Work
• On-Demand Service Creation
• Service Isolation/Virtualization
• Conclusion

12
On Demand - How?

• Node deployment (CODA)
• Hardware configuration
• Node priming

• Service deployment (SODA)
• Service download
• Service activation
• Service resizing
• Service teardown

13
Node Deployment (CODA)


A.K.A. Xinu Back-end Testbed
14
Application Service Deployment (SODA)

• Service Download
• Similar with kernel image download
• Key Entities
• Service Agent
• Service Master
• Service Daemon
• Service Switch

15
Service Request From Clients
Service Request From Clients
Service Switch for S
Service Switch for S
Service S
SODA Daemon
Service S
SODA Daemon
Service S
SODA Daemon
Service S
Virtual Server
Guest OS
Guest OS
Guest OS
Guest OS
Host OS
Host OS
Host OS
SODA Master
SODA Agent
Service Creation Request From ASP
16
Outline

• SODA Overview
• Related/Previous Work
• On-Demand Service Creation
• Service Isolation/Virtualization
• Conclusion

17
Service Isolation - How ?
One Physical node

• Resource Virtualization
• CPU Cycles
• Network Bandwidth
• Memory Size
• Disk Storage
• Virtual Machine
• GuestOS (UML)
• Isolation Kernel
• Proportional Scheduler
• CPU, Network Bandwidth, Memory
• Virtual Server Internetworking

Virtual Server

GuestOS
GuestOS
Host OS
18
VM-based Isolation Features

• Administrative Isolation
• Fault/Intrusion Isolation
• Resource Isolation

19
VM-based Sample Services
Scenario 1. One web service 2. One
honeynet hosting
20
Isolation Kernel

• CPU Isolation
• Network Out-bound Bandwidth Isolation
• Memory Usage Limit

21
CPU Isolation
Scenario 1) CPU-intensive green 2)
IO-intensive blue 3) Web red
Original Linux CPU Scheduler
Linux CPU Fair Scheduler
22
Service Virtualization Load Balancing - How ?
Client Request

• Virtual Server
• Virtual Cluster
• Service Switch

23
Service Virtualization Load Balancing
Scenario 1. ResaResb 12 2. ReqaReqb
12
Host OS
Distribution of requests by Service Switch
Response time from virtual service node
24
Service Bootstrapping Time
Linux Configuration Image size Time(seattle) Time(tacoma)
Rootfs_tomrtbt_1.7.205 15 MB 2.0 sec. 3.0 sec.
Rootfs_base_1.0 29.3 MB 3.0 sec. 4.0 sec.
Root_fs_lfs_4.0 400 MB 4.0 sec. 16.0 sec.
Root_fs.rh-7.2-server.pristine.20021012 253 MB 22.0 sec. 42.0 sec.
seattle Dell PowerEdge server with 2.66GHz Intel
Xeon processor and 2GB RAM tacoma Dell desktop
PC with 1.8GHz Intel Pentium 4 processor and
768MB RAM
25
Slow Down factor
Scenario 1. Virtual service node with
service switch 2. Service running in host OS
with service switch 3. Service running in
host OS without service switch
System call VM (cycles) Linux
getpid 27,276 1,208
geteuid 26,648 1,064
dup2 26,904 1,084
mmap 27,864 1,208
munmap 27,044 1,200
gettimeofday 37,004 1,368
26
Outline

• SODA Overview
• Related/Previous Work
• On-Demand Service Creation
• Service Isolation/Virtualization
• Conclusion

27
Conclusion

• Design and Implementation of SODA architecture
• Highly Efficient On-demand Service Priming
• Satisfactory Service Isolation
• VM-based approach to address Application Service
  Hosting paradigm

28
Future Work

• Other VMs
• Resource Allocation Model Algorithm
• Service Placement
• Service Migration
• Freeze / Migrate/ Restart
• Security

29
Publication

• Xuxian Jiang, Dongyan Xu, "Protection of
  Application Service Hosting Platforms an
  Operating System Perspective", submitted for
  publication, April 2003
• Xuxian Jiang and Dongyan Xu SODA a
  Service-On-Demand Architecture for Application
  Service Hosting Utility Platforms to appear in
  Proceedings of The 12th IEEE International
  Symposium on High Performance Distributed
  Computing (HPDC-12), Seattle, WA, June, 2003
• Douglas E. Comer and Xuxian Jiang Running Linux
  On Back-end Computers In the Xinu Lab Technical
  report, Department of Computer Sciences, Purdue
  University, work in progress 2003
• Xuxian Jiang, Yu Dong, Dongyan Xu, Bharat
  Bhargava GnuStream A P2P Media Streaming System
  Prototype to appear in IEEE International
  Conference on Multimedia Expo (ICME), July 2003
  

30
References

• Services Migration
• 1.1, 09/01 Steven Osman, Dinesh Subhraveti,
  Gong Su, and Jason Nieh, "The Design and
  Implementation of Zap A System for Migrating
  Computing Environments", Proceedings of the Fifth
  Symposium on Operating Systems Design and
  Implementation (OSDI 2002), Boston, MA, December
  9-11, 2002, pp. 361-376.
• 1.2, 14/01 S. Ranjan, J. Rolia, H. Fu, and E.
  Knightly, "QoS-Driven Server Migration for
  Internet Data Centers", in Proceedings of IWQoS
  2002, Miami, FL, May 2002.
• 1.3, 05/02 Amin Vahdat, Thomas Anderson,
  Michael Dahlin, David Culler, Eshwar Belani, Paul
  Eastham, and Chad Yoshikawa, "WebOS Operating
  System Services For Wide Area Applications", in
  The Seventh IEEE Symposium on High Performance
  Distributed Computing, July 1998.
• Utility Computing
• 2.1, 09/01 K. Appleby, S. Fakhouri, L. Fong,
  G. Goldszmidt, and M. Kalantar, "Oceano SLA
  Based Management of a Computing Utility", in
  IFIP/IEEE Intl. Symp. on Integrated Network
  Management May 2001
• 2.2, 06/02 Andrew A. Chien, "Architecture of
  the Entropia Distributed Computing System, ",
  International Parallel and Distributed Processing
  Symposium April 2002
• 2.3, 12/02 R. Figueiredo, P. Dinda, J.
  Fortes, "A Case For Grid Computing on Virtual
  Machines ", ICDCS 2003, to appear 2003
• Cluster
• 3.1, 11/01 Justin Moore, Jeff Chase "Cluster
  On Demand", CS Technical Report Duke University,
  May 2002

31
References (2)

• Virtual Machine
• 4.1, 09/01 Andrew Whitaker, Marianne Shaw, and
  Steven D. Gribble, "Scale and Performance in the
  Denali Isolation Kernel" Proceedings of the Fifth
  Symposium on Operating System Design and
  Implementation (OSDI 2002), Boston, MA, December
  2002
• 4.2, 15/01 George W. Dunlap, Samuel T. King,
  Sukru Cinar, Murtaza Basrai, Peter M. Chen,
  "ReVirt Enabling Intrusion Analysis through
  Virtual-Machine Logging and Replay" Proceedings
  of the 2002 Symposium on Operating Systems Design
  and Implementation (OSDI) ,, Boston, MA, December
  2002
• 4.3, 15/01 C. P. Sapuntzakis, R. Chandra, B.
  Pfaff, J. Chow, M. S. Lam and M. Rosenblum,
  "Optimizing the Migration of Virtual Computers",
  in Proceedings of the Conference on Operating
  Systems Design and Implementation, December 2002.
  
• 4.4, 15/01 Emin Gun Sirer, Robert Grimm,
  Arthur J. Gregory and Brian N. Bershad, "Design
  and Implementation of a Distributed Virtual
  Machine for Networked Computers", in Proceedings
  of the Seventeenth Symposium on Operating Systems
  Principles, pages 202-216, Kiawah Island, South
  Carolina, December 1999.
• 4.5, 18/01 Peter M. Chen, Brian D. Noble,
  "When virtual is better than real", Proceedings
  of the 2001 Workshop on Hot Topics in Operating
  Systems (HotOS), May 2001. review 4.6, 01/02
  Karim Yaghmour, "Adaptive Domain Environment for
  Operating Systems", Opersys Inc., June 2002.

32
References (3)

• Resource Management
• 5.1, 10/01 John Reumann, Ashish Mehra, Kang G.
  Shin, and Dilip Kandlur, "Virtual Services A New
  Abstraction for Server Consolidation,'', in Proc.
  of USENIX 2000 Annual Technical Conference, June
  18-23, 2000, San Diego, CA, U.S.A.
• 5.2, 12/01 Bhuvan Urgaonkar, Prashant Shenoy
  and Timothy Roscoe, "Resource Overbooking and
  Application Profiling in Shared Hosting
  Platforms'', Proceedings of the Fifth Symposium
  on Operating Systems Design and Implementation
  (OSDI),, Boston, MA, December 2002
• 5.3, 13/01 Kai Shen, Hong Tang, Tao Yang, and
  Lingkun Chu, "Integrated Resource Management for
  Cluster-based Internet Services''. in Proc. of
  the 5th USENIX Symposium on Operating Systems
  Design and Implementation (OSDI'02), Boston MA,
  December 2002
• 5.4, 15/01 Gaurav Banga, Jeffrey C. Mogul and
  Peter Druschel "Resource containers A new
  facility for resource management in server
  systems'' . in Proceedings of the Third Symposium
  on Operating Systems Design and Implementation
  (OSDI), , New Orleans, LA, February 1999
• 5.5, 15/01 Mohit Aron, Peter Druschel and
  Willy Zwaenepoel, "Cluster Reserves A Mechanism
  for Resource Management in Cluster-based Network
  Servers". in Proceedings of the ACM SIGMETRICS
  Conference on Measurement and Modeling of
  Computer Systems , Santa Clara, CA, June 2000
• 5.6, 17/01 Jose Renato Santos, Koustuv
  Dasgupta, G. (John) Janakiraman and Yoshio
  Turner, "Understanding service demand for
  adaptive allocation of distributed resources". in
  Proceedings of IEEE Global Internet Symposium
  (GLOBECOM '02), Taipei, Taiwan, November 17-21,
  2002

33
References (4)

• Network Servers
• 6.1, 15/01 Mohit Aron, Darren Sanders, Peter
  Druschel and Willy Zwaenepoel, "Scalable
  Content-aware Request Distribution in
  Cluster-based Network Servers". in Proceedings of
  the USENIX 2000 Annual Technical Conference , San
  Diego, CA, Jun 2000
• 6.2, 16/01 Matt Welsh, David Culler, and Eric
  Brewer. "SEDA An Architecture for
  Well-Conditioned, Scalable Internet Services". in
  Proceedings of the Eighteenth Symposium on
  Operating Systems Principles (SOSP-18), Banff,
  Canada, October, 2001 6.3, 16/01 Matt Welsh,
  David Culler. "Virtualization Considered Harmful
  OS Design Directions for Well-Conditioned
  Services". in Proceedings of the 8th Workshop on
  Hot Topics in Operating Systems (HotOS VIII), ,
  Schloss Elmau, Germany, May, 2001
• 6.4, 04/02 Jeremy Kerr "Achieving Linear
  Scalability of Network Services through Load
  Balancing".   "Research Proposal Selection
  Algorithms Dynamic Feedback in Network Load
  Balancer"  "A review of currently available
  literature on load balancing "  Course Project
• Linux-Based extension
• 7.1, 16/01 David Coulson, "UML-based
  pseudo-dedicated hosting service".
  OpenConsultancy 2002
• 7.2, 17/01 Ashvin Goel, Luca Abeni, Charles
  Krasic, Jim Snow, and Jonathan Walpole,
  "Supporting time-sensitive applications on
  general-purpose operating systems.". In
  Proceedings of the Fifth USENIX Symposium on
  Operating Systems Design and Implementation Dec
  2002
• 7.3, 05/02 Vijay Sundaram, Abhishek Chandra,
  Pawan Goyal and Prashant Shenoy, "Application
  Performance in the QLinux Multimedia Operating
  System ". Proceedings of the Eighth ACM
  Conference on Multimedia, Los Angeles, CA, pages
  127-136, November 2000.

34
References (5)

• Emulation Network testbed
• 8.1, 18/01 Amin Vahdat, Ken Yocum, Kevin
  Walsh, Priya Mahadevan, Dejan Kostic, Jeff Chase,
  and David Becker, "Scalability and Accuracy in a
  Large-Scale Network Emulator". Proceedings of 5th
  Symposium on Operating Systems Design and
  Implementation (OSDI), Dec. 2002
• 8.2, 27/01 Christopher A. Telfer,
  "Implementation and Evaluation of Reconfigurable
  Network Testbed" Ph.D. Thesis March 2003
  chapters 2  3  4  5 
• 8.3, 05/02 White, Lepreau, Stoller, Ricci,
  Guruprasad, Newbold, Hibler, Barb, and Joglekar,
  "An Integrated Experimental Environment for
  Distributed Systems and Networks" 0SDI 2002 Dec
  2002
• 8.4, 05/02 Larry Peterson, Tom Anderson David
  Culler, and Timothy Roscoe, "A Blueprint for
  Introducing Disruptive Technology into the
  Internet" Proceedings of the 1st ACM Work on Hot
  Topics in Networks (HotNets-I), Princeton, NJ
  October 28-29, 2002
• 8.5, 06/02 Xin Liu, Huaxia Xia, and Andrew
  Chien, "Network Emulation Tools for Modeling Grid
  Behaviors." The 3rd IEEE/ACM International
  Symposium on Cluster Computing and the Grid
  CCGrid 2003