NETE4631 Working with Cloud-based Storage

1
NETE4631Working with Cloud-based Storage

• Lecture Notes 11

2
Mobile Cloud Computing - Recap

• Mobile cloud computing
• A model where processing is done in the cloud,
  data is stored in the cloud, mobiles device
  serves as a presentation platform or a display
• Advantage of cloud apps to mobile cloud
• Thinner devices -gt less processing, consume less
  power, and have better battery life
• Avoidance of vendor lock-in.

3
Securing Approach Recap (2)

• Mobile web service are those in which information
  is transferred between applications (browser) and
  services over the internet.
• WS-Discovery from OASIS Standard
• WSDL (Web Service Description Language)
• UDDI (Universal Description, Discovery, and
  Integration)
• SOAP (Simple Object Access Protocol)

4
BlackBerry Push Service Recap (3)
5
Lecture Outline

• Measuring the digital universe
• Provisioning cloud storage
• Creating cloud storage systems
• Cloud backup solutions
• Cloud storage interoperability

6
Measuring the Digital Universe

• Facts of hunger for storage
• An email with a 1GB attachment to 3 people can
  generate an estimated 50GB of stored managed
  data.
• Only 25 of the data stored is unique, while 75
  of the data stored is duplicated.
• 70 of the data stored in the world is used
  initiated.
• More than 50 of the data created everyday is the
  data that is automatically generated, especially
  from video cameras and surveillance photos,
  financial transaction event logs, performance
  data and so on.
• Much of the data produced is temporal, and
  deleted.

7
EMCs Digital Universe Homepage
8
Cloud Storage Data Usage in 2020

• By International Data Corporation, Digital
  Universe, May 2010

9
Provisioning Cloud Storage

• IaaS model
• Storage accessed by Web service API
• Cloudy characteristics
• Network access most often through browser
• On-demand provisioning
• User control
• SaaS model
• Software package on top of cloud storage for
  backup, synchronization, archiving, etc.

10
Storage Devices

• Block storage device
• Raw storage that can create volumes
• Data is transferred in blocks
• Example, hard disk, flash drives
• Faster data transfers/ additional overhead on
  clients
• File storage device
• Expose its storage to client in a form of files
• Example, file server, most often in the form of
  Network Attached Storage (NAS) devise
• Slower transfers/ less overhead from clients

11
Cloud Storage Types

• Unmanaged storage
• Preconfigured storage (limited level of mgt)
• Cannot (1) format as your like, (2) install your
  own file system (FAT, NTFS), and (3) change drive
  properties (compression, encryption)
• Reliable, relatively cheap, easy to work with
• Managed storage
• Provided as a raw disk
• Can (1) format and partition the disk, (2) attach
  or mount the disk, and (3) make storage assets
  available to applications and other users
• Support applications built using Web services

12
Dropbox File Transfer Utility
13
Amazon S3 and Rackspace Cloud
14
Creating Cloud Storage Systems

• Concepts
• Multiple copies of data are stored on multiple
  servers and in multiple locations
• Storage virtualization software
• Failover - gt changing the pointers to the stored
  objects location
• Example
• Amazon Web Service (EC2, S3) supports failover
  / load balancing -gtbut you must purchase these
  features

15
ByCasts StorageGRID
16
Evaluating Cloud Storage

• Important considerations
• Client self-service
• Strong management capabilities
• Scale up more disks
• Scale out additional storage systems
• Performance characteristics such as throughput
• Block-based or file-based protocol support
• Seamless maintenance and upgrades

17
Cloud Backup Solutions

• Last line of defense in a strong backup routine
• Backup types
• Full system or image backups
• Point-in-time (PIT) backups or snapshots
• Incremental backups
• 3-2-1 Backup rule
• 3 copies (1 primary and 2 backups)
• 2 different media
• 1 copy should be stored offside

18
Cloud Backup Features

• Logon authentication
• High encryption of data transfers
• Automated and scheduled backup
• Fast backup (snapshots) after full online backup,
  with 10-30 historical versions of a file retained
• Ability to retrieve historical versions of file

19
Cloud Backup Features (2)

• Multiplatform support
• Web-based management console
• 24x7 technical support
• Logging and reporting of operations
• Multisite storage or replication, enabling data
  failover

20
Cloud Attached Backup
21
Cloud Storage Interoperability

• Open standards (operating-system neutral and
  file-system neutral)
• Workgroups
• Cloud Data Management Interface (CDMI) from
  Storage Networking Industry Association (SNIA)
• http//www.snia.org
• Open Cloud Computing Interface (OCCI) from SNIA
  and Open Grid Forum (OGF)
• http//www.ogf.org

22
References

• Chapter 15 of Course Book Cloud Computing Bible,
  2011, Wiley Publishing Inc.