AWS

1
AWS

• Amazon Web Services

Georges Akpoly CS252
2
Overview of AWS

• Amazon Elastic Compute Cloud (EC2)
• Amazon Simple Storage Service (S3)
• Amazon Simple Queue Service (SQS)
• Amazon Mechanical Turk (MTurk)
• Alexa Web Services
• Amazon E-Commerce Service (ECS)
• Amazon Flexible Payments Service (FPS)

3
Starting Point
One machine Apache, IIS PHP / Perl / Java /
SQL Server, MySQL, Oracle
4
Worst Case Populariy
5
A Difficult Path
6
Problem Backup

• High availability
• Redundancy
• Very big data sets

7
Problem File System

• Important files have to be accessed by many
  servers
• NFS / Samba not practical

8
Problem Messaging

• Many servers on different locations have to
  communicate
• Creating a reliable and scalable message queue is
  really hard

9

• Dont reinvent the wheel!

10
Amazon Web Services
11
S3 - Simple Storage Service

• Redundant storage - as much as you like
• max. 5 GB per object
• Organized in Buckets
• Web Service API for uploads
• Downloads via
• Web Service
• HTTP / HTTPS
• BitTorrent

12
S3 - Buckets

• Unique over all S3
• Contains many key-value-metadata tupel
• Cannot contain other buckets!
• Key can contain /

13
S3 with AWSS3

• Upload

• Download

14
S3 with AWSS3

• How do you run a website from S3
• 1 caveat no index.html support
• So its only useful to offload traffic and
  storage from your main site

15
S3 with AWSS3

• Set up a bucket name vanlug
• Store a key in it tux.png
• Make it publicly accessible
• Set up a CName static.vanlug.com and points it
  to vanlug.s3.amazonaws.com
• Load up http//static.vanlug.com/tux.png
• Thats it.

16
S3 with AWSS3

• JungleDisk
• This application lets you mount S3 like it is a
  local drive
• Cross platform, support linux, Mac, Windows
• Encryption can be pre or post upload.

17
EC2 - Elastic Compute Cloud

• Based on XEN virtualization
• On demand virtual servers - controlled with Web
  Service API

• Use your favorite Linux distro (Linux 2.6.16),
  Amazon Machine Images (AMI) are stored on S3
• ACLs for hosts/ports access control

18
EC2 - Elastic Compute Cloud

• How much does it cost
• Traffic between EC2 instances and S3 is free.
  Even if they are not in the same datacenter
• 0.10 per instance-hour consumed ( or part of an
  hour consumed)
• Same prices for traffic and storage as S3

19
EC2 - Elastic Compute Cloud

• What you can do with it
• You are the root, do anything
• Install software
• Apache
• VPN
• UT2004, Call of Duty
• Jabber
• Load kernel modules

20
SQS - Simple Queue Service

• Distributed, highly scalable and reliable message
  system
• Unlimited number of queues and messages
• Locking / releasing built-in
• 256 KB message payload
• Basic permission model

21
SQS gem
Setup
Usage
22
MTurk

• Amazon uses Artificial Artificial Intelligence
• Submitters enter Human Intelligence tasks into
  the queue and workers can solve them
• Workers can be tested for capabilities before
  they are trusted
• Submitters can refuse results if they find them
  unsatisfactory
• There are feedback system in place so Workers can
  know if the submitters will pay

23
MTurk

• Some examples
• Podcast transcription services
• Image recognition for mapping service
• Amazon has used it themselves for internal
  projects

24
Resources

• Developer Connection
• http//developer.amazonwebservices.com/connect/kb
  category.jspa?categoryID59
• Forums
• http//developer.amazonwebservices.com/connect/fo
  rumindex.jspa
• Resource Center
• http//developer.amazonwebservices.com/connect/kbc
  ategory.jspa?categoryID59
• 265,000 developers

25
Questions???
26
Thank you for your attention