Universal Computing @ Berkeley Activities in the ISRG / Endeavour

1
Universal Computing _at_ BerkeleyActivities in the
ISRG / Endeavour

• David Culler
• Randy Katz, Eric Brewer, Anthony Joseph, James
  Landay and others
• http//www.cs.berkeley.edu/culler
• Philips Visit
• 8/5/99

2
Natural Tides of Innovation
Innovation
??
Integration
Personal Computer Workstation Server
Log R
Minicomputer
Mainframe
2/99
Time
3
Expanding the Spectrum

• Desktops
• max out at few 100M
• in your face
• connected to the infrastructure

4
Issues Converge at the Extremes

• Powerful Services on Small Devices
• massive computing and storage in the
  infrastructure
• active adaptation of form and content on the
  way
• Lean, Flexible Communication Building-Blocks
• simplicity is the key to efficiency
• Federated System of Systems
• Availability, Automatic Configuration and
  Management
• Novel interfaces and usage models
• Plug it all together and have it DWYM!
• Computer Science focused on problems of scale!

5
Outline

• Brief perspective on current activities
• Directions ahead under the Endeavour effort

6
ISRG Projects

• Millennium Testbed
• Culler, Demmel, (Intel, NSF, UCB, Microsoft,
  Sun, IBM, Nortel)
• Ninja Proactive Infrastructure
• Brewer, Culler, Katz, Joseph (ARPA)
• Iceberg Computer/Telephony Integration
• Katz, Joseph (Ericsson, ATT)
• Istore / Telegraph / Oceanic
• Patterson, Hellerstein, Kubiatowitz, Brewer
• GUIR - novel user interfaces
• Landay
• Universal Computing Lab
• IBM
• gt Endeavour Expedition to the 21st Century

7
Underlying Message

• Its not just putting together good computer
  science research projects, its growing a
  community that thinks in the emerging world

8
Experimental Testbed
Fax
IBM WorkPad
Image/OCR
Text
Speech
MC-16
Ericsson
CF788
Motorola Pagewriter 2000
WLAN
Pager
306 Soda
405 Soda
326 Soda Colab
GSM BTS
Network Infrastructure
Millennium Cluster
Smart Spaces Personal Information Management
Millennium Cluster
9
Ninja Vision

• You walk into a room

10
Push Services into an Active Infrastructure
Infrastructure Services
gt enable Distributed Innovation of Scalable,
Avail. Services
11
Embedded Untrusted Interface?
12
One Time Passwd to pseudo-service

• Cannot increasing the security of the channel so
  decrease the value of the content.

13
Informal Collaborative Interfaces
Take free-form ink notes on Pilots or CrossPads
Meet in any environment
accumlate, share, transform in the
infrastructure
14
Building the Bazaar

• What we need is not just a new research project,
  but a new computing culture
• gt Build a department-wide, universal wireless
  PDA infrastructure, smart spaces and a community
  to take it forward
• Initial Seed Fall 98 with IBM
• 150 IBM workpads lots of cradles IR ???
• Pervade the first-year grad research projects
• bold experiment in the senior UI course
• accelerated the on-going research efforts
• Follow-on Universal Computing Lab
• Endeavour provides the framework

15
Some Lessons

• Communication is enabling
• low-power wireless needs to be like IP
• Virtual Environment is important
• Devices connect into the infrastructure
• Network HotSync, groupware, centralized e-mail
• gt Need lean, clean communication substrate
• User Service is fundamental
• not just profile and customization info
• routing point for security
• Much room for improvement in devices
• Development effort is the limiting factor
• OSKI 1 person for infrastructure, 2 for WorkPad
• gt need complete distributed system debugging and
  simulation environment

16
The Endeavour ExpeditionCharting the Fluid
Information Utility

• Randy H. Katz, Principal Investigator
• EECS Department
• University of California, Berkeley
• Berkeley, CA 94720-1776

17
Vision/Objective

• Enhancing human understanding through information
  technology
• Make it dramatically more convenient for people
  to interact with information, devices, and other
  people
• Supported by a planetary-scale Information
  Utility
• Stress tested by challenging applications in
  decision making and learning
• New methodologies for design, construction, and
  administration of systems of unprecedented scale
  and complexity
• Figure of merit how effectively we amplify and
  leverage human intellect
• A pervasive Information Utility, based on fluid
  systems technology to enable new approaches for
  problem solving learning

18
Potential Impacts on Commercial Practice

• Personal Information Mgmt is the Killer App
• Not corporate processing but management,
  analysis, aggregation, dissemination, filtering
  for the individual
• People Create Knowledge, not Data
• Not management/retrieval of explicitly entered
  information, but automated extraction and
  organization of daily activities
• Information Technology as a Utility
• Continuous service delivery, on a
  planetary-scale, constructed on top of a highly
  dynamic information base
• Beyond the Desktop
• Community computing infer relationships among
  information, delegate control, establish
  authority

19
Proposed Approach

• Information Devices
• Beyond desktop computers to MEMS-sensors/actuators
  with capture/display to yield enhanced activity
  spaces
• InformationUtility
• InformationApplications
• High Speed/Collaborative Decision Making and
  Learning
• Augmented Smart Spaces Rooms and Vehicles
• Design Methodology
• User-centric Design withHW/SW Co-design
• Formal methods for safe and trustworthy
  decomposable and reusable components

• Fluid, Network-Centric System Software
• Partitioning and management of state between soft
  and persistent state
• Data processing placement and movement
• Component discovery and negotiation
• Flexible capture, self-organization, and re-use
  of information

20
High Speed Decision Making
Learning Classroom
E-Book
Vehicles
Applications
Collaboration Spaces
Info Appliances
Human Activity Capture
Generalized UI Support
Event Modeling
Transcoding, Filtering, Aggregating
Statistical Processing/Inference
Proxy Agents
Negotiated APIs
Self-Organizing Data
Information Utility
Interface Contracts
Wide-area Search Index
Nomadic Data Processing
Wide-Area Data Processing
Automated Duplication
Distributed Cache Management
Movement Positioning
Stream- and Path-Oriented Processing Data Mgmt
Non-Blocking RMI
Soft-/Hard-State Partitioning
Laptop
PDA
Wallmount Display
Camera
Information Devices
Smartboard
MEMS Sensor/Actuator/Locator
Handset
21
Task Structure

• Task 1 Base Program
• Option 1 Systems Architecture for Vastly Diverse
  Computing Devices
• Option 2 Implementation and Deployment of the
  Oceanic Data Information Utility
• Option 3 Sensor-Centric Data Management for
  Capture and Reuse
• Option 4 Negotiation Architecture for
  Cooperating Components
• Option 5 Tacit Knowledge Infrastructure and
  High-Speed Decision-Making
• Option 6 Information Management for Intelligent
  Classroom Environments
• Option 7 Scalable Safe Component-based Design
  and UI Design Tools
• Option 8 Scaled-up Field Trials

22
Base Program Leader Katz

• Broad but necessarily shallow investigation into
  all technologies/applications of interest
• Primary focus on Information Utility
• No new HW design commercially available
  information devices
• Only small-scale testbed in Soda Hall
• Fundamental enabling technologies for Fluid
  Software
• Partitioning and management of state between soft
  and persistent state
• Data and processing placement and movement
• Component discovery and negotiation
• Flexible capture, self-organization, info re-use
• Limited Applications
• Methodology Formal Methods User-Centered Design

23
Option 1 System Architecture for Vastly Diverse
DevicesLeader Culler

• Distributed control resource management data
  mvmt transformation, not processing
• Path concept for information flow, not the thread
• Persistent state in the infrastructure, soft
  state in the device
• Non-blocking system state, no application state
  in the kernel
• Functionality not in device is accessible thru
  non-blocking remote method invocation
• Extend the Ninja concepts (thin client/fat
  infrastructure) beyond PDAs to MEMS devices,
  cameras, displays, etc.

24
Option 2 Implementation Deploy-ment of Oceanic
Data Info UtilityLeader Kubiatowicz

• Nomadic Data Access serverless, homeless, freely
  flowing thru infrastructure
• Opportunistic data distribution
• Support for promiscuous caching freedom from
  administrative boundaries high availability and
  disaster recovery application-specific data
  consistency security
• Data Location and Consistency
• Overlapping, partially consistent indices
• Data freedom of movement
• Expanding search parties to find data, using
  application-specific hints (e.g., tacit
  information)

25
Option 3 Sensor-Centric Data Management for
Capture/ReuseLeader Hellerstein

• Integration of embedded MEMS with software that
  can extract, manage, analyze streams of
  sensor-generated data
• Wide-area distributed path-based processing and
  storage
• Data reduction strategies for filtering/aggregatio
  n
• Distributed collection and processing
• New information management techniques
• Managing infinite length strings
• Application-specific filtering and aggregation
• Optimizing for running results rather than final
  answers
• Beyond data mining to evidence accumulation
  from inherently noisy sensors

26
Option 4 Negotiation Architecture for
Cooperating ComponentsLeader Wilensky

• Cooperating Components
• Self-administration through auto-discovery and
  configuration among confederated components
• Less brittle/more adaptive systems
• Negotiation Architecture
• Components announce their needs and services
• Service discovery and rendezvous mechanisms to
  initiate confederations
• Negotiated/contractural APIs contract designing
  agents
• Compliance monitoring and renegotiation
• Graceful degradation in response to environmental
  changes

27
Option 5 Tacit Knowledge Infra-structure/Rapid
Decision MakingLeader Canny

• Exploit information about the flow of information
  to improve collaborative work
• Capture, organize, and place tacit information
  for most effective use
• Learning techniques infer communications flow,
  indirect relationships, and availability/participa
  tion to enhance awareness and support
  opportunistic decision making
• New collaborative applications
• 3D activity spaces for representing
  decision-making activities, people, information
  sources
• Visual cues to denote strength of ties between
  agents, awareness levels, activity tracking,
  attention span

28
Option 6 Info Mgmt for Intelligent
ClassroomsLeader Joseph

• Electronic Problem-based Learning
• Collaborative learning enabled by information
  appliances
• Enhanced Physical and Virtual Learning Spaces
• Wide-area, large-scale group collaboration
• Capture interaction once for replay
• Preference/task-driven information device
  selection
• Service accessibility
• Device connectivity
• Wide-area support
• Iterative evaluation

29
Option 7 Safe Component Design and UI Design
ToolsLeader Sangiovanni

• Information Appliances as an application of
  hardware/software codesign
• Co-design Finite State Machines (CFSMs)
• Formal methods to verify safety from faults
• Safe partitioning of components into
  communicating subcomponents placed into the
  wide-area
• Model-based User Interface Tools
• Information device user interfaces
• Multimodal interface design for variety of devices

30
Option 8 Scaled-up Field TrialsLeader Katz

• Testbed Rationale
• Study impact on larger/more diverse user
  community
• Higher usage levels to stress underlying
  architecture
• Make commitment to true utility functionality
• Increasing Scale of Testbeds
• Building-Scale
• Order 100s individuals
• Campus-Scale
• Order 1000s individuals
• City-Scale
• Order 100000 individuals

31
Putting It All Together

• 1. Diverse Devices
• 2. Data Utility
• 3. Capture/Reuse
• 4. Negotiation
• 5. Tacit Knowledge
• 6. Classroom
• 7. Design Methods
• 8. Scale-up

Devices Utility Applications
Component Discovery Negotiation
Fluid Software
Info Extract/Re-use
Self-Organization
Group Decision Making Learning
32
universal

• Function adjective
• 1 including or covering all or a whole
  collectively or distributively without limit or
  exception
• 2 a present or occurring everywhere b
  existent or operative everywhere or under all
  conditions ltuniversal cultural patternsgt
• 3 a embracing a major part or the greatest
  portion (as of mankind) lta universal stategt
  ltuniversal practicesgt b comprehensively broad
  and versatile lta universal geniusgt
• 4 a affirming or denying something of all
  members of a class or of all values of a variable
  b denoting every member of a class lta universal
  termgt
• 5 adapted or adjustable to meet varied
  requirements (as of use, shape, or size)

33
F99 Universal Computing Lab w/ IBM

• Intelligence in the infrastructure
• Production Ninja cluster servers
• Computing and connectivity wherever you go
• compact notebooks
• and in the space around you
• kiosk machines with touch-sensitive flat panels
• with novel form factors
• more pilots
• plus a mix of wired ethernet, wireless, and IR
• rennovated offices to form a flexible shared
  space cutting across areas

34
Where should Philips and UCB go together?
35
Constrained Personal Device Untrusted Gateway
NINJA
Key Store
Personal Appl
sRMI
Content Filter (pseudonym)
Embeded Untrusted Client
https
DATEK (Trust Contract)
Trusted Client
The Internet
https
36
Example Minimal Trader

• Shared secret between user and keystore
• keystore maps to service identity /
  authentication
• Content filter transcodes to very concise info to
  pilot

37
Uniform Access to Diverse Services
NINJA
Key Store
Personal Appl
sRMI
GWY
RMI PXY
ST
CF
Trade-R-us
Trade-R-us
Content Filter (pseudonym)
Embeded Untrusted Client
https
DATEK (Trust Contract)
Trusted Client
The Internet
https
38
Automated Clients, ...
NINJA
Key Store
Personal Appl
sRMI
GWY
RMI PXY
ST
CF
BOT svc
Trade-R-us
Trade-R-us
Content Filter (pseudonym)
Embeded Untrusted Client
https
DATEK (Trust Contract)
Trusted Client
The Internet
https
39
Fall98 Project Excerpts

• E-Commerce and Security
• Pay-Per-Use Services on the Palm Computing
  Platform (Mike Chen, Andrew Geweke)
• Secure Email Infrastructure for PDAs (Hoon Kang,
  Rob von Behren)
• SyncAnywhere - Secure Network HotSync (Mike Chen,
  Helen Wang)
• Groupware
• Kiretsu - Ninja Instant Messaging Service (Matt
  Welsh, Steve Gribble)
• The MASH MediaPad - Shared Electronic Whiteboard
  for the PalmPilot (Yatin Chawathe)
• NotePals - Lightweight Meeting Support Using PDAs
  (Richard Davis)
• OSKI - Open Shared Kalendaring Infrastructure
  (Jason Hong, Brad Morrey, Mark Newman)
• OS and Communications
• PalmRouter - Networking Sporadically Connected
  Devices (Andras Ferencz, Robert Szewczyk)
• Numerous Architecture Studies
• Excellent UI Projects
• Ink Chat, Nutrition/Excercise Tracker, Rendezvous
  - Meeting Scheduler