Implementation and Evaluation

1
Implementation and Evaluation

• Sam Madden
• with
• Ling, Panos, Phil, Reed, Teja, Vijay

2
How do we implement and evaluate?

• Simulations?
• Benchmarks?
• Datasets
• Testbeds!

3
Testbeds

• Classes of testbeds
• Cars
• Phones
• Military Testbeds

4
Desirable Properties

• Realistic
• Maintainable
• Incentives?
• Appropriateness of API / available features
• Black box give me data
• Low-level network access
• Scale
• Privacy / Security
• Policies, etc.
• Involve both research industry
• Openness / IP rights
• Simple!

5
Conclusion

• Testbeds are key to being able to implement and
  evaluate mobile sensornet applications
• Tools to help manage / track / store / anonymize
  data from these testbeds are needed
• What is the role of GENI?
• What about SBIR / STTR?