NovelSee - PowerPoint PPT Presentation
Title:
NovelSee
Description:
Eric Minner & James Pittman Outline Project Statement / Motivation Concept overview Quick computer vision overview Demo Lessons Learned Future Work Project ... – PowerPoint PPT presentation
Number of Views:60
Avg rating:3.0/5.0
Title: NovelSee
1
NovelSee
- Eric Minner James Pittman
2
Outline
- Project Statement / Motivation
- Concept overview
- Quick computer vision overview
- Demo
- Lessons Learned
- Future Work
3
Project Description
- Participatory sensing often relies on receiving a
great number of varied inputs to provide a useful
service. - The goal of the project is to design a system
concept that will find novel images in the world. - This system needs to have a way to help encourage
a stream of interesting and novel shots.
4
Concept Overview
- Leverage existing mobile phone capture and image
transfer protocols to allow users to submit
images. - Setup a backend server using apache, and a
website to host novel photo of the day - Use a computer vision algorithm to parse the
submitted images and create a ranking scheme to
encourage further participation for users to
submit images
5
Concept Diagram
WWW
Backend PC
Apache Server
GMAIL Server
Email Retrieval Application (Outlook)
Backend Java Application for image processing
and ranking
HTML PHP source for picture of the day
website
Image Metric Files
6
Image Flow
Wait for Image
Image Received from Email
Java App detects new Image
Extract Image Features
Compare against database
Accumulate Similarity measure
Update database IMFs
Update Database Hierarchy
N
Has the novel image changed?
Generate new image IMF
Update Webpage
Y
Add to database
7
Demo
8
Lessons Learned
- Choosing non subjective features for images is
very hard. When you automatically rank images
based on a feature type you wont always get the
result that visually you think you should - Large images (1MB or larger) take forever to send
to the server. We need something to handle memory
size scaling (the iPhone has this built in, but
not all devices do) - Resolution scaling (for proper display on the
site) was an issue and currently we just force
all the images to the same size
9
Future Work
- Integrate the image capture and submission into a
mobile phone application - Improve image scoring / feedback process to users
by having the system return a ranking directly to
the user either via email/SMS or as part of the
application - Adapt system to work with other types of
participatory sensing (such as fuel prices or
carbon footprint tracking) - Image scaling / compression when received by
email
Recommended
CrystalGraphics Presentations
