Ishikawa Komuro Lab

1
Alvaro Cassinelli, Yusaku Kuribara, Masatoshi
Ishikawa
Daito Manabe
Ishikawa Komuro Lab Rhizomatics
2
Ishikawa Komuro Lab Rhizomatics
3
A human sized optical pick-up head?
sound from doodles (???)
Ishikawa Komuro Lab Rhizomatics
4
Ishikawa Komuro Lab Rhizomatics
5
collaborative performance...
Ishikawa Komuro Lab Rhizomatics
6
3d objects (augmented architectures?)
Ishikawa Komuro Lab Rhizomatics
7
Interaction principles (work in progress)
Pitch controlled by the inclination of the
lines rotation transposition Pitch is
continuously modulated as a function of curvature
of the lines kiki/bouba effect Corner
detection discrete sounds. Bouncing on
lines percussion, rythms Interaction
between spots and intermodulation effects control
Ishikawa Komuro Lab Rhizomatics
8
Working principle smart scanner

• no camera, no image processing (intelligent
  sensing)
• markerless tracking
• miniaturization possible
• can write information back!

Ishikawa Komuro Lab Rhizomatics
9
Ishikawa Komuro Lab Rhizomatics
10
Conclusion

• Augmenting paintings shapes with interactive
  light

• Playful interaction...

... but can this be really used as a musical
instrument?
Ishikawa Komuro Lab Rhizomatics
11
Current and future work
As a musical instrument (interaction)

• right balance between control and randomness
• find and/or form a virtuoso for this
  instrument!!

As a non-interactive piece

• create paintings/sculptures that are also
  musical scores

Ishikawa Komuro Lab Rhizomatics
12
Advocating new interactive projection paradigm
classic camera/projector setup new paradigm the
sensing display

• no pixelated sensor nor projector
• 3d sensing possible
• reflectance, polarization, etc
• no focus necessary
• wearable! (picoProjector)
• long distance (kilometers!)

Ishikawa Komuro Lab Rhizomatics
13
Related applications

• Art Entertainment (small / large scale)

• Human computer interface

• Optical whiskers for the blind (haptic radar)

• Real time medical imaging and treatment

Ishikawa Komuro Lab Rhizomatics
14
Thank you!
Ishikawa Komuro Lab Rhizomatics