A Humane Representation of Thought

Victor, B., 2014. Humane representation of thought: A trail map for the 21st century, in: UIST’14.

Real World

Tangible User Interfaces

Ishii, H., Ullmer, B., 1997. Tangible bits: Towards seamless interfaces between people, bits and atoms, in: CHI’97.
Ishii, H. et al., 2012. Radical atoms: Beyond tangible bits, toward transformable materials. interactions.

Augmented Reality

Spatial Augmented Reality

Uses projectors or screens in the environments to display information spatially related to this environment
Raskar, R. et al., 1998. Spatially augmented reality, in: IWAR’98.
Raskar, R. et al., 2001. Shader lamps: Animating real objects with image-based illumination, in: Eurographics’01.

Augmented Objects

Augmented Objects

How does it work?

Augmented Objects

Interaction

How can we interact with digital content hosted on physical objects?

Direct Interaction

Bandyopadhyay, D. et al., 2001. Dynamic shader lamps : painting on movable objects. ISAR’01.

Direct Interaction

Marner, M.R. et al., 2009. Physical-virtual tools for spatial augmented reality user interfaces, in: ISMAR’09.
Benko, H. et al., 2012. Miragetable: Freehand interaction on a projected augmented reality tabletop, in: CHI’12.

Interaction

Gervais, R. et al., 2015. Pointing in spatial augmented reality from 2D pointing devices, in: INTERACT’15.
Gervais, R., et al., 2016. Tangible Viewports: Getting out of flatland in desktop environments, in: TEI’16.

Introspection

How can we use augmented objects to reveal hidden information about our own selves?

Introspection

Mercier-Ganady, J. et al., 2014. The mind-mirror: See your brain in action in your head using eeg and augmented reality, in: VR’14.

Introspection

Norooz, L. et al., 2015. BodyVis: A new approach to body learning through wearable sensing and visualization, in: CHI’15.

Introspection

Frey, J., Gervais, R., et al., 2014. Teegi: Tangible EEG interface, in: UIST’14.
Gervais, R., Frey, J., et al., 2016. TOBE: Tangible Out-of-Body Experience, in: TEI’16.

Interaction

Standard way of pointing

Now what happens if...

Removing the screen

Does pointing still works without a screen?

Study

Questions

Differences between SCREEN and SAR conditions for pointing?

Does pointing in SAR follow Fitts' law?

Pointing technique

Pointing technique

Apparatus

SCREEN vs SAR

Scene

Procedures

MacKenzie, I.S., 1992. Movement time prediction in human-computer interfaces.

Design

Participants

  • 16 participants
  • Familiar with mice
  • Little experience with graphics tablets
  • No experience with SAR systems

Results

Time

Users were 11% faster using a screen vs SAR

Inefficiency

Fitts' law

MacKenzie, I.S., 1992. Movement time prediction in human-computer interfaces.

Metaphor

Pointing technique

Applications

Painting / Progamming

Objects in Sync

Text Annotations

Complementary Representations

Jansen, Y. et al., 2013. Evaluating the efficiency of physical visualizations, in: CHI.

Towards the Desk as a Working Space

Direct-Indirect Combination

Improvised Working Surfaces

Introspection

Collaboration

EEG

Objectives

  • What can EEG measure?
  • How does the brain work?

Filters

Exposing the Signal Processing

Exploratory Study

Teegi Disco

Going Further

Inner Mirror

Building your own mirror

Metrics

Sensors & Signal Processing

3D Printing

Feedback

Customization

Use Case

In Summary

Contributions

Designing for Calmness and Wellbeing

Thank You

Results

Tangible Viewports Interaction Space

Teegi Installation

Tobe Installation