The continuing development of miniature low-power sensors marks a
historic period in the relationships between people and machines. On
the one hand, these devices raise the terrible spectre of invasive
surveillance. At the same time, they create the potential for new
modes of interaction and communication. New interface ecosystems can
sense, recognize, respond to, and represent nuances in
in our environments and in our bodies.
They spawn new forms of communication.
The Interface Ecology Lab is emphasizing processes of
human expression and social interaction as we develop sensory
interfaces that involve embodied awareness of the human body and the physical world.
We integrate sensor networks with methods from ubiquitous, pervasive, and wearable computing, real time embedded systems, psychophysiology, pattern recognition, performance studies, installation art, conceptual art, and context-aware, location-aware and embodied HCI. The new interactivity is based on our physical and corporeal beings. The forms we are creating include mixed-reality games, installations, body-based affordances, and aesthetic design environments.
invisible, pressure sensitive multi-touch (Scanning FTIR)
Scanning FTIR (pictured above) is a unique optoelectronic multi-touch technology developed at the interfae ecology lab. It allows for pressure sensitive multi-touch input in a thin, transparent form factor. By incorporating pressure along with multi-finger input, we greatly increase the dimensionality of the human-computer interface and open up new pathways for fluid interaction with cutting-edge applications.
multi-touch gesture learning and recognition (mgestr)
While recent developments in multitouch hardware have brought the potential for supporting new forms of human-centered computing, this potential is as yet hardly realized. mgestr is a system that understands human expressions of intent by learning and recognizing gestures performed on a multitouch surface.
Our long term objective is to give human participants an interactive experience in which embodied gestures performed by the human hand are mapped to actions in ways that are natural, meaningful and intuitive.
publications and exhibitions
Moeller, J., Kerne, A., Scanning FTIR: Unobtrusive Multi-Touch Sensing through Waveguide Transmissivity Imaging, Proceedings of the 4th International Conference on Tangible, Embedded and Embodied Interaction, Cambridge, MA, Janurary 25-27 2010.
Damaraju, S., Kerne, A. Multitouch Gesture Learning and Recognition System. , Extended Abstracts of IEEE Workshop on Tabletops and Interactive Surfaces, Amsterdam, Netherlands, 1-3 October 2008.
Webb, A., Kerne, A., Koh, E., Joshi, P., Park, Y., Graeber, R., Choreographic Buttons: Promoting Social Interaction through Human Movement and Clear Affordances, ACM Multimedia 2006, Santa Barbara, CA.
Toups, Z., Overby, K., Kerne, A., Graeber, R., Cooper, T., Alley, E., Censor Chair, ACM SIGCHI Intl Conf on Advances in Computer Entertainment, June 2006, Hollywood.
Alley, E. Cooper, T., Graeber, R., Kerne, A., Overby, K., Toups, Z.,
Censor Chair: Exploring Censorship and Social Presence
through Psychophysiological Sensing, Proc ACM Multimedia 2005, 922-929.
