Develop a multitouch kiosk application for browsing through a curated collection of faceted information.
Multitouch screens are soon going to be as common as flat screen monitors are today. Interacting with a screen simultaneously using multiple fingers breaks most assumptions that commonly hold true for common mouse based human-computer interaction. You will have the opportunity to tackle problems of the next generation user interfaces. We need to understand how this new modality of interaction can help build more natural interactions. This project investigates this new modality in the context of information browsing. Presentation of information is part art, part science. The visual generated by an application fundamentally changes the users perception and interpretation of the presented information. The multitouch kiosk provides you with a space to experiment with different visualizations of information for the selected domain.
This project develops a kiosk style interactive application for browsing information. Examples of such applications are a restaurant finder, a Jukebox, a library kiosk or an information kiosk at a museum. Your group will explore and analyze issues of developing multitouch applications and browsing through faceted information. You will identify a domain of interest and build the required semantics to extract, store and visually represent information for that domain. Using this curated library of information, the application will allow a user to browse, query, filter and collect information of interest to them through the modality of multitouch.
- Multitouch enabled display (19" multitouch display)
- Ecologylab Semantics library for information representation, extraction and display.
- Prefuse visualization toolkit.
- Shen, C., Ryall, K., Forlines, C., Esenther, A., Everitt, K., Hancock, M., Morris, M.R., Vernier, F., Wigdor, D., and Wu, M. Interfaces, Interaction Techniques and User Experience on Direct-Touch Horizontal Surfaces. IEEE Computer Graphics and Applications, Sept/Oct 2006, 36-46.
- Wigdor, D., Williams, S., Cronin, M., Levy, R., White, K., Mazeev, M., and Benko, H., Ripples: utilizing per-contact visualizations to improve user interaction with touch displays. In Proc. UIST '09, 3-12.
- Ping Yee, Kirsten Swearingen, Kevin Li, and Marti Hearst, Faceted Metadata for Image Search and Browsing, In Proc. ACM CHI '03.
- Excerpts from Envisioning Information by Edwarde Tufte, will be available in reserves section of the library.
- Micro/Macro Readings 37-52
- Layering and Seperation 53-66
- Small Multiples 67-80
- Direct Manipulation and Virtual Environments, Chapter 5, Designing the User Interface, Shneiderman, B., Plaisant, C., Addison-Wesley, 2010. [electronic reserve]
- Buxton, B. Multi-touch systems that I have known and loved.
- Han, J. Y., Low-cost multi-touch sensing through frustrated total internal reflection. In Proc UIST '05, 115-118.
- Wilson, M. L., Andre, P. and schraefel, m. c., Backward Highlighting: Enhancing Faceted Search. In Proc. UIST '08, 235-238.
- Wilson, A. D., Izadi, S., Hilliges, O., Garcia-Mendoza, A., and Kirk, D., Bringing physics to the surface. In Proc UIST '08, 67-76.
- Prototypes of multitouch applications, source: Jeff Han
- Gestural Interaction Techniques for document management and annotation, source: Mitsubishi Electric Research Laboratories
- Ripples, visual feedback techniques for touch surfaces, source: ACM UIST '09
- What task or activity will the users perform with the kiosk application ? Describe a scenario in which a user interacts with your application. Highlight how the unique features will support the user in performing their task. Use multiple scenarios, if necessary, to focus on each unique feature.
- Select information sources (websites) for the selected domain. What are the specific information fields and semantics (relationships between fields) that are critical for the user's task ? How will these relationships be presented visually to the user ? For example, an album field for each song denotes a group of songs. This grouping could be presented as a folder, in a tree or as a list.