From Google to bookmarks, collections of information resources are
typically presented in a form which is impoverished for cognition and
experience: the list of textual elements.
We need to represent collections of information resources in
personal forms that help us discover connections between the resources.
combinFormation is a mixed-initiative tool for browsing and collecting,
which uses sampling and composition to make connections
between information resources visible.
a mixed-initiative system that uses composition for
browsing, collecting, and arranging information samples from web
pages. The samples act as visual, semiotic, and navigational
surrogates for the documents from which they are extracted. The
initiatives are the system's generation of composition, and the user's
direct manipulation. The system's generative actions -- collecting
information samples, and composing them visually -- are conducted
iteratively, based on a user model.
The system presents the ongoing
generation of the composition to the user in an interactive
information space. In this space, one of the user's initiatives is to
directly manipulate the composition through interactive design
operations, which enable samples to be displaced, layered, annotated,
and removed. The user can also express positive or negative interest
in each sample. Expressions of interest affect the model, creating a
feedback loop through the visualization.
Kerne, A., Koh, E., Smith, S. M., Webb, A., Dworaczyk, B.,
combinFormation: Mixed-Initiative Composition of Image and Text Surrogates Promotes Information Discovery
ACM Transactions on Information Systems (TOIS)
, Dec. 2008, 5:1-5:45,
Kerne, A., Damaraju, S., Kumar, B., and Webb, A.
Meta-Metadata: A Semantic Architecture for Multimedia Metadata Definition, Extraction, and Presentation.
Poster and Demo Proceedings of the 3rd International Conference on Semantic and Digital Media Technologies
Koblenz, Germany, 3-5 December 2008.
Kerne, A., Smith, S.M., Koh, E., Choi, H., Graeber, R.,
An Experimental Method for Measuring the Emergence of New Ideas in Information Discovery
International Journal of Human-Computer Interaction (IJHCI)
24 (5) July 2008, 460-477.
Koh, E., Kerne, A., Webb, A., Damaraju, S., Sturdivant, D.,
Generating Views of the Buzz: Browsing Popular Media and Authoring using Mixed-Initiative Composition
Proceedings of ACM Multimedia
Augsburg, Germany, 23-29 September 2007.
Kerne, A., Koh, E., Dworaczyk, B., Mistrot, J.M., Choi, H.,
Smith, S., Graeber, R., Caruso, D., Webb, A., Hill, R., Albea, J., A
Mixed-Initiative System for Representing Collections as Compositions of
Image and Text Surrogates
Proc Joint ACM/IEEE Conf. on Digital Libraries (JCDL)
2006, Chapel Hill.
Kerne, A., Koh, E., Smith, S.M., Choi, H., Graeber, R., Webb., A.,
Promoting Emergence in Information Discovery by Representing Collections with Composition
Proc ACM Creativity & Cognition
Washington DC, June 2007, 117-126.
Koh, E., Caruso, D., Kerne, A., Gutierrez-Osuna, R.,
Elimination of Junk Document Surrogate Candidates through Pattern Recognition
Proceedings of ACM Symposium on Document Engineering
Winnipeg, Canada, 28-31 August 2007.
Koh, E., Kerne, A., Hill, R.,
Creativity Support: Information Discovery and Exploratory Search
Proceedings of ACM SIGIR Conference
Amsterdam, Netherlands, 23-27 July 2007.
Kerne, A., Koh, E., Choi, H., Dworaczyk, B., Smith, S.M., Hill,
R., Albea, J., Supporting
Creative Learning Experience with Compositions of Image and Text
, Proc Ed Media 2006
, June 2006, Orlando.
Kerne, A., Koh, E., Sundaram, V., Mistrot, J.M.,
semantic clustering in spatial hypertext
, Proc ACM Document
Nov 2005, Bristol, UK, 84-93.
Kerne, A., Mistrot, J.M., Khandelwal,
M.,Sundaram, V., Koh, E., Using
Composition to Re-Present Personal Collections of Hypersigns
Computational Semiotics in Games and New Media (CoSIGN)
, Sept 2004,
Kerne, A., Sundaram, V.,
A Recombinant Information Space,
Proc Computational Semiotics in Games and New Media (CoSIGN) 2003, 48-57.
Kerne, A., Smith, S.M., Choi, H., Graeber, R., Caruso, D.,
Evaluating Navigational Surrogate Formats with Divergent Browsing Tasks
, Proc ACM CHI 2005
Kerne, A., Sundaram, V., Wang, J., Khandelwal, M., Mistrot, J.M.,
Human + Agent: Creating Recombinant Information,
Proc ACM Multimedia 2003, 454-455.