A Paper-Based Interface for Video Browsing and Retrieval

6. Related Work

Paper-based representations that include links to electronic information provide fertile ground for exploring new multimedia retrieval technologies. In spite of its similarity to several recent efforts, Video Paper is different from all of them. For example, in one case users manually add links to text strings in paper documents that can retrieve the representation for that text in another language [1]. In another instance, users take notes on paper attached to a device that simultaneously records audio [9]. Subsequently, one can page through the notepad and replay the audio that was captured when a notation was written.

Another example allows users to manually select interesting key frames while a video is playing or a presentation is given [5]. A paper representation shows those images on a time line with a machine-readable code that can activate the video replay.

All of these techniques contrast sharply with our emphasis on automatically producing a paper representation for a multimedia recording that a person can understand without necessarily using an electronic device. Our documents also have bar codes that can trigger a multimedia player to start at any randomly selected point.

The layout of a Video Paper document is carefully designed so that a reader can easily browse and access a long video recording. An online solution with similar characteristics provided an html interface to TV programs [8]. However, there was no provision for paper-based access to the multimedia data in this system.

7. Conclusions

A novel solution for video and retrieval was proposed and evaluated that uses the characteristics of newspapers and paper-based displays to provide an efficient and easyto- use method for finding information in videos. Recent results with news broadcasts and recorded meetings confirm the intuition of the system's developers that Video Paper is an ideal interface for browsing and selectively accessing recorded video.

An application to oral histories showed how Video Paper can provide easy access to multimedia data and thereby enriching the reader's experience in ways that were not possible with previous technology.

References

1. Arai, T., Aust, D., and Hudson, S. E., "PaperLink: A technique for hyperlinking from real paper to electronic content," Conference on Human Factors in Computing Systems (CHI 1997), 327-334.
2. Boreczky, J., A. Girgensohn, G. Golovchinsky, and S. Uchihashi, "An Interactive Comic Book Presentation for Exploring Video," Conference on Human factors in Computing Systems (CHI 2000), pp. 185-192, 2000.
3. P. Chiu, A. Kapuskar, S. Reitmeier, and L. Wilcox, "Notelook: Taking Notes in Meetings with Digital Video and Ink," ACM Multimedia '99, Oct. 1999, Orlando, FL.
4. J. Graham, "The Reader's Helper: A Personalized Document Reading Environment," Proceedings of the CHI 99 conference on Human factors in computing systems: the CHI is the limit, May 1999, 481-488.
5. D. L. Hecht, "Printed Embedded Data Graphical User Interfaces," IEEE Computer, March 2001, 47-55.
6. S. Klemmer, J. Graham, G. Wolff, and J. Landay, "Books with voices: Paper transcripts as a physical interface to oral histories," ACM Conference on Human Factors in Computing Systems (CHI-2003), Fort Lauderdale, Florida, April 5-10, 2003
7. D. S. Lee, B. Erol, J. Graham, J. J. Hull, and N. Murata, "Portable Meeting Recorder," ACM Multimedia 2002, Juan Les Pins, France, Dec. 1-6, 2002, 493-502.
8. B. Shahraray and D. C. Gibbon, "Automated Authoring of Hypermedia Documents of Video Programs", ACM Multimedia 95, November 5-9, 1995, San Francisco, CA.
9. L. Stifelman, B. Arons, and C. Schmandt, "The Audio Notebook: Paper and Pen Interaction with Structured Speech," ACM CHI Conference, Seattle, WA, March 31 - April 5, 2001, 182-189.