We'll investigate how others have evaluated systems for information awareness, summarization, understanding of gist, and situation awareness:
- Pousman, Z. and Stasko, J. 2007. Ambient information systems: evaluation in two paradigms. Proc. 1st Workshop on Ambient Information Systems. Colocated with Pervasive 2007.
- Masson, M. E. J. 1982. Cognitive processes in skimming stories. Journal of Experimental Psychology, 8, 5, 400-417.
- Endsley, M.R. (1995). Measurement of situation awareness in dynamic systems.
Human Factors, 37, 1, 65-84.
- Lin, C. and Hovy, E. 2003. Automatic evaluation of summaries using N-gram co-occurrence statistics. Proc. Association For Computational Linguistics on Human Language Technology - Volume 1, 71-78.