Brain-Computer Interaction Research Group Website
To further increase the bandwidth from humans to computers, I am investigating methods for sensing signals that users naturally give off while using a computer system. I plan to use this data to augment the explicit input that the user provides through standard input devices. Using a relatively new brain imaging tool called functional near-infrared spectroscopy, along with a more established brain sensing tool called electroencephalography (EEG), we can detect signals within the brain that indicate various cognitive states. These devices provide data on brain activity while remaining portable and non-invasive. If used with care, this additional information can lead to interfaces that adapt appropriately to changes in the user's cognitive state. The focus of my research is to investigate the impact that these input modalities can have on HCI research.
A. Sassaroli, F. Zheng, L.M. Hirshfield, A. Girouard, E.T. Solovey, R.J.K. Jacob, and S. Fantini, “Discrimination of Mental Workload Levels in Human Subjects with Functional Near-Infrared Spectroscopy,” Journal of Innovative Optical Health Sciences (2008). [link]
E.T. Solovey. "Using Your Brain for Human-Computer Interaction," Doctoral Symposium, ACM UIST 2009 Symposium on User Interface Software and Technology, ACM Press (2009). [link]
E.T. Solovey, A. Girouard, K. Chauncey, L.M. Hirshfield, A. Sassaroli, F. Zheng, S. Fantini , and R.J.K. Jacob, “Using fNIRS Brain Sensing in Realistic HCI Settings: Experiments and Guidelines,” ACM UIST 2009 Symposium on User Interface Software and Technology, ACM Press (2009). [link]
L.M. Hirshfield, E.T. Solovey, A. Girouard, J. Kebinger, R.J.K. Jacob, A. Sassaroli, and S. Fantini , “Brain Measurement for Usability Testing and Adaptive Interfaces: An Example of Uncovering Syntactic Workload with Functional Near Infrared Spectroscopy,” Proc. ACM CHI 2009 Human Factors in Computing Systems Conference, ACM Press (2009). [link]
A. Girouard, E.T. Solovey, L.M. Hirshfield, K. Chauncey, A. Sassaroli, S. Fantini, and R.J.K. Jacob, “Distinguishing Difficulty Levels with Non-invasive Brain Activity Measurements,” Proc. INTERACT 2009 Conference (2009). [link]
L. Hirshfield, K. Chauncey, R. Gulotta, A. Girouard, E. Solovey, R. Jacob, A. Sassaroli, and S. Fantini, “Combining Electroencephalograph and Near Infrared Spectroscopy to Explore Users' Instantaneous and Continuous Mental Workload States,” HCI International 2009 13th International Conference on Human-Computer Interaction, Springer (2009). [link]
A. Sassaroli, F. Zheng, M. Coutts, L. M. Hirshfield, A. Girouard, E. T. Solovey, R. J. K. Jacob,Y. Tong, B. deB. Frederick, and S. Fantini, " Application of near-infrared spectroscopy for discrimination of mental workloads," SPIE Proceedings 7174, (2009). [link]
A. Sassaroli, Y. Tong, L. M. Hirshfield, A. Girouard, E. T. Solovey, R. J. K. Jacob, S. Fantini, "Real-time assessment of mental workload with near infrared spectroscopy: potential for human-computer interaction", OSA topical meeting, BIOMED, BMD14 (2008) [link]
L.M. Hirshfield, A. Girouard, E.T. Solovey, R.J.K. Jacob, A. Sassaroli, Y. Tong, and S. Fantini , "Human-Computer Interaction and Brain Measurement Using Functional Near-Infrared Spectroscopy," ACM UIST 2007 Symposium on User Interface Software and Technology, ACM Press, Poster paper (2007). [link]
'
A. Girouard, E.T. Solovey, R. Mandryk, D. Tan, L. Nacke, R.J.K. Jacob, “Brain, Body and Bytes: Psychophysiological User Interaction,” Proc. ACM CHI 2010 Extended Abstracts. (2010). [link]
L.M. Hirshfield, E.T. Solovey, A. Girouard, R.J.K. Jacob, J. Kebinger, M.S. Horn, O. Shaer, J. Zigelbaum, and R.J.K. Jacob, “Using Brain Measurement to Evaluate Reality Based Interactions,” Proc. ACM CHI 2009 Workshop on Challenges in Evaluating Usability and User Experience of Reality-Based Interaction (2009). [link]
A. Girouard, L.M. Hirshfield, E. Solovey, and R.J.K. Jacob, “Using functional Near-Infrared Spectroscopy in HCI: Toward evaluation methods and adaptive interfaces,” Proc. ACM CHI 2008 Workshop on Brain-Computer Interfaces for HCI and Games (2008). [link]
E. T. Solovey. "Using your brain for human-computer interaction," Grace Hopper Celebration of Women in Computing. Poster Session (2008).
A. Girouard, E. T. Solovey, L. M. Hirshfield, K. Chauncey, A. Sassoroli, S. Fantini, and R. J. K. Jacob, "Distinguishing Difficulty Levels with Non-invasive Brain Activity Measurements," Technical Report 2008-3, Department of Computer Science, Tufts University, Medford, Mass. (2008).
"Mind-reading Computers: It may sound like sci-fi, but one day a computer may sense when you’re stressed and tell you to take a break," Tufts Journal Feb. 3, 2008. [link] [pdf]
"Tufts researchers delve into the human brain with cutting-edge 'light imaging' technology," Tufts Daily Oct. 18, 2007. [link] [pdf]
"Mind controls computer," EE Times Oct. 5, 2007. [link] [pdf]
"Computer Can Tell How Hard You're Working," Fox News Oct. 3, 2007. [link] [pdf]
"Mind-Reading Computers," BBC Focus Magazine Oct. 3, 2007. [link] [pdf]
"Building a computer that reads minds," MSNBC Oct. 2, 2007. [link] [pdf]
"Technology Could Enable Computers To 'Read The Minds' Of Users," Science Daily, Oct. 1, 2007. [link] [pdf]
J. C. Keller, "Technology May Bridge Emotion Gap between Humans and Computers," Engineering eNews, (May 2007). [link] [pdf]
"A window into the brain: new techniques for brain-computer interaction," Graduate Research Symposium, Tufts University, April 13, 2007.
|
