Brain-Computer Interaction

An Attention Management System

AugCog test subject

Pacific Science & Engineering is researching brain-computer interfaces to augment and optimize operator performance. Currently, PSE is investigating methods for creating a closed-loop attention management system to help operators remain alert during sustained monitoring tasks, such as air traffic control or monitoring semi-automated systems, including unmanned aerial vehicles. The system monitors psychophysiological variables, such as EEG brain waves and eye movements in real-time and uses them to predict operator vigilance. When the variables predict a loss of vigilance, the system intervenes to re-engage the operator.

Psychophysiological measures are used to predict vigilance, and the task interface is then modified to return the operator to optimal performance.

PSE is investigating methods for combining multiple psychophysiological variables to produce more accurate predictions, using the latest technology for no contact and minimal contact measure in order to increase operator comfort and mobility, and developing innovative methods for re-engaging the operator.

Eye, head, and EEG tracking

Setting up an AugCog test subject

Eye tracking is illustrated by the circles around the eyes and the lines emanating from the eyes, head movement is illustrated by the 3D coordinates centered on the face, and the head cap is used to acquire EEG.

References and Downloads

St. John, M. & Risser, M. R. (2007). Mitigating the vigilance decrement: Perceptual versus cognitive interventions. In Proceedings of the Fourth International Conference on Augmented Cognition. Baltimore, MD: ACI.

Download the complete report in PDF format

St. John, M., Risser, M. R., & Kobus, D. A. (2006). Toward a usable closed-loop attention management system: Predicting vigilance from minimal contact head, eye, and EEG measures. In Proceedings of the Second International Conference on Augmented Cognition. San Francisco: ACI. Download the paper

St. John, M., Kobus, D. A., Morrison, J. G., & Schmorrow, D. (2004). Overview of the DARPA Augmented Cognition technical integration experiment. International Journal of Human-Computer Interaction, 17, 131-149. Download the paper

Get Acrobat PDF Reader