Though the sheer volume of information that requires understanding by warfighters has increased dramatically, the complexity of that information and the associated processing by computers and humans has similarly increased. This leads to the conclusion that for any complex phenomenon, the large number of relevant input systems and techniques creates an interface problem with exponential proportions. It is therefore critical that technologies be researched and demonstrated for the representation and interpretation of multiple, diverse data sources, and for human interpretation of these data sources. Whereas filters and summarization (roll-up) might adequately accommodate the volume, no amount of such measures can help with the complexity. Consider the complexity of an operation represented as a polyhedron. The number of notional facets remains fixed regardless of how it’s turned. However not all facets are always available for attention. If a warfighter is faced with continuously understanding, and acting on as required the scope of activities represented by each facet, then a new paradigm for human perception of complex data and interaction with that complex information system is required. Research is therefore required to understand the physiologic carrying capacity of information in the human nervous system for sustained, volitional interaction within an experiential information environment. This research should lead to interface systems with interactive representations, with humans in some cases instrumented to enable optimal perception and sensibility of the experiential interaction with information. Traditional, display-centric HCI approaches are already insufficient to deal with the complexity and dynamicity of the information. They furthermore provide insufficient understanding to the human in order to accomplish the transformation from data through information to actionable knowledge.

Current research shows that physiologic mechanisms restrain the information carrying capacity of any particular channel; audio, for example. Information systems require the ability to remap cognitive and volitional expression to other channels in order to overcome the limitations of any particular channel. This use of multiple channels will enhance the sensibility, perceptibility, and express-ability of complex information and interactions in an experientially rich environment. This was the unrealized goal of virtual reality research.

However, what is really required are dynamic, contextually sensitive, interactive, representational systems for supporting time-critical decision making given highly complex information assessment environments. One approach may be to utilize unconventional spatial representations to more accurately convey the high dimensional nature of the operational environment; and to provide a perceptively (by humans) valid analog of the multi-directional (computer-to-human-to-computer, and human-to-human), dynamic information flow.

This paradigm of interface technology is based on new theories of human-computer interaction that are physiologically and cognitively oriented. This emerging paradigm of human computer interaction incorporates multi-sense rendering technologies, giving sustained perceptual effects, and natural user interface devices that measure multiple physiological parameters simultaneously and use them as inputs. Biologically optimized interactive information technology has the potential to facilitate effective communication. This increase in effectiveness will impact both human-computer and human-human communication through enhanced ability to express.

Optimizing the human computer interface will rely on the knowledge base of physiology and neuroscience. That is, the more we know about the way we acquire information physiologically the more we know the optimum way for a human to interact with intelligent information systems. Research in human sensory physiology, specifically sensory transduction mechanisms, shows us that there are designs in our nervous systems optimized for feature extraction of spatially rendered data, temporally rendered data, and textures. Models of information processing based on the capacity of these neurophysiologic structures to process information will help our efforts to enhance perception of complex relationships by integrating visual, binaural, and tactile modalities.