Visual Interaction

Experts develop some specialized notation to describe and document activities they perform to accomplish a task. They use text, pictures, and graphs to assume a meaning

• The document appear to the user as collection of ‘characteristic structures’ (cs) - functional or perceptual units

• Association of a cs with its description is called a ‘characteristic pattern’ (cp)

• Description of cs is organized as an ‘attributed symbol’

• Relation between cs and its description is made explicit by two functions:

  int - mapping the cs into the attributed symbol
  
  mat - mapping the symbol into its structure
  In VIS a cp = (<set of pixels>, <attributed symbol>, <int, mat>)

• Image i of document is formed by many css

• Visual Sentence ‘vs’ = <i, d, <int, mat>>

The focus of this work is limited to commands given on a video screen and on VIS implementation