The system should be able to detect that some sensors are not providing information, or giving the complete view of the scene, and automatically choose and query the sensors that can help in giving the whole scene. In order to do so the system should have the knowledge about the real world and the sensors. This knowledge could be stored in the ontological knowledge base consisting of three parts: the sensor part describing the sensors, recognition algorithms and so on, the external conditions part providing a description of external conditions such as weather condition, light condition and so on, and the sensible things part describing objects to be sensed.

Multimedia dependencies and constraints for the multiple (quick/slow) decision cycles can also be integrated into the ontological knowledge base.