Vertical/Horizontal Reasoning

Horizontal Reasoning (Multi Source Data Fusion MSDF)

Stype (c1, c2) ((St (t1, t2, t3) (Saudio-object(*) audio_source)) or (St (t1, t2, t3) (Svideo-object(*) video_source)))

In horizontal reasoning we first extract time slices of objects from audio source and the corresponding time slices of objects from video source, combine such information, and then extract two types of objects. The query can be expressed as: 
SELECT     type
CLUSTER  c1, c2
FROM  ((SELECT     t
        CLUSTER    t1, t2, t3
        FROM    SELECT  audio-object
                CLUSTER *
                FROM    audio_source)
        OR
       (SELECT     t
        CLUSTER    t1, t2, t3
        FROM    SELECT  video-object
                CLUSTER * 
                FROM    video_source))
 In horizontal reasoning the fused information must be at the same level of abstraction. In the above example, audio source and video source are different. After objects are extracted, then they can be combined.