COGNITUS is focused on content. Users upload videos whilst at an event, the content is enhanced by the COGNITUS components (UHD, high frame rate, HDR, etc.). The videos are made available to production, and are delivered back to the users’ devices via adaptive streams. Accordingly, four main workflows cover the most significant procedures in COGNITUS: (i) UGC enhancement, (ii) Event creation (i.e. calls for contributions), (iii) Discovery of related content and synchronisation, and (iv) Content delivery.

The UGC enhancement workflow includes the components activated in order to analyse and assess the quality of the original content and enhance it, following several video and audio quality improvement steps. In parallel, a number of components analyse the content to produce relevant semantic metadata based on visual aspects of the content or metadata that can be found on social media. The result of this processing is a high quality, all-intra HEVC encoded video at very high rates using the Turing codec, which will be used by professional producers in order to produce creative plots/clips based on the collected UGC.

UGC enhancement workflow

The event creation workflow includes a number of tasks responsible for semantically initializing an event. This process involves fetching relevant metadata from social platforms to be potentially correlated with new UGC arriving to the platform.

Content discovery

The discovery of content related to an event and the synchronization workflow facilitates the professional producers to quickly find what they are looking for in order to create new plots/clips.

Adaptive delivery

Finally, the content delivery workflow involves the tasks that produce the various versions of the content (high/low resolution, high/low frame rate, HDR/SDR, etc.), encoding (using the Turing codec) and the creation of the DASH streams that will enable the adaptive streaming of the content to the users’ devices.

Event creation, Discovery of related content & synchronisation and content delivery workflows