ES2410304B1 - DEVICE AND SCALABLE SYSTEM FOR OVERPRINTING OF VIDEO FLOWS. - Google Patents

Abstract

Device and scalable system that allows dynamic alteration of video streams minimizing their recoding for the insertion of images in frames, such as the logos identifying television channels ("fly"), multi-channel overprint (multi picture-in-picture) ), overprinting of custom images, among others. It comprises a trimmer (20), a synthesizer (30), a mixer (40) and a controller (10). The trimmer (20) cuts regions in the frames of a video stream (50) according to a crop pattern (52) to produce a clipped stream (60) and clip streams (70) and / or scaled (74). The synthesizer (30) synthesizes video streams matching the clippings according to a synthesis pattern (32) to produce streams with synthesized clippings (80) from (70, 74). The mixer (40) mixes the streams (60, 80) according to a mixing pattern (42) to produce video streams with overprinted clippings (90). The controller (10) coordinates the joint operation.

Description

image 1

image2

image3

image4

image5

-

=

image6

image7

image8

image9

IP video with synthesized clippings (80), to build an IP video stream of the input with overprinted clippings for each of the m users of the system.

Each mix pattern (42) pmx is a set of tuples (clipped input IP video stream (60), sequence of synthesized clip IP video streams (80), user destination address) that associate each input stream

trimmed with a sequence Zx = {zx, zx, ..., zx | pr |} of the IP video streams with synthesized clippings (80), of the

12 ij form (tij, Zx, Dx). The number of elements in the sequence Zx matches | prij |, the number of regions defined in the prij clipping pattern. Additionally, the dimensions of each of the regions defined in Zx coincide with each of the regions of the prij clipping pattern. The resulting flow (90) is delivered to the destination address Dx,.

The mixer produces m streams (90) by combining the frames of the clipped input IP video stream (60) and the synthesized clip IP video streams (80) that match in sequence number (originally generated by the trimmer (20) and propagated by the synthesizer (30)), using intermediate buffers to mitigate the time lags between flows. These streams with input video that are superimposed on synthetic clippings (90) are sent over the network to the destination addresses D1, D2, ..., Dm, for example a unicast address and UDP port, one for each of the m users .

Cluster mixer

A cluster mixer is a mixer (40) whose responsibility is shared among several sub-mixers for scalability reasons. The sub-mixers receive the clipped input video streams (60) of the same network as the sub-trimmer outputs, and the video streams with synthesized clippings (80) of the same network as the sub- outputs synthesizers; The output of each sub-mixer can be in different networks. Submixers process their inputs in the same way as an individual mixer (40).

All sub-mixers, together, work as if they were a single mixer. The mixer is divided into and sub-mixers responsible for generating the IP video stream of the input with overprinted clippings

(90) for, at most, ceil (m / y) users. Each sub-mixer i receives the mixing patterns (42) corresponding to the users (i-1) * ceil (m / y) +1 ai * ceil (m / y) with the exception of i = y, in which case receive the mixing patterns (y1) * ceil (m / y) +1 to m.

Each sub-mixer receives only the IP video streams with synthesized clippings (80) z relevant to the mix patterns (42) received in the sub-mixer. For this, the sub-mixer subscribes to a specific multipoint reception point for video streams with synthesized clippings (80) of interest, for example by subscribing to the multicast groups corresponding to each video stream with synthesized clippings present in the mix patterns assigned to the sub-mixer, that is, assigned unionpm (Zx).

x

Each sub-mixer only receives, at most, ceil (m / y) clipped input IP video streams (60) corresponding to the mix patterns (42) received in the sub-mixer. To do this, the sub-synthesizer subscribes to a specific multipoint reception point for the clipped input IP video streams (60) of interest, for example by subscribing to the multicast groups corresponding to each clipped input IP video stream present in the mix patterns assigned to the sub-mixer, that is, assigned unionpm ({tij}).

x = (rij, Zx, Dx)

Each sub-mixer produces, at most, ceil (m / y) video streams for each of the, at most, ceil (m / y) users with overprinted input IP video streams with synthetic clippings (90 ).

The joint output of the cluster mixer is the aggregate of the individual outputs of each sub-mixer.

d) Controller

The controller (10) is in charge of coordinating the joint operation of trimmer (20), synthesizer (30) and mixer (40). The controller (10) receives, for each of the m users in the system, an overlay pattern (12) pok = (ci, prk, Opsk, Dk), which associates an input stream (50) ci, a pattern trimming (52) prk for ci, and a sequence of pairs (synthesis operation (33), set of scaled input streams (74)) Opsk, for each of the rectangular regions of prk .. With this information the system It generates an IP video stream with the superimposed input ci (90) according to the overlay pattern (12) and sends it to the destination address Dk.

The admission process (11) followed by the controller (10) to incorporate a new user k is as follows:

i) Receive the overlay pattern (12) pok = (ci, prk, Opsk, Dk).

ii) Determine if the trimmer (20) has a prij = prk for ci; if it does not exist then add to the trimmer (20) the new clipping pattern (52) prij = prk for the input stream (50) ci. If the trimmer (20) is distributed in a cluster, the controller (20) communicates exclusively with the sub-trimmer in charge of the input flow (50) ci.

image10

image11

image12

Claims (1)

- image 1 image2