EP4078944A1

EP4078944A1 - Method for transferring at least one image content to at least one viewer

Info

Publication number: EP4078944A1
Application number: EP20838984.1A
Authority: EP
Inventors: Wolfgang Vonolfen; Stefan Eickeler; Peter ISAJCZUK
Original assignee: Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Current assignee: Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Priority date: 2019-12-19
Filing date: 2020-12-18
Publication date: 2022-10-26
Also published as: US20230070449A1; DE102019220278A1; WO2021123365A1

Abstract

The invention relates to a method for transferring at least one image content to at least one viewer, wherein image contents are represented by a plurality of individual images, a display displays the plurality of individual images periodically one after the other, and wherein a camera outputs a plurality of recordings of a scene at least partially containing the display, wherein for each recording, the camera outputs at least one of the individual images displayed and wherein the individual images of at least one of the image contents is transferred to at least one viewer.

Description

Method for transmitting at least one image content to at least one viewer

The invention relates to a method for transmitting at least one image content to at least one viewer, with image content being represented by a large number of individual images, a display periodically showing the large number of individual images one after the other and with a camera showing a large number of recordings from a display at least partially contained scenery, the camera outputs at least one of the displayed individual images for each recording and the individual images at least one of the

Image content is transmitted to at least one viewer.

The invention is based on a situation in which a camera takes recordings of a scene that contains a display for displaying image content. A typical example of such situations are sporting events in which there are advertisements in the stadium, for example for advertising, and which are recorded and transmitted with television cameras. The TV cameras record the advertisements, for example the boards of a soccer field, and transmit the content displayed on the advertisements with the television image. It is desirable if other image contents of these displays can be transmitted in the images recorded by the camera than a viewer perceives on site. In this way, the viewer can see image content on site that is relevant to him, while at the same time a television viewer can see other image content that is relevant for the television viewer.

One approach to show a viewer of the images recorded by the camera different image content than a direct viewer of the display perceives is to alternately display the different image contents on the display in quick succession and the camera with the presentation on the display synchronize so that the camera only records one of the image content. The problem here, however, is that the image content intended for the television viewer must be presented by the display in such a way that the immediate on-site viewer of the display perceives this additional display content as little as possible.

The object of the present invention is to provide a method for transmitting at least one image content to at least one viewer that allows the viewer of images recorded by the camera to be presented to the viewer other image content than a direct viewer who is perceived by the immediate viewer The viewer is affected as little as possible.

Advantageous refinements of the invention also make it possible to set motion blur fe well for the viewer of the images recorded by the camera. Further refinements make it possible to keep a flickering effect low for direct viewers of the display. In addition, advantageous refinements of the invention allow photographers of the on-site display to record the image content that is visible to immediate viewers with the highest possible probability.

The object is achieved by the method for transmitting at least one image content to at least one viewer according to claim 1 and by the device for transmitting at least one image content to at least one viewer according to claim 31. The dependent claims indicate advantageous developments of the method according to claim 1.

The invention relates to a method for transmitting at least one image content to at least one viewer. Image content can be understood here to mean content represented by one or more images that follow one another in time, that is to say, for example, a video or a still image that is displayed over a certain period of time. An image content is therefore always represented by one or more individual images, which can change over time, for example in the case of a video, or can also be temporarily or constantly constant, such as for a still image or a section of a video that is static for a certain period of time . Each of the individual images preferably represents exactly one of the image contents, so that no single image represents several of the image contents at the same time. An image content is understood to mean the complete content of all individual images belonging to the corresponding image content.

According to the invention, a display is provided which displays the plurality of Einzelbil countries periodically one after the other. The individual images are thus shown in chronological order by the display. The display takes place periodically, which means that the order in which the individual images of the different image contents are displayed is repeated periodically. It should be pointed out that the individual images do not have to repeat themselves, but rather the chronological sequence in which they belong to the at least two image contents is repeated.

According to the invention it is also provided that the display shows a plurality of individual images within each display period of at least one of the image contents and / or shows one of the image contents for a longer time than at least one other of the image contents. Longer in time means that the total time that this image content is displayed in a respective period is longer for one of the image contents than for at least one other, whereby the total time does not have to be contiguous, but can be contiguous. Thus, at least within a time interval in each period of at least one of the image contents, several individual images are displayed shown. This achieves on the one hand that for a direct viewer of the display that image content from which several individual images are represented can be highlighted, and on the other hand this increases the likelihood that a photo that a photographer takes of the display on site to record this image content.

According to the invention, a camera is provided which outputs a large number of recordings of a scene which at least partially contains the display. The scenery can of course also contain the entire display. The scene rie is the area that is mapped by the images output by the camera. An example of such a scenario would be a sports stadium in which an LED strip acts as a display.

The focus here is on which images the camera outputs, since this is more relevant to the method according to the invention than the question of what the camera is recording. What the camera records depends on the camera technology. For the viewer to whom the at least one image content is to be transmitted, however, only what is output by the camera is important.

According to the invention, a recording timing, which is the time sequence of the recordings output by the camera, is synchronized with a frame timing, which is the time sequence with which the display shows the individual images, so that the camera for each recording it outputs at least outputs one of the frames indicated by the display. Timing is therefore generally understood to be a time sequence. Since the individual images are displayed periodically, the recording timing will normally also be periodic. The recording timing is understood to mean the chronological sequence of those times at which the recordings depict the scenery. The times that result in the recording timing are times when light from the scene rie entered the camera. Since a camera image is normally created with a certain exposure time, the recording timing is made up of the time intervals in which light has entered the camera to generate the corresponding recordings. These exposure times or recording intervals have a certain temporal location in the recording timing, that is, a start or end time and a certain duration. The recording timing should be differentiated of the times when the camera outputs the recordings.

Since the recording timing determines those points in time and time intervals at which light incident on the camera is taken into account for the corresponding recordings, it can be coordinated with the individual image timing so that each recording contains at least one of the individual images.

According to the invention, the individual images of at least one of the image contents are then transmitted to at least one of the at least one viewer. Normally, this image content can be transmitted to a large number of viewers, such as television viewers, for example.

Transmission is to be understood here as any type of transmission to the viewer or viewers, although it is advantageous, but not mandatory, for the viewer to also display the image content. The viewer can also record or save the image content without showing it.

In an optional embodiment of the invention, the camera can output all of the individual images displayed by the display. It is particularly advantageous here if the camera outputs the combination or sum of some or all of the individual images. In particular, the camera can output this sum as exactly one recording in each case. For this purpose, the individual images displayed by the display can advantageously be designed in such a way that when the individual images are combined and in particular in the sum of the individual images, only the image content that is to be transmitted to the viewer results. All other image contents can be designed in the individual images in such a way that they cancel or erase each other in the combination and in particular in the case of summation.

In a further advantageous embodiment of the invention, the recording timing can be synchronized with the individual image timing such that the camera outputs exactly one of the individual images displayed by the display for each recording. This makes it possible to present the image content that is to be transmitted to the viewer on the display with only one single image per display period, which makes it available to a direct on-site viewer of the display Background can occur and ideally is not even perceptible. This applies in particular when the image content that is intended to be recognizable to the direct observer is displayed with a large number of individual images per period.

The individual images that are displayed by the display are preferably designed in such a way that a direct viewer of the display perceives exactly one of the image contents. This can be achieved in particular in that the individual images are designed in such a way that the individual images displayed by the display complement each other to form exactly one image content perceived by the immediate viewer of the display. This addition can advantageously be completed within a period. However, it is also possible that one of the image contents is designed in such a way that it is neutralized for the direct observer over several periods, for example if, in successive periods, he alternately shows a certain pattern and an inverse of the pattern, which the pattern neutralized for the immediate observer.

In a particularly preferred embodiment of the invention, a first one of the image contents can have a color correction of a second one of the image contents, which is designed so that a direct viewer of the display perceives the first image content without a color change compared to the original first image content. This can be achieved, for example, by adding the color correction to the first image content by adding an inverse of the individual images of the second image content in the corresponding display period to the individual images of the first image content of this period. This addition is preferably carried out pixel by pixel. However, this is only to be understood as an example. In the following, various options are shown as to how the individual images can be designed in order to make only the first image content recognizable to a direct viewer of the display.

In general, the individual images displayed by the display per display period can firstly contain first individual images that represent a first image content, secondly, second individual images that represent a second image content, and thirdly, third individual images that color compensation of the second individual images for a direct viewer of the display cause. The first, second and third individual images are preferably not the same individual images. For a direct viewer of the display, only those individual images can be seen in this embodiment which represent the first image content, while the second individual images are neutralized with the third individual images. The recording timing can then preferably be synchronized with the individual image timing such that the camera outputs the second individual images, but not the first individual images and not the third individual images.

In this embodiment of the invention, it is particularly advantageous if the display shows the third individual images divided into at least two groups, the at least two groups being separated from one another by at least one or more of the first and / or second individual images. If the third individual images are divided into at least two groups, this reduces the duration for which the same image content is continuously displayed within one period and increases the number of content changes. By increasing the alternating frequency within a period, the flicker effect is reduced. The flicker effect occurs primarily in the lateral field of vision of the human eye, because there, with few receptors, one hardly perceives image resolution and predominantly movement. In the central field of vision it is exactly the opposite. The main influence for the flicker effect is the picture brightness and less the color of the picture. This is due in particular to the comparatively small number of color receptors compared to brightness receptors on the retina of the eye. Investigations have shown that even a color change every 10 ms is imperceptible. Differences in brightness, on the other hand, are still perceptible, even if a jump in brightness only takes place in 2 ms of 20 ms.

The present invention is applicable to all formats for displaying and recording image content, in particular to all television formats. These formats can have different frequencies with which they display or record images. Typical image refresh rates are, for example, 50 Hz and 60 Hz. Different refresh rates lead to different durations of the individual images or frames. The duration of an image or frame is equal to 1 divided by the refresh rate. For example, for a refresh rate of 50 Hz, the duration of an image is 20 ms and for a refresh rate of 60 Hz a duration of 16.66 ms. Advantageously, these durations of an image or frame can be the length of the display period in the present invention. In the context of this document, the generalized unit "ze" is to be used as the unit of time. 1 ze is defined as the duration of the display period divided by i, where i is a number greater than or equal to 2. i is preferably greater than or equal to 8 or greater or equal to 10. Particularly preferably, i = 20 or i = 16.6. In the case of an implementation of the invention with a refresh rate of 50 Hz with i = 20, 1 ze = 1 ms would be. With a refresh rate of 60 Hz with i = 20 1 ze = 0.83 ms. The unit ze can be defined accordingly for all other refresh rates. Alternatively, the unit ze can also be defined so that 1 ze = 1 ms applies in systems with a refresh rate of 60 Hz. In this case Thus, 1 ze can be equal to the display period divided by i = 16.6. In both 50 Hz and 60 Hz systems, ze can also be obtained by dividing the display period by other values i such as 10, 8.3, 40 or 33.2 These can optionally be selected so that 1 ze = 1 ms or an integer multiple of 1 ms or 1 ms divided by an integer.

In an advantageous embodiment of the invention, the display can display a first of the image contents within a respective display period for a first duration, here referred to as tl51, and then one for a duration that is equal to the total duration of the display period minus the first duration tl51 display the second of the image content that is color-corrected to compensate for the first of the image content. It is preferred here if the first duration t151 is shorter than the duration of the display period minus t151. The shorter the first duration, the less the individual images of the second image content have to be changed for color correction. A typical example could be that within one display period, a single image of the first image content is initially displayed for 2 weeks, then for 8 weeks at least one single image of the second image content, then for example for 2 weeks at least one single image of an inverse of the first image content and then for example 8 ze at least one single image of the second image content. The combination of the individual images of the second image content with the at least one individual image of the inverse of the first image content serves as the second image content, which is color-corrected to compensate for the first image content. That here in the color-corrected second picture content the inverse of the first image content is displayed between individual images of the actual second image content is advantageous, since this can reduce the flicker effect. However, it is also possible to display the inverse before or after the individual images of the second image content or also to divide the second image content into more than two groups.

The duration with which an individual image is displayed can be the same for all individual images. A longer display of one of the image contents can then be brought about by displaying several of these individual images of the same length in direct succession. The duration of these single images of the same length can be, for example, the shortest duration with which one of the image contents is displayed continuously. But it is also possible that the individual images have different durations. In particular, it is possible that the uninterrupted display of the respective image content takes place in that the individual images are displayed for the duration that the corresponding image content is displayed without interruption.

In an advantageous embodiment of the invention, the display can initially display individual images of the first of the image contents for a first duration tl81 within a respective display period, then for the same duration tl81 individual images of an inverse of the first of the image contents and then for the remainder of the display period, i.e. for one Duration equal to the duration of the display period minus twice tl81, one or more individual images of a second of the image contents. For example, if the period is 20 ze and tl81 equal to 2 ze, the second image content is displayed for 16 ze in this example.

In this case, the recording timing of the camera is preferably synchronized with the display of the individual images, i.e. the individual image timing, so that the camera only outputs the first individual images of the first of the image contents, i.e. those individual images that are displayed within one display period during the first duration tl81 are displayed, but not the individual images of the inverse of the first of the image content, and preferably also not the individual images of the second image content. This refinement is particularly advantageous for camera types which, like a slow motion camera, cannot output individual images and at the same time the overall image, but which have higher sampling frequencies and at the same time variable shutters. In this embodiment of the invention, the shutdown ter of the camera are operated asynchronously and are set to the first occurrence of the duration tl81 and to the time of the display of the second image content within one display period. This is advantageous because a photographer who photographs the advertisement on site has a high probability of capturing content that is color-correct. In addition, the motion blur is retained for at least one of the two image contents.

In an advantageous embodiment of the invention, the display can initially show individual images of the first of the image contents for a first duration tl91, then for the same duration tl91 individual images of an inverse of the first image content, then for a second duration tl92 individual images of the second of the image contents, then for a duration t193 individual images of the second of the image contents whose common luminance is matched to the common luminance of the individual images of the first image content, and then again for a duration t192 individual images of the second of the image contents. For example, tl91 = 2 ze, tl92 = 6 ze and tl93 = 4 ze. This refinement is advantageous, in particular if it is assumed that the first image content has a different luminance than the second image content. The sequence described results in a frequency doubling for the change in luminance compared to the embodiment described above. This can reduce the flicker effect. In this embodiment, a direct photographer of the advertisement receives satisfactory images during the first period t191, as well as during the period t193 and the last period t192.

A further advantageous embodiment of the invention provides, within one period, to initially display tlll individual images of a first of the image contents for a duration tlll individual images of an inverse of the first image content for the same duration, then display tll2 individual images of a second of the image contents for a duration tll2 , then display for a duration t113 single images of the second image content whose luminance is adjusted, then display tll2 single images of the second image content for a duration, then display again for a duration t113 single images of the second image content, the luminance of which is adjusted, and then again to display again for a duration t112 individual images of the second image content. The equalization of the luminance of the individual images of the second image content take place in such a way that the luminance of all individual images, the luminance of which is adjusted, is equal to a common luminance of all individual images of the first image content. Since the flicker effect is caused by changes in the luminance, this luminance adjustment can reduce the flicker effect. The camera can then output precisely the individual images of the first image content displayed during the initial duration t111 and the individual images of the second image content displayed during a, preferably second, occurrence of the duration t112, but preferably not the other individual images. In this embodiment, for example, tlll = 2 ze, tll2 = 4 ze and tll3 = 2 ze.

In the case of asynchronous scanning, the camera could output the first image content for the duration tlll, then be blind for a duration of tlll, for example, then record the second image content or any part of it for the remainder of the period of the display period. The recording of the second image content can advantageously be as long as possible in order to be able to image as much motion blur as possible, but this is not necessary. A camera with a shutter could, for example, record the first image content for a time of 2 ze, and after 10 ze the first 2 ze of the luminance-corrected second image content, which is displayed for time t112, for example for 4 ze. The most advantageous sequence in this embodiment would be that described above.

It is advantageous if the recording timing is synchronized with the individual image timing so that the camera outputs the first image or images of the first of the image contents or a part or all of the individual images of the second of the image contents, but not the individual images of the inverse of the first Image content and not the individual images of the second of the image content with adjusted luminance. In principle, however, it is also conceivable that one would also like to record the individual images of the second of the image contents with adapted luminance. This can happen if other criteria contradict it (e.g. if the display cannot technically show the required division and the camera is just as inflexible).

When using high-resolution cameras, you may come across technical limits due to the large amount of data. Currently available For example, UHD cameras can currently only expose twice the set TV frequency (for example 50 Hz) with the same shutter length, for example with 2 ms every 10 ms. For such circumstances, the display can show a first one of the image contents and a second one of the image contents for a duration t201, for example t201 = 2 ze, alternating with a time interval t202, for example t202 = 10 ze, from one another, the recording timing of the camera as follows It can be synchronized with the display timing that the camera outputs recordings of the durations t201, but not recordings from the time intervals t202.

In an advantageous refinement of this embodiment, the display can show individual images of the first and / or the second image content during the time intervals t202. This increases the probability that the corresponding image content will be displayed on a photograph taken directly from the display. In addition, the motion blur is obtained.

In an advantageous embodiment, the display can show at least two individual images during the time intervals t202, which contain an inverse of at least one image content displayed during the periods t201, with at least one individual image of another image content being able to be displayed between these individual images.

A particularly preferred embodiment of the invention provides that the display shows the image content during each display period in the following order: for a duration of t201 a first A of the image content, for a duration t202 a second B of the image content for a duration t201 / 2 an inverse A 'of the image content A, for a duration t203 the second B of the image content, for a duration t 201/2 the inverse A' of the image content A, and for a duration t202 the second B of the image content, with particular preference t201 = 2 ze, t202 = 7 ze, t203 = 2 ze can be. This configuration represents an optimum insofar as it combines a minimization of the flicker effect, a color-correct exposure of content for photographers who photograph the scenery on site and a long exposure time for the second image content B to preserve the motion blur. In an optional embodiment of the invention, all of the individual images output by the camera can be transmitted to the viewer and displayed to him. This means that just by setting the recording timing it can be achieved that the viewer only perceives one of the image contents.

It is also possible, however, for individual images of different image contents that are excluded by the camera to be transmitted to different viewers. As a result, the display can show different image contents for different viewers who are not on site, and these different image contents can be selectively transmitted to the different viewers. For example, a billboard in a stadium could display advertisements to television viewers from different countries.

In an advantageous embodiment of the invention, a further camera can be provided, which can in particular be a motion picture camera that outputs only part of the individual images displayed per display period, this part of the individual images representing exactly one of the image contents. A recording timing in this further camera can be designed so that the further camera only records images or only outputs images recorded at times at which the display shows individual images of the corresponding image content. This additional camera does not have to be adjusted to the individual images themselves and can be a normal slow camera. In this way, for example, a television broadcaster can record the scenery with its own cameras and can synchronize its cameras with the image content that is of interest to its viewers.

In an advantageous embodiment of the invention, at least one of the image contents can have or consist of a pattern and an inverse of the pattern, the pattern and the inverse of the pattern particularly preferably being displayed alternately in successive display periods. This image content can then be used to recognize the display in the scenery recorded by the camera and, particularly preferably, to distinguish the display from areas of the scenery that are not the display. This refinement makes it possible to fade in image content for a viewer in the moving image recorded by the camera where the display is recognized in the recorded moving image. This will It is possible to fade in different content at the location of the display in the recorded moving image for a variety of different groups of viewers, while the display itself only needs to display two different image contents, namely those for immediate viewers and those containing the pattern.

In an advantageous embodiment of the invention, the individual images recorded by the camera, which belong to the same image content, can be summed up and / or interpolated according to content or intensity for each display period. In this way, it is possible to display to the viewer to whom the individual images are transmitted a motion blur, which results from the fact that there is movement in the corresponding image content.

In general, it is advantageous if several individual images of different image contents are alternately displayed within a respective display period, so that each image content does not appear consecutively at least twice within a respective display period. This can reduce the flicker effect.

Advantageously, the display can represent a plurality of identical individual images within a respective display period of at least one of the image contents. This can increase the probability that this image content will appear unimpaired and with the correct exposure on a direct photograph of the display, which, for example, a photographer takes on site.

The invention can take into account special properties of the display. In Europe, for example, production is carried out with a refresh rate of 50 Hz (20 ms per frame), while content is normally displayed on LED displays at 60 Hz, as it is transmitted via commercially available computer monitor technology (transmission via DVI standard). operate. It can be advantageous if the display and the camera are written with the same frequency. However, it is also possible to display briefly displayed content frame-synchronized for the camera. However, it is not necessary here that the image content that has been displayed for a long time, i.e. that Image content, for which individual images may be displayed for a longer period than the other image content, must also be synchronized. It is also possible that the display continues to show at 60 Hz while briefly displayed image content is shown at a different frame rate, synchronized with the recording camera. The invention also works in such an embodiment. The image content can therefore be sent to the display at a first frame rate that is different from a display frequency of the display, but which is the same as a recording frequency of the camera.

Advantageously, each display period can contain a different number of individual images for the various image contents. In particular, each display period can contain more individual images of one of the image contents than individual images of another of the image contents.

As already mentioned, fluctuations in luminance cause a flicker effect that is noticeable to the human eye. The luminance of the display of one of the image contents can therefore advantageously adapt the luminance to the level of the other image content for a short time. As a result, the change in luminance within the period takes place with a higher frequency, without affecting the images for direct photographs of the display or cameras with longer exposures.

The invention can be further improved by suitably setting the luminance and thereby taking into account the respectively displayed colors. In particular, it is advantageous to consider the luminance effect of individual colors separately. A display of magenta in one of the image contents A can be color-balanced with green. Green and magenta have almost the same luminance effect in the human eye. The situation is different with the combination of blue and yellow. The influence of blue on the luminance effect is very small (for example only 10%), while that of yellow is close to white (100%). For two image contents A = magenta and B = green, there is little, for image contents A = blue and B = yellow there are very strong flicker effects. A color compensation for a blue picture content can therefore only be done with dark yellow. In this way, a color falsification would remain in the blue. A full color correction can then be made in each other's individual images Image content. The individual images are preferably subdivided into a plurality of partial areas, which can in particular be pixels, with a common luminance of corresponding partial areas of the individual images of the first image content being equal to a common luminance of corresponding partial areas of the individual images of the second image content. Corresponding sub-areas are those sub-areas that are shown at the same location on the display. This can minimize the flicker effect.

The camera used according to the invention can advantageously be a slow motion camera which can output, for example, 100, 150, 300 or up to 400 recordings per second. The camera advantageously has such a recording frequency that it can output an integral multiple of the individual images displayed by the display for each recording.

According to the invention, a device for transmitting at least one image content to at least one viewer is also specified, with which a method as described above can be carried out. This device contains at least one display with which a plurality of individual images can be displayed periodically one after the other, with the display within a display period of at least one of the image contents several individual images can be displayed and / or at least one of the image contents can be displayed longer than the other image content. The device also contains a camera with which a plurality of recordings of a scene containing the display at least partially can be output. A recording timing, which is a chronological sequence of the recordings output by the camera, is synchronized with a frame timing with which the display can display the single images so that the camera outputs at least one single image per recording. The individual images of at least one of the image contents can be transmitted to at least one of the at least one viewer.

The invention is to be explained below with the aid of a few examples. It shows:

FIG. 1: an exemplary arrangement of a device for carrying out the method according to the invention, and FIG. 2: a schematic representation of the basis of the method according to the invention.

FIG. 1 shows a device with a display 1 and a camera 2 with which a method according to the invention can be carried out. The display 1 can display at least two different image contents in each case by means of a large number of individual images. The display shows the individual images periodically one after the other. It displays a plurality of individual images within one display period of at least one of the image contents and / or it displays at least one of the image contents longer than the other image content or contents. The camera 2 outputs a large number of recordings of a scenery which at least partially contains the display 1. It is then a recording timing, which is a temporal sequence of the recordings issued by the camera 2, synchronized with a frame timing with which the display 1 shows the individual images, so that the camera 2 per recording at least one of the displayed by the display Outputs individual images. The individual images of at least one of the image contents are transmitted to at least one of the at least one viewer 3.

The camera 2 can, for example, be a high-speed camera which is synchronized with the display 1 via the shutter, for example, in such a way that only one image content is visible at the time of exposure. The image content can be a video signal, for example.

The following convention is to be used in this document. Different picture contents are named with different capital letters, i.e. A, B, ... The picture contents are displayed uninterruptedly by the display for certain periods of time, i.e. not interrupted by other picture contents, or displayed in consecutive individual pictures. The temporal length of these durations should be specified here in time units ze, a time unit ze being defined as the duration of a display period divided by a number i that is greater than or equal to 2. The duration d of the successive display of a picture content should be indicated by the number of time units as a number followed by the capital letters designating the picture content. The specification Bd means that the image content B is indicated consecutively or without interruption for a duration of d ze. For example, B2 means that the image content B is given for 2 ze. The duration of the display period depends on the refresh rate of the standard used. In Europe, a refresh rate of 50 Hz is common, so that the duration of a period can advantageously be 20 ms. In this example, 1 ze = 1 ms can advantageously be. In the nomenclature, a dash means that the corresponding content has been color-corrected. For example, A2 'means that a color correction of the image content A is displayed for 2 ze. Two lines mean that a luminance correction of the corresponding image content is displayed. B4 "means that the image content B is displayed for 4 ze with a luminance correction.

FIG. 2 shows schematically an example of the method according to the invention. The display 1 shows a large number of individual images 5a, 5b,..., 5m within a period 4 in each case. The camera 2 outputs a large number of recordings of a scenery which at least partially contains the display 1. The high-speed camera 2 can transmit one of the image contents 6 to a viewer 3. The camera 2 can, but does not have to, also output an image 7 that is visible to a direct viewer of the display.

In the example shown, the camera 2 records on the one hand an image content A as well as all other image components displayed within the display period 4. The combination of all image components of the high-speed camera 2 complement each other in this example to form the video content that can be perceived by an immediate observer.

For example, by setting a shutter of a further camera, the latter can record image content B with the images of a content displayed for a longer period or an image content A with images of an image content that is only displayed briefly. A high-speed camera 2 can receive both at the same time. For example, the high-speed camera can be a slow motion camera and a normally recording camera can be, for example, a commercially available TV camera. The contents of the other recorded individual images are arbitrary. They can be the same or different. The combination, for example addition of all recorded partial images of a display period, can then result in the video actually shown, which a viewer of the display can also perceive on site. One or more individual images of the recordings output by the camera 2 can be used here, as can the overall image of all the images output by the camera 2.

If a high-speed camera also allows shutter settings (e.g. 1 ze exposure every 2 ze, i.e. 1 ms exposure phase and 1 ze blind phase), these can be used, for example, for content with color compensations. Individual image components recorded by the high-speed camera can also contain the color compensations instead of regular video content. Furthermore, the display of a content for one or more exposure phases and blind phases can take place in an overlapping manner.

Since the contents of the other recorded images of a high-speed camera 2 are arbitrary, they can also be differentiated further. The method described can also be repeated in any combination within a period, for example to differentiate further content. However, the property is preferably retained that the sum of all image contents of a period results in the actual content perceptible by the viewer.

Likewise, the first image content of a display period does not necessarily have to be used in order to display a different content than what is actually displayed. It can be at any point in time recorded as a single image by the high-speed camera 2, for example in the middle or at the end of the period.

The displayed content of an image of the high-speed camera is arbitrary. It preferably supplements itself with all other contents shown in the period to form the actual content visible to the viewer. He can do one show interesting content for a viewer, which is used without further image processing. In particular, it can contain one or more specific colors or patterns that can be recognized via image processing. The patterns can oscillate over the sequence of images of one content or all of the content, so that the image processing can contain a recognition of the time sequence of the images.

In the idea presented here, two (or more) video content (picture content) can be shown on a display in such a way that a camera shutter set for a short time only sees the frames of one video and a shutter set for the full frame period sees the other video . A high-speed camera 2 can record several individual images in the frame period, of which one individual image (or several individual images in the case of more than one "hidden video") show the frames of the briefly displayed video, other individual images any other content, the total A viewer of the display only sees the video displayed in the full frame period. As a direct advantage of this approach, a motion blur is obtained for the video consisting of the sum of all individual images corresponds to the recording of any other camera with a long exposure time. Switching the video from different camera positions no longer changes the image perception. At the same time, one receives recordings from one camera position with two (or more) contents on the display. The last sentence should clarify again why the use of the slow motion camera and the use of the whole tbildes brings an improvement to this application as a new idea.

Since the display remains freely selectable at the time of the further individual images as well as in the course of an exposure time, further improvements can be set up during this period.

As described, the flicker effect occurs primarily in the lateral field of vision of the human eye, because there, with few receptors, there is hardly any image resolution and predominantly movement is perceived. In the central field of vision it is exactly the other way around. The main influence for the flicker effect is the picture brightness and less the color of the picture. This can be justified for the entire field of vision from the comparatively low The number of color receptors compared to brightness receptors on the retina of the eye ("All cats are gray at night."). Studies have shown that even a change in color every 10 ms is imperceptible. Differences in brightness, on the other hand, are still perceptible, even if there is a jump in brightness in only 2ms of 20ms, if you want to briefly display other colors within the display of each video frame (20ze), it is sufficient to reduce the flicker effect to consider the brightness differences of the content.

The simplest way is to increase the frequency of the brightness display so that it is above human perception. So far, if the display of two video contents over the 20ze display period in the form A2 + B18 '(A2 means briefly displayed video A for 2ze, B18' color-corrected video B with full frame period 20ze, i.e. B = (A2 + B18 ' ), stands for the color correction), then it can be changed in the following double sequence A2 + (B8 '+ A2 + B8') without the recordings of both video contents showing changes. Only the color tone of the video displayed for a short time is increased and must be more balanced in the color correction of the video displayed for a long time. However, this poses a problem for photographers, since they can expose at any point in time without being synchronized to the display. If the sequence is A2 + (B8 + A2 '+ B8), the color balance takes place in the second phase (A2') of the short video A and the content of the long video B can remain unchanged in terms of color.

As mentioned in the first section of this document, the properties of the high-speed camera used are not sufficiently taken into account. There are camera types which, like slow motion cameras, cannot output individual images and at the same time the overall image, but which allow higher sampling frequencies as well as variable shutters. For such cameras, the display can initially be adapted in the form of A2 + A2 '+ B16. That is, the briefly displayed video A is followed by its inversion for color correction. In the remaining time of a frame period, the long displayed video B is displayed. The shutter of the camera is operated asynchronously and is set accordingly to the first 2 ze and the last 16 ze of a frame period. The image sequence obtained is split into two video streams (de-multiplexed). The advantage is that photographers are very likely to record content with the correct color and that the motion blur is retained for at least one of the two videos. There remains a higher proportion of differently bright displays if one assumes that video A has a different luminance than video B. To reduce the resulting flicker effect, the luminance can also be adjusted here in the form of a frequency doubling. This can be done in the time of the display of B16, in which the content is fixed. On the other hand, changing the luminance is sufficient to reduce the flicker effect. A possible remedy is the following division of the display: A2 + A2 '+ B6 + B4 "+ B6 stands for a reduction of the luminance in video B to the level of video A).

When using high-resolution cameras, the technical limits are reached due to the large amount of data. The currently available UHD camera from a manufacturer can currently only expose twice in the set TV frequency (here 50Hz as an example) with a shutter of the same length, e.g. twice with 2 ze every 10 ze. In order to display two video contents here, both contents would have to be displayed alternately for 2 weeks after every 10 weeks (i.e. A2 + x '+ B2 + y', x and y of the same length). In order to expose one of the two videos for as long as possible for other cameras and for photographers and thus to preserve the motion blur, x and y show portions of one video B (ie A2 + [B8 + B2] + A2 '+ B6 or A2 + B6 + A2 '+ [B2 + B8]). B8 and B2 show identical content. The exposure takes place at the time of display of A2 and B2. Since A2 and A2 'are closer to one another in time, the flicker effect is increased. One remedy is to divide a phase (A2 ') accordingly and to achieve the reduction via a triply divided process (i.e. A2 + B7 + Al' + B2 + Al '+ B7). This sequence combines the reduction of the flicker effect, color-correct exposure of content for photographers and a long exposure time for video B to preserve the motion blur.

In a similar way, special properties of LED displays can be taken into account. In Europe, production is carried out at 50Hz (20ms per frame), the content is displayed on LED displays without the approaches described here for fading in additional content, however, on television, it is currently unsynchronized at 60Hz, as it is Monitor technology (transmission via DVI standard). Only when the display is synchronized with the clock of the recording camera can briefly displayed content be frame-synchronized for the camera. However, it is not necessary here that the video content that has been displayed for a long time must also be synchronized. Rather, it is entirely possible that it continues to be displayed at 60Hz, while the briefly displayed content is displayed at a different frame rate synchronously with the recording camera. The approaches discussed in this document remain independent and thus serve the same purpose.

For each video that is briefly displayed, a motion blur, especially for camera pans, can also be calculated retrospectively through suitable use of camera sensors in conjunction with image processing (or through pure image processing).

As mentioned in the first section, it is primarily the fluctuation of the luminance that causes the flicker effect that can be perceived by the human eye. Colors, on the other hand, are hardly responsible. As already mentioned above, in the long display of a video B, the luminance can be adapted to the level of the briefly displayed video A for a short time. As a result, the change in luminance takes place over the 20 ce with twice (or even higher) frequency, without affecting the images for photographers or cameras with longer exposures.

The interplay of luminance and the respective displayed colors can bring further improvements. For this it is advantageous to consider the luminance effect of individual colors separately. A display of stomach ta in a briefly displayed video A can be balanced with green (separately as with A2 + A2 '+ B16 or in combination as with A2 + B18') for color neutrality. Green / magenta have almost the same luminance effect in the human eye. The situation is different with the combination of blue / yellow. The influence of blue on the luminance effect is very small (eg only 10%) while that of yellow is close to white (100%). For two videos, A = magenta and B = green, there are hardly any flicker effects, for videos A = blue and B = yellow. A compensation for A2 = blue in the form of A2 + B8 + A2 '+ B8 can therefore only be done with dark yellow for A2'. This leaves a color falsification in the blue. A complete color correction is then possible via a correction in phases B8. This gives a sequence of the form A2 + B8 '+ A2' + B8 'with A2 = blue, A2' = dark yellow and B8 '= content B with a slight yellow cast. Other combinations in which the content B is displayed in the correct color for a long time (e.g. A2 + B7 + B1 '+ A2' + B7 + B) are also possible. For video content A and B, which do not show the mentioned colors over a large area in the picture (eg multicolored natural pictures), the overall effect of the luminance in a picture or in a sub-area of the picture can also be corrected. A predominantly green image with a few and small blue dots in video A and predominantly magenta content in video B, for example, will cause almost no flicker effects in the human eye. A separate correction of the dark blue is therefore not necessary.

Claims

1. A method for transmitting at least one image content to at least one viewer, with at least two different image content each being represented by a plurality of individual images, a display periodically displaying the plurality of individual images one after the other, the display being displayed within a display period of at least one of the image content represents multiple individual images and / or at least one of the image content represents longer than the other image content (s), with a camera outputting a plurality of recordings of a scenery at least partially containing the display, with a recording timing that is a chronological sequence of the is synchronized with a frame timing with which the display shows the individual images that the camera outputs at least one of the individual images displayed by the display for each recording, the individual images at at least one of the image contents est one of the at least one viewer to be broadcast.

2. The method according to the preceding claim, wherein the camera outputs all of the individual images displayed by the display.

3. The method according to any one of the preceding claims, wherein the recording timing is synchronized with the frame timing so that the camera outputs exactly one of the individual images displayed by the display for each recording.

4. The method according to any one of the preceding claims, wherein the individual images displayed by the display are designed so that a direct viewer of the display perceives exactly one of the image contents and / or that the information displayed by the display is supplement individual images to form exactly one image content perceived by a direct viewer of the display.

5. The method according to any one of the preceding claims, wherein a first of the image content has a color correction of a second of the image content, which is designed so that a direct viewer of the display perceives the first image content without a color change compared to the original first image content, preferably the color correction is added to the first image content by adding an inverse of the individual images of the second image content in the corresponding display period, preferably pixel by pixel, to the individual images of the first image content in this period.

6. The method according to any one of the preceding claims, wherein the individual images displayed per display period by the display contain first first individual images that represent a first image content, two least contain second individual images that represent a second image content and thirdly contain third individual images that represent a Effect color compensation of the second individual images for a direct viewer of the display.

7. The method according to the preceding claim, wherein the display shows the third individual images divided into at least two groups, where the at least two groups are spaced apart by at least one or more of the first and / or second individual images.

8. The method according to any one of the preceding claims, wherein the display within each display period initially for a duration tl51, for example tl51 = 2 ze, the unit ze is defined as the duration of the display period divided by a number i, i> = 2, a displays the first of the image contents, and then for a duration that is equal to the duration of the display period minus tl51, displays a second of the image contents that is color-corrected to compensate for the first of the image contents, for example, the display within one display period initially for 2 show at least one single image of the first image content, then for 8 ze at least one individual image of the second image content, then for 2 ze at least one individual image of an inverse of the first image content and then for 8 ze at least one individual image of the second image content.

9. The method according to any one of the preceding claims, wherein the display within each display period initially for a duration tl81, for example tl81 = 2 ze, the unit ze is defined as the duration of the display period divided by a number i, i> = 2, Displays individual images of a first of the image contents, then displays individual images of an inverse of the first of the image contents for a duration tl81, and then displays individual images of a second of the image contents for the remainder of the display period, for example se 16 ze, the recording timing of the camera so with the The individual image timing is synchronized so that the camera holds the first individual images of the first of the image content and outputs the individual images of the second of the image content, but not the individual images of the inverse of the first of the image content.

10. The method according to any one of the preceding claims, wherein the display within a period initially for a duration tl91, for example tl91 = 2 ze, the unit ze is defined as the duration of the display period divided by a number i, i> = 2, single displays images of a first one of the image contents, then displays individual images of an inverse of the first of the image contents for a duration tl91, then displays individual images of a second one of the image contents for a duration tl92, for example tl92 = 6 ze, then for a duration tl93, for example tl93 = 4 shows single images of the second of the image contents, the common luminance of which is matched to the common luminance of the single images of the first of the image contents, and then displays single images of the second of the image contents for a duration t192.

11. The method according to any one of claims 1 to 9, wherein the display within a period initially for a duration tlll, for example tlll = 2 ze, the unit ze is defined as the duration of the display period divided by a number i, i> = 2, individual images of a first one of the image content displays, then for a duration tlll individual images of an in- verses of the first one of the image contents, then for a duration tll2, for example tll2 = 4 ze, displays individual images of a second one of the picture contents, then for a duration tll3, for example tll3 =

2 ze, displays individual images of the second image content, the luminance of which is equalized, then displays for a duration tll2 individual images of the second image content, then again for a duration t113 displays individual images of the second image content, the luminance of which is adjusted, and then again for one Duration tll2 displays individual images of the second image content, the luminance of the individual images of the second image content being adjusted in such a way that the luminance of all individual images whose luminance is adjusted is equal to a common luminance of the individual images of the first image content, with the camera being accurate outputs the individual images of the first image content displayed during the first duration tlll and the individual images of the second image content displayed during one, preferably before the second, occurrence of the duration tll2.

12. The method according to any one of the two preceding claims, wherein the recording timing is synchronized with the frame timing that the camera outputs the first frame or frames of the first of the image content and some or all of the individual images of the second image content, but not the Individual images of the inverse of the first of the image contents and not the individual images of the second of the image contents with adjusted luminance.

13. The method according to any one of the preceding claims, wherein the display has a first one of the image content and a second one of the image content for a duration t201, for example t201 = 2 ze, where the unit ze is defined as the duration of the display period divided by a number i, i> = 2, alternating with a time interval t202, for example t202 = 10 ze, from one another, the recording timing of the camera being synchronized with the display timing so that the camera outputs recordings of durations t201, but not recordings from the time intervals t202.

14. The method according to the preceding claim, wherein the display shows individual images of the first and / or the second of the image contents during the time intervals t202.

15. The method according to any one of the two preceding claims, wherein the display shows at least two individual images during the time intervals t202 which contain an inverse of at least one image content displayed during the duration t201, with at least one individual image of another image content being displayed between these individual images.

16. The method according to any one of the preceding claims, wherein the ad displays the image content in the following sequence during a respective display period: a first A of the image content for a duration t201, a second B of the image content for a duration t202, for a duration t201 / 2 an inverse A 'of the image content A, for a duration t203 the second B of the image content, for a duration t201 / 2 the inverse A' of the image content A, and for a duration t202 the second B of the image content, where preferably t201 = 2 ze, t202 = 7 ze, t203 = 2 ze, where the unit ze is defined as the duration of the display period divided by a number i, i> = 2.

17. The method according to any one of the preceding claims, wherein all the individual images output by the camera are transmitted to the viewer and displayed to him.

18. The method according to any one of claims 1 to 16, wherein the individual images of different image contents output by the camera are transmitted to different viewers.

19. The method according to any one of the preceding claims, wherein a further camera outputs only part of the individual images displayed per display period, this part of the individual images representing exactly one of the image contents.

20. The method according to any one of the preceding claims, wherein at least one of the image content has a pattern and an inverse of the pattern or consists of it, the pattern and the inverse of the pattern is displayed alternately in successive lowing of the display periods, preferably this image content to a Recognition device is transmitted, which recognizes the display based on this image content in the scene recorded by the camera and particularly preferably distinguishes the display from areas that are not the display.

21. The method according to any one of the preceding claims, wherein for each display period the individual images output by the camera, which belong to the same image content, are added up and / or interpolated according to content or intensity.

22. The method according to any one of the preceding claims, wherein a plurality of individual images of different image contents are displayed alternately within each display period.

23. The method according to any one of the preceding claims, wherein the display shows a plurality of identical individual images within a respective display period of at least one of the image contents.

24. The method according to any one of the preceding claims, wherein the image content is sent to the display at a first frame rate that is different from a display frequency of the display and wherein a recording frequency of the camera is equal to the first frame rate.

25. The method according to any one of the preceding claims, wherein each display period contains more individual images of one of the image contents than individual images of another of the image contents.

26. The method according to any one of the preceding claims, wherein the recording timing of the camera is periodic with a period which is equal to a period of a period of the frame timing of the display.

27. The method according to any one of the preceding claims, wherein a common luminance of the individual images of the first image content is equal to a common luminance of the individual images of the second image content.

28. The method according to any one of the preceding claims, wherein the individual images have a plurality of partial areas, a common luminance of corresponding partial areas of the individual images of the first image content being equal to a common luminance of corresponding partial areas of the individual images of the second image content.

29. The method according to the preceding claim, wherein different colors contribute according to their brightness values to the common luminance of the corresponding sub-areas.

30. The method according to any one of the preceding claims, wherein the camera can output up to 100 or up to 120 or up to 150 or up to 300 or up to 400 or up to 800 or up to 960 recordings per second.

31. A device for transmitting at least one image content to at least one viewer, having at least one display with which a plurality of individual images can be displayed periodically one after the other, with the display within one display period of at least one of the image contents being able to display multiple individual images , a camera with which a plurality of recordings of a scene at least partially containing the display can be output, with recording timing, which is a chronological sequence of recordings output by the camera, with frame timing with which the display is used to display the individual images can be displayed, can be synchronized in such a way that the camera outputs at least one individual image displayed by the display for each recording, the individual images of at least one of the image contents being transferable to at least one of the at least one viewer, the device using a method according to one of the preceding - pending claims is feasible.