EP4078944A1 - Verfahren zur übertragung von zumindest einem bildinhalt an zumindest einem betrachter - Google Patents
Verfahren zur übertragung von zumindest einem bildinhalt an zumindest einem betrachterInfo
- Publication number
- EP4078944A1 EP4078944A1 EP20838984.1A EP20838984A EP4078944A1 EP 4078944 A1 EP4078944 A1 EP 4078944A1 EP 20838984 A EP20838984 A EP 20838984A EP 4078944 A1 EP4078944 A1 EP 4078944A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- individual images
- display
- image content
- image
- duration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2625—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/2224—Studio circuitry; Studio devices; Studio equipment related to virtual studio applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/272—Means for inserting a foreground image in a background image, i.e. inlay, outlay
- H04N5/2723—Insertion of virtual advertisement; Replacing advertisements physical present in the scene by virtual advertisement
Definitions
- the invention relates to a method for transmitting at least one image content to at least one viewer, with image content being represented by a large number of individual images, a display periodically showing the large number of individual images one after the other and with a camera showing a large number of recordings from a display at least partially contained scenery, the camera outputs at least one of the displayed individual images for each recording and the individual images at least one of the
- Image content is transmitted to at least one viewer.
- the invention is based on a situation in which a camera takes recordings of a scene that contains a display for displaying image content.
- a typical example of such situations are sporting events in which there are advertisements in the stadium, for example for advertising, and which are recorded and transmitted with television cameras.
- the TV cameras record the advertisements, for example the boards of a soccer field, and transmit the content displayed on the advertisements with the television image. It is desirable if other image contents of these displays can be transmitted in the images recorded by the camera than a viewer perceives on site. In this way, the viewer can see image content on site that is relevant to him, while at the same time a television viewer can see other image content that is relevant for the television viewer.
- One approach to show a viewer of the images recorded by the camera different image content than a direct viewer of the display perceives is to alternately display the different image contents on the display in quick succession and the camera with the presentation on the display synchronize so that the camera only records one of the image content.
- the problem here, however, is that the image content intended for the television viewer must be presented by the display in such a way that the immediate on-site viewer of the display perceives this additional display content as little as possible.
- the object of the present invention is to provide a method for transmitting at least one image content to at least one viewer that allows the viewer of images recorded by the camera to be presented to the viewer other image content than a direct viewer who is perceived by the immediate viewer The viewer is affected as little as possible.
- Advantageous refinements of the invention also make it possible to set motion blur fe well for the viewer of the images recorded by the camera. Further refinements make it possible to keep a flickering effect low for direct viewers of the display. In addition, advantageous refinements of the invention allow photographers of the on-site display to record the image content that is visible to immediate viewers with the highest possible probability.
- the object is achieved by the method for transmitting at least one image content to at least one viewer according to claim 1 and by the device for transmitting at least one image content to at least one viewer according to claim 31.
- the dependent claims indicate advantageous developments of the method according to claim 1.
- Image content can be understood here to mean content represented by one or more images that follow one another in time, that is to say, for example, a video or a still image that is displayed over a certain period of time.
- An image content is therefore always represented by one or more individual images, which can change over time, for example in the case of a video, or can also be temporarily or constantly constant, such as for a still image or a section of a video that is static for a certain period of time .
- Each of the individual images preferably represents exactly one of the image contents, so that no single image represents several of the image contents at the same time.
- An image content is understood to mean the complete content of all individual images belonging to the corresponding image content.
- a display which displays the plurality of Einzelbil countries periodically one after the other.
- the individual images are thus shown in chronological order by the display.
- the display takes place periodically, which means that the order in which the individual images of the different image contents are displayed is repeated periodically. It should be pointed out that the individual images do not have to repeat themselves, but rather the chronological sequence in which they belong to the at least two image contents is repeated.
- the display shows a plurality of individual images within each display period of at least one of the image contents and / or shows one of the image contents for a longer time than at least one other of the image contents.
- Longer in time means that the total time that this image content is displayed in a respective period is longer for one of the image contents than for at least one other, whereby the total time does not have to be contiguous, but can be contiguous.
- several individual images are displayed shown. This achieves on the one hand that for a direct viewer of the display that image content from which several individual images are represented can be highlighted, and on the other hand this increases the likelihood that a photo that a photographer takes of the display on site to record this image content.
- a camera which outputs a large number of recordings of a scene which at least partially contains the display.
- the scenery can of course also contain the entire display.
- the scene rie is the area that is mapped by the images output by the camera.
- An example of such a scenario would be a sports stadium in which an LED strip acts as a display.
- the focus here is on which images the camera outputs, since this is more relevant to the method according to the invention than the question of what the camera is recording. What the camera records depends on the camera technology. For the viewer to whom the at least one image content is to be transmitted, however, only what is output by the camera is important.
- a recording timing which is the time sequence of the recordings output by the camera, is synchronized with a frame timing, which is the time sequence with which the display shows the individual images, so that the camera for each recording it outputs at least outputs one of the frames indicated by the display.
- Timing is therefore generally understood to be a time sequence. Since the individual images are displayed periodically, the recording timing will normally also be periodic. The recording timing is understood to mean the chronological sequence of those times at which the recordings depict the scenery. The times that result in the recording timing are times when light from the scene rie entered the camera. Since a camera image is normally created with a certain exposure time, the recording timing is made up of the time intervals in which light has entered the camera to generate the corresponding recordings. These exposure times or recording intervals have a certain temporal location in the recording timing, that is, a start or end time and a certain duration. The recording timing should be differentiated of the times when the camera outputs the recordings.
- the recording timing determines those points in time and time intervals at which light incident on the camera is taken into account for the corresponding recordings, it can be coordinated with the individual image timing so that each recording contains at least one of the individual images.
- the individual images of at least one of the image contents are then transmitted to at least one of the at least one viewer.
- this image content can be transmitted to a large number of viewers, such as television viewers, for example.
- Transmission is to be understood here as any type of transmission to the viewer or viewers, although it is advantageous, but not mandatory, for the viewer to also display the image content.
- the viewer can also record or save the image content without showing it.
- the camera can output all of the individual images displayed by the display. It is particularly advantageous here if the camera outputs the combination or sum of some or all of the individual images. In particular, the camera can output this sum as exactly one recording in each case.
- the individual images displayed by the display can advantageously be designed in such a way that when the individual images are combined and in particular in the sum of the individual images, only the image content that is to be transmitted to the viewer results. All other image contents can be designed in the individual images in such a way that they cancel or erase each other in the combination and in particular in the case of summation.
- the recording timing can be synchronized with the individual image timing such that the camera outputs exactly one of the individual images displayed by the display for each recording.
- the individual images that are displayed by the display are preferably designed in such a way that a direct viewer of the display perceives exactly one of the image contents.
- This can be achieved in particular in that the individual images are designed in such a way that the individual images displayed by the display complement each other to form exactly one image content perceived by the immediate viewer of the display.
- This addition can advantageously be completed within a period.
- one of the image contents is designed in such a way that it is neutralized for the direct observer over several periods, for example if, in successive periods, he alternately shows a certain pattern and an inverse of the pattern, which the pattern neutralized for the immediate observer.
- a first one of the image contents can have a color correction of a second one of the image contents, which is designed so that a direct viewer of the display perceives the first image content without a color change compared to the original first image content.
- This can be achieved, for example, by adding the color correction to the first image content by adding an inverse of the individual images of the second image content in the corresponding display period to the individual images of the first image content of this period.
- This addition is preferably carried out pixel by pixel.
- this is only to be understood as an example.
- various options are shown as to how the individual images can be designed in order to make only the first image content recognizable to a direct viewer of the display.
- the individual images displayed by the display per display period can firstly contain first individual images that represent a first image content, secondly, second individual images that represent a second image content, and thirdly, third individual images that color compensation of the second individual images for a direct viewer of the display cause.
- the first, second and third individual images are preferably not the same individual images.
- For a direct viewer of the display only those individual images can be seen in this embodiment which represent the first image content, while the second individual images are neutralized with the third individual images.
- the recording timing can then preferably be synchronized with the individual image timing such that the camera outputs the second individual images, but not the first individual images and not the third individual images.
- the display shows the third individual images divided into at least two groups, the at least two groups being separated from one another by at least one or more of the first and / or second individual images. If the third individual images are divided into at least two groups, this reduces the duration for which the same image content is continuously displayed within one period and increases the number of content changes. By increasing the alternating frequency within a period, the flicker effect is reduced.
- the flicker effect occurs primarily in the lateral field of vision of the human eye, because there, with few receptors, one hardly perceives image resolution and predominantly movement. In the central field of vision it is exactly the opposite.
- the main influence for the flicker effect is the picture brightness and less the color of the picture.
- the present invention is applicable to all formats for displaying and recording image content, in particular to all television formats. These formats can have different frequencies with which they display or record images. Typical image refresh rates are, for example, 50 Hz and 60 Hz. Different refresh rates lead to different durations of the individual images or frames.
- the duration of an image or frame is equal to 1 divided by the refresh rate. For example, for a refresh rate of 50 Hz, the duration of an image is 20 ms and for a refresh rate of 60 Hz a duration of 16.66 ms.
- these durations of an image or frame can be the length of the display period in the present invention.
- the generalized unit "ze" is to be used as the unit of time.
- the display can display a first of the image contents within a respective display period for a first duration, here referred to as tl51, and then one for a duration that is equal to the total duration of the display period minus the first duration tl51 display the second of the image content that is color-corrected to compensate for the first of the image content. It is preferred here if the first duration t151 is shorter than the duration of the display period minus t151. The shorter the first duration, the less the individual images of the second image content have to be changed for color correction.
- a typical example could be that within one display period, a single image of the first image content is initially displayed for 2 weeks, then for 8 weeks at least one single image of the second image content, then for example for 2 weeks at least one single image of an inverse of the first image content and then for example 8 ze at least one single image of the second image content.
- the combination of the individual images of the second image content with the at least one individual image of the inverse of the first image content serves as the second image content, which is color-corrected to compensate for the first image content. That here in the color-corrected second picture content the inverse of the first image content is displayed between individual images of the actual second image content is advantageous, since this can reduce the flicker effect.
- the duration with which an individual image is displayed can be the same for all individual images. A longer display of one of the image contents can then be brought about by displaying several of these individual images of the same length in direct succession.
- the duration of these single images of the same length can be, for example, the shortest duration with which one of the image contents is displayed continuously. But it is also possible that the individual images have different durations. In particular, it is possible that the uninterrupted display of the respective image content takes place in that the individual images are displayed for the duration that the corresponding image content is displayed without interruption.
- the display can initially display individual images of the first of the image contents for a first duration tl81 within a respective display period, then for the same duration tl81 individual images of an inverse of the first of the image contents and then for the remainder of the display period, i.e. for one Duration equal to the duration of the display period minus twice tl81, one or more individual images of a second of the image contents. For example, if the period is 20 ze and tl81 equal to 2 ze, the second image content is displayed for 16 ze in this example.
- the recording timing of the camera is preferably synchronized with the display of the individual images, i.e. the individual image timing, so that the camera only outputs the first individual images of the first of the image contents, i.e. those individual images that are displayed within one display period during the first duration tl81 are displayed, but not the individual images of the inverse of the first of the image content, and preferably also not the individual images of the second image content.
- This refinement is particularly advantageous for camera types which, like a slow motion camera, cannot output individual images and at the same time the overall image, but which have higher sampling frequencies and at the same time variable shutters.
- the shutdown ter of the camera are operated asynchronously and are set to the first occurrence of the duration tl81 and to the time of the display of the second image content within one display period. This is advantageous because a photographer who photographs the advertisement on site has a high probability of capturing content that is color-correct.
- the motion blur is retained for at least one of the two image contents.
- the display can initially show individual images of the first of the image contents for a first duration tl91, then for the same duration tl91 individual images of an inverse of the first image content, then for a second duration tl92 individual images of the second of the image contents, then for a duration t193 individual images of the second of the image contents whose common luminance is matched to the common luminance of the individual images of the first image content, and then again for a duration t192 individual images of the second of the image contents.
- tl91 2 ze
- tl92 6 ze
- tl93 4 ze.
- This refinement is advantageous, in particular if it is assumed that the first image content has a different luminance than the second image content.
- the sequence described results in a frequency doubling for the change in luminance compared to the embodiment described above. This can reduce the flicker effect.
- a direct photographer of the advertisement receives satisfactory images during the first period t191, as well as during the period t193 and the last period t192.
- a further advantageous embodiment of the invention provides, within one period, to initially display tlll individual images of a first of the image contents for a duration tlll individual images of an inverse of the first image content for the same duration, then display tll2 individual images of a second of the image contents for a duration tll2 , then display for a duration t113 single images of the second image content whose luminance is adjusted, then display tll2 single images of the second image content for a duration, then display again for a duration t113 single images of the second image content, the luminance of which is adjusted, and then again to display again for a duration t112 individual images of the second image content.
- the equalization of the luminance of the individual images of the second image content take place in such a way that the luminance of all individual images, the luminance of which is adjusted, is equal to a common luminance of all individual images of the first image content. Since the flicker effect is caused by changes in the luminance, this luminance adjustment can reduce the flicker effect.
- the camera could output the first image content for the duration tlll, then be blind for a duration of tlll, for example, then record the second image content or any part of it for the remainder of the period of the display period.
- the recording of the second image content can advantageously be as long as possible in order to be able to image as much motion blur as possible, but this is not necessary.
- a camera with a shutter could, for example, record the first image content for a time of 2 ze, and after 10 ze the first 2 ze of the luminance-corrected second image content, which is displayed for time t112, for example for 4 ze.
- the most advantageous sequence in this embodiment would be that described above.
- the recording timing is synchronized with the individual image timing so that the camera outputs the first image or images of the first of the image contents or a part or all of the individual images of the second of the image contents, but not the individual images of the inverse of the first Image content and not the individual images of the second of the image content with adjusted luminance.
- the recording timing is synchronized with the individual image timing so that the camera outputs the first image or images of the first of the image contents or a part or all of the individual images of the second of the image contents, but not the individual images of the inverse of the first Image content and not the individual images of the second of the image content with adjusted luminance.
- the display can show individual images of the first and / or the second image content during the time intervals t202. This increases the probability that the corresponding image content will be displayed on a photograph taken directly from the display. In addition, the motion blur is obtained.
- the display can show at least two individual images during the time intervals t202, which contain an inverse of at least one image content displayed during the periods t201, with at least one individual image of another image content being able to be displayed between these individual images.
- This configuration represents an optimum insofar as it combines a minimization of the flicker effect, a color-correct exposure of content for photographers who photograph the scenery on site and a long exposure time for the second image content B to preserve the motion blur.
- all of the individual images output by the camera can be transmitted to the viewer and displayed to him. This means that just by setting the recording timing it can be achieved that the viewer only perceives one of the image contents.
- the display can show different image contents for different viewers who are not on site, and these different image contents can be selectively transmitted to the different viewers.
- a billboard in a stadium could display advertisements to television viewers from different countries.
- a further camera can be provided, which can in particular be a motion picture camera that outputs only part of the individual images displayed per display period, this part of the individual images representing exactly one of the image contents.
- a recording timing in this further camera can be designed so that the further camera only records images or only outputs images recorded at times at which the display shows individual images of the corresponding image content.
- This additional camera does not have to be adjusted to the individual images themselves and can be a normal slow camera. In this way, for example, a television broadcaster can record the scenery with its own cameras and can synchronize its cameras with the image content that is of interest to its viewers.
- At least one of the image contents can have or consist of a pattern and an inverse of the pattern, the pattern and the inverse of the pattern particularly preferably being displayed alternately in successive display periods.
- This image content can then be used to recognize the display in the scenery recorded by the camera and, particularly preferably, to distinguish the display from areas of the scenery that are not the display.
- This refinement makes it possible to fade in image content for a viewer in the moving image recorded by the camera where the display is recognized in the recorded moving image. This will It is possible to fade in different content at the location of the display in the recorded moving image for a variety of different groups of viewers, while the display itself only needs to display two different image contents, namely those for immediate viewers and those containing the pattern.
- the individual images recorded by the camera which belong to the same image content, can be summed up and / or interpolated according to content or intensity for each display period. In this way, it is possible to display to the viewer to whom the individual images are transmitted a motion blur, which results from the fact that there is movement in the corresponding image content.
- the display can represent a plurality of identical individual images within a respective display period of at least one of the image contents. This can increase the probability that this image content will appear unimpaired and with the correct exposure on a direct photograph of the display, which, for example, a photographer takes on site.
- the invention can take into account special properties of the display.
- production is carried out with a refresh rate of 50 Hz (20 ms per frame), while content is normally displayed on LED displays at 60 Hz, as it is transmitted via commercially available computer monitor technology (transmission via DVI standard). operate.
- It can be advantageous if the display and the camera are written with the same frequency.
- it is also possible to display briefly displayed content frame-synchronized for the camera.
- it is not necessary here that the image content that has been displayed for a long time, i.e. that Image content, for which individual images may be displayed for a longer period than the other image content, must also be synchronized.
- the display continues to show at 60 Hz while briefly displayed image content is shown at a different frame rate, synchronized with the recording camera.
- the invention also works in such an embodiment.
- the image content can therefore be sent to the display at a first frame rate that is different from a display frequency of the display, but which is the same as a recording frequency of the camera.
- each display period can contain a different number of individual images for the various image contents.
- each display period can contain more individual images of one of the image contents than individual images of another of the image contents.
- the luminance of the display of one of the image contents can therefore advantageously adapt the luminance to the level of the other image content for a short time. As a result, the change in luminance within the period takes place with a higher frequency, without affecting the images for direct photographs of the display or cameras with longer exposures.
- the invention can be further improved by suitably setting the luminance and thereby taking into account the respectively displayed colors.
- a display of magenta in one of the image contents A can be color-balanced with green. Green and magenta have almost the same luminance effect in the human eye. The situation is different with the combination of blue and yellow. The influence of blue on the luminance effect is very small (for example only 10%), while that of yellow is close to white (100%).
- a color compensation for a blue picture content can therefore only be done with dark yellow. In this way, a color falsification would remain in the blue.
- a full color correction can then be made in each other's individual images Image content.
- the individual images are preferably subdivided into a plurality of partial areas, which can in particular be pixels, with a common luminance of corresponding partial areas of the individual images of the first image content being equal to a common luminance of corresponding partial areas of the individual images of the second image content.
- Corresponding sub-areas are those sub-areas that are shown at the same location on the display. This can minimize the flicker effect.
- the camera used according to the invention can advantageously be a slow motion camera which can output, for example, 100, 150, 300 or up to 400 recordings per second.
- the camera advantageously has such a recording frequency that it can output an integral multiple of the individual images displayed by the display for each recording.
- a device for transmitting at least one image content to at least one viewer contains at least one display with which a plurality of individual images can be displayed periodically one after the other, with the display within a display period of at least one of the image contents several individual images can be displayed and / or at least one of the image contents can be displayed longer than the other image content.
- the device also contains a camera with which a plurality of recordings of a scene containing the display at least partially can be output.
- a recording timing which is a chronological sequence of the recordings output by the camera, is synchronized with a frame timing with which the display can display the single images so that the camera outputs at least one single image per recording.
- the individual images of at least one of the image contents can be transmitted to at least one of the at least one viewer.
- FIG. 1 an exemplary arrangement of a device for carrying out the method according to the invention
- FIG. 2 a schematic representation of the basis of the method according to the invention.
- FIG. 1 shows a device with a display 1 and a camera 2 with which a method according to the invention can be carried out.
- the display 1 can display at least two different image contents in each case by means of a large number of individual images.
- the display shows the individual images periodically one after the other. It displays a plurality of individual images within one display period of at least one of the image contents and / or it displays at least one of the image contents longer than the other image content or contents.
- the camera 2 outputs a large number of recordings of a scenery which at least partially contains the display 1.
- a recording timing which is a temporal sequence of the recordings issued by the camera 2, synchronized with a frame timing with which the display 1 shows the individual images, so that the camera 2 per recording at least one of the displayed by the display Outputs individual images.
- the individual images of at least one of the image contents are transmitted to at least one of the at least one viewer 3.
- the camera 2 can, for example, be a high-speed camera which is synchronized with the display 1 via the shutter, for example, in such a way that only one image content is visible at the time of exposure.
- the image content can be a video signal, for example.
- the following convention is to be used in this document. Different picture contents are named with different capital letters, i.e. A, B, ...
- the picture contents are displayed uninterruptedly by the display for certain periods of time, i.e. not interrupted by other picture contents, or displayed in consecutive individual pictures.
- the temporal length of these durations should be specified here in time units ze, a time unit ze being defined as the duration of a display period divided by a number i that is greater than or equal to 2.
- the duration d of the successive display of a picture content should be indicated by the number of time units as a number followed by the capital letters designating the picture content.
- the specification Bd means that the image content B is indicated consecutively or without interruption for a duration of d ze.
- B2 means that the image content B is given for 2 ze.
- the duration of the display period depends on the refresh rate of the standard used. In Europe, a refresh rate of 50 Hz is common, so that the duration of a period can advantageously be 20 ms.
- 1 ze 1 ms can advantageously be.
- a dash means that the corresponding content has been color-corrected.
- Two lines mean that a luminance correction of the corresponding image content is displayed.
- B4 "means that the image content B is displayed for 4 ze with a luminance correction.
- FIG. 2 shows schematically an example of the method according to the invention.
- the display 1 shows a large number of individual images 5a, 5b,..., 5m within a period 4 in each case.
- the camera 2 outputs a large number of recordings of a scenery which at least partially contains the display 1.
- the high-speed camera 2 can transmit one of the image contents 6 to a viewer 3.
- the camera 2 can, but does not have to, also output an image 7 that is visible to a direct viewer of the display.
- the camera 2 records on the one hand an image content A as well as all other image components displayed within the display period 4.
- the combination of all image components of the high-speed camera 2 complement each other in this example to form the video content that can be perceived by an immediate observer.
- the latter can record image content B with the images of a content displayed for a longer period or an image content A with images of an image content that is only displayed briefly.
- a high-speed camera 2 can receive both at the same time.
- the high-speed camera can be a slow motion camera and a normally recording camera can be, for example, a commercially available TV camera.
- the contents of the other recorded individual images are arbitrary. They can be the same or different.
- the combination for example addition of all recorded partial images of a display period, can then result in the video actually shown, which a viewer of the display can also perceive on site.
- One or more individual images of the recordings output by the camera 2 can be used here, as can the overall image of all the images output by the camera 2.
- a high-speed camera also allows shutter settings (e.g. 1 ze exposure every 2 ze, i.e. 1 ms exposure phase and 1 ze blind phase), these can be used, for example, for content with color compensations. Individual image components recorded by the high-speed camera can also contain the color compensations instead of regular video content. Furthermore, the display of a content for one or more exposure phases and blind phases can take place in an overlapping manner.
- the contents of the other recorded images of a high-speed camera 2 are arbitrary, they can also be differentiated further.
- the method described can also be repeated in any combination within a period, for example to differentiate further content.
- the property is preferably retained that the sum of all image contents of a period results in the actual content perceptible by the viewer.
- the first image content of a display period does not necessarily have to be used in order to display a different content than what is actually displayed. It can be at any point in time recorded as a single image by the high-speed camera 2, for example in the middle or at the end of the period.
- the displayed content of an image of the high-speed camera is arbitrary. It preferably supplements itself with all other contents shown in the period to form the actual content visible to the viewer. He can do one show interesting content for a viewer, which is used without further image processing. In particular, it can contain one or more specific colors or patterns that can be recognized via image processing. The patterns can oscillate over the sequence of images of one content or all of the content, so that the image processing can contain a recognition of the time sequence of the images.
- two (or more) video content can be shown on a display in such a way that a camera shutter set for a short time only sees the frames of one video and a shutter set for the full frame period sees the other video .
- a high-speed camera 2 can record several individual images in the frame period, of which one individual image (or several individual images in the case of more than one "hidden video") show the frames of the briefly displayed video, other individual images any other content, the total
- the display only sees the video displayed in the full frame period.
- the flicker effect occurs primarily in the lateral field of vision of the human eye, because there, with few receptors, there is hardly any image resolution and predominantly movement is perceived. In the central field of vision it is exactly the other way around.
- the main influence for the flicker effect is the picture brightness and less the color of the picture. This can be justified for the entire field of vision from the comparatively low The number of color receptors compared to brightness receptors on the retina of the eye ("All cats are gray at night.”). Studies have shown that even a change in color every 10 ms is imperceptible.
- the properties of the high-speed camera used are not sufficiently taken into account.
- the display can initially be adapted in the form of A2 + A2 '+ B16. That is, the briefly displayed video A is followed by its inversion for color correction. In the remaining time of a frame period, the long displayed video B is displayed.
- the shutter of the camera is operated asynchronously and is set accordingly to the first 2 ze and the last 16 ze of a frame period.
- the image sequence obtained is split into two video streams (de-multiplexed).
- the advantage is that photographers are very likely to record content with the correct color and that the motion blur is retained for at least one of the two videos. There remains a higher proportion of differently bright displays if one assumes that video A has a different luminance than video B. To reduce the resulting flicker effect, the luminance can also be adjusted here in the form of a frequency doubling. This can be done in the time of the display of B16, in which the content is fixed. On the other hand, changing the luminance is sufficient to reduce the flicker effect.
- a possible remedy is the following division of the display: A2 + A2 '+ B6 + B4 "+ B6 stands for a reduction of the luminance in video B to the level of video A).
- the currently available UHD camera from a manufacturer can currently only expose twice in the set TV frequency (here 50Hz as an example) with a shutter of the same length, e.g. twice with 2 ze every 10 ze. In order to display two video contents here, both contents would have to be displayed alternately for 2 weeks after every 10 weeks (i.e. A2 + x '+ B2 + y', x and y of the same length).
- x and y show portions of one video B (ie A2 + [B8 + B2] + A2 '+ B6 or A2 + B6 + A2 '+ [B2 + B8]).
- B8 and B2 show identical content.
- the exposure takes place at the time of display of A2 and B2. Since A2 and A2 'are closer to one another in time, the flicker effect is increased.
- One remedy is to divide a phase (A2 ') accordingly and to achieve the reduction via a triply divided process (i.e. A2 + B7 + Al' + B2 + Al '+ B7). This sequence combines the reduction of the flicker effect, color-correct exposure of content for photographers and a long exposure time for video B to preserve the motion blur.
- a motion blur especially for camera pans, can also be calculated retrospectively through suitable use of camera sensors in conjunction with image processing (or through pure image processing).
- the luminance can be adapted to the level of the briefly displayed video A for a short time. As a result, the change in luminance takes place over the 20 ce with twice (or even higher) frequency, without affecting the images for photographers or cameras with longer exposures.
- a display of stomach ta in a briefly displayed video A can be balanced with green (separately as with A2 + A2 '+ B16 or in combination as with A2 + B18') for color neutrality.
- Green / magenta have almost the same luminance effect in the human eye.
- the situation is different with the combination of blue / yellow.
- the influence of blue on the luminance effect is very small (eg only 10%) while that of yellow is close to white (100%).
- a complete color correction is then possible via a correction in phases B8.
- Other combinations in which the content B is displayed in the correct color for a long time e.g. A2 + B7 + B1 '+ A2' + B7 + B) are also possible.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- Strategic Management (AREA)
- Accounting & Taxation (AREA)
- Development Economics (AREA)
- Marketing (AREA)
- Finance (AREA)
- Game Theory and Decision Science (AREA)
- Economics (AREA)
- Entrepreneurship & Innovation (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Television Systems (AREA)
- Television Signal Processing For Recording (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE102019220278.0A DE102019220278A1 (de) | 2019-12-19 | 2019-12-19 | Verfahren zur Anzeige von Videos |
| PCT/EP2020/087299 WO2021123365A1 (de) | 2019-12-19 | 2020-12-18 | Verfahren zur übertragung von zumindest einem bildinhalt an zumindest einem betrachter |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4078944A1 true EP4078944A1 (de) | 2022-10-26 |
Family
ID=74175790
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP20838984.1A Pending EP4078944A1 (de) | 2019-12-19 | 2020-12-18 | Verfahren zur übertragung von zumindest einem bildinhalt an zumindest einem betrachter |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US11997410B2 (de) |
| EP (1) | EP4078944A1 (de) |
| DE (1) | DE102019220278A1 (de) |
| WO (1) | WO2021123365A1 (de) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP7851614B2 (ja) * | 2023-01-31 | 2026-04-27 | 株式会社ジャパンディスプレイ | 表示システム |
| CN116996631B (zh) * | 2023-09-26 | 2023-12-08 | 牡丹江师范学院 | 一种制作实时显示演唱视频的系统及方法 |
| CN119071463B (zh) * | 2024-08-20 | 2025-12-19 | 神力视界(深圳)文化科技有限公司 | 一种虚拟拍摄方法及装置 |
Family Cites Families (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5293231A (en) * | 1991-11-07 | 1994-03-08 | Elbex Video, Ltd. | Apparatus for synchronizing terminal equipment |
| KR100633965B1 (ko) * | 1999-05-24 | 2006-10-16 | 마츠시타 덴끼 산교 가부시키가이샤 | 영상 전환 장치 및 영상 출력 장치 |
| US7064778B1 (en) * | 1999-09-10 | 2006-06-20 | Pelco Incorporated | Multi-camera system for implementing digital slow shutter video processing using shared video memory |
| US7408986B2 (en) * | 2003-06-13 | 2008-08-05 | Microsoft Corporation | Increasing motion smoothness using frame interpolation with motion analysis |
| KR100415838B1 (ko) * | 2003-09-19 | 2004-01-31 | (주)유디피 | 캡쳐 불능 기간을 정확히 결정하여 캡쳐 효율을 향상시킨다채널 영상 신호 캡쳐 시스템 및 캡쳐 방법 |
| GB2437575A (en) * | 2006-04-27 | 2007-10-31 | Andrew Peter Phelan | Audience-specific image display |
| AU2011304767B2 (en) | 2010-09-20 | 2016-01-14 | Fraunhofer-Gesellschaft Zur Forderung Der Angewandten Forschung E. V. | Method for differentiating background and foreground of a setting and method for replacing a background in images of a setting |
| GB2494707B (en) * | 2011-09-19 | 2014-10-08 | Sony Comp Entertainment Europe | Generation and display of stereoscopic images |
| US20140118591A1 (en) * | 2012-10-28 | 2014-05-01 | Chad L. Maglaque | Dynamic Coded Aperture Camera |
| US9445154B2 (en) * | 2013-07-08 | 2016-09-13 | Glance Networks, Inc. | Method for demonstrating interaction with a touch sensitive screen via video |
| US20160031370A1 (en) * | 2014-07-29 | 2016-02-04 | Magna Electronics Inc. | Vehicle vision system with video switching |
| US10110822B2 (en) * | 2015-06-09 | 2018-10-23 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Method for tracking at least one object and method for replacing at least one object by a virtual object in a moving image signal recorded by a camera |
| JP6596148B2 (ja) * | 2016-03-29 | 2019-10-23 | オリンパス株式会社 | 画像伝送システム、画像受信装置、画像送信装置、画像伝送方法、画像受信方法、画像送信方法、およびプログラム |
| US20180020167A1 (en) * | 2016-05-10 | 2018-01-18 | Production Resource Group, Llc | Multi Background Image Capturing Video System |
| EP3574651B2 (de) * | 2017-01-27 | 2024-07-03 | H2VR HoldCo, Inc. d/b/a Megapixel VR | Verfahren und system zur übertragung von alternativem bildinhalt einer physikalischen anzeige an unterschiedliche zuschauer |
| ES2755776T3 (es) * | 2017-02-02 | 2020-04-23 | Fraunhofer Ges Forschung | Procedimiento para sustituir contenidos de imágenes |
| US10785455B2 (en) * | 2017-05-15 | 2020-09-22 | Toshiba Mitsubishi-Electric Industrial Systems Corporation | Plant operating state analysis system |
| US11206442B2 (en) * | 2017-08-01 | 2021-12-21 | Vishare Technology Limited | Methods and apparatus for video streaming with improved synchronization |
| US11490137B2 (en) * | 2018-07-27 | 2022-11-01 | Appario Global Solutions (AGS) AG | Method and system for transmitting alternative image content of a physical display to different viewers |
| EP3850825B1 (de) * | 2018-09-13 | 2024-02-28 | Appario Global Solutions (AGS) AG | Verfahren und vorrichtung zur synchronisation einer digitalen fotokamera mit einem auf einer physikalischen anzeige angezeigten alternativen bildinhalt |
| WO2021056030A1 (en) * | 2019-09-22 | 2021-03-25 | Mean Cat Entertainment, Llc | Camera tracking system for live compositing |
-
2019
- 2019-12-19 DE DE102019220278.0A patent/DE102019220278A1/de active Pending
-
2020
- 2020-12-18 EP EP20838984.1A patent/EP4078944A1/de active Pending
- 2020-12-18 WO PCT/EP2020/087299 patent/WO2021123365A1/de not_active Ceased
- 2020-12-18 US US17/787,401 patent/US11997410B2/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021123365A1 (de) | 2021-06-24 |
| US20230070449A1 (en) | 2023-03-09 |
| US11997410B2 (en) | 2024-05-28 |
| DE102019220278A1 (de) | 2021-06-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11825137B2 (en) | Method and system for transmitting alternative image content of a physical display to different viewers | |
| DE602004003355T2 (de) | 3d-videokonferenzen | |
| DE69215058T2 (de) | Dreidimensionale Bildwiedergabeeinrichtung, die elektrisch erzeugte Parallaxstreifen verwendet | |
| WO1996018265A1 (de) | Bildtransferverfahren und -vorrichtung | |
| EP0776576B1 (de) | Verfahren und vorrichtung zur darstellung von stereoskopischen videobildern auf einem display | |
| WO2021123365A1 (de) | Verfahren zur übertragung von zumindest einem bildinhalt an zumindest einem betrachter | |
| DE3435332A1 (de) | Hochaufloesendes fernsehsystem fuer verschiedene fernsehfilmnormen | |
| AU2007245421A1 (en) | A method and means for varying the content of a display | |
| WO2015188948A1 (de) | Optische freiraumübertragung | |
| DE19545356C2 (de) | Vorrichtung zur Darstellung von Stereo-Videobildern | |
| EP1650978B1 (de) | Verfahren zur Bilddarstellung unter Verwendung einer sequentiellen Farbdarstellung | |
| DE10352492B4 (de) | Ansteuerung zur Stereoprojektion | |
| EP3907987B1 (de) | Verfahren und vorrichtung zur projektion individueller bilder für eine mehrzahl an betrachtern | |
| EP2612502B1 (de) | Verfahren zur darstellung von mehreren bildfolgen | |
| DE102007039079B4 (de) | Verfahren und Anordnung zur räumlichen Darstellung einer Szene mit nur geringer oder ohne Beleuchtung | |
| WO2009097848A1 (de) | Verfahren und anordnung zur räumlichen darstellung mit farblich-sequentieller beleuchtung | |
| EP0543131B1 (de) | Einrichtung zur Erzeugung von Bildeffekten in Videogeräten | |
| DE10201674B4 (de) | Verfahren und Vorrichtung zur gleichzeitigen Darstellung von zumindest zwei Bildquellen mit zumindest zwei unterschiedlichen Bildwiederholungsraten | |
| EP1591883A2 (de) | Anordnung und Verfahren zur Ansteuerung mehrerer Grafikdisplays | |
| WO2002008879A2 (de) | Verfahren, vorrichtung und gerät zur erfassung von bilddaten |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20220718 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
| 17Q | First examination report despatched |
Effective date: 20240619 |
|
| 17Q | First examination report despatched |
Effective date: 20240626 |