Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N5/00—Details of television systems
  • H04N5/222—Studio circuitry; Studio devices; Studio equipment
  • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
  • H04N5/272—Means for inserting a foreground image in a background image, i.e. inlay, outlay
  • H04N5/2723—Insertion of virtual advertisement; Replacing advertisements physical present in the scene by virtual advertisement

Definitions

• RGB LED diodes designed to be overlaid by another display during optical sensing; RGB LED diode for use in said display element
• the invention concerns the display element with RGB LED diodes which allows to replace the image from display element by another display after the capturing of the active display element by means of a camera. After such processing an image visible by the direct viewer differs from the image which is seen indirectly through the camera.
• the RGB LED diode which simplifies the construction of the display elements is subject of the invention, too.
• Monochromatic background is often used for the display of the studio views, whereby this background is supplied by the static or dynamic image after the processing of the data from the camera.
• Contemporary digital television technology stems from the originally motion picture technology, where the special effects scenes were produced by the substitution of such background.
• the anchor or other persons move in the studio environment where the monochromatic - for example, green or blue - backgrounds is considered to be a part of the natural working environment.
• There are no spectators in such studio who would require the image to be produced on the background directly on the spot; alternatively, the spectators view the resulting image in the studio on the screen with the background already created.
• Publication US2015015743 from 15.01.2015 discloses a billboard which uses infrared radiation for the identification of its surface (or place) in the views.
• the image on the billboard is during the processing of the image data supplied by the view different from the image on the billboard as viewed by the spectator on the spot.
• the problem is the achievement of the appropriate infrared lighting of the billboard.
• the infrared light has to be capable of passing through the first layer of the billboard with the applied image and it should not affect the chromaticity of the image.
• This publication discloses a solution where the image is printed with use only the CMY elements (cyan, magenta, yellow) without K (black) element.
• the publication describes the use of the two bands, or ranges, of the infrared radiation 780-810 nm and 820-900 nm, which are sufficiently distant from each other and can be separated by respective optical filters.
• the radiation from one band is absorbed by the special surface of the billboard; the differences between the data for the two different bands of the infrared radiation are therefore used for the identification of the surface.
• Such solution is complicated and with each substitution of the billboard it is necessary to check the result viewed at the spot and also the substituted image; billboard and image have to meet multiple limiting conditions.
• the display element with the set of RGB LED diodes which are evenly distributed on the surface and their emission of light is oriented outside the surface which essence lies in the fact that it has a source of stable monochromatic optical radiation with the wavelength over 680 nm, where these sources are directionally oriented similarly to RGB LED diodes, whereby these sources are basically evenly distributed on the surface of the display element between the RGB LED diodes or by RGB LED diodes.
• the optical radiation in this text denotes optical radiation, light, optical waves.
• the display element includes a source of the light which is invisible to the human eye.
• the source of the monochromatic optical radiation is in the preferable arrangement an infrared source of the light with wavelength between 680 nm and 1 mm, or with photons energy between 0,0012 and 1 ,63 eV, respectively.
• any radiation invisible to the human eye can be used; one that is not harmful to health and that is in the optical band, which means that it can be viewed by the optical devices with the sensors sensitive to the given spectrum.
• the sources of the monochromatic optical radiation have the wavelength between 760 nm to 950 nm, especially preferable between 780 nm to 900 nm.
• the source of the invisible light will be stable and monochromatic, which means that the source of the invisible light will radiate unchanging color during the whole time of activity of the display element.
• the source of the radiation therefore differs from the RGB LED diodes in two basic aspects: the source of the radiation has a spectrum in the invisible range, and the source radiates solidly, with the result which does not change temporarily as opposed to RGB LED diodes which are designed and directed to achieve changing image as a result.
• the sources of the radiation can naturally but insignificantly change its intensity, and therefore the exact wavelength, within the operational margins of tolerance (temperature changes, fluctuations in power supply), but in general there will be only two regimes - on and off; they therefore do not require the direction which RGB LED diodes do, which are dynamically directed so that the changing image is achieve on the display element.
• the display element has two basic RGB LED diodes which display the image visible to the human eye.
• the optical radiation invisible to human eye mainly infrared radiation, is sensed by the sensor of the camera with the respective sensitivity. This results in the state where one surface of the display element is seen with the different result based on the fact whether it is viewed by the human eye or by the camera sensitive to the invisible radiation.
• the human eye will see on the display element the image corresponding to the data which guide the RGB LED diodes; the camera will view the display element as a monochromatic surface.
• Such singular monochromatic surface with the known chromaticity allows one to substitute it during the processing by the different display.
• Known methods of the digital processing - known, for example, from the field of processing of the studio views - can be used.
• the monochromatic for example, green or blue - surface is used, whereby the anchor is before the background wearing, if possible, clothes of different color.
• the monochromatic surface has to be appropriately lighted, the persons before the background should not cast shadow.
• the use of the active source of radiation in the invisible spectrum where the radiation does not pass through the carrier with the image visible at the spot removes the technical limitations of the billboard present in the prior state of the art as well as the limitations and problems with the lighting of the billboard.
• Individual point sources of the radiation in the invisible spectrum are located between the RGB LED diodes or by the RGB LED diodes; they do not form the lower backlight of the billboard where interferences could have occurred with the image in the visible place.
• the prior state of the art according to US2015015743 in one realization uses LED diodes in the background of the billboard, but these serve precisely as the backlight in the visible spectrum, that is, for the presentation of the billboard to the spectators at the spot.
• the sources of the invisible radiation are not in the back plane behind the carrier of the visible image, but they are in the plane where the visible image is displayed by means of RGB LED diodes. This brings, aside from the simplification of the whole system, the possibility - not present in the prior state of the art - to dynamically alter the image visible at the spot, for example the image visible by the spectators of the football match.
• the display element displays by means of RGB LED diodes the visible image according to the available data and at the same time it emits on the same surface the radiation invisible to the human eye - unseen by the viewer at the spot - but visible for the camera with the respective wavelength-sensitive sensing.
• the image data from the camera are analyzed, whereby the monochromatically luminous surface is recognized.
• the analyzed surface has different dimensional projection, which can be reliably assessed since the outer shape of the surface is stable and known in advance - usually it is a rectangle.
• the outer outline and spatial transposition can be therefore reliably determined based on the data gathered by the camera. In this way we can determine where, to which surface in the overall image and with which matrix transformation should we insert the desired image.
• the data from the camera include this information in the form of the altered shape of the surface.
• Monochromatically luminous surface's shape is interrupted, obstructed by the given object and in the processing only the new surface, recognized on the basis of the gathered data as actually mechanically optically seen, is covered by the new image.
• the processing of the image can take place in such a way that instead of the image actually displayed by the display element on the spot another image is inserted to the transferred image data, for example, advertisement tied to a specific territory or special interests, whereby this new image appears on the outside as if displayed in the place from where the image is transmitted.
• the display element with the RGB LED diodes which according to this invention is designed for being covered by another display, is mainly meant to display the advertisement in the exterior environment, for example during the sport events.
• the spectators at the stadium view an advertisement on the display element, which can be focused locally.
• the advertisement can be dynamic, which increases its effect as compared to static banners. It would not have been effective if the locally focused advertisement - for example, advertisement for the family restaurant next to the stadium - were broadcast to the territorially broad area. Thanks to this invention it is possible to substitute the local advertisement in the transmitted data for the globally useful advertisement, or it is possible to alter the data for each country or region independently.
• Display element with the RGB LED diodes according to this invention can be used in the interior environment, too, for example in a studio.
• the display element will serve as a reader or a similar element for the anchor; the camera will analyze this surface as a surface which will be substituted by the desired background.
• the display element can be a part of the optical transfer of the information in the humanly invisible area, for example, in the public spaces it can serve to simplify the orientation for the visually impaired, who can - by means of a simple sensor of the respective radiation with the sonic output - orient themselves according to the statically distributed display elements on the platforms.
• the source of the stable monochromatic optical radiation is infrared LED diode. It can be placed between RGB LED diodes on the common PCB board or on the independent PCB board placed behind the PCB board with the RGB LED diodes. In the latter case parts of the infrared LED diodes pass through the openings in the PCB board with the RGB LED diodes.
• Infrared LED diodes used in the display element according to this invention can be selected in such a way that they emit in the given band of the wavelength.
• the unity of the emitted wavelength simplifies the identification of the surface in the image data.
• the selection can be achieved by the choice, where the emission spectrum of each infrared LED diode is measured.
• Infrared LED diodes can be selected in such a way that they emit on the surface in two different wave spectrums, eventually the absorption filters can be used to achieve this goal, whereby the filters suppress part of the required spectrum. This can be preferable, for example, when we want to identify part of the display element with the older system from the prior state of the art.
• the image in the infrared spectrum will be sensed in such a way that we are able to gather image data for both spectrums of the emission; in these data the surface of the display element will appear differently. This contrast can be used as an identifier of the surface of the display element.
• the infrared LED diodes can serve the additional identification function, too.
• the infrared LED diodes can shine or flash with the frequency which corresponds to the range of the scanning frequency of the camera. Different display elements will use different frequency and therefore they can be distinguished in the image data without taking into consideration the origin from the respective local camera.
• Subsequent identification function can in another realization be ensured in such a way that a different brightness and/or different wavelength of the infrared LED diodes will generate an identification pattern on the surface, once again in the invisible spectrum.
• the pattern can have different geometrical shape. It will be preferable if the pattern produced on the surface is produced repeatedly, so that it can be assessed even if the surface of the display element is partially obstructed.
• the display element can be equipped by the infrared LED diodes even outside the surface with the RGB LED diodes.
• it can have a belt with the shining infrared LED diodes around the circumference, whereby the belt has set identification mark.
• multiple display elements in a single place can be identified on the basis of the pre-prepared plan of the production of the views from the event, when the order of the entering of the particular display element into the view is known in advance.
• the RGB LED display element have a high density of the distribution of the RGB LED diodes, that is, it has a raster with the small dimension of the grid as compared with the distinguishing angle of the supposed viewer, such arrangement can be produced where part of the RGB LED diodes is substituted by the infrared LED diodes. In such case it is possible to create desired effect without the intervention to the architecture of the PCB boards; the direction will be set in such a way that the infrared LED diodes shine solidly.
• the density of the RGB LED diodes will in such arrangement remain higher or same as visible resolution seen by the given viewer; that means that the viewer in such application and at a given distance does not sense the infrared LED diodes as holes, gaps in the raster with the RGB LED diodes.
• the density of the raster can increase so that it can then offer sufficient compensation for the loss of the display LED in favor of the infrared LED.
• diffuser which diffuses the monochromatic optical radiation from the point sources to the surface of the display element.
• the diffuser preferably in form of a plate, can have openings which correspond by its size and location to the RGB LED diodes.
• the diffuser can be continuous; the surface of the display element will be covered continuously by the diffuser and RGB LED diodes, too. Usage of the appropriate diffuser can lower the necessary number of infrared LED diodes.
• the plate of the diffuser can have solid circumference so that the identification of the circumference of the display element is simpler even during poor visibility; eventually the circumferential edge of the display element can be for this purpose equipped by the higher density of the continuously placed infrared LED diodes.
• the source of the invisible monochromatic optical radiation is placed directly into the socket of the RGB LED diode.
• the original RGB LED diode is substituted for RGB + IR LED diode according to this invention and it is mounted to the original grid. RGB parts of the diode are directed by the original method and stable power supply is led to the additional contact for the IR part.
• the source of the invisible monochromatic optical radiation can have different location. In case the original LED construction has three quarters of the shell (casing, pocket) with R, G and B parts occupied, the source of the invisible monochromatic optical radiation can be placed into the remaining quarter of the shell. The available quarter of the shell is the unoccupied quarter of the shell besides the three quarters occupied by R, G and B emitters.
• infrared LED diode Even though the infrared LED diode itself is known, its connection in the single body with the RGB LED diode is new. Infrared LED diodes are used for the data transfers, for example, in remote controllers or for the medical purposes.
• the connection of the infrared RGB LED which displays the dynamically changing image in the visible spectrum with the IR LED diode which statically shines in the invisible spectrum is new and it brings with itself the synergistic advantage during the use of the display element according to this invention.
• the advantage of this invention is the ability to use the existing means, hardware and software commonly used for the keying of the monochromatic background.
• the proposed invention simply identifies in the image data from the camera the surface intended for the substitution of the image, whereby it also functions as the dynamical display element on the spot.
• Figure 1 depicts a detail of the display element with RGB LED diodes according to the state of the art.
• Figure 2 is an arrangement with the infrared LED diodes which are placed on the independent PCB board.
• Figure 3 is a cross-section through the PCB board and a mask with RGB LED diodes according to the state of the art; subsequently, figure 4 is a cross- section with the infrared LED (IR LED) diodes depicted on the independent PCB board.
• IR LED infrared LED
• Figure 5 depicts an arrangement where IR LED diodes are placed directly on the PCB board with RGB LED diodes and the radiating part of the IR LED diodes is covered by diffuser on the surface of the display element.
• Figure 6 is a cross-section through part of such display element.
• Figure 7 is a view of the display element where the IR LED diodes are placed in the original grid on the places left out by RGB LED diodes.
• FIGS 8 to 15 depict the process of keying of the original image.
• Figure 8 depicts a spatial view of the RGB LED display element with the advertisement as seen by the spectator on the stadium. Identical display element is depicted on the figure 9 in the way it is sensed by the camera with the optical sensor sensitive to infrared radiation.
• Figure 9 depicts the infrared view of the camera together with the original environment covered.
• Figures 10 and 1 1 depict the surface of the display element with the original image substituted for the new image in the German and French version of the broadcast.
• Figures 14 and 15 depict the resulting coverage of the new image in German and French broadcast.
• Figures 16 and 17 depict the body of RGB LED diodes in which the source of the infrared radiation is pocketed (shelled, cased), too.
• Figure 16 depicts the infrared sector in the free quarter of the shell;
• figure 17 depicts two infrared emitters alongside the RGB emitters, but still within common outer shell (casing).
• Figure 18 depicts multiple display elements which are different in the infrared spectrum by the identification patterns with various intensity of the radiation or different wavelength. This figure corresponds to the view from the figure 9.
• Figure 19 depicts the diffuser with the example of the diffuser with the continuous surface, where the RGB LED diodes are depicted by the dotted line and infrared LED diodes are depicted by the gray filling. All LED diodes are placed under the plate of the diffuser. Examples of realization
• the front plastic mask 7 creates a raster with RGB LED diodes 2, which are attached to the PCB board 4 by the SMD montage.
• the evenly distributed transition openings are produced in the plastic mask 7.
• the openings for the cylindrical shell of the infrared LED diode 3 are in each corner on the raster of the plastic mask 7.
• Infrared LED diodes 3 are supplied by common power which in this example has only to basic positions - on and off.
• RGB LED display element 1 is in this example part of the side advertisement panels on the football pitch. On the stadium itself the display element 1 displays a locally oriented advertisement, for example, in English language for English-speaking customer. RGB LED display element 1 is situated in space in such a way that it occurs in the views of the cameras according to the course of the game; figure 8 depicts only one, static camera. RGB LED display element is at the time when the event is not broadcast anywhere displaying the full color dynamic advertisement; it operates as common screen. In case of a television broadcast, the infrared LED diodes are turned on, which will not be noticed by the spectators on the stadium. The cameras have optical sensors sensitive to the infrared component of the light, therefore they will sense the active display element 1 as a continuous monochromatic surface according to figure 9. Such defined surface can be identified as designed for substitution by another display. Pursuant to the projection of the known rectangular surface of the RGB LED display element 1, the spatial transposition of the new image is calculated for each view which is inserted to the monochromatically delimited surface from the figure 9.
• Advertisement according to figure 10 is displayed for the German viewer
• advertisement according to figure 11 is display for the French viewer, whereby all other surfaces in the display are broadcast for all image branches.
• the RGB display element 1 is produced in such a way that infrared LED diodes 3 are placed directly on the PCB board 4 on which there are RGB LED diodes 2 attached, too.
• the diffuser 5 is placed on the mask 7, whereby the diffuser 5 covers the infrared LED diodes 3. It has a form of the plate with the openings which are placed adjacently to RGB LED diodes 2.
• the diffuser 5 homogenizes the density of the distribution of the brightness of the infrared LED diodes 3. It can be produced in whole with the mask 7.
• Display element 1 has a density of the distribution of LED diodes than is twice the required density for the particular application; that is, for a given overall size and the distance from the viewer.
• the mask 7 has a raster corresponding to the higher density of the LED diodes.
• the infrared LED diodes 3 are attached to the PCB board 4; these are depicted by gray circle on figure 7.
• the chessboard-like alternation of the RGB LED diodes 2 and infrared LED diodes 3 are chosen; in another arrangement the alteration can be different, for example infrared LED diodes 3 can be placed alongside the edges in the continuous strip. Infrared LED diodes 3 are on the PCB board 4 connected to the common power circuit.
• RGB + IR LED diode according to figure 16 is produced from the original RGB LED diode 2, which in the optical part of the shell has originally used three quarters for the individual R, G and B components of the light. Infrared emitter is inserted into the free quarter and at least one further contact is led out of the body.
• RGB + IR LED diode is its easy application in the hitherto known masks 7 of the display elements
• the design of the PCB board 4 is adjusted on the spot only minimally, so that the common power supply for the additional contact of RGB + IR LEAD diode is created.
• the IR component can be supplied by power from either R, G or B component; in such case, however, the I R component cannot be turned on and off without turning on and off the other components, which means that infrared radiation will be turned on whenever RGB LED diodes 2 are turned on.
• Infrared emitter in form of a small infrared LED diode 3 is according to figure 17 placed alongside emitters of R, G and B components of light. These two groups are placed together in the optical shell. There is a small optical partition between them in order to diminish the co- effecting of R, G and B components of light placed close to the infrared emitters.
• Infrared LED diodes 3 are selected into three groups according to the peak of the wavelength in which the shine at referential temperature and stable power supply. In first and second group there are infrared LED diodes 3 with first and second wavelength with ⁇ 5% margin of tolerance. The rest is in the third group and these are not used during mounting. Infrared LED diodes 3 are mounted onto the surface of the display element 1 in such a way that one group produces a patter, for example a square, on the background with the infrared LED diodes 3 selected from the second group.

Landscapes

• Business, Economics & Management (AREA)
• Marketing (AREA)
• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Illuminated Signs And Luminous Advertising (AREA)
• Led Device Packages (AREA)

Applications Claiming Priority (2)

Publications (1)

Family

ID=56108676

Family Applications (1)

Country Status (3)

Families Citing this family (4)

Family Cites Families (6)

• 2015
  • 2015-04-08 SK SK50015-2015A patent/SK500152015A3/sk unknown
• 2016
  • 2016-04-08 EP EP16727544.5A patent/EP3281401A1/de not_active Withdrawn
  • 2016-04-08 WO PCT/IB2016/051996 patent/WO2016162837A1/en unknown

Also Published As

Similar Documents

Legal Events