EP2697707A1 - Procédé d'amélioration du contenu d'images vidéographiques par codage de contenus additionnels sur une image vidéographique principale - Google Patents

Procédé d'amélioration du contenu d'images vidéographiques par codage de contenus additionnels sur une image vidéographique principale

Info

Publication number
EP2697707A1
EP2697707A1 EP11721579.8A EP11721579A EP2697707A1 EP 2697707 A1 EP2697707 A1 EP 2697707A1 EP 11721579 A EP11721579 A EP 11721579A EP 2697707 A1 EP2697707 A1 EP 2697707A1
Authority
EP
European Patent Office
Prior art keywords
videographic
differentiated
encoding
content
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP11721579.8A
Other languages
German (de)
English (en)
Inventor
Giuseppe Biava
Roberto CHIODINI
Stefano Ivaldi
Simone IANNUNZIO
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
AESYS SpA
Original Assignee
AESYS SpA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by AESYS SpA filed Critical AESYS SpA
Publication of EP2697707A1 publication Critical patent/EP2697707A1/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G06F3/1431—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display using a single graphics controller
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
    • G09G2340/0428—Gradation resolution change
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/10—Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/12—Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
    • G09G2340/125—Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels wherein one of the images is motion video
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2380/00—Specific applications
    • G09G2380/06—Remotely controlled electronic signs other than labels
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/14—Display of multiple viewports

Definitions

  • the present invention generally refers to devices for multiple display of differentiated graphic contents, such texts, images, movies, and particularly refers to a method for enhancing the information content of videographic images in such devices.
  • the invention may have useful applications in the diffusion to the public of: differentiated information contents based on installation area, such for example stations, airports, subways, etc., as well as in devices with opposite displaying directions assembled on mobile means for public transport such buses, trams, trains, etc.; where the signals are. necessarily displayed, such as for example directionai arrows: or, more generally, information signs, such as for ascent or descent of passengers, messages about next stop, etc.
  • the invention may be applied in all cases wherein a main graphic content must be displayed on a plurality of devices placed in different installation solutions and, for this reason, requiring a differentiated display of information from case to case.
  • a typical example of such applications can be composed of two graphic panels with TFT LCD technology mounted with opposite display directions (in configuration called "back-to-back") aboard a metro.
  • the same display image for example having an arrow to indicate the passengers the descent side, should be able to be turned in the opposite direction in one of the two devices, just to indicate a common descent direction.
  • Figure 1 of the appended drawings shows schematically an example of one of the currently used techniques for the playback of two video contents 1 and 2 on as many respective display devices 1a,;:2a.
  • a graphics processor 3 such as a Dual Output graphic chipset, with two independent integrated video outputs, as; is commonly the case with Embedded PC.
  • FIG. 2 Another typical example of the known art for playing two video contents 1 and 2 on as many respective display devices 1a, 2a is illustrated in Figure 2.
  • a graphics processor 4 is used composed of one or more additional graphics cards, each of which is handling a single independent video output as it often happens in case of common desktop PCs.
  • Teletext is an interactive service used in the television-area;; consisting of text pages viewable on a television screen by user's request and it is used to provide users with information of various kinds.
  • This information is transmitted periodically within video frames, in particular within the vertical blanking interval.
  • This technique provides an additional content with an only textual or very low graphic resolution nature. It also requires a specific decoder able to detect and decode the additional information content. Further, such a content does not interact in any way with the images in the video frames and, therefore, provides no differentiated graphic content in relation to the displayed images.
  • Video mixer It is a device used to switch different video sources on a single output signal and in some cases to mix them together or add some special effects, such as texts or graphics addition, or the handling of chromatic or structural proprieties of the image.
  • the video sources once mixed together in one final video content, can not be selectively reconstructed or discriminated anymore.
  • it is necessary to have a number of video outputs at least equal to the number of sources, as shown in the example represented in Figure. 2.
  • 3D Imaging represents the set of making and viewing techniques for images, drawings, photographs and videos, designed to communicate an illusion of three dimensions, similar to that generated by the binocular vision of the human visual system, , by presenting two different images separately to the left and right eyes, respectively, of the beholder.
  • Alternate darkening system it consists in discriminating, by glasses provided with active synchronized shutters (active shutter glasses) two images, one intended for the right eye and the other intended for the left eye, projected in rapid sequence.
  • Polarized lens system it consists incdiscriminating ⁇ by polarized glasses orthogonally oriented one relatively to the other, two images, one intended for the right eye and the other intended for the left .eye, projected in -rapid sequence.
  • ⁇ . ⁇ ⁇ . - Autostereoscopy or AS-3D it consists in "hiding" to each eye the image intended for the other eye through the implementation of appropriate technologies directly on the medium (paper print or monitor), thus not requiring the use of other devices.
  • Some implementing technologies of this system are based on: lenticular network, parallax barrier, illumination and holographic screen.
  • the application of autostereoscopic techniques involves, as mentioned, the implementation of special technologies directly to the display medium.
  • the overall image must necessarily be larger, since it must be composed of a plurality of points of view of the original image, observed in the left eye and the right eye respectively, using specific devices depending on the implemented technology. This also means that the illusion of three-dimensionality is achieved only observing the device within determined observation angles.
  • the above described techniques involve the use of optical devices, such as glasses with additional filtering or polarized lenses, or opto-electronic devices such as active synchronized shutters.
  • the alternate darkening system does not provide information contents in real time, but discriminates, through active synchronized shutters, two images shown at different times.
  • the present inventors looked for a further technique for displaying differentiated videographic contents being able to allow a real discrimination of graphic contents on different playback'; devices, advantageously without the need for optical or opto-electronic devices and additional ' resources and without worsening- the: graphics,; processor performance .
  • the present invention is the result of such a research and has the object to provide an innovative method for enhancing the information content of videographic images with differentiated graphical contents, and more particularly a method for reconstructing the afore said differentiated images for their display on different playback devices.
  • This object is achieved, according to the invention, with a method for enhancing the information content of videographic images comprising: prearranging a main videographic image,
  • Figure 3 a block diagram of the whole process according to the invention.
  • Figure 4 a block diagram of the video - encoding process
  • Figure 5 a block diagram of the video - decoding process
  • Figure 6 an example of creating an encoded image
  • Figure 7 an example of encoding a single differentiated content in a single 8 bit chromatic channel.
  • Figure 8 an example of encoding the positional and controlling information
  • Figure 9 an example of decoding and reconstructing a single 8 bit chromatic channel.
  • FIG. 3 a block diagram of the whole process is therefore represented whereby, for example, at least two differentiated video contents 11 and 12 are mixed and encoded into a video encoding system 13, then processed in real-time in a video - decoding system 14 so as to separate and reconstruct the distinct and independent video information on as many display devices 15 and 16.
  • the proposed method does not change the bit or byte size of the main image nor its resolution. In consequence, the transmission bandwidth necessary to send the image to the display devices is unaffected too.
  • the method may be implemented by any data processing device (microprocessor), any programmable logic device (FPGA, CPLD, etc..) or, more generally, by any digital processing logic circuit.
  • microprocessor microprocessor
  • FPGA programmable logic device
  • CPLD CPLD
  • digital processing logic circuit any digital processing logic circuit.
  • the proposed encoding provides for the enhancement of the main image with one or more differentiated images and informations about the position of these differentiated images and possible controlling information.
  • the ; differentiated images are encoded within the main image in the exact position wherein they will have to ⁇ besdisplayed as differentiated contents on different playback devices:
  • FIG 6 an example of. creation of. an encoded image is shown.
  • An area is defined in the: main image, for example, of 250/200 pixels wide by 50/100 pixels height wherein, for example, a directional arrow of a defined color is shown ( Figure 6, a). It is then created a differentiated content of the same size of the defined area, such as a directional arrow with another color having opposite direction to the previous ( Figure 6, b). At this point, the differentiated content is encoded in the defined area on the main image, thus generating the encoded image to be transmitted ( Figure 6, c).
  • the real encoding is carried out at the level of each color component constituting the pixel of the main image and the differentiated contents to be encoded.
  • the pixels defined in the differentiated content area on the encoded image are composed using the 4 most significant bits (MSBs, Most Significant Bits) of each chromatic channel constituting the main image and the 4 most significant bits of each chromatic channel forming the differentiated content.
  • the resulting encoded image is then ready to be transmitted to the various devices of graphic reproduction.
  • Figure 7 an example of encoding is shown, wherein the 4 bits obtained from the main image are placed at the higher position of the byte constituting the chromatic component of the encoded image, whereas the 4 bits obtained from the differentiated contents are placed at the lower position.
  • Table 1 shows an example of encoding with a single differentiated content of a 24-bit pixel (then consisting of 8 bits for the chromatic red component, 8 bits for the green and 8-bit for the blue ones), that will be the differentiated content area in the encoded image.
  • Sub-pixels of Differentiated Content 1 1 1 0 0 1 0 0 1 0 0 1 0 0 1 0 0 1 0 0 1
  • each image (which can be static or dynamic) could be enhanced with, more differentiated contents, and; then differently played on various devices for graphic playback.
  • the encoding of positional data can be carried out entering in binary encode the pixel coordinates on the graphic matrix corresponding to the two opposite vertices related to each area inside which the differentiated content is encoded. It will be still possible to use different information for the determination of each differentiated content area, such as, by way of example, a vertex, its position in relation to the area and the pixel dimensions (width and height) of the area itself.
  • the coordinates could be defined according to format "row, column” and reported on the pixel matrix having as reference (0, 0) the first pixel in the upper left corner, i.e. the usually transmitted first pixel containing the image information, as shown in Figure 6.
  • Figure 8 shows an example of encoding corresponding to the location of a single area with differentiated content. It is also shown how it may be possible to insert a controlling byte, through which the presence of differentiated content areas in the image itself is indicated to the graphics processor during the receiving step, and, consequently, the decoding and processing of the areas is started.
  • the encoding may be implemented on any RGB color component, depending on the number of differentiated encoded areas, or possibly on all three color components depending on the number of positional information determining them.
  • the encoding may be implemented using the less significant bit (LSB) of the red color component of each pixel constituting the image, encoding the whole string of 40 bits in the first row (then using 40 pixels) starting from the reference pixel in the upper left corner (0, 0).
  • LSB less significant bit
  • the receiving graphics processor may proceed with the processing of the encoded image discriminating the display of differentiated content on different devices.
  • the most significant bits of the main image and the most significant bits in the differentiated contents for each color component of every pixel can be decoded and thereby the various images can be reconstructed.
  • the 4 most significant bits of each chromatic component of the encoded image are used to reconstruct the 4 most significant bits of each chromatic component of the main image, while the 4 less significant bits are used to reconstruct the 4 most significant bits of each chromatic component of the differentiated content.
  • the complete reconstruction both of the main and differentiated content images is carried out also reporting at the bottom the same 4 bits decoded and placed; in the most significant portion of the byte. In this way. an.8;bit binary;; approximation of the chromatic level is carried out for each color component, as shown in Figure 9.
  • Tha reconstruction of the main image and differentiated content images can be carried but, ; depending on the application and the type of encoded image, by or

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Computer Graphics (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

La présente invention concerne un procédé visant à améliorer le contenu informatif d' images vidéographiques et comprenant les étapes consistant à : disposer préalablement une image vidéographique principale; disposer préalablement au moins une image vidéographique comportant des contenus informatifs additionnels; effectuer le codage vidéo de l'image vidéographique ajoutée aux contenus vidéographiques différenciés additionnels et procéder ensuite au décodage vidéo de la reproduction sélective des contenus vidéographiques différenciés additionnels dans la même image principale sur divers dispositifs d'affichage.
EP11721579.8A 2011-04-11 2011-04-11 Procédé d'amélioration du contenu d'images vidéographiques par codage de contenus additionnels sur une image vidéographique principale Withdrawn EP2697707A1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/IT2011/000107 WO2012140678A1 (fr) 2011-04-11 2011-04-11 Procédé d'amélioration du contenu d'images vidéographiques par codage de contenus additionnels sur une image vidéographique principale

Publications (1)

Publication Number Publication Date
EP2697707A1 true EP2697707A1 (fr) 2014-02-19

Family

ID=44579242

Family Applications (1)

Application Number Title Priority Date Filing Date
EP11721579.8A Withdrawn EP2697707A1 (fr) 2011-04-11 2011-04-11 Procédé d'amélioration du contenu d'images vidéographiques par codage de contenus additionnels sur une image vidéographique principale

Country Status (2)

Country Link
EP (1) EP2697707A1 (fr)
WO (1) WO2012140678A1 (fr)

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5680151A (en) * 1990-06-12 1997-10-21 Radius Inc. Method and apparatus for transmitting video, data over a computer bus using block transfers
AU655338B2 (en) * 1991-11-25 1994-12-15 Sony (Australia) Pty Limited Audio and multiple video monitoring on a computer display
AU7433996A (en) * 1996-10-16 1998-05-11 Thomson Consumer Electronics, Inc Apparatus and method for generating on-screen-display messages using line doubling
US6333750B1 (en) * 1997-03-12 2001-12-25 Cybex Computer Products Corporation Multi-sourced video distribution hub
JP3619427B2 (ja) * 1999-11-05 2005-02-09 株式会社ビューポイントコミュニケーションズ 情報表示装置
JP2005134479A (ja) * 2003-10-28 2005-05-26 Pioneer Electronic Corp 描画装置及び方法、コンピュータプログラム並びに描画表示システム
JP4512795B2 (ja) * 2004-06-18 2010-07-28 富士通セミコンダクター株式会社 画像表示システムおよび画像処理装置
JP4517746B2 (ja) * 2004-06-25 2010-08-04 船井電機株式会社 デジタル放送受信装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2012140678A1 *

Also Published As

Publication number Publication date
WO2012140678A1 (fr) 2012-10-18

Similar Documents

Publication Publication Date Title
US10567728B2 (en) Versatile 3-D picture format
CN104333746B (zh) 广播接收机及其3d字幕数据处理方法
CN102292977B (zh) 用于在三维图像中提供隐藏式字幕编排的系统及方法
RU2667605C2 (ru) Способ кодирования сигнала видеоданных для использования с многовидовым устройством визуализации
KR101651442B1 (ko) 이미지 기반 ３ｄ 비디오 포맷
KR101630866B1 (ko) ３ｄ 이미지 데이터의 전송
US9438879B2 (en) Combining 3D image and graphical data
ES2927481T3 (es) Manejo de subtítulos en dispositivo de visualización en 3D
US20110293240A1 (en) Method and system for transmitting over a video interface and for compositing 3d video and 3d overlays
CN102918855B (zh) 用于合理使用帧打包格式的活动空间的方法及设备
US20100091012A1 (en) 3 menu display
US20110298795A1 (en) Transferring of 3d viewer metadata
KR20110114673A (ko) 3ｄ 이미지 데이터의 전송
KR20070041745A (ko) 비디오 정보를 전송하기 위한 시스템 및 방법
US20090207237A1 (en) Method and Device for Autosterioscopic Display With Adaptation of the Optimal Viewing Distance
US20160057488A1 (en) Method and System for Providing and Displaying Optional Overlays
US11936936B2 (en) Method and system for providing and displaying optional overlays
US10742953B2 (en) Transferring of three-dimensional image data
US20120081513A1 (en) Multiple Parallax Image Receiver Apparatus
ITMO20080267A1 (it) Sistema per codificare e decodificare immagini stereoscopiche
WO2012140678A1 (fr) Procédé d'amélioration du contenu d'images vidéographiques par codage de contenus additionnels sur une image vidéographique principale
US20120154383A1 (en) Image processing apparatus and image processing method
KR101567710B1 (ko) 특수 안경을 착용한 관찰자만 정보를 볼 수 있는 디스플레이 시스템
CN113243112B (zh) 流式传输体积视频和非体积视频
ITBS20110048A1 (it) Metodo per arricchire il contenuto informativo di immagini videografiche

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20131030

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20140701