KR20150146055A - System and method for providing additional information of video using light data communication - Google Patents

System and method for providing additional information of video using light data communication Download PDF

Info

Publication number
KR20150146055A
KR20150146055A KR1020140075885A KR20140075885A KR20150146055A KR 20150146055 A KR20150146055 A KR 20150146055A KR 1020140075885 A KR1020140075885 A KR 1020140075885A KR 20140075885 A KR20140075885 A KR 20140075885A KR 20150146055 A KR20150146055 A KR 20150146055A
Authority
KR
South Korea
Prior art keywords
rgb color
additional information
color data
information
image
Prior art date
Application number
KR1020140075885A
Other languages
Korean (ko)
Inventor
정종수
전병훈
Original Assignee
(주)모이텍
정종수
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by (주)모이텍, 정종수 filed Critical (주)모이텍
Priority to KR1020140075885A priority Critical patent/KR20150146055A/en
Publication of KR20150146055A publication Critical patent/KR20150146055A/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/23614Multiplexing of additional data and video streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/64Circuits for processing colour signals
    • H04N9/641Multi-purpose receivers, e.g. for auxiliary information

Abstract

The present invention relates to a system and method for providing additional image information using RGB color, and more particularly, to a display apparatus for converting additional information related to a main image and the main image into RGB color data and displaying the converted RGB color data on a part of the main image. A camera unit for photographing the RGB color data; A decoding unit for converting the photographed RGB color data according to a previously stored RGB color table to decode the additional information; And a control unit for displaying the decoded additional information. Accordingly, when providing images such as advertisements, broadcasts, and the like, a part of the main image is set as an additional information providing area to provide additional information in a data transmission method using RGB colors, and a user terminal receives RGB color data through a camera The supplementary information of the image can be provided to the user terminal without requiring additional wireless communication equipment.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a system and a method for providing additional image information using RGB color,

More particularly, the present invention relates to a system and method for providing additional image information using RGB colors, and more particularly, to a system and method for providing additional image information using RGB colors, (R / G / B) color, and the user terminal receives the RGB color data through the camera and provides the additional image information using the RGB color System and method.

[0002] Display devices, which are media for providing information visually to users, are used in a wide range of fields from portable terminals to displays installed in TVs, monitors, and public spaces. When displaying contents to be displayed, there is no way to transmit additional information besides the information displayed on the screen. In general, one display device can transmit only one display information.

In order to provide additional information through such a display device, it is necessary to provide a cable for connection with a receiving terminal or a wireless communication module, and to add a communication interface function for data communication with a connected terminal have.

On the other hand, interest in optical wireless technology complementary to RF technology has increased due to depletion of RF band frequency, possibility of confusion among various wireless communication technologies, increase of security requirement of communication, and the development of ultra high-speed ubiquitous communication environment of 4G wireless technology And research on visible light communication using visible light LEDs is being conducted by various companies and research institutes.

The visible light communication using LED pixels is a technology for transmitting and receiving data between three colors using red, green and blue, and researches for the utilization thereof are continuing.

Korean Patent Laid-Open No. 10-2013-0079301: Color-free visible light communication system without flicker

SUMMARY OF THE INVENTION The present invention has been conceived to solve the above-described problems, and it is an object of the present invention to provide a method and apparatus for providing additional information in a data transmission method using RGB colors, There is provided a system and method for providing additional image information using an RGB color, which enables receiving RGB color data through a camera and confirming the corresponding supplementary information.

According to an aspect of the present invention, there is provided an image processing method for converting additional information related to a main image and a main image into red green blue (R / G / B) A display device for displaying on a part of the area; A camera unit for photographing the RGB color data; A decoding unit for converting the photographed RGB color data according to a previously stored RGB color table to decode the additional information; And a user terminal having a control unit for displaying the decoded supplementary information. The present invention also provides an image supplementary information providing system using RGB color.

Here, the user terminal may include: a memory for storing the RGB color table; And an RGB color data extracting unit for extracting the RGB color data from a screen photographed by the camera unit.

When displaying the RGB color data, the display device may display a plurality of times for the same frame a predetermined number of times.

The additional information may include at least one of text information, image information, moving picture information, and audio information.

According to another aspect of the present invention, there is provided an image processing apparatus including a camera unit for capturing RGB color data including a main image and additional information related to the main image; A memory for storing an RGB color table including data information on the RGB colors; A decoding unit for converting the photographed RGB color data according to a previously stored RGB color table to decode the additional information; And a controller for displaying the decoded additional information.

According to still another aspect of the present invention, there is provided a method of controlling an image processing apparatus, the method comprising: storing an RGB color table including data information on RGB colors in a user terminal; Converting the additional information related to the main image and the main image into RGB color data and displaying the converted RGB color data on a part of the main image; Converting the RGB color data photographed by the user terminal according to the RGB color table to decode the additional information; And displaying the decoded additional information at the user terminal.

According to the image providing additional information providing system and method using the RGB color of the present invention, a partial area of the image is provided as an additional information providing area when providing images such as advertisement, broadcasting, etc., and additional information is provided by a data transmission method using RGB color And the user terminal can receive the RGB color data through the camera and check the corresponding additional information, thereby providing additional information to the user terminal without any additional wireless communication equipment.

In addition, according to the system and method for providing additional image information using the RGB color of the present invention, additional information related to an image being viewed can be confirmed at the user terminal while viewing images such as advertisement, broadcasting, and the like.

1 is a schematic configuration diagram of a video additional information providing system using RGB colors according to an embodiment of the present invention;
Figure 2 is a block diagram of the user terminal of Figure 1;
FIG. 3 is a flow chart of the control of the user terminal of FIG.
FIG. 4 is a diagram illustrating an image providing information providing state using RGB colors according to an embodiment of the present invention
5 is a flowchart of a method of providing additional image information using RGB colors according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description with reference to the accompanying drawings, the same or corresponding components will be denoted by the same reference numerals, and redundant description thereof will be omitted.

FIG. 1 is a schematic configuration diagram of a video additional information providing system using RGB colors according to an embodiment of the present invention.

As shown in FIG. 1, an image providing additional information system using RGB colors includes a display device 100 for providing additional information in a data transmission scheme using RGB colors together with a main image 110, And a user terminal 200 that photographs the displayed RGB color data with a camera and receives and processes the additional information.

The display device 100 displays additional information using RGB colors together with a main image 110 of an advertisement image, a broadcast image, and the like. The display device 100 may set a partial area of the main image 110 being provided as an additional information providing area and display additional information displayed as RGB color data in the additional information providing area. Here, the RGB color data may be provided in a stationary pattern, or may be provided in a pattern that changes with the passage of time.

The additional information displayed on the display device 100 may be provided to the user terminal 200 in the RGB color data transmission scheme. Here, in the RGB color data transmission method, RGB data is generated by mapping data divided into bits and dividing the data into bits for R, G, and B colors, respectively, so that RGB color data is generated on the receiving side And the data assigned to the RGB color is restored.

 The additional information may include data in various formats such as text, image, moving picture, and audio. For example, the display device 100 may display the home shopping advertisement as the main image 110, and simultaneously provide detailed information such as name, price, and manufacturer of the product as additional information. In addition, the display device 100 may display only video, provide audio information as additional information, and provide link information of a web site related to the main video 110 being displayed.

The display device 100 may include an image display device such as a liquid crystal display (LCD), a projection TV, and a light emitting diode (LED).

The user terminal 200 receives the image in which the RGB color data is displayed from the additional information providing region 120 included in the main image 110 and restores the data assigned to the RGB color. The user terminal 200 can receive RGB color data by photographing the additional information providing region 120 using a camera. The user terminal 200 includes an RGB color table 300 in which data allocated to R, G, and B colors are stored in the form of a table 300. The RGB color table 300 may be provided on the display device 100 side or may be directly input by the user.

According to the present invention, in the display apparatus 100, the RGB color data is provided as additional information together with the main image 110, and the user terminal 200 provides additional information by using the camera and the RGB color table 300 . Accordingly, while viewing the information displayed on the display device 100, the user terminal 200 can receive and confirm additional information related to the screen being viewed without a separate communication device.

2 is a control block diagram of the user terminal 200 of FIG.

2, the user terminal 200 includes a camera unit 220, an RGB color data identification unit 230, a decoding unit 240, an input unit 250, a display unit 260, a memory unit 270 And a control unit 210. [0029]

The input unit 250 receives a user operation signal such as a key input or an audio input and transmits the user operation signal to the control unit 210.

The display unit 260 outputs various display data generated in the terminal 200. In an embodiment of the present invention, the display unit 260 can display additional information extracted from the RGB color data received from the display device 100 have.

Various information necessary for the operation of the terminal 200 is stored in the memory unit 270. Also, in the embodiment of the present invention, the RGB color table 300 including the data information allocated to the colors R, G, and B is stored in the memory unit 270. Here, the RGB color table 300 may be provided by the display device 100 providing RGB color data, or may be directly input by the user.

The camera unit 220 photographs a screen of the display device 100. The camera unit 220 receives the optical signal generated from the screen, converts the received optical signal into a video signal, and outputs the video data.

The RGB color data identifying unit 230 extracts RGB color data from the image data photographed by the camera unit 220. Here, the RGB color data may be provided in a stationary pattern, or may be provided in a pattern that changes with the passage of time. The RGB color data identification unit 230 extracts the RGB color data for each frame and provides the RGB color data to the decoding unit 240.

The decoding unit 240 converts each color included in the RGB color data into bit data based on the RGB color table 300 stored in the memory unit 270. [ The decoding unit 240 decodes the RGB color data as additional information and transmits the decoded RGB color data to the control unit 210. [

The control unit 210 controls the operation of each component of the terminal 200 and in particular the control unit 210 according to an embodiment of the present invention is connected to the additional information providing area of the display device 100 through the camera unit 220 120). The RGB color data provided in the additional information providing region 120 of the display device 100 may include additional information related to the main image 110 currently being displayed.

The control unit 210 controls the RGB color data identification unit 230 and the decoding unit 240 to extract RGB color data from the image data photographed by the camera unit 220 and to decode the RGB color data. The control unit 210 may store the decoded additional information in the memory unit 270 and display the decoded supplementary information on the display unit 260. [ In addition, the control unit 210 may output additional information in various formats such as text, image, moving picture, and audio according to the data format of the extracted additional information, and may refer to a path or an address included in the additional information, And may receive additional information from the content provider or server to the user terminal 200. [

3 is a control flowchart of the user terminal 200 of FIG.

The RGB color table 300 including the data information allocated to the colors R, G, and B is stored in the memory unit 270 of the user terminal 200 (S110). Here, the RGB color table 300 may be provided from the display device 100 that provides RGB color data, or may be directly input by the user.

Thereafter, the control unit 210 of the user terminal 200 controls the camera unit 220 according to the user's selection to photograph the additional information providing area of the main image 110 provided by the display device 100 (S120 ).

The RGB color data identification unit 230 extracts RGB color data from the image data photographed by the camera unit 220 (S130). Here, the RGB color data may be provided in a stationary pattern, or may be provided in a pattern that changes with the passage of time.

The decoding unit 240 decodes the RGB color data into additional information based on the RGB color table 300 stored in the memory unit 270 (S140).

The control unit 210 receives the additional information from the decoding unit 240 and displays the additional information on the display unit 260 (S150). Here, the additional information may include various information such as moving image, audio, and a website link, and the controller 210 processes the additional information according to the decoded data format.

4 is a diagram illustrating a state in which image additional information using RGB color is provided according to an embodiment of the present invention.

As shown in FIG. 4, a home shopping advertisement image is provided to the display device 100 as a main image 110, and an additional information providing region 120 may be set in a lower right region thereof.

Additional information displayed in the RGB color data format may be displayed in the additional information providing area 120. [

The user terminal 200 may capture additional information using the camera unit 220 and decode the captured RGB color data using the RGB color table 300 according to the user's selection, Can be displayed. Here, the additional information is information related to a home shopping advertisement as the main image 110, and may include price information of an article, order and approval information, manufacturer information, virtual fitting information, and the like.

On the other hand, the contents of the main image 110 can be changed, and the contents of the additional information can also be changed. When viewing the music video through the display device 100, the additional information provided to the user terminal 200 may include information on the artist, song name, lyrics, concert information, and the like. In addition, an interface for downloading an MP3 file or a music video file can be provided to provide a content sales service to a user.

Further, if the main image 110 is a movie trailer, the additional information provided to the user terminal 200 may include movie information, a movie review, and the like, and may also include link information for moving to a movie theater reservation site.

4 is a diagram illustrating a state in which image additional information using RGB color is provided according to an embodiment of the present invention.

The RGB color data for providing additional information can be generated by dividing data to be provided in units of bits and allocating colors of R, G, and B to data divided into bits. For example, the data to be transmitted is set by setting the data value of red (R) to "100", the data value of blue (B) to "010" and the data value of green Can be converted into RGB color data.

The embodiment of FIG. 4 exemplifies a case of sequentially providing data of "100", "010", and "001", and shows a state in which three frames are allocated to one data value to provide additional information . When one data value is transmitted using a single frame, it is not easy for the receiving side to recognize it, and data may be missed. In order to prevent such an error, the embodiment of FIG. 4 exemplifies a case where one data value is provided using a plurality of frames.

As described above, according to the present invention, a partial area of a main image is set as an additional information providing area when providing images such as advertisements, broadcasts, etc. to provide additional information in a data transmission method using RGB colors, So that the additional information can be confirmed by receiving the RGB color data.

It will be understood by those skilled in the art that the present invention can be embodied in other specific forms without departing from the spirit or essential characteristics thereof. It is therefore to be understood that the embodiments described above are to be considered in all respects only as illustrative and not restrictive. The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

100: display device 110: main picture
120: additional information providing area 200:
210: control unit 220:
230: RGB color data identification unit 240: decoding unit
250: input unit 260:
270: memory unit 300: RGB color table

Claims (6)

A display device for converting additional information related to the main image and the main image into red green blue (R / G / B) color data and displaying the converted data on a part of the main image; And
A camera unit for photographing the RGB color data; A decoding unit for converting the photographed RGB color data according to a previously stored RGB color table to decode the additional information; And a control unit for displaying the decoded additional information. The image providing information providing system using RGB color.
The method according to claim 1,
The user terminal comprises:
A memory in which the RGB color table is stored; And
And an RGB color data extracting unit for extracting the RGB color data from a screen photographed by the camera unit.
The method according to claim 1,
The display device includes:
Wherein when the RGB color data is displayed, the image is displayed a predetermined number of times for the same frame a plurality of times.
The method according to claim 1,
The additional information,
Wherein the image information includes at least one of text information, image information, moving image information, and audio information.
A camera unit for capturing RGB color data including a main image and additional information related to the main image;
A memory for storing an RGB color table including data information on the RGB colors;
A decoding unit for converting the photographed RGB color data according to a previously stored RGB color table to decode the additional information; And
And a control unit for displaying the decoded additional information.
Storing an RGB color table including data information on RGB colors in a user terminal;
Converting the additional information related to the main image and the main image into RGB color data and displaying the converted RGB color data on a part of the main image;
Converting the RGB color data photographed by the user terminal according to the RGB color table to decode the additional information; And
And displaying the decoded additional information in the user terminal.
KR1020140075885A 2014-06-20 2014-06-20 System and method for providing additional information of video using light data communication KR20150146055A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020140075885A KR20150146055A (en) 2014-06-20 2014-06-20 System and method for providing additional information of video using light data communication

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020140075885A KR20150146055A (en) 2014-06-20 2014-06-20 System and method for providing additional information of video using light data communication

Publications (1)

Publication Number Publication Date
KR20150146055A true KR20150146055A (en) 2015-12-31

Family

ID=55128811

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020140075885A KR20150146055A (en) 2014-06-20 2014-06-20 System and method for providing additional information of video using light data communication

Country Status (1)

Country Link
KR (1) KR20150146055A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20170085953A (en) * 2016-01-15 2017-07-25 국민대학교산학협력단 Method and apparatus for 2D Color Code optical wireless communication
KR102324926B1 (en) * 2021-03-22 2021-11-10 국민대학교산학협력단 Apparatus and method for 2d color code optical wireless communication considering signal circumstances

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20130079301A (en) 2011-12-31 2013-07-10 이문기 Flicker free color visible light communication system

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20130079301A (en) 2011-12-31 2013-07-10 이문기 Flicker free color visible light communication system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20170085953A (en) * 2016-01-15 2017-07-25 국민대학교산학협력단 Method and apparatus for 2D Color Code optical wireless communication
KR102324926B1 (en) * 2021-03-22 2021-11-10 국민대학교산학협력단 Apparatus and method for 2d color code optical wireless communication considering signal circumstances
KR20220131806A (en) * 2021-03-22 2022-09-29 국민대학교산학협력단 Apparatus and method for 2d color code optical wireless communication considering signal circumstances

Similar Documents

Publication Publication Date Title
US10271009B2 (en) Method and apparatus for providing additional information of video using visible light communication
US9355599B2 (en) Augmented information display
US11128908B2 (en) Electronic device and method for controlling the same
US20160261927A1 (en) Method and System for Providing and Displaying Optional Overlays
KR20200126019A (en) Fingerprint layouts for content fingerprinting
JP2009212768A (en) Visible light communication light transmitter, information provision device, and information provision system
US20080118062A1 (en) System, Methods, Apparatuses, and Computer Program Products for Providing a Private Multiple Screen
CN102413343A (en) Image display apparatus and method for operating the same
KR20130057298A (en) Image display apparatus, and method for operating the same
CN102088631B (en) Live and demand broadcast method of digital television (TV) programs as well as related device and system
CN103369411A (en) Multiscreen video playing system dynamically generating scaled video, and related device
US20160057488A1 (en) Method and System for Providing and Displaying Optional Overlays
US11936936B2 (en) Method and system for providing and displaying optional overlays
KR101615763B1 (en) Method for operating additional information of video using visible communication and apparatus for the same
KR20160074970A (en) Display device and method for controlling the same
KR20190118336A (en) A multimedia device for processing video signal and a method thereof
US20090262242A1 (en) System and method for display device operation synchronization
KR20150146055A (en) System and method for providing additional information of video using light data communication
KR20190029904A (en) A digital device and method for controlling the same
US20220343879A1 (en) Display apparatus and control method thereof
CN109479155B (en) Method and apparatus for personal multimedia content distribution
EP2947619A1 (en) Method for providing advertisement, display device, mobile device, and non-transitory recordable medium
CN102025936A (en) Video aspect ratio conversion method and device
JP2008160238A (en) Information processor and processing method
KR20150081660A (en) Information sharing device and Information sharing method associated with TV program

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E601 Decision to refuse application