KR20150115189A - Data transferring system using image code, displaying method for image code in display apparatus and decoding method for image code - Google Patents

Abstract

The present invention relates to a data transmitting system (100) using an image code, which generates an image code including a series of brightness values for at least one color, wherein the system (100) comprises: a code generator (110), in which a series of brightness values correspond to binary codes representing source data; a display device (120) outputting at least one color having a series of brightness values in a code area on a display panel in an order of a series of brightness values; and a code decoder (130) obtaining an image code to be outputted on the display device (120) from a camera to decode the image code.

Description

TECHNICAL FIELD [0001] The present invention relates to a system for transmitting data using an image code, a method for outputting an image code to a display device, and a method for decoding an image code.

The technique described below relates to a system for transferring specific data via a video code from a display device to a decoding device including a camera.

The wireless communication method using RF (Radio Frequency) is getting popular for the transmission of digital data. Furthermore, various studies are being conducted to replace RF communication methods. Typically, there is a visible light communication method using a LED light emitting device and a receiver.

Korean Patent Publication No. 2004-0041778 (May 20, 2004) Korean Patent Publication No. 2009-0050731 (2009.05.20)

Conventionally, a visible light communication method for replacing RF communication has a disadvantage in that a separate light emitter receiver device is necessary because only one bit can be expressed at a time through the blinking of white light. In addition, there has been an attempt to perceive the color itself represented by the display device as specific data. However, this method has a problem in that it is difficult to express a very large amount of data by using a limited color because one color is matched with specific data.

The technique described below defines a different brightness value for at least one color outputted from the display device with different binary codes and provides a technique for transmitting specific data based on a series of brightness values output from the display device do.

The technique described below outputs a series of brightness values for at least one color that can be output from the display device and outputs a series of brightness values from a video image of the display device acquired through a camera in a separate decoding device to a binary code or a binary code You want to decode it with meaningful source data.

The solutions to the technical problems described below are not limited to those mentioned above, and other solutions not mentioned can be clearly understood by those skilled in the art from the following description.

A system for delivering data using an image code generates an image code comprising a series of brightness values for at least one color, the series of brightness values comprising a code generation device corresponding to a binary code representing source data, A display device for outputting at least one color having a luminosity value of the luminosity value in a sequence of luminosity values in a code zone on a display panel and a code decoding device for obtaining an image code outputted to the display device through a camera, .

The brightness value corresponds to at least one of a binary number, a binary code, or a part of a binary code. The image code may represent the source data with a combination of a plurality of brightness values for one color or a combination of a plurality of brightness values for each of a plurality of colors.

The code zone is at least one of a plurality of first zones divided by a reference number or a plurality of second zones not overlapping in the entire display zone, the size of the first zone or the second zone being at least one of a display The display device can be determined according to the distance between the device and the camera.

At least one of the display device and the code decoding device measures the illuminance using the illuminance sensor and adjusts the brightness of the image outputted from the display device according to the measured illuminance or the brightness of the image outputted from the display device Or the code decoding apparatus can adjust the degree of exposure of the lens of the camera.

A method of outputting an image code to a display device includes the steps of the computer device receiving input of the source data through the input interface device, the computer device selecting at least one of the colors outputable to the display device, Determining a series of brightness values for a selected color corresponding to a portion of the binary code or binary code and determining the selected color having a series of brightness values in a sequence of brightness value values in a code region on the display panel of the display device And outputting.

A method for decoding a video code includes the steps of outputting a color having a series of brightness values corresponding to a portion of a binary code or binary code representing the source data to a plurality of code regions on the display panel, Determining a brightness value of a color output in a code zone according to a plurality of code zone orders in an image acquired by the camera, the computer apparatus comprising: Determining a part of the binary code or the binary code corresponding to the brightness value of the color to be obtained; and decrypting the source data by combining a part of the plurality of binary codes or binary codes.

The technique described below provides a system or method capable of data transmission in an environment where RF communication can not be used by using a simple device such as a portable terminal.

The technique described below enables a more efficient and accurate data transmission by adjusting the size of a region where a color having a series of brightness values is outputted from the display device according to the distance between the display device and the camera of the decoding device.

The technique described below allows precise data transmission by adjusting the brightness of the image output from the display device or the degree of exposure of the camera lens according to the ambient illuminance.

The technique described below can decode an image output to a display device according to the surrounding environment or device characteristics in a device for decoding data into the most appropriate model among various color models to enable more accurate data transmission.

The effects of the techniques described below are not limited to those mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the following description.

1 shows a schematic example in which an image code is transferred in a system for transferring data using an image code.
2 is an example of transmitting data using an image code in a system for transmitting data using an image code.
3 is an example of a block diagram showing a configuration of a system for transferring data using an image code.
4 is another example of a block diagram showing the configuration of a system for transferring data using an image code.
5 (a) is an example of a code zone in which the entire display area on the display panel is divided into quadrangles, and Fig. 5 (b) FIG. 5C shows an example of a code zone having a hexagonal shape, and FIG. 5C shows an example of a code zone having a circular shape.
6 shows an example in which the code area is changed in size according to the distance between the display device and the camera.
FIG. 7 shows an example of a decoded brightness value interval used in the process of decoding an image code.
8 is an example of a result of analyzing RGB values according to distances in a decoding apparatus receiving an image code having a blue (B) color.
FIG. 9 is an example of a result of analyzing RGB values according to the type of a camera in a decoding apparatus receiving an image code having a blue (B) color.
10 is an example of a flowchart of a method of outputting an image code to a display device.
11 is an example of a flowchart for a method of decoding an image code.

The following description is intended to illustrate and describe specific embodiments in the drawings, since various changes may be made and the embodiments may have various embodiments. However, it should be understood that the following description does not limit the specific embodiments, but includes all changes, equivalents, and alternatives falling within the spirit and scope of the following description.

The terms first, second, A, B, etc., may be used to describe various components, but the components are not limited by the terms, but may be used to distinguish one component from another . For example, without departing from the scope of the following description, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

As used herein, the singular " include "should be understood to include a plurality of representations unless the context clearly dictates otherwise, and the terms" comprises & , Parts or combinations thereof, and does not preclude the presence or addition of one or more other features, integers, steps, components, components, or combinations thereof.

Before describing the drawings in detail, it is to be clarified that the division of constituent parts in this specification is merely a division by main functions of each constituent part. That is, two or more constituent parts to be described below may be combined into one constituent part, or one constituent part may be divided into two or more functions according to functions that are more subdivided. In addition, each of the constituent units described below may additionally perform some or all of the functions of other constituent units in addition to the main functions of the constituent units themselves, and that some of the main functions, And may be carried out in a dedicated manner. Accordingly, the presence or absence of each component described in the present specification should be interpreted as a function. For this reason, the configuration of the components according to the system 100 for transmitting data using the image code of the below- It should be clear that it can be different from the corresponding drawings to the extent that the object of the described technique can be achieved.

Also, in performing a method or an operation method, each of the processes constituting the method may take place differently from the stated order unless clearly specified in the context. That is, each process may occur in the same order as described, may be performed substantially concurrently, or may be performed in the opposite order.

In a computer device, data is represented by a specific code. For example, the text data is represented by a code such as Unicode, ASCII code, or the like. The computer device identifies an ASCII code or the like as an array of binary numbers.

The technique described below uses the brightness value of a specific color output from a display device as a binary code represented by an electrical signal in a computer device or a code represented by a binary code. That is, the technique described below can encode and decode specific data using brightness values. The code represented by a binary number is called a binary code below.

The technique described below is a technique of decrypting a brightness value of a specific color encoded and outputted by a display device by a separate receiving device including a camera device and delivering specific data.

In the 8-bit ASCII code, the alphabetic character 's' is represented by '01110011'. If the brightness value of a specific color is defined to correspond to the binary number '01110011', the alphabetical character 's' can be expressed by a specific brightness value. In this case, the kind of brightness value is required as many as the number of characters that can be expressed in ASCII code.

Furthermore, it is possible to express a specific code even if it is defined in advance that a specific brightness value corresponds to a binary digit of several digits. For example, the alphabetic character 's' can be represented by two binary digits '01', '11', '00', and '11'. If the brightness value for a particular color represents the binary digit of the two digits, then text data representation is possible with only four different brightness values.

It is obvious that the techniques described below can be applied to the transmission of various data represented by codes such as binary, octal, decimal or hexadecimal.

The terms used in the description of the following description will first be defined.

In the technique described below, the display device encodes the data to be transmitted and outputs a color having a specific brightness value, and the decoding device including the camera decodes the image output from the display device. The data to be encoded is referred to as source data. Source data is meant to include all types of data represented as digital data. The source data includes text data, image data, voice data, and the like. However, it is presumed that the source data is text data for convenience of explanation.

As described above, the source data can be represented by a specific binary code. In the technique described below, since the brightness value of a specific color corresponds to a specific binary code, the source data can eventually be represented by a series of brightness values. In this case, the source data is represented by an ordered list of brightness values. Further, if multiple colors are used, the source data may be represented by a list of brightness values for a plurality of colors.

A series of brightness values representing the source data is called "image code ".

When two-digit binary codes are expressed by one brightness value, four brightness values for one color can represent binary codes corresponding to '00, '01,' 10 'and' 11 '. In the case of text data, one letter can be represented by four brightness values.

Furthermore, if you use two colors and use four brightness values for each color, you can represent binary codes with three digits with eight brightness values. Even when a plurality of colors are used, the source data is eventually expressed as a list of brightness values for at least one color. Specifically, when a plurality of colors are used, the source data is represented by a list of " color-distinguishing information and brightness values ". For the sake of convenience, however, it is assumed that the source data is represented by an image code having a series of brightness values.

The techniques described below may be applied to other codes than the binary code, and the number of color values to be used and the number of brightness values for each color value may vary.

Hereinafter, a system 100 for transmitting data using an image code, a method 300 for outputting an image code to a display device, and a method 500 for decoding an image code will be described in detail with reference to the drawings.

1 shows a schematic example in which an image code is transferred in a system 100 for transferring data using an image code.

The system 100 for transmitting data using an image code includes a code generation device 110 for generating the image code, a display device 120 for outputting the image code, and a display device 120 for displaying the image code output from the display device 120 And a code decoding device 130 for decoding the image code acquired through the camera. 1, the code generating apparatus 110 is not illustrated, but a code decoding apparatus 130 acquires an image code output from the display apparatus 120 through a camera.

The display device 120 includes a portable terminal such as a smart phone shown at the upper left of FIG. 1 and a device such as a computer monitor device shown at the lower left. A device including a CPU such as a smart phone includes a code generation device 110 and a display device 120 in one device.

Some of the image codes or image codes output on the screen of the display device 120 are shown in FIG. The code decoding device 130 located at a predetermined distance from the display device 120 obtains a part of the image code or image code output on the display panel of the display device 120 through the camera. The code decoding apparatus 130 includes a PC for acquiring image data through a separate camera shown in the upper right of FIG. 1, and a device such as a smart phone having a built-in camera.

It is preferable that the display device 120 and the code decoding device 130 are positioned within a distance at which the code image output from the display device 120 can be decoded. If the camera device is connected to the code decoding device 130 or wirelessly exchanges data, it suffices that the display device 120 and the camera are located within a distance at which the code image can be decoded. Hereinafter, a distance at which a code image can be decoded is referred to as a "decodable distance ". The decodable distance may vary depending on the size of the display panel, the performance of the display device 120, the performance of the camera, or the surrounding environment (illuminance, etc.) where the image code is output.

Hereinafter, an example in which a video code is transmitted will be described in more detail. 2 is an example of transmitting data using an image code in a system 100 for transmitting data using an image code. 2 (a) shows an example in which the code generating apparatus 110 codes the source data into a specific image code, FIG. 2 (b) shows an example in which the display apparatus 120 outputs a part of the image code , And FIG. 2 (c) shows an example of encoding the image code acquired by the code decoding device 130 through the camera.

In FIG. 2, it is assumed that the source data is text data, and the text data is represented by an 8-bit ASCII code. Referring to FIG. 2, the image coding apparatus 110 receives text data called 'hello'. 'hello' is 01101000 (h), 01100101 (e), 01101100 (l), 01101100 (l), 01101111 (o) in ASCII codes.

If the number of brightness values for any color constituting the image code is equal to or greater than the number of ASCII codes, each of the ASCII codes may be previously matched to one brightness value. However, it may not be easy for the decoder to distinguish the brightness value by the number of ASCII codes. Therefore, in the following description, it is assumed that the brightness value expresses a two-digit binary number. 00 is displayed with a brightness value of 99, 01 is displayed with a brightness value of 137, 10 is displayed with a brightness value of 176, 11 is displayed with a brightness value of 215 Respectively. The brightness value shown in FIG. 2 is only one example, and is an example for largely dividing a color having a brightness value of 0 to 255 into four zones.

The image coding device 110 determines a series of brightness values corresponding to the binary codes representing the input source data using the image code table. An 8-bit ASCII code represents one character with 8 bits, so one letter can be represented by four brightness values. In FIG. 2 (b), the display device 120 displays eight brightness values in one screen. The display device 120 of FIG. 2 (b) displays two characters in one screen, so 'hello' can be represented by three image frames. A region in which a hue having a specific brightness value shown in Fig. 2 (b) is output is referred to as a code region. As will be described later, the shape and size of the code area can be changed depending on the characteristics of the apparatus or the environment in which the image code is transmitted.

In addition, the order in which a series of brightness values constituting the image code are output to the code area is set in advance. The order in which colors having a series of brightness values are outputted must be shared by both the display device 120 and the code decoding device 130. [

The code decoding apparatus 130 obtains the image code output from the display device 120 by the camera, and determines a series of brightness values constituting the image code. The display device displays a series of brightness values in eight code zones. Therefore, in order for the code decoding apparatus 130 to accurately and quickly acquire the image code from the display device, it is desirable that the information on the position and size of the code area is known in advance. Of course, the code decoding apparatus 130 may process the image acquired by the camera to determine a code area classified by the brightness value.

Furthermore, it is preferable that at least one of the code zones in which the display device 120 outputs the brightness value outputs a reference brightness value that is not related to the image code. This is because there is room to be interpreted as a value other than the specific brightness value determined by the code generating device 110 in accordance with the illuminance by which the display device 120 outputs the image, the performance of the display device, the performance of the camera, When the reference brightness value is used, the code decoding device 130 determines the brightness value of the code area in which the reference brightness value is output from the image acquired by the camera. The brightness value of the reference brightness value in the camera image is called the comparative brightness value. In this case, the code decoding apparatus can determine a consistent brightness value by comparing the comparison brightness value with the brightness value of the color output from the remaining code area.

Fig. 2 shows a concept of how image codes are coded and decoded. The image code shown in Fig. 2 is only one example. Various other codes that represent text data may be used, and furthermore, the source data may be other types of data than text data.

Referring to FIG. 2, for example, an image code represents a set of binary codes representing 'hello' or an 8-bit binary code representing one character. That is, the image code means a code corresponding to the entire source data or a code expressing a significant part of the source data. If the source data is not text data, it may be a single image code capable of distinguishing data of a certain time unit. When the source data is video data, a code representing one frame or a code representing a specific area of one frame may be an image code.

Although not illustrated in FIG. 2, the image code may include information indicating the start and end of the image code. For example, at least one code zone having a brightness value of 60 may be a start header announcing the beginning of an image code, and at least one code zone having a brightness value of 255 may be an end header announcing the end of the image code have. Of course, the start header and end header may be defined as a combination of other brightness values or other brightness values that do not represent the source data.

3 is an example of a block diagram illustrating the configuration of a system 100 for transferring data using an image code.

A system (100) for delivering data using an image code generates an image code comprising a series of brightness values for at least one color, the series of brightness values comprising code generation corresponding to a binary code representing the source data A display device (120) for outputting at least one color having a series of luminosity values in a sequence of luminosity values in a code area on a display panel, and an image code output to the display device (120) And a code decoding device 130 for decoding the image code.

The source data may be input through the interface 111 of the code generating device 110. [ The interface 111 includes a data input means connected to the code generation device 110, which is a computer device, and an interface device capable of receiving data included in a storage medium such as a USB.

The code generation unit 112 refers to a code table stored in a storage medium such as a memory to generate an image code corresponding to the input source data. For example, the code table may store an ASCII code representing text data and a brightness value for a particular color corresponding to the binary code comprising the ASCII code. A binary code is a code that expresses a specific data in binary. The code generation unit 112 corresponds to an arithmetic unit (CPU or the like) capable of generating a series of brightness values constituting an image code or image code based on the source data.

The image code generated by the code generating device 110 is transmitted to the display device 120. [ The image code received by the actual display device 120 corresponds to a command to output a certain color value to a certain position (code area) of the display panel with a certain brightness value. 3, the code generation device 110 and the display device 120 are not shown as one block, but the code generation device 110 and the display device 120 correspond to one device. For example, the code generation device 110 and the display device 120 may be implemented in a single device such as a smart phone, a tablet PC, or the like, or may be implemented as a computer main body and a monitor connected thereto.

The separate code decoding apparatus 130 obtains the image code output from the display apparatus 120 located at a relatively short distance through the camera 131. [ The code decoding unit 132 analyzes the image obtained through the camera 131 to determine a brightness value of a color to be output to the code area and decodes the image code using a decoding table 133 stored in a storage medium such as a memory . The code decoding unit 132 determines a brightness value for the code region of the acquired image, and searches the decoded table for the determined brightness value to complete the corresponding binary code. For example, as shown in FIG. 2, if each brightness value corresponds to a binary digit of two digits, the 8-bit binary code represented by four brightness values is completed to decode the text data.

When a hue having a reference brightness value is output to at least one of the plurality of code zones as described above, the code decoding unit 132 determines the above-described comparison brightness value and outputs the comparison brightness value to the remaining code areas based on the comparison brightness value And determines the relative brightness value of the color to be displayed.

4 is another example of a block diagram showing a configuration of a system 100 for transferring data using an image code. The system 100 for transferring data using the image code shown in FIG. 4 is different from the system shown in FIG. 3 in that the code generation device 110 and the display device 120 are located at a remote place. The rest of the configuration and functions of each configuration are the same as those described in Fig.

The source data may be input through the input interface 121 of the display device 120. [ In this case, the inputted source data is transmitted to the communication module 114 of the code generation device 110 located at a remote place through the communication module 122. The code generating unit 112 of the code generating apparatus 110 generates an image code based on the source data received through the communication module 114. The code generation device 110 transmits the generated image code to the display device 120 through the communication module 114. The display device 120 refers to the image code and displays a specific color Lt; / RTI >

Further, the source data may not be transmitted to the code generating apparatus 110 via the display apparatus 120 but may be input through the interface 111 of the code generating apparatus 110 as shown in FIG.

The code decoding apparatus 130 may use various algorithms for detecting the above-described color values in order to detect an area representing a code color value in an image input to the camera 131. [ Furthermore, if a screen output from the plurality of display devices 120 is detected, n: 1 communication is possible.

The image code generated by the code generating device 110 includes a series of brightness values for at least one color. Each brightness value corresponds to at least one of a binary number, a binary code, or a portion of a binary code. In FIG. 2, an example in which one brightness value corresponds to a two-digit binary number or a part of a binary code is described.

Furthermore, binary codes may be represented by different brightness values for a given color, but a plurality of colors may be used. For example, blue and red may be used and four brightness values may be used for each color. When using two colors, you can distinguish eight binary codes or a part of binary code by brightness value.

As a result, the image code can represent the source data with a combination of a plurality of brightness values for one color or a combination of a plurality of brightness values for each of a plurality of colors.

The variables related to the data rate are the number of brightness values for one color, whether a plurality of colors are used, and the number of colors for which a series of brightness values are displayed on one display screen. The rate at which source data is transmitted can be determined by the sender and the receiver in agreement. It is possible to establish stable communication with a certain time margin between frames considering the screen output speed of the display device 120 and the video input speed of the code decoding device 130.

Meanwhile, the image code output from the display panel 120 of the display device 110 may be output to a code area having various sizes and shapes.

For example, the code zone may be at least one of a total display zone on the display panel, a plurality of first zones divided by a reference number of the entire display zone, or a plurality of second zones not overlapping in the entire display zone.

The entire display area refers to the entire screen capable of video output. When the code area is the entire display area on the display panel, one of the colors having a certain brightness value is displayed on one screen.

The plurality of first zones means that the entire display zone is divided equally or evenly. The plurality of second zones means an example in which only a part of the entire display zone is used as a code zone. The second zone may be at least one of a circle, regular polygon, or irregular shape.

5 (a) is an example of a code zone in which the entire display area on the display panel is divided into quadrangles, and Fig. 5 (b) FIG. 5C shows an example of a code zone having a hexagonal shape, and FIG. 5C shows an example of a code zone having a circular shape.

5 (a) shows an example in which the entire display screen of the display panel is divided into a rectangular shape. 5 (a) corresponds to the example of the first zone described above. 5 (b) and 5 (c) show an example in which a code area is used for a part of the entire display screen of the display panel. 5 (b) and 5 (c) correspond to examples of the second zone described above. 5 (b) and 5 (c) are of course only one example for the second zone, and the second zone may have a different shape or irregular shape.

Since the number of cases in which the code area divides the entire display screen of the display panel into the first area case color can be limited, the number of code areas outputting hues having a specific brightness value is large, The second zone, which is easy to change, is more secure.

The order in which the position, size, and series of brightness values of the code zone are output may be the information that the display device 120 and the code decoding device 130 previously share. In this case, the position of the code zone in which a series of brightness values are output may be changed automatically or over time according to the user's selection. In FIG. 2, if a serial number is displayed in a code area in which the entire display screen is divided, initially, when a series of brightness values are sequentially output in numerical order, the arrangement of the code area in which a series of brightness values are output may be changed It is.

When a hue having a reference brightness value is output from a plurality of code zones, the code decoding apparatus 130 obtains a brightness value of the code zone in which the reference brightness value is output, a brightness value of the hue output in each of the remaining code zones, And decodes the image code.

The size of the code zone (including the first zone or the second zone) may be determined according to the distance between the display device 110 and the camera 131. [ 6 shows an example in which the size of the code area is changed according to the distance between the display device 120 and the camera 131. [

In FIG. 6, when the distance between the display device 120 and the camera 131 is 50, eight code zones are outputted, and one code zone is a circle having a diameter of 10. If the distance between the display device 120 and the camera 131 is 100 and the size of the code area is still 10, the size of the code area to be input to the camera 131 becomes small, . Accordingly, it is preferable that the size of one code zone increases in proportion to the distance between the display device 120 and the camera 131. [ 6 shows an example in which the diameter of the code area is increased to 15 when the distance between the display device 120 and the camera 131 increases to 100. FIG. As the size of the code area increases, the number of code areas that can be displayed on one screen can be reduced. In FIG. 6, the metric unit values for distance and diameter are not separately shown. FIG. 6 shows an example of a circular code area, but the size of the code area can be adjusted according to a certain standard (distance to the center of gravity, length in one direction, and the like).

The distance D is calculated by the code decoding device 130 using the following equation and transferred to the display device 120 or the code generation device 110 or the display device 120 receives the image information acquired by the camera, Can be calculated by Equation (1).

Here, W _c is the one-direction actual length of a part of the display device or the display device, W _r is the unidirectional pixel length of the image of a part of the display device or the display device in the image acquired through the camera, W _p is the image And the FOV is the viewing angle of the camera. At this time, W _c and W _r use the reference corresponding to each other.

There is also a problem that the accuracy of communication varies depending on the illuminance of the surrounding environment. When the surroundings are excessively dark or bright, the emission color of the transmitter may be relatively less bright or dark, so that color detection itself may not be achieved. If the color is not detected, the receiver can not recognize the transmitter, so the communication itself is not performed.

At least one of the display device 120 and the code decoding device 130 may measure the illuminance using the illuminance sensor and may adjust the brightness of the image output from the display device 120 according to the measured illuminance, The device 120 may adjust the color of the image output from the display device 120 or the code decoding device 130 may adjust the degree of exposure of the lens of the camera 131. [

As described above, in the case of 8-bit ASCII code, eight brightness values are required for one character if the brightness value expresses one bit, and four code color values are required if the brightness value expresses two bits. The color values classified according to the brightness value are represented by specific numerical values in a computer device or a display device according to a method of expressing colors.

For example, the code generating device 110 generates an image code having a brightness value 99 corresponding to '00'. The display device 120 outputs a color having a brightness value of 99 in a specific code area.

However, depending on the illuminance or the hardware performance, the code decoding apparatus 130 may be difficult to determine that the brightness value output to the display apparatus 120 is exactly 99.

When two-digit binary codes are represented by four brightness values, the code decoding apparatus 130 can use four brightness value intervals corresponding to four brightness values. That is, if the brightness value of a hue outputted to a specific code zone is included in a specific brightness value interval, the code decoding device 130 interprets the brightness value range as a representative brightness value. Such a brightness value interval is called a decoding brightness value interval.

FIG. 7 shows an example of a decoded brightness value interval used in the process of decoding an image code. An example of a decoded brightness value interval corresponding to the brightness value shown in Fig. 2 is shown in Fig.

The process of determining the decoded brightness value interval and the number of decoded brightness value intervals should consider an algorithm for detecting the hue value output from the display device 120. [ Blob Labeling algorithm, Camshift algorithm, Adaboost algorithm can be used for color value detection. For convenience of explanation, it is assumed that the Blob Labeling algorithm based on the YCbCr color model is used.

In FIG. 7, when the brightness value is 60 to 255 for a specific color, only the interval of brightness values 60 to 255 is used, assuming that the code decoding apparatus 130 has good detection efficiency for the brightness value constituting the image code. Of course, the range of the brightness value may be different depending on the type of color, the hardware performance of the display device and the camera device, the brightness value detection environment, and the user's setting.

The decoded brightness value interval is 2 ^m . and m represents the number of bits expressed by one brightness value. In FIG. 7, m is set to 2, and once the reference brightness value is set to 60 and 255, the 10% interval at both ends of the range of 60 to 255 is set as a margin interval for the reference brightness value. The remaining 80% of the interval is divided into quadrants, and the intervals are set to represent bits 00, 01, 10, and 11, respectively. It is obvious that FIG. 7 is only one example of the decoded brightness value interval and that various other intervals can be used.

The code decryption apparatus 130 does not necessarily use the color used by the code generating apparatus 110 in the process of detecting the color value. For example, if the code generation device 110 generates a code color value by selecting a color B (Blue), the code decoding device 130 generates code color values based on G (Green) Value. ≪ / RTI > The brightness difference value of one color may be represented by a brightness value difference with respect to another color, and in some cases, the code decoding apparatus 130 may display brightness values May be more accurate. The code decoding apparatus 130 can determine a color for image code decoding according to an illumination environment and a hardware characteristic for acquiring an image code.

8 is an example of a result of analyzing RGB values according to distances in a decoding apparatus receiving an image code having a blue (B) color. 8A shows a case where the distance between the display device 120 and the camera 131 is 45 cm and FIG. 8B shows a case where the distance between the display device 120 and the camera 131 is 100 cm. Referring to FIG. 8, it can be seen that the G value is linearly changed corresponding to the B value in which the color changes. Therefore, in the case of the experimental environment of FIG. 8, the code decoding apparatus 130 may decode the image code based on the G color. In the graph of FIG. 8, the horizontal axis represents the brightness value output from the display device 120, and the vertical axis represents the brightness value determined by analyzing the image acquired by the code decoding device 130.

FIG. 9 is an example of a result of analyzing RGB values according to the type of a camera in a decoding apparatus receiving an image code having a blue (B) color. FIG. 9A shows a case where an image code is acquired using a webcam of a PC, and FIG. 9B shows a case where an image code is acquired using a camera of a smartphone. In the graph of FIG. 9, the horizontal axis represents the brightness value output from the display device 120, and the vertical axis represents the brightness value determined by analyzing the image acquired by the PC and the smartphone corresponding to the code decoding device 130.

Referring to FIG. 9, when the camera of the smartphone is used, unlike the case of using the PC webcam, the color B (blue) is suitable for use in the decryption algorithm. In Fig. 9 (b), only the B color increases linearly with the actual distance.

It is preferable that the code decoding apparatus 130 determines the color for decoding because the color suitable for use in the decoding algorithm is different according to the code decoding apparatus 130 and / or the camera 131 as in the experimental result shown in Fig. 9 Do.

For example, before the display device 120 starts communication, colors of brightness values of 5 to 255 are output once every predetermined period, and when the code decoding device 130 acquires an image output from the display device 120 9, it is possible to find the most suitable color to use in the decryption algorithm. With this method, even if the display device 120 or / and the code decoding device 130 for transferring the source data are replaced, it is possible to transfer the source data without any trouble.

Furthermore, the code decoding apparatus 130 may appropriately select a color model suitable for code decoding from among various color models representing color images.

The code decoding device 130 analyzes the brightness value of the color constituting the image code acquired through the camera 131, determines a binary code corresponding to the brightness value, and decodes the image code. At this time, the code decoding apparatus 130 may determine the brightness value of the color using at least one of the RGB model, the YCbCr model, and the YCgCo model.

Furthermore, the code decoding apparatus 130 may determine the brightness value of the color using at least one of the Cb channel of the YCbCr model, the Cr channel of the YCbCr model, the Cg channel of the YCgCo model, or the Co channel of the YCgCo model.

Further, the code decoding apparatus 10 may use at least one of various existing color models, or may determine a brightness value using a model that selectively combines some channels among the color models.

In this process, the code decoding device 130 analyzes the sample image output from the display device 120 and selects a color model or a color model channel whose brightness value is most clearly distinguished.

10 is an example of a flowchart for a method 400 for outputting an image code to a display device. Hereinafter, the portion of the system 100 for transmitting data using the image code will be briefly described.

A method 400 for outputting an image code to a display device includes receiving 410 the source data via the input interface device, selecting 420 the at least one color capable of being output to the display device, Determining (430) a series of brightness values for the selected color corresponding to a portion of the binary code or binary code in which the computer device represents the source data, and determining a set of brightness values for the selected color having a series of brightness values (Step 450) in a value order on the code area on the display panel of the display device. Here, the computer device corresponds to the code generating device 110 described above.

The computer device can measure the illuminance using the illuminance sensor and adjust the brightness value of the image output from the display device according to the illuminance measured. Alternatively, the display device that receives the predetermined brightness value from the computer device may adjust the brightness value of the image output from the display device according to the measured illuminance. Alternatively, the code decoding device or the camera may adjust the degree of exposure of the camera lens according to the measured illuminance. The illuminance sensor may be included in a computer device or a code decoding device, and the illuminance measured by one device may be shared with other devices so that the image code is transmitted according to illuminance. Furthermore, the computer device or the display device may determine colors that are more easily transmitted according to the measured illuminance, or may determine colors that are easier to decode according to the illuminance measured by the code decoding device as described above, have.

The code zone is at least one of a plurality of first zones divided by a reference number or a plurality of second zones not overlapping in the entire display zone.

A method 400 of outputting an image code to a display device includes the step 440 of determining the size of the first zone or the second zone according to the distance between the camera and the display panel, . The computer device can determine the distance D using Equation (1). The size and number of code zones may be adjusted in step 450 to output according to the determined distance.

11 is an example of a flowchart for a method 500 for decoding an image code. Here, the computer device is a device corresponding to the code decoding device 130.

A method (500) for decoding an image code (510) includes outputting (510) a hue having a series of brightness values corresponding to a portion of a binary code or binary code representing source data to a plurality of code zones on a display panel, (520) a computer device acquires an output image of a display panel through a camera, the computer device determining a brightness value of a color output from the code area according to a plurality of code zone orders in an image acquired by the camera 530), determining (540) a portion of a binary code or binary code corresponding to a brightness value of a color output by the computing device in a plurality of code zones, and combining the portions of the plurality of binary codes or binary codes And decoding (550) the source data.

In step 510, the display device outputs a reference brightness value for the color in at least one of the plurality of code areas, and in step 530, the computer device determines a brightness value Value (the above-described comparative brightness value) and a series of brightness values obtained through the camera can be compared to decode the image code.

In the step 530 of determining the brightness value, the computer device displays the R channel of the RGB model, the G channel of the RGB model, the B channel of the RGB model, the Cb channel of the YCbCr model, the Cr channel of the YCbCr model, the Cg channel of the YCgCo model, The brightness value of the color can be determined using at least one channel of the Co channels of the model. Furthermore, the computer device is not limited to the above-mentioned color model, and various color models may be selectively selected or combined to determine the brightness value of the color.

Further comprising outputting a sample image having a different brightness value for the color before the outputting step (510), wherein in the step of determining the brightness value (530), the computer device displays a sample image To determine a color or color model in which different brightness values are distinguished, and to decode the image code based on the determined color or color model. The specific procedure is as described above.

The computer device or the display device corresponding to the code generating device outputs the promised sample image while increasing or decreasing the brightness value in the range of 0 to 255 and outputs the promised sample image to the decoding device And determines whether the result is obtained. The sample image may be a plurality of frames in which brightness values continuously change, or may be composed of a plurality of frames having different brightness values.

It should be noted that the present embodiment and the drawings attached hereto are only a part of the technical idea included in the above-described technology, and those skilled in the art will readily understand the technical ideas included in the above- It is to be understood that both variations and specific embodiments which can be deduced are included in the scope of the above-mentioned technical scope.

100: a system for transmitting data using an image code
110: code generation device 111: interface
112: code generation unit 113: code table
114: communication module 120: display device
121: input interface 122: communication module
123: display panel 130: code decoding device
131: camera 132: code decoding unit
133: Decryption table

Claims (20)

A code generation device for generating an image code including a series of brightness values for at least one color, the series of brightness values corresponding to binary codes representing source data;
A display device for outputting the at least one color having the series of brightness values to the code zone on the display panel in the sequence of brightness value values; And
And a code decoding apparatus for decoding the image code by acquiring the image code output from the display device through a camera. The method according to claim 1,
Wherein the brightness value is transmitted using an image code corresponding to at least one of a binary number, a binary code, and a part of a binary code. The method according to claim 1,
The image code
Wherein the image data is represented by a combination of a plurality of brightness values for one color or a combination of a plurality of brightness values for each of a plurality of colors. The method according to claim 1,
Wherein the code zone comprises at least one of an entire display zone on the display panel, a plurality of first zones divided by a reference number of the entire display zone, or a plurality of second zones not overlapping in the entire display zone To transmit data. 5. The method of claim 4,
Wherein the second zone is at least one of a circle, a regular polygon, or an atypical shape. The method according to claim 1,
Wherein the code zone is at least one of a plurality of first zones divided by a reference number or a plurality of second zones not overlapping in the entire display zone,
Wherein the size of the first area or the second area transmits data using an image code determined by the display device according to a distance between the display device and the camera. The method according to claim 6,
The distance D may be calculated by the code decoding device by calculating the following equation and transmitting it to the display device or receiving the image information acquired by the camera by the code generating device or the display device, A system that delivers data using code.

Wherein W _c is the one-direction actual length of the display device or part of the display device, W _r is the unidirectional pixel length of an image of the display device or part of the display device, W _p the camera is a pixel length of the image, such as the one-way direction by obtaining, FOV is the field of view of the camera, using W _c and W _r is the reference corresponding to each other.) The method according to claim 1,
At least one of the display device and the code decoding device measures illuminance using an illuminance sensor,
The display device adjusts the brightness of the image output from the display device according to the measured illuminance or the display device adjusts the color of the image output from the display device, And the data is transmitted using an image code that controls the degree of exposure of the image. The method according to claim 1,
The display device
Outputting the at least one color to a plurality of code regions and outputting a reference brightness value for the at least one color in at least one of the plurality of code regions. 10. The method of claim 9,
The code decoding apparatus
And comparing the brightness value of the code zone in which the reference brightness value is output with the brightness value of the color output in each of the remaining code zones, and transmitting the data using the image code for decoding the image code. The method according to claim 1,
The code decoding apparatus
A brightness value of a color constituting the image code acquired through the camera is analyzed, a binary code corresponding to the brightness value is determined to decode the image code,
And transmits the data using an image code that determines the brightness value of the color using at least one of an RGB model, a YCbCr model, and a YCgCo model. 12. The method of claim 11,
The code decoding apparatus
Using the image code for determining the brightness value of the color using at least one of the Cb channel of the YCbCr model, the Cr channel of the YCbCr model, the Cg channel of the YCgCo model, or the Co channel of the YCgCo model, The system to deliver. The computer device receiving input of the source data through the input interface device;
Selecting at least one of the hues that the computer device can output to the display device;
Determining a series of brightness values for the selected color corresponding to a portion of the binary code or binary code representing the source data; And
And the computer device outputting the selected color having the series of brightness values to the code area on the display panel of the display device in the sequence of brightness value values. 14. The method of claim 13,
The computer device measures illuminance using an illuminance sensor,
A controller for controlling brightness of an image output from the display device according to the measured illuminance or adjusting a brightness of an image output from the display device or a lens of a camera for photographing an image output from the display device And outputting an image code for adjusting the degree of exposure to the display device. 14. The method of claim 13,
Wherein the code zone is at least one of a plurality of first zones divided by a reference number or a plurality of second zones not overlapping in the entire display zone,
Wherein the computer device outputs to the display device an image code for determining the size of the first zone or the second zone according to a distance between the camera for photographing the screen of the display panel and the display panel. 16. The method of claim 15,
And the computer device outputs to the display device an image code for determining the distance D using the image photographed by the camera.

Where W _c is the one-direction actual length of the display panel or a part of the display panel, W _r is the unidirectional pixel length of the image of the display panel or part of the display panel, W _p the camera is a pixel length of the image, such as the one-way direction by obtaining, FOV is the field of view of the camera, using W _c and W _r is the reference corresponding to each other.) Outputting a color having a series of brightness values corresponding to a portion of the binary code or the binary code representing the source data to a plurality of code zones on the display panel;
The computer device acquiring an output image of the display panel through a camera;
Determining a brightness value of a color output from the code zone according to the plurality of code zone orders in an image acquired by the camera;
Determining a portion of the binary code or the binary code corresponding to a brightness value of a color output to the plurality of code zones; And
And the computer device comprises decoding the source data by combining a plurality of the binary codes or a part of the binary codes. 18. The method of claim 17,
In the outputting step, the display device outputs a reference brightness value for at least one of the plurality of code zones,
In the step of determining the brightness value, the computer device decodes the image code for decoding the image code by comparing the brightness value of the code zone in which the reference brightness value is output with the brightness value of the color output in the remaining code zone Way. 18. The method of claim 17,
In determining the brightness value, the computer device
Using at least one of the R channel of the RGB model, the G channel of the RGB model, the B channel of the RGB model, the Cb channel of the YCbCr model, the Cr channel of the YCbCr model, the Cg channel of the YCgCo model, or the Co channel of the YCgCo model, A method of decoding an image code that determines a brightness value of a color. 18. The method of claim 17,
Further comprising the step of outputting a sample image in which the display device has different brightness values for the hue before the outputting step,
Wherein the computer device analyzes the sample image output from the display device to determine the brightness value based on a color in which different brightness values are distinguished in the determining of the brightness value, Determining a color model in which different brightness values are distinguished from each other by analyzing the sampled image, and determining the brightness value using the determined color model.

Images