JP2006092107A - Radio communication system using color codes - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve problems wherein conventional radio communications have no directivity, is difficult to detect a target position, and hard to grasp communication conditions with human eyes. <P>SOLUTION: Matrix codes displayed on a display section are photographed by a photograph section, and digital data is read out by analyzing an image with color patterns. An information transmitting location for reading out the information from the image is easily identified since the information on the matrix codes in a photographed range is read out. A user can determine whether communication is under way or not since the communication is carried out by visible color patterns. If a color displayed by a specific unit code in the matrix codes is correlated with specific information, the user can visibly grasp what transmitting or receiving information is correlated with. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a method and apparatus for wireless data communication.

In recent years, RFID (Radio Frequency Identification) has been attracting attention as a means for communicating a small amount of data such as ID data, and recognizing and identifying a person or an object, and wireless communication at a short to medium distance has been developed.
JP 2001-233410 A

  However, since RFID communicates with a reader using radio waves or electromagnetic waves, it is difficult to detect each position even if a plurality can be recognized simultaneously. This is shown in FIG. Reference numeral 501 denotes an RFID tag, and reference numeral 500 denotes a tag reader. As shown in the figure, since radio waves or electromagnetic waves are generally radiated around the tag reader 500, even if the relative distance from each RFID tag 501 is known, the respective positions cannot be detected. In order to detect the position, it is necessary to provide three or more readers and perform three-point measurement, which complicates the apparatus.

  In addition, when communication is performed using radio waves or electromagnetic waves, the communication state cannot be confirmed by humans. Although security has been improved by various technologies in recent years, the possibility of being read without knowing the information of the tag (IC card) that it owns or reading unnecessary information cannot be discarded. is there. This is because if the reader and the tag exist within a range where radio waves and electromagnetic waves reach, communication may be performed regardless of the intention of the owner. At the same time, even when information communication is carried out consciously, it is usually not possible to determine what information is being transmitted or received if there are multiple pieces of information in the tag. Is possible.

  In order to solve the above-described problems, the present invention can grasp the communication state visually in order to solve the point that communication by radio waves or electromagnetic waves is difficult for humans to understand intuitively. An object of the present invention is to provide an information communication method that can easily associate positional information from which the information is transmitted and that can physically control communication.

  In the wireless communication system of the present invention, the minimum structural unit is a two-dimensional matrix code composed of a code that displays a plurality of colors in the visible light range and changes the display color along the time axis, and digital data is a matrix code. A conversion code for converting to color pattern data for a certain time is used.

  The wireless communication system of the present invention includes an information display unit that displays the two-dimensional matrix code, and a display control unit that converts the digital data into color pattern data at regular time intervals according to the conversion code and sends a display command to the information display unit. An information transmitting means for displaying the configured transmission data, an imaging unit for imaging the information display unit, and detecting the color pattern of the matrix code by performing image processing on the captured image information, and reconverting according to the conversion code By this, it is comprised from the information acquisition means which receives the said transmission data comprised from the image information analysis part which reads digital data from the said information transmission means.

  In one form of the wireless communication system of the present invention, a specific color pattern at a specific position in the matrix code displayed on the information display unit is associated with specific transmission information.

  In one form of the information transmission means of the present invention, the matrix code of the information display unit is arranged in a two-dimensional matrix with a single unit of LED or a group of LEDs that can be changed in color by a combination of a plurality of LEDs as a minimum unit.

  In one form of the information transmission means of the present invention, the matrix code of the information display unit is displayed on a color display system.

  In one form of the information transmission means of the present invention, the period of the color pattern displayed on the information display unit is the same as the time of one frame of the imaging unit.

  In one form of the information display part of this invention, in detecting the said information display part by the said information acquisition means, a part of said matrix code is used as a position detection means.

  In one form of the information display part of this invention, in detecting the said information display part by the said information acquisition means, infrared LED is installed in the vicinity of the said matrix code, and it uses as a position detection means.

  In one form of the image analysis unit of the present invention, an information display unit is detected by the position detection unit from the image obtained from the imaging unit, and the color pattern indicated by the information display unit is subjected to image processing for each frame. To do.

  In one form of the image analysis unit of the present invention, the image processing method separates the color of an image for each frame by a threshold value, accumulates the data as code data of one frame, and repeats the same.

  In one form of the image analysis unit of the present invention, the image processing method starts data storage after detecting data display start information from the matrix code, stops data storage when data display end information is detected, and stores the data. The converted data is converted into digital data according to the conversion code.

  In one form of the wireless communication system of the present invention, a physical shutter is provided in the information display unit and the imaging unit, and reception and transmission are performed so that unexpected communication is not performed when the user does not want to perform communication. It has a structure that can be physically cut off.

  In one form of the wireless communication system of the present invention, an image obtained from the imaging unit is associated with digital data converted from a matrix code in the image, and the content of the data is located at the position of the matrix code in the image. Are combined so as to be displayed on the external display device.

  According to one aspect of the wireless communication system of the present invention, when the data acquired by conversion is an ID code, a data reference function is provided to superimpose information held by the ID on an image by referring to an external or internal database. Including an image composition unit.

  In one form of the wireless communication system of the present invention, the information transmission unit and the information acquisition unit are attached to the same device, and perform bidirectional communication with the same device.

  As described above, according to the present invention, by reading the two-dimensional color matrix code existing in the imaging range, data within a certain range can be read, that is, directional wireless communication can be performed.

  Further, since the matrix code is displayed on the LED or various displays, the display information can be changed.

  In addition, since the matrix code is configured by color display that can be seen by the human eye, the user can visually confirm the transmission state of the data.

  Further, by associating the color indicated by the matrix code with the information transmitted at that time, the user can visually confirm what kind of data is transmitted.

  In addition, by superimposing the captured image and the read information on the display, the user can visually understand the position of the matrix code transmitting the information in association with the information.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 shows the basic configuration of the present invention. First, the digital information sent to the information transmitting unit 100 is converted into color pattern data by the display control unit 101 based on a certain conversion code. Next, data is displayed as a matrix code on the information display unit 102 in accordance with the converted color pattern data. In the information acquisition unit 200, the imaging unit 201 captures an area including the matrix code, and the information analysis unit 202 analyzes the obtained image. In the information analysis unit 202, first, the matrix code is detected by the position detecting means, and then the color pattern displayed in the range is detected. Digital data is obtained by reconverting the detected color pattern based on the conversion code.

  FIG. 2 shows an information display unit 20 composed of a single color LED 21 as one embodiment of the information display unit. In a preferred form of the invention, each LED 21 forms a square two-dimensional matrix. In FIG. 2, a 3 × 3 square matrix is formed, but 5 × 5, 9 × 9, etc. may be used, and the number is not particularly limited. The LEDs 21 constituting the matrix are composed of several colors such as RGB.

  FIG. 3 shows an information display unit 30 configured as a minimum unit of LED groups 31 that can change color as one embodiment of the information display unit. The LED group 31 includes RGB LEDs and can display a plurality of colors in the visible light range. As a preferred form of the invention, each LED group 31 forms a square two-dimensional matrix. Although a 3 × 3 square matrix is formed in FIG. 3, it may be 5 × 5, 9 × 9, etc., and the number is not particularly limited.

  FIG. 4 shows a matrix code 40 output to the color display device 41 as one embodiment of the information display unit. A display method of the display device 41 is a CRT (Cathode Ray Tube), a liquid crystal display, a plasma display, an EL (Electroluminescence) display, an FED (Field Emission Display), and the like, and the forms thereof are a TV monitor, a PC (Personal Computer), and a PDA (PDA). There is no particular limitation on the form of a display device such as a personal digital assistance (Personal Digital Assistance), a mobile phone, a PHS (Personal Handy Phone), or a street display. In FIG. 4, a 5 × 5 square matrix is formed, but it may be 3 × 3, 9 × 9, etc., and the number is not particularly limited.

  FIG. 5 shows an example of the form of information transmitted by the information display unit. Reference numeral 50 denotes one frame of the matrix code indicated by the information display unit, which changes like 5a, 5b... Along the time axis. The transmission information is composed of a frame 51 indicating data display start information, a frame 52 indicating data display end information, and a data section 56 for transmission. A total of 55 is a series of transmission data. Further, the information display unit repeats transmission of the transmission data 55, and a certain idle time 53 is included between the transmission data. The information acquisition unit may read the data at any timing while the data is repeatedly displayed. Even when reading fails, reading may be started again while being repeatedly displayed. The time of one frame 50 of the information display unit is set to be the same as the time of one frame of the imaging unit. As a result, even if there is a difference in synchronization between the information display unit and the imaging unit, approximate synchronization can be achieved by exceeding an appropriate number of idle times.

  In order to accurately read the matrix code portion from the image photographed by the imaging section, the position detecting means shown in FIG. 6 or FIG. 7 is used. FIG. 6 shows a form in which a part 60 of the color code constituting the matrix code 1 is used as position detecting means. More specifically, for example, in FIG. 6, the three color codes 60 at the vertices in the 3 × 3 matrix code perform lighting of a predetermined color (predetermined color and predetermined blinking pattern). Indicates existence. The information analysis unit can detect the matrix code more easily by detecting the predetermined color pattern. On the other hand, FIG. 7 shows an embodiment in which an infrared LED 70 is installed in the vicinity of the matrix code as the position detecting means. As long as the position of the matrix code can be accurately detected, the installation location of the infrared LED is not particularly limited. By using the infrared LED, it is not necessary to use a part of the square matrix code as the position detecting means, and it is possible to detect the position without destroying the homogeneity of the matrix code.

  FIG. 8 shows a flowchart of processing performed by the information analysis unit. Each process in the flowchart is performed for each image of each frame sent from the imaging unit. The information analysis unit detects the matrix code from the image sent from the imaging unit using the position detection means (S1). After detecting the matrix code, it is determined whether or not the data display start information frame is detected (S2). The data display start information frame is detected by extracting color information in the matrix code range and determining whether the color arrangement pattern corresponds to predetermined data display start information. When the data display start information frame is detected, the image of the data frame to be subsequently displayed is subjected to image processing, and color information and its arrangement information are detected (S3). The detected information is accumulated (S4), and this is repeated until a data end information frame is detected (S5). When the data end information frame is detected, the accumulation of the detection information is ended. The accumulated information becomes code color information and arrangement information in each frame and a continuous color / arrangement change pattern, and is converted into digital data according to the conversion code. If the conversion fails, the matrix code is read again from the beginning (S6).

  Further, according to the present invention, since the matrix code existing in the range photographed by the imaging unit is read, information from only an arbitrary direction can be acquired. As a means for reading information by a similar method, a two-dimensional bar code or the like can be considered. However, in the present invention, since the information indicated by the matrix code is variable, more complicated data transfer can be performed. Since the code itself emits light, it can be read at a distance farther than the two-dimensional barcode.

  The color matrix code of the present invention is characterized in that a color indicated by a specific unit code in the matrix code is associated with specific information. For example, in FIG. 9, when the code 90 present in the center shows a red color, the data transmitted by the information transmitting means is personal information (individual ID, name, telephone number, etc.). Show. As another example, when the code 90 indicates a blue color, the data transmitted by the information transmitting unit is URL data. In this way, when specific information is transmitted, if the data conversion code is organized so that a specific color is displayed, the information that the user is transmitting or receiving is specifically related to what It can be confirmed visually. In order to achieve the above object, the color displayed by a specific unit code should not be different for each frame so that it can be recognized by human eyes. Further, since it is necessary for the user to grasp the relationship between specific information transmission and specific color, it is not preferable that the system becomes too complicated.

  In the present invention, since the matrix code is read from the captured image and information transmitted from the matrix code is received, the received information can be displayed superimposed on the position in the captured image. Furthermore, even if there are a plurality of matrix codes in the image, it is easy to determine and display the position in each image. FIG. 10 shows an example in which the received information and the image are displayed in a superimposed manner. The objects 91 and 92 have a matrix code 1 displayed by the information display unit. When a range including this object is imaged by a terminal 90 including an information acquisition unit including an imaging unit and an information analysis unit, an image synthesis unit, and a display device 93, the information acquisition unit receives data from matrix codes installed on the objects 91 and 92. Read. If the data here is the name of each object, the image composition unit superimposes the names “Object001” and “Object010” on the captured image and displays them on the display device 93.

  In addition, when the data read from the matrix code is ID data, a more detailed information related to the ID may be superimposed and displayed by referring to the database. For example, FIG. 11 shows a configuration of referring to a database. In FIG. 11, the ID unique to the person is read from the information transmission means of the person 94. The image composition unit obtains information related to the ID from the database 96 on the network 95, and displays the information 940 superimposed on the captured image. In this example, the database is assumed to be in a database server on the network, but it may be installed adjacent to the information acquisition unit and held in the same device.

  It is also a preferred embodiment that a light shielding shutter is installed in the information display unit and / or the image pickup unit so that the user can perform data communication at an arbitrary timing. That is, if the user does not need to perform communication or does not want to perform communication, the user never performs unexpected communication if the shutter is closed.

  Further, the communication speed in the present invention depends on the number of color codes, the displayable color tone of the display unit, the frame rate of the imaging unit, and the color detection capability of the information analysis unit. For example, it is assumed that one color code is composed of RGB LEDs in a 3 × 3 matrix code as shown in FIG. In addition, it is assumed that one color code can display eight colors by a combination of On and Off of RGB LEDs, and the information analysis unit can detect each of these eight colors. As other conditions, all (9) color codes are used for data communication, and the position detection information is performed by another means. Further, assuming that the frame rate of the imaging unit is 15 frames / second, the communication speed can be calculated as follows.

  First, since one of the eight color codes is displayed at a time, eight kinds of information can be transmitted. That is, transmission of 3-bit information. Since there are nine color codes, 3 × 9 = 27 bits is the amount of information transmitted in one display. Since the frame rate of the imaging unit is 15 frames / second, 27 × 15 = 405 bits can be transmitted per second. That is, it is 405 bps, and information of about 50 bytes can be transmitted per second. From this, it is practically impossible to communicate large amounts of data, but it is considered sufficient for transmitting ID information, URL data, and very short text data. In addition, since this value is the lowest level value in the configuration using the present invention, the number of color codes is increased, the display color of the color code is increased, the number of colors that can be detected by the color detection capability is increased, and the imaging unit It is also possible to communicate at a higher communication speed by a method such as increasing the frame rate. For example, if the 9 × 9 matrix code is used and the other conditions are as described above, the communication speed is about 4 kbps, and 1 kbyte data communication can be performed in about 2 seconds.

  Hereinafter, an application example of the present invention will be described more specifically.

  FIG. 12 shows an example in which the wireless communication system of the present invention is mounted on a portable terminal. In FIG. 12, the shape of the mobile phone 111 is shown, but any other shape such as a PDA or a card type is not particularly limited. This is not limited to the case of a portable terminal, but it is possible to perform mutual wireless communication at a short distance by mounting information transmitting means and information acquiring means on one terminal. Moreover, by installing in a portable terminal, it can be applied to applications such as personal authentication and electronic money in addition to data exchange. Even when such important data is transmitted or received, the communication system of the present invention can provide a sense of security because the user can grasp the communication contents to some extent from the color displayed by the matrix code.

  FIG. 13 shows an example of collecting and selecting information on objects in the real space by superimposing images and information. Currently, all things are connected to the network, but when you want to communicate with a specific thing on the network, you must search for that thing on the network. It is inconvenient to know the name and ID of In particular, when it is desired to connect to a physical object in front of the network, the same operation must be performed and an intuitive user interface is necessary.

  In FIG. 13, there are notebook PCs 301 </ b> A and 301 </ b> B and a TV 302 connected to the wireless LAN base station 310. It is assumed that each device includes the information transmission unit and the information acquisition unit of the present invention. Assume that the user wants to access the TV 302 from the notebook PC 301A. In this case, the notebook PC 301A needs to acquire the ID of the TV 302. Therefore, the ID information is displayed on the information display unit of the TV 302 and is displayed on the display 303 together with the captured image read by the imaging unit of the notebook PC 301A. Here, since the notebook PC 301B also exists in the vicinity, the information is similarly displayed on the display. However, since the ID is displayed together with the image information, the user can easily specify the ID of the TV 302. In a further preferred embodiment, clicking an ID on the image starts wireless LAN communication with the TV 302 as it is. Such an operation is difficult to realize with a conventional authentication method such as RFID because it is difficult to acquire tag position information.

  As described above, according to the above-described embodiment, by reading the two-dimensional color matrix code existing in the imaging range, data within a certain range can be read, that is, directional wireless communication can be performed.

  Further, since the matrix code is displayed on the LED or various displays, the display information can be changed.

  In addition, since the matrix code is configured by color display that can be seen by the human eye, the user can visually confirm the transmission state of the data.

  Further, by associating the color indicated by the matrix code with the information transmitted at that time, the user can visually confirm what kind of data is transmitted.

  In addition, by superimposing the captured image and the read information on the display, the user can visually understand the position of the matrix code transmitting the information in association with the information.

It is the schematic which shows the basic composition of this invention. It is a figure of the structural example of the 3x3 matrix code | cord | chord using single color LED. It is a figure of the example of the 3x3 matrix code comprised as a minimum unit the LED group which combined RGB LED. It is an example which displays a matrix code on a display apparatus. It is the schematic which showed the time-axis change of the information displayed. It is the schematic which uses a part of code | cord | chord as a position detection means. It is the schematic in the case of using infrared LED as a position detection means. It is a flowchart of the process which an information analysis part performs. It is the schematic of the correlation of the color of code | cord | chord, and transmission information. It is the schematic of the superimposition of an image and read information. It is the schematic of the superimposition of an image and reading information, and use of a database. The example provided with the radio | wireless communications system of this invention in the portable terminal. Usage example of superimposing image and reading information. It is explanatory drawing of the conventional radio | wireless communication.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Information transmission means 101 Display control part 102 Information display part 200 Information acquisition means 201 Imaging part 202 Information analysis part

Claims (15)

A two-dimensional matrix code composed of codes in which the minimum structural unit displays a plurality of colors in the visible light range and changes the display color along the time axis;
A wireless communication system using a conversion code for converting digital data into color pattern data of a predetermined time of a matrix code. Display of transmission data comprising an information display unit for displaying the two-dimensional matrix code, and a display control unit for converting digital data into color pattern data at a predetermined time interval according to the conversion code and sending a display command to the information display unit Information transmission means to
Image information that reads the digital data from the information transmitting means by detecting the color pattern of the matrix code by performing image processing on the captured image information and reconverting according to the conversion code The wireless communication system according to claim 1, further comprising an information acquisition unit configured to receive the transmission data configured by an analysis unit.   The wireless communication system according to claim 1, wherein a specific color pattern at a specific position in the matrix code displayed on the information display unit is associated with specific transmission information.   The wireless communication system according to claim 2, wherein the matrix code of the information display unit is arranged in a two-dimensional matrix with a single unit LED or a group of LEDs that can be changed by a combination of a plurality of LEDs as a minimum unit.   The wireless communication system according to claim 2, wherein the matrix code of the information display unit is displayed on a color display system.   The wireless communication system according to claim 1, wherein a period of the color pattern displayed on the image display unit is the same as a time of one frame of the imaging unit.   The wireless communication system according to claim 2, wherein a part of the matrix code is used as a position detecting unit in detecting the information display unit by the information acquiring unit.   The wireless communication system according to claim 2, wherein when the information display unit is detected by the information acquisition unit, an infrared LED is installed in the vicinity of the matrix code and used as a position detection unit.   The information display unit is detected by the position detection unit from the image obtained from the imaging unit, and the color pattern indicated by the information display unit is subjected to image processing for each frame. Wireless communication system.   10. The wireless communication according to claim 9, wherein the image processing method classifies the color of an image for each frame according to a threshold value, accumulates the data as code data of one frame, and repeats the data. system.   The image processing method starts data accumulation after detecting data display start information from a matrix code, stops data accumulation when data display end information is detected, and converts the accumulated data into digital data according to a conversion code. The wireless communication system according to claim 9.   A structure in which a physical shutter is provided in the information display unit and the imaging unit, and reception and transmission can be physically blocked so that unexpected communication is not performed when the user does not want to communicate. The wireless communication system according to claim 2, further comprising:   An image obtained from the imaging unit is associated with digital data converted from a matrix code in the image, and the content of the data is superimposed on the position of the matrix code in the image and displayed on an external display device The wireless communication system according to claim 1, further comprising an image composition unit that performs image composition.   The wireless communication system according to claim 2, further comprising a data reference function for superimposing information held in an ID on an image by referring to an external or internal database when the data acquired by conversion is an ID code.   The wireless communication system according to claim 2, wherein the information transmission unit and the information acquisition unit are attached to the same device and perform bidirectional communication with the same device.

Images