JP5099180B2 - Information decoding apparatus, information decoding method, and program - Google Patents

Description

The present invention relates to an information decoding apparatus, an information decoding method, and a program applied to an information transmission system that transmits and receives information using light as a transmission medium.

  Conventionally, an information transmission system using a visible light communication technique has been devised. For example, a digital camera is used as an information decoding device, and by continuously capturing images of light emitting units present at the angle of view, information is decoded from blinking bright spots emitted by the light emitting units, and on the captured image. A system for displaying a graphic such as a balloon and information at the position of a bright spot has been devised (see, for example, Patent Document).

JP 2003-179556 A

  However, in the above technology, for example, when there are a plurality of bright spots based on the same information in the angle of view, a light emitting unit is displayed in order to display a figure and information such as a balloon corresponding to the position of each bright spot. It is impossible for the receiving side to output a single piece of information to the receiving side terminal in a plane display or the like.

  The present invention has been made in view of such problems, and an object of the present invention is to make it possible to report information with more expressiveness in a technique for transmitting and receiving information using light as a transmission medium.

In order to achieve the above-mentioned object, the invention described in claim 1 is a system that regularly receives light emitted from a plurality of light-emitting devices that exist outside and modulate light by temporally changing light. A light receiving means comprising a plurality of light receiving elements arranged in a dimension, a decoding means for decoding information from changes in light received by the light receiving means, common information included in information decoded by the decoding means, A storage unit that stores a plurality of sets of light receiving positions in the light receiving unit of the light having a temporal change emitted by a plurality of light emitting devices, and whether the storage unit further stores a plurality of boundary line information. First determining means for determining whether or not, and if the first determining means determines that further boundary line information has been stored, a display means for displaying the light receiving positions where these boundary line information is stored so as to be connected by a line and, the Characterized in that it obtain.

According to a second aspect of the present invention, in the first aspect of the present invention, the display unit connects the plurality of light receiving positions where the boundary line information is stored among the light receiving positions with lines, and the boundary line. When there is a light receiving position where no information is stored, information indicating the direction of expansion of the region surrounded by the line is displayed toward the light receiving position where the boundary line information is not stored .

The invention described in claim 3 further comprises second determination means for determining whether or not the storage means stores the order information in addition to the boundary line information in the invention described in claim 1 or 2. The display means displays the light receiving positions in which the boundary line information is stored among the light receiving positions stored in the storage means so as to be connected by a line along the order information .

According to a fourth aspect of the present invention, in the invention according to the third aspect, the display means connects the light receiving position where the boundary line information is stored with a line along the order information. The light receiving positions that are out of order are characterized by displaying information indicating that they are light receiving positions in the same region without being connected by this line .

The invention according to claim 5 is the invention according to any one of claims 1 to 4, wherein the common information includes first display information common to a range surrounded by the boundary line information, and the display The means is characterized in that the light receiving positions where the boundary line information is stored are connected by a line and the first display information is displayed in a range surrounded by the boundary line .

According to a sixth aspect of the present invention, in the invention according to any one of the first to fifth aspects, the storage means is a second display individually set in the plurality of light emitting devices in addition to the common information. And further comprising a third determining means for determining whether or not the information is stored, wherein the display means includes a light receiving position of the stored light receiving position for the light receiving position where the second display information is stored. The second display information is displayed nearby .

In order to achieve the above object, the invention according to claim 7 is a light receiving unit including a plurality of light receiving elements regularly arranged in a two-dimensional array, and exists outside and modulates information into temporal light changes. A light receiving step for continuously receiving light emitted by a plurality of light emitting devices that emit light, a decoding step for decoding information from changes in light received at the light receiving step, and information decoded at the decoding step, respectively. A storage step of storing a plurality of sets of the common information included in the light-receiving portions of the light having the temporal change emitted by the plurality of light-emitting devices in association with each other, and further storing in the storage step If it is determined that a plurality of boundary line information is stored, and if it is determined that the boundary line information is further stored in this determination step, the light receiving position where these boundary line information is stored is represented by a line. Characterized by comprising a display step of displaying the dance, the.

In order to achieve the above-mentioned object, the invention according to claim 8 is characterized in that a computer included in an information decoding apparatus including a light receiving unit including a plurality of light receiving elements regularly arranged in a two-dimensional array is externally provided, and information is temporally transmitted. A light receiving means for continuously receiving light emitted from a plurality of light emitting devices that emit light modulated by a change in light, a decoding means for decoding information from light changes received by the light receiving means, and a decoding means for decoding the information respectively. Storage means for storing a plurality of sets of the common information included in the received information and the light receiving positions of the light receiving portions of the light having the temporal change emitted by the plurality of light emitting devices in association with each other. Further, a judgment means for judging whether or not a plurality of boundary line information is stored, and if this judgment means judges that the boundary line information is further stored, the boundary line information is stored. Characterized in that the functioning of the light position as the display means, for displaying so as to connect a line.

  ADVANTAGE OF THE INVENTION According to this invention, in the technique which transmits / receives information using light as a transmission medium, the alerting | reporting of information with richer expressiveness is attained.

It is a figure which shows the utilization form which concerns on 1st Embodiment. (A) And (b) is a figure which shows the function structure of a light-emitting device, respectively. It is a figure which shows the information stored in an information storage part, and is a figure which shows the data format of the information which a light emission part transmits. It is a figure which shows the conceptual circuit structure of a digital camera. It is a flowchart which shows the processing content of a digital camera. It is a figure which shows the display mode of a display part. It is a figure which shows the arrangement | positioning state of the street lamp (light emission part) in 2nd Embodiment. (A) is the data format of the information which a light emission part transmits, (b) is a figure which shows the content of the information which a light emission part transmits. It is a flowchart which shows the processing content of a digital camera. It is a flowchart which shows the processing content of a digital camera. It is a figure which shows the display mode of a display part. It is a figure which shows the display mode of a display part. It is a figure which shows the display mode of a display part. It is a figure which shows the display mode of a display part. It is a figure which shows the display mode of a display part. It is a figure which shows the display mode of a display part.

(First embodiment)
DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, a first embodiment of the invention will be described with reference to the drawings. It should be noted that the specific details or examples in the following description and the illustrations of numerical values, character strings, and other symbols are only for reference in order to clarify the idea of the present invention, and the present invention may be used in whole or in part. Obviously, the idea of the invention is not limited. In addition, a well-known technique, a well-known procedure, a well-known architecture, a well-known circuit configuration, and the like (hereinafter, “well-known matter”) are not described in detail, but this is also to simplify the description. Not all or part of the matter is intentionally excluded. Such well-known matters are known to those skilled in the art at the time of filing of the present invention, and are naturally included in the following description.

  FIG. 1 is a diagram showing a usage pattern in the present embodiment, which is a simplified representation of a city scene. In the figure, a city is composed of sections 100, 200, 300, and 400 divided by roads 500 and 600. Of these sections, the section 100 includes a park including the baseball field 110, the section 200 includes buildings 210 and 220, and the section 400 includes a building 410. Further, in the distant view 700, there are a building 710 and buildings 720 and 730 simulating the shape of a tower.

  In the section 100, street lamps 120a to 120l provided with light emitting units 121a to 121l are laid so as to surround the park, and a facility 122 for controlling light emission driving of these light emitting units exists. The buildings 210, 220, 410, 720, and 730 are provided with light emitting portions 211, 221, 411, 721, and 731, and the building 710 is also provided with a light emitting portion 711. Reference numeral 800 denotes a digital camera as an information decoding apparatus, and this embodiment describes a case where an operator of the digital camera 800 takes a bird's-eye shot of the city.

  The light emitting units 121a to 121l, 211, 221, 411, 711, 721, and 731 are driven to emit light so that the luminance changes with time in addition to the use for identifying the self position with respect to the lighting or flying object. As a result, it can also be used as an information transmission device in a visible light communication system, but details are described in Japanese Patent Laid-Open No. 2003-179556, and therefore will be omitted.

  FIG. 2A is a diagram illustrating a functional configuration of the light emitting device including the light emitting units 211, 221, 411, 711, 721, and 731. In the figure, the light emitting device includes a light emitting unit 221 (221, 411, 711, 721, and 731), a drive control unit 212, an information modulation unit 213, and an information storage unit 214.

  The light emitting unit 221 (221, 411, 711, 721, and 731) is composed of a light emitting device such as an LED. The information storage unit 214 stores information to be transmitted to the information decoding device. Typically, the name of the building provided with the light emitting unit 221 (221, 411, 711, 721, and 731), the number of floors laid, floor information, and the building or its floor (floor) Display information including commercial elements such as events being held is stored as digital data. The information modulation unit 213 is a circuit unit for encoding and modulating the digital data stored in the information storage unit 214 into information that changes in luminance with time. The coding scheme and the modulation scheme are arbitrary, but 4PPM (Pulse-position modulation) employing a subcarrier with a frequency of 28.8 (kHz) is desirably employed.

  In accordance with the data modulated by the information modulation unit 213, the drive control unit 212 transmits the light emitting units 221 (221, 411, 711, 721, and 731), for example, in a cycle that can be transmitted in a standardized visible light communication system. This is a circuit unit that controls driving so that the luminance changes with time, such as blinking driving. In addition, these circuit parts connected to the light emitting part 221 (221, 411, 711, 721, and 731) are installed in the buildings 210, 220, 410, 720, 730, and the building 710. Is provided.

FIG. 2B is a diagram illustrating a functional configuration of the light emitting device including the light emitting units 121a to 121l. In the figure, the light emitting device includes light emitting units 121a to 121l, drive control units 123a to 123l, an information modulation unit 124, and an information storage unit 125.
The light emitting units 121a to 121l are configured by light emitting devices such as LEDs. The information storage unit 125 stores information to be transmitted to the information decoding device. As shown in FIG. 3 in detail, the information stored in the information storage unit 125 is set in common to the light source unique ID information 901 set individually for the light emitting units 121a to 121l and the light emitting units 121a to 121l. Guidance point ID information 902 and display information 903. In addition, about the display information 903, the name of the facility (a park in this embodiment) of the section surrounded by the streetlights 120a to 120l where the light emitting units 121a to 121l are laid, events being held at the facility, etc. Display information including commercial elements is stored as digital data.

  The information modulation unit 124 is a circuit unit for encoding and modulating the digital data stored in the information storage unit 125 into information that changes in luminance with time. The coding scheme and the modulation scheme are arbitrary, but 4PPM (Pulse-position modulation) employing a subcarrier with a frequency of 28.8 (kHz) is desirably employed. In accordance with the data modulated by the drive control units 123a to 123l and the information modulation unit 124, the light emitting units 121a to 121l are driven to blink in a cycle that can be transmitted in a standardized visible light communication system, for example. Is a circuit unit that controls the drive so as to change. In this functional configuration of the light emitting device, each of the street lights 120a to 120l includes light emitting units 121a to 121l and drive control units 123a to 123l, and the facility 122 includes an information modulation unit 124 and an information storage unit 125. Prepare. Then, by embedding a transmission cable connecting the facility 122 and the streetlights 120a to 120l in the section 100, etc., the illumination control of the light emitting units 121a to 121l, the modulation control, and the synchronization of the light emission timing for information transmission in the facility 122 The control is centrally managed.

  Therefore, even if an event or the like is temporarily held in this section 100, the information transmitted by each of the light emitting units 121a to 121l is controlled only by rewriting the information set in the information storage unit 125 in the facility 122. This makes it easier to manage the information to be transmitted.

  FIG. 3 shows information stored in the information storage unit 125 described above, and is also a data format 900 of information transmitted by the light emitting units 121a to 121l. Each of the light emitting units 121a to 121l emits light while changing the luminance with time, thereby cyclically transmitting the contents of the data format 900 to an external unspecified number of information decoding devices.

  FIG. 4 is a diagram showing a conceptual circuit configuration of the digital camera 800. In the figure, a digital camera 800 includes a lens 801, an imaging unit 802, a buffer 803, a decoding processing unit 804, an image processing unit 805, a control unit 806, a program memory 807, a display unit 808, an operation unit 809, an image recording unit 810, And a bus 811.

The lens 801 includes a zoom lens and a focus lens, and an image picked up by the image pickup unit 802 by inputting a control signal based on a zoom control operation from the operation unit 809 and focus control by the control unit 806. It has a function to control the angle of view and optical image.
The imaging unit 802 is configured by an imaging device such as a CCD or a CMOS as a plurality of light receiving elements regularly arranged in a two-dimensional array, and an optical image received through the lens 801 is converted into a control signal from the control unit 806. Based on the above, the image is picked up (received) with an image angle of view within a predetermined range, and the image signal within the image angle of view is converted into digital data and output to the image processor 805. Further, in the imaging mode described later, the imaging unit 802 continuously captures images within the imaging angle of view in time, and outputs the imaging angle of view as a continuous frame to the image processing unit 805 to obtain a through image. Are displayed on the display unit 808 and the frame is sequentially output to the buffer 803.

  The buffer 803 includes a storage unit and a coordinate data list 8031 serving as a storage unit. The buffer 803 receives a predetermined amount of frames output from the imaging unit 803 based on a control signal from the control unit 806 (specifically, at least the data format 900). The number of pieces of information corresponding to the brightness-changed information transmitted at (1) is temporarily stored. Further, in the case where there is “brightness” by receiving the light of the light emitting units 121a to 121l, 211, 221, 411, 711, 721, and 731 in each of the predetermined amount of frames, in the imaging field angle The light receiving position where this “brightness” exists (specifically, the center coordinate of the imaging range where the “brightness” is received, hereinafter referred to as the bright point coordinate) and the temporal change in luminance between the predetermined amount of frames at this coordinate. For example, the mode is stored in the coordinate data list 8031 as a bit data string of lighting = “1” / extinguishing = “0” and updated.

The decoding processing unit 804 has a function of decoding the luminance change mode stored in the coordinate data list 8031 into digital data information based on a control signal from the control unit 806.
Based on the control signal from the control unit 806, the image processing unit 805 adjusts the image quality and image size so that the frame (digital data) output from the imaging unit 802 is displayed on the display unit 808 as a through image. In addition, when a control signal based on a recording instruction operation is input from the operation unit 809, the optical within the imaging field angle (or within the display range displayed on the display unit 808) of the imaging unit 802 at the time when the recording instruction is given. For example, the image has a function of encoding and file- ing with a compression encoding method such as JPEG.

The control unit 806 has a function of controlling the entire digital camera based on a program stored in the program memory 807.
The program memory 807 stores the operation of the digital camera 800 according to the present embodiment as a program. For example, when an operation such as power-on is detected in the operation unit 809, the control unit 806 reads and loads the program. Execute the process.
The display unit 808 includes, for example, a display element such as a liquid crystal device and a driver that drives the display element. The display unit 808 displays a through image output from the image processing unit 805 and displays information decoded by the decoding processing unit 804. In association with the bright spot coordinates from which this information has been read, the information has a function of superimposing and displaying the above-described through image.

The operation unit 809 includes a shutter key for detecting a recording instruction, a zoom key for operating the zoom lens of the lens 801, and the like.
The image recording unit 810 stores the optical image filed by the image processing unit 805 and the information decoded by the decoding processing unit 804.

  Next, processing contents of the control unit 806 of the digital camera 800 of this embodiment will be described with reference to the flowchart of FIG.

First, at the start, when the digital camera 800 is set to the shooting mode, the control unit 806 causes the imaging unit 802 to continuously capture images within the imaging angle of view in time, and sets the imaging angle of view as a continuous frame. The image processing unit 805 outputs the image, and the display unit 808 sequentially displays and updates the through image corresponding to the frame. The frames are sequentially output to the buffer 803 and accumulated (step S1).
When accumulation of frames in the buffer 803 is started in step S1, the buffer 803 stores a predetermined amount of frames (specifically, at least the number of frames corresponding to the information whose luminance has been changed transmitted in the data format 900). Is stored (step S2). If it is determined that a predetermined amount of frames has been accumulated, the process proceeds to step S3. If it is determined that frames have not been accumulated, the process returns to step S1.

  If it is determined in step S2 that the buffer 803 has accumulated a predetermined amount of frames, a coordinate data list 8031 is generated (step S3). Specifically, the bright spot coordinates by the light of the light emitting units 121a to 121l, 211, 221, 411, 711, 721, and 731 are obtained for each of the predetermined amount of frames, and between the predetermined amount of frames at the coordinates. Is generated as a bit data string of lighting = “1” / extinguishing = “0”, for example, and a coordinate data list 8031 associated with the bright spot coordinates is generated.

  When the coordinate data list 8031 is generated in step S3, the decoding processing unit 804 reads out the luminance change mode for each bright spot coordinate from the coordinate data list 8031 and decodes it into information (step S4). Then, in the decoded information, it is determined whether or not there are a plurality of bright spot coordinates having the same guide point ID information 902 transmitted in the data format 900 shown in FIG. 3 (step S5).

  If it is determined that there are a plurality of bright spot coordinates having the same guide point ID information 902 (step S5 → Yes), the distribution state of the plurality of bright spot coordinates having the same guide point ID information 902 is analyzed (step S6). ), The circumscribed polygons having these as vertices are drawn so as to be superimposed on the through image (step S7). Then, the inside of the drawn circumscribed polygon is hatched with a specific color that is translucent (step S8), and the decoded information (display information 903) is controlled to be superimposed and displayed at the center of the hatched area (step S8). S9).

On the other hand, when it is determined that there are not a plurality of bright spot coordinates having the same guide point ID information (step S5 → No), it is determined that information independent from the bright spot coordinates is transmitted, and the information is ballooned. Is combined with an image imitating the shape of the image and controlled to be superimposed and displayed on the corresponding bright spot coordinates of the through image output from the image processing unit 805 (step S10).
After the display control in steps S9 and S10, it is determined whether or not the exit from the shooting mode is detected by detecting any operation on the operation unit 809 (step S11), and the exit from the shooting mode is determined. If it is determined that the image capturing mode has been detected, the process is terminated (step S11 → No). If it is determined that exit from the shooting mode is detected (step S11 → Yes), the process returns to step S1.

FIG. 6 is a diagram showing a display mode of the display unit 808 in step S9 of FIG.
This figure shows a state in which the “state where the city is viewed from above” shown in FIG. 1 is displayed on the display unit 808. The bright spot coordinates obtained by imaging the light emission of the light emitting unit 211 in FIG. In addition, the balloon 215 is combined with “A building” which is the name of the display building as decoded display information, and is superimposed on the through image. In addition, a balloon 222 is synthesized with the bright spot coordinates obtained by imaging the light emission of the light emitting unit 221 in FIG. 1, and the balloon name “B building” which is the description of the building name and floor is displayed as decoded display information in the balloon 222. “3F Showroom” is synthesized and superimposed on the through image. Further, a balloon 412 is synthesized with the bright spot coordinates obtained by imaging the light emission of the light emitting unit 411 in FIG. 1, and further, the balloon name 412 is a description of the building name and tenant as decoded display information in the balloon 412. The “view restaurant” is synthesized and superimposed on the through image.

  Further, a balloon 712 is combined with the bright spot coordinates obtained by imaging the light emission of the light emitting unit 711 in FIG. 1, and the balloon name 712 is a description of the name and event of this building as decoded display information. "Tower XX" is synthesized and superimposed on the through image. Further, a balloon 722 is synthesized with the bright spot coordinates obtained by imaging the light emission of the light emitting unit 721 in FIG. 1, and the balloon name 722 is a description of the building name and tenant as decoded display information in the balloon 722. “Restaurant **” is synthesized and superimposed on the through image. Also, a balloon 732 is combined with the bright spot coordinates obtained by imaging the light emission of the light emitting unit 731 in FIG. 1, and the balloon name 732 is an explanation of the name and event of this building as decoded display information. The event ## ”is synthesized and superimposed on the through image.

  On the other hand, since a plurality of bright spot coordinates obtained by imaging the light emission of the light emitting units 121a to 121l in FIG. 1 are set with guide point ID information common to the information decoded from each, the light emitting units 121a to 121l are set. As the display information 903, the circumscribed polygon 126 having the vertex corresponding to the bright spot coordinates corresponding to is drawn, and the inside of the circumscribed polygon is hatched with a semitransparent specific color and decoded at the center of the hatched area. The display content 127, which is the name of the facility in the section 100, that is, “◯ × Comprehensive park” is synthesized and superimposed on the through image.

Thus, the content notified by the light emission accompanied by the temporal luminance change of the light emitting units 121a to 121l is due to the hatched surface, and the light emission by the light emitting units 211, 221 411, 711, 721, 731 is performed. It can be distinguished from the content to be notified.
Therefore, according to the first embodiment, it is possible to display information with a single piece of information on the information decoding apparatus, and it is possible to notify information with more expressive power.

(Second Embodiment)
In the first embodiment, information is displayed on the surface when all of the light emitting units 121a to 121l are within the imaging angle of view. However, the operator actually operates the digital camera 800 to perform imaging. When the operator performs an optical zoom operation, points the main body of the digital camera 800 in another direction, or an obstacle enters between the digital camera 800 and a landscape that falls within the imaging angle of view, etc. There is a case where all of 121a to 121l cannot be accommodated in the imaging angle of view.
In the second embodiment, an improvement method considering the above case will be described in detail. In the second embodiment, components having the same functional configuration are denoted by the same reference numerals, and description thereof is omitted.

  FIG. 7 is a diagram illustrating an arrangement state of street lamps (light emitting units) in the present embodiment, and street lamps 120m to 120t provided with light emitting units 121m to 121t are laid in a specific range. These street lights 120m to 120t are provided with a facility 122 as in the first embodiment, and the lighting control, modulation control, and synchronization control of light emission timing for information transmission are centrally managed by this facility. Yes.

  FIG. 8A shows a data format 910 of information transmitted by the light emitting units 121m to 121t. This data format is in addition to “display information 1” 916 and “display information 2” 917 corresponding to the light source unique ID information 911, the guide point ID information 912, and the display information 903 described in detail in the first embodiment. , Boundary line flag 913, boundary point number information 914, and total boundary number information 915 are set.

  FIG. 8B shows the contents of information transmitted by the light emitting units 121m to 121t emitting light while changing in luminance with time. In the figure, for example, the light emitting unit 121m has “01” as the light source unique ID information 911, “123” as the guidance point ID information 912, “1” as the boundary line flag 913, “1” as the boundary point number information 914, “6” as total boundary number information 915, facility information “xx park” existing in this specific range as “display information 1” 916, and spot near street lamp 120 m having this light emitting part 121 m as “display information 2” 917 Information "near the intersection of XX" is set.

  8A and 8B, the boundary line flag 913 is based on whether or not the point where the light emitting unit (streetlight) is installed is on the outer periphery of the specific range. “1” or “0” is set. For example, in FIG. 7, street lamps 120m, 120n, 120o, 120t, 120s, and 120p having light emitting portions 121m, 121n, 121o, 121t, 121s, and 121p are laid on the outer periphery of this specific range. Therefore, the boundary flag 913 is set to “1”, but the street lamps 120q and 120r having the light-emitting portions 121q and 121r are laid inside this specific range, “0” is set in the line flag 913.

  The boundary point number information 914 is set with a number (number) that is ordered according to a predetermined rule in the light emitting unit in which “1” is set in the boundary line flag 913. For example, in the present embodiment, numbers are sequentially assigned clockwise. For example, in FIG. 7, street lamps 120m, 120n, 120o, 120t, 120s, and 120p having light emitting units 121m, 121n, 121o, 121t, 121s, and 121p are set with numbers 1 to 6 clockwise. . It should be noted that “0” or “null” code is attached to the light emitting unit in which “0” is set in the boundary flag 913. The total boundary number information 915 indicates the total number of light emitting units laid in this specific range and having the boundary line flag 913 set to “1”.

Next, processing contents of the control unit 806 of the digital camera 800 of this embodiment will be described with reference to the flowcharts of FIGS. 9 and 10.
First, when it is determined in step 5 that there are a plurality of bright spot coordinates having the same guide point ID information (step S5 → Yes), the total included in the decoded information of the plurality of bright spot coordinates is included. It is determined whether or not there are as many bright spot coordinates as the number set in the boundary number information 915 (step S61). If it is determined that there are as many bright spot coordinates as the number set in the total boundary number information 915 (step S61 → Yes), each base point coordinate is connected in the order of the numbers set in the boundary point number information 914 to set a circumscribed polygon. (Step S62), the process proceeds to Step S7 in FIG.

On the other hand, if it is determined that there are no bright spot coordinates as many as the number set in the total boundary number information 915 (step S61 → No), the boundary point number information 914 of each piece of information decoded from the plurality of bright spot coordinates is referred to, and the boundary It is determined whether or not there is a bright spot coordinate corresponding to information having the point number “1” and the boundary point number having the same value as the number set in the total boundary number information 915 (step S63).
When it is determined that there is a bright point coordinate corresponding to information having the boundary point number “1” and the boundary point number having the same value as the number set in the total boundary number information 915 (step S63 → Yes), A definite boundary line connecting these bright spot coordinates is set (step S64), and the boundary point number information 914 in each piece of information decoded from a plurality of bright spot coordinates is referred again, and the boundary point number continues to the information. It is determined whether or not the corresponding bright spot coordinates exist (step S65).

  If it is determined that there is a bright spot coordinate corresponding to the information with the boundary point number (step S65 → Yes), a definite boundary line connecting these bright spot coordinates is set (step S66), and set in step S64. A hatching area having a specific pattern is set between the determined boundary line and the determined boundary line set in step S66 (step S67). Then, “display information 2” 917 is set for the set definite boundary lines and the bright spot coordinates located at the ends of these definite boundary lines, and “display information 1” 916 is set for the hatched area and the center of the hatched area. Control is performed so as to superimpose and display on the through image (step S68), and the process proceeds to step S11.

FIG. 11 is a diagram showing a display mode of the display unit 808 in step S68.
The figure shows a state where the “street lamp (light emitting unit) arrangement state” shown in FIG. 7 is displayed on the display unit 808, that is, a bright spot by the light emitting units 121m, 121o, 121p, and 121t within the imaging angle of view. In FIG. 8B, the bright spot coordinates and the number set in the total boundary number information 915 by the light emitting unit 121m that transmits the boundary point number “1”, that is, “6” is shown. A definite boundary line 128 that connects the bright spot coordinates by the light emitting unit 121p that transmits the boundary point number having the same value as “” is set.
On the other hand, in FIG. 8B, the light emitting unit that transmits the information having the boundary point number is transmitted to the light emitting unit 121o that transmits the boundary point number “3” and the light emitting unit 121t that transmits the boundary point number “4”. Therefore, a definite boundary line 128 that connects these bright spot coordinates is set.

  In addition, a hatching area 129 having a specific pattern is set between these fixed boundary lines 128. At the center of the hatching area, the display content 127 as “display information 1” 916, that is, “XX park” is displayed. Further, the bright spot coordinates by the light emitting units 121m, 121o, 121p, and 121t include “display information 2” 917 “near the intersection of ○○” balloon display 130m and “xx near the intersection” balloon display 130o. , A balloon display 130p for “center entrance” and a balloon display 130t for “south exit” are superimposed on each other.

  Therefore, even if information cannot be received from all the light emitting units existing in the range, the operator can display information such as the approximate size of the range and the name, and the vicinity of each light emitting unit. Display information can be grasped.

On the other hand, if it is determined in step S65 that there is no bright spot coordinate corresponding to the information with the boundary point number (step S65 → No), the boundary line flag 913 in each piece of information decoded from a plurality of bright spot coordinates is set. With reference to this, it is determined whether or not there is a bright spot coordinate corresponding to information for which “0” is set in the boundary line flag 913 (step S71).
When it is determined that there is a bright spot coordinate corresponding to information for which “0” is set in the boundary line flag 913 (step S71 → Yes), it corresponds to information in which “0” is set in the boundary line flag. A hatching area having a specific shape, specifically a specific pattern imitating an arrow, is set in the direction in which the bright spot coordinates exist (step S72). Then, “display information 2” 917 is superimposed and displayed on the through image on the coordinates of the bright spot located at the end of the set definite boundary line, and “display information 1” 916 is centered on the hatched area and the hatched area. (Step S68), and the process proceeds to step S11.

FIG. 12 is a diagram showing a display mode of the display unit 808 when the process of step S68 is performed via step S72.
This figure shows a state in which the “arrangement state of street lamps (light emitting units)” shown in FIG. In FIG. 8B, the bright spot coordinates by the light emitting unit 121m that transmits the boundary point number “1” and the number set in the total boundary number information 915, that is, “6” are shown. A definite boundary line 128 that connects the bright spot coordinates by the light emitting unit 121p that transmits the boundary point number of the same value is set.

On the other hand, the light-emitting unit that transmits information in which “0” is set in the boundary flag 913 is the light-emitting unit 121q in FIG. 8B, and thus is directed in the direction in which the bright spot coordinates by the light-emitting unit 121q exist. A hatching area 131 having a specific pattern imitating an arrow is set.
Further, in the center of the hatching area 131, the display content 127 as “display information 1” 916, that is, “xx park”, and the bright spot coordinates by the light emitting units 121m, 121p, 121q include “display information”. A balloon display 130m of “2” 917 “near the intersection”, a balloon display 130p of “center entrance”, and a balloon display 130q of “fountain” are respectively superimposed.

  Therefore, even if the information cannot be received from all the light emitting units existing in the range, if the information from the light emitting unit existing in the inner area of the range can be received, the operator It is possible to grasp display information such as the direction of spread and name, and display information near each light emitting unit.

  In step S71, if there is no bright spot coordinate corresponding to information for which “0” is set in the boundary flag 913, that is, there is a bright spot coordinate in which “1” is set in the boundary flag 913. When the determination is made (step S71 → No), a hatching area of a specific pattern is set in accordance with a preset analysis method (step S73), and “display information” is displayed on the bright spot coordinates positioned at the end of the set definite boundary line. 2 ”917 is controlled so that“ display information 1 ”916 is superimposed and displayed on the through image in the hatched area and the center of the hatched area (step S68), and the process proceeds to step S11.

The “preliminary analysis method” processed in step S73 is specifically as follows.
When the definite boundary line connecting the bright spot coordinates that transmit the boundary point number information having the same value as the total boundary number information and the bright spot coordinates that transmit the boundary point number information “1” is set, the total boundary number information The hatching area is to be set on the right side in the direction from the bright spot coordinates for transmitting the boundary point number information having the same value to the bright spot coordinates for transmitting the boundary point number information “1”.
When there are at least two bright spot coordinates and the boundary point number information number sequentially follows information corresponding to these bright spot coordinates, the smaller bright spot coordinates go to the larger bright spot coordinates. The right side of the direction is the range where the hatching area should be set.

  Therefore, even if information cannot be received from all the light emitting units existing in the range, if the information can be received from a part of the light emitting units on the outer periphery of the range, the operator can change the range. Display information such as the direction of spread and name, and display information in the vicinity of each light emitting unit can be grasped.

If it is determined in step S63 that there is no bright spot coordinate corresponding to the information having the boundary point number “1” and the boundary point number having the same value as the number set in the total boundary number information 915 (step S63). S63 → No), similarly to step S65 described above, it is determined whether there is a bright spot coordinate corresponding to the information with the boundary point number (step S69).
If it is determined that there is a bright spot coordinate corresponding to the information with the boundary point number (step S69 → Yes), a fixed boundary line connecting these bright spot coordinates is set (step S70). Referring to the boundary flag 913 in each piece of information decoded from the bright spot coordinates, it is determined whether or not there is a bright spot coordinate corresponding to the information for which “0” is set in the boundary line flag 913 (step). S71).

  When it is determined that there is a bright spot coordinate corresponding to information for which “0” is set in the boundary line flag 913 (step S71 → Yes), it corresponds to information in which “0” is set in the boundary line flag. A hatching area having a specific shape, specifically a specific pattern imitating an arrow, is set in the direction in which the bright spot coordinates exist (step S72). Then, “display information 2” 917 is superimposed and displayed on the through image on the coordinates of the bright spot located at the end of the set definite boundary line, and “display information 1” 916 is centered on the hatched area and the hatched area. (Step S68), and the process proceeds to step S11.

  Therefore, even if the information cannot be received from all the light emitting units existing in the range, if the information from the light emitting unit existing in the inner area of the range can be received, the operator It is possible to grasp display information such as the direction of spread and name, and display information near each light emitting unit.

  On the other hand, if it is determined in step S71 that there is no bright spot coordinate corresponding to the information for which the boundary flag 913 is set to “0” (step S71 → No), a specific analysis is performed according to the above-described preset analysis method. A hatching area of the pattern is set (step S73), “display information 2” 917 is set to the bright spot coordinates located at the end of the set definite boundary line, and “display information 1” is set to the hatching area and the center of the hatching area. "916" is controlled to be superimposed on the through image (step S68), and the process proceeds to step S11.

FIG. 12 is a diagram showing a display mode of the display unit 808 when the process of step S68 is performed via step S69 (Yes) → step S70 → step S71 (No) → step S73.
This figure shows a state in which the “street lamp (light emitting unit) arrangement state” shown in FIG. 7 is displayed on the display unit 808, that is, only the bright spots by the light emitting units 121 n, 121 o, and 121 t within the imaging angle of view. In FIG. 8B, the bright spot coordinates by the light emitting unit 121n that transmits the boundary point number “2” and “3” next to the boundary point number “2” are transmitted. A definite boundary line 128 that connects the bright spot coordinates by the light emitting unit 121o is set. Further, a definite boundary line 128 that connects the bright spot coordinates by the light emitting unit 121o that transmits the boundary point number “3” and the bright spot coordinates by the light emitting unit 121t that transmits “4” next to the boundary point number “3”. Is set.

Then, the right side of the direction in which the boundary point number of the definite boundary line is “2” → “3” → “4” is the setting range of the hatching area, and inside the triangles that apex the light emitting parts 121n, 121o, and 121t A hatching area 132 is set.
Further, in the center of the hatching area 132, the display content 127 as “display information 1” 916, that is, “xx park”, and the bright spot coordinates by the light emitting units 121n, 121o, 121t include “display information”. The balloon display 130n of “North Exit” that is “2” 917, the balloon display 130o of “near the intersection”, and the balloon display 130t of “South Exit” are superimposed and displayed.

  Therefore, even if information cannot be received from all the light emitting units existing in the range, if the information can be received from a part of the light emitting units on the outer periphery of the range, the operator can change the range. Display information such as the direction of spread and name, and display information in the vicinity of each light emitting unit can be grasped.

On the other hand, if it is determined in step S69 that there is no bright spot coordinate corresponding to the information followed by the boundary point number (step S69 → No), it is determined whether or not there is only one bright spot coordinate within the shooting angle of view. (Step S74).
If it is determined that only one exists (step S74 → Yes), it is determined whether or not “0” is set in the boundary flag 913 in the information transmitted from the bright spot coordinates (step S75). When it is determined that “0” is set in the boundary flag 913 (step S75 → Yes), a hatching area having a specific pattern centered on the bright spot coordinates is set (step S76), and the center of the hatching area is set. Then, “display information 1” 916 and “display information 2” 917 are controlled to be superimposed on the through image on the bright spot coordinates (step S77), and the process proceeds to step S11.

FIG. 14A is a diagram illustrating a display mode of the display unit 808 when the process of step S77 is performed.
This figure shows a state where the “street lamp (light emitting unit) arrangement state” shown in FIG. 7 is displayed on the display unit 808, that is, a case where only a bright spot by the light emitting unit 121r is included in the imaging angle of view. In FIG. 8B, since the light emitting unit 121r transmits information in which “0” is set in the boundary flag 913, hatching of a specific pattern centering on the bright spot coordinates by the light emitting unit 121r. An area 133 is set.
Further, in the center of the hatching area 131, the display content 127 as “display information 1” 916, that is, “XX park”, and the bright spot coordinates by the light emitting unit 121r are “display information 2” 917. A balloon display 130r for a certain “stage” is superimposed and displayed.

  Therefore, even if information cannot be received from all the light emitting units existing in the range, if the information can be received only from the light emitting units existing in the inner area of the range, the operator can change the range. Is not only information on coordinate points but a range with a certain extent, and display information such as the name of the range and display information in the vicinity of the light emitting unit can be recognized.

  On the other hand, if it is determined in step S75 that “0” is not set in the boundary flag 913, that is, “1” is set in the boundary flag 913 (step S75 → No), this bright spot coordinate A specific definite boundary line is set centering on (step S78), and control is performed so that “display information 1” 916 and “display information 2” 917 are superimposed on the through image on the bright spot coordinates (step S78). S79), the process proceeds to step S11.

FIG. 14B is a diagram showing a display mode of the display unit 808 when the process of step S79 is performed.
The figure shows a state in which the “street lamp (light emitting unit) arrangement state” shown in FIG. 7 is displayed on the display unit 808, that is, a case where only the bright spot by the light emitting unit 121n is included in the imaging field angle. In FIG. 8B, since the light emitting unit 121n transmits information in which “1” is set in the boundary flag 913, the specific cross of the cross is centered on the bright spot coordinates by the light emitting unit 121n. A definite boundary line 134 is set.
In addition, a balloon display 130n is superimposed and displayed on the bright spot coordinates, “XX park” as “display information 1” 916 and “north exit” as “display information 2” 917, respectively.

  Therefore, even if the information cannot be received from all the light emitting units existing in the range, if the information can be received only from the light emitting units existing in the outer periphery of the range, the operator can obtain the bright spot. It is possible to grasp that the point indicated by the coordinates is the outer periphery of a range that has a certain extent, and it is possible to grasp the display information such as the name of the range surrounded by the outer periphery, and the display information near the light emitting unit it can.

  On the other hand, when it is determined in step S74 that only one bright spot coordinate does not exist within the shooting angle of view, that is, there are a plurality of bright spot coordinates (step S74 → No), in the information transmitted from these bright spot coordinates, the boundary line It is determined whether or not “0” is set in the flag 913 (step S80). When it is determined that “0” is set in the boundary flag 913 (step S80 → Yes), a hatching area of a specific pattern including these bright spot coordinates is set (step S81), and the process proceeds to step S77.

FIG. 15 is a diagram showing a display mode of the display unit 808 when the process of step S77 via step S81 is performed.
This figure shows a state in which the “arrangement state of street lamps (light emitting units)” shown in FIG. 7 is displayed on the display unit 808, that is, a bright spot by the light emitting unit 121q and a bright spot by the light emitting unit 121r within the imaging field angle. In FIG. 8B, since the light emitting units 121q and 121r both transmit information in which “0” is set in the boundary flag 913, the light emitting units 121q and 121r A hatching area 133 having a specific pattern including the bright spot coordinates is set.
Further, in the center of the hatching area 131, the display content 127 as “display information 1” 916, that is, “xx park” is displayed, and the bright spot coordinates by the light emitting unit 121q are displayed as “display information 2” 917. A balloon display 130r for a certain “fountain” and a bright spot coordinate by the light emitting unit 121r are superimposed with a balloon display 130r for “stage” as “display information 2” 917, respectively.

  Therefore, even if information cannot be received from all the light emitting units existing in the range, if the information can be received from a plurality of light emitting units existing in the inner area of the range, the operator can It is possible to grasp that the light emitting parts are not independent from each other and are included in a common range, and it is possible to grasp display information such as the name of the common range and display information near the light emitting part. .

  On the other hand, if it is determined in step S78 that “0” is not set in the boundary line flag 913, that is, “1” is set (step S80 → No), the brightness of these bright spot coordinates is determined. A specific definite boundary line centered on the point coordinates is set (step S82), and control is performed so that “display information 1” 916 and “display information 2” 917 are superimposed on the through image on the respective bright spot coordinates. (Step S83), the process proceeds to Step S11.

FIG. 16 is a diagram showing a display mode of the display unit 808 in step S83.
The figure shows a state in which the “street lamp (light emitting unit) arrangement state” shown in FIG. 7 is displayed on the display unit 808, that is, a bright spot by the light emitting unit 121m and a bright spot by the light emitting unit 121t within the imaging angle of view. In FIG. 8B, since the light emitting units 121m and 121t both transmit information in which “1” is set in the boundary flag 913, the respective bright spot coordinates are shown. A specific definite boundary line 134 of the cross is set around the center.
In addition, in the bright spot coordinates corresponding to the light emitting unit 121m, “display park 1” 916 “XX park” and “display information 2” 917 “near the intersection of ○○” are superimposed on the balloon display 1301m. In the bright spot coordinates corresponding to the light emitting section 121t, “display park 1” 916 “xx park” and “display information 2” 917 “south exit” are superimposed on the balloon display 1301t. ing.

Therefore, even when information cannot be received from all the light emitting units existing in the range, if the information can be received from a plurality of light emitting units existing in the outer periphery of the range, the operator can emit the light from those units. It is possible to grasp that the parts are not independent from each other and are included in a common range, and it is possible to grasp display information such as the name of the common range and display information in the vicinity of the light emitting part.
As described above, according to the second embodiment, even when information cannot be received from all the light emitting units within the range, the range is expanded or expanded, or included in a common range. And display information such as the name of the range, and display information in the vicinity of the light emitting unit.

In the second embodiment, by setting the boundary line flag 913 in the information to be transmitted, the light emitting unit exists on the outer periphery of a specific range, or within the specific range. However, without setting the boundary line flag 913, whether or not the light emitting unit is determined by whether or not “0 (or“ null ”code)” is set in the boundary point number information 914 is set. You may make it prescribe | regulate whether it exists in the outer periphery of a specific range, or exists in the inside of the specific range.
By doing so, it is possible to reduce the information to be transmitted by the light emitting unit and reduce the burden on the information decoding process.

  In the present embodiment, the case where the city where the light emitting unit (light emitting device) for transmitting information is laid down is photographed is described, but the present invention is not limited to this. This is effective for transmission / decoding display of information having a certain degree of spread, such as expression by displaying an object.

120a to 120t Street lamps 121a to 121t Light emission units 123a to 123l Drive control unit 124 Information modulation unit 125 Information storage unit 126 circumscribed polygon 127 Display content 128, 134 Fixed boundary line 129, 131-133 Hatching regions 130m to 130r, 130t 800 Digital camera 802 Image capturing unit 803 Buffer 804 Decoding processing unit 805 Image processing unit 806 Control unit 807 Program memory 808 Display unit 900, 910 Data format 901, 911 Light source unique ID information 902, 912 Guide point ID information 903 Display information 913 Boundary line Flag 914 Boundary point number information 915 Total boundary number information 916 Display information 1
917 Display information 2
1301m, 1301t Balloon display 8031 Coordinate data list

Claims (8)

A light receiving means composed of a plurality of regularly arranged two-dimensional light receiving elements that continuously receive light emitted by a plurality of light emitting devices that exist outside and modulate information into temporal light changes;
Decoding means for respectively decoding information from changes in light received by the light receiving means;
A memory for storing a plurality of sets of the common information included in the information decoded by the decoding means and the light receiving positions in the light receiving means of the light having the temporal change emitted by the plurality of light emitting devices in association with each other. Means,
First determining means for determining whether or not the storage means further stores a plurality of boundary line information;
When it is determined that the boundary line information is further stored by the first determination unit, the display unit displays the light receiving positions where the boundary line information is stored so as to be connected by a line;
An information decoding apparatus comprising: The display means connects a plurality of light receiving positions where the boundary line information is stored among the light receiving positions with lines, and if there is a light receiving position where the boundary information is not stored, an area surrounded by the lines 2. The information decoding apparatus according to claim 1, wherein information indicating a direction of spread of the image is displayed toward a light receiving position where the boundary line information is not stored. The storage means further comprises second determination means for determining whether or not the order information is stored in addition to the boundary line information;
The display means displays the light receiving positions where the boundary line information is stored among the light receiving positions stored by the storage means so as to be connected by a line along the order information. 2. The information decoding device according to 2 . The display means connects the light receiving positions in which the boundary line information is stored with a line along the order information, and the light receiving positions that are out of order in the order information are not connected with the line, and both are the same. 4. The information decoding apparatus according to claim 3, wherein information indicating a light receiving position of the area is displayed . The common information includes first display information common to a range surrounded by the boundary line information,
5. The display unit connects the light receiving positions where the boundary line information is stored with a line, and displays the first display information in a range surrounded by the boundary line. An information decoding device according to any one of the above . The storage means further comprises third determination means for determining whether or not the second display information individually set for the plurality of light emitting devices is stored in addition to the common information.
The display means displays the second display information in the vicinity of the light receiving position of the stored light receiving position for the light receiving position in which the second display information is stored. The information decoding device according to any one of 1 to 5 . A light receiving unit including a plurality of light receiving elements regularly arranged in a two-dimensional array continuously receives light emitted from a plurality of light emitting devices that exist outside and modulate information into temporal changes in light. A light receiving step;
A decoding step for respectively decoding information from changes in the light received in the light receiving step;
A plurality of sets of common information included in the information decoded in the decoding step and a light receiving position in the light receiving unit of the light having the temporal change emitted by the plurality of light emitting devices are stored in association with each other. A memory step;
A determination step of determining whether or not a plurality of boundary line information is stored in the storage step;
If it is determined that the boundary line information is further stored in this determination step, a display step for displaying the light receiving positions where the boundary line information is stored so as to be connected by a line;
An information decoding method comprising: A computer provided in an information decoding device including a light receiving unit including a plurality of light receiving elements regularly arranged two-dimensionally,
A light receiving means for continuously receiving light emitted by a plurality of light emitting devices that exist outside and modulate light by temporal change in light;
Decoding means for decoding information from changes in light received by the light receiving means,
A storage for storing a plurality of sets of common information included in the information decoded by the decoding unit and a plurality of sets of light receiving positions of the light having a temporal change emitted from the plurality of light emitting devices in association with each other. means,
Determination means for determining whether or not a plurality of boundary line information is further stored by the storage means;
When it is determined that the boundary line information is further stored by the determination unit, the display unit displays the light receiving positions where the boundary line information is stored so as to be connected by lines.
A program characterized by functioning as

Images