JP7024186B2 - Display devices, information processing systems, information processing methods and programs - Google Patents

Description

The present invention relates to a display device, an information processing system, an information processing method and a program.

Conventionally, a light emitting device superimposes information on a blinking pattern of light to emit light, and a light receiving device receives a blinking pattern of light from a light emitting device to acquire information superimposed on the blinking pattern of light. A technique for transmitting information using light as a communication medium is known (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2016-143960

However, in the above-mentioned conventional technique, even if the blinking pattern of the light from the light emitting device is received as it is and displayed and output, the user who is a viewer can only recognize the blinking pattern, so that the information indicated by the blinking pattern can be obtained. There was a problem that it was not easy to know what to show.

The present invention has been made in view of such problems, and an object of the present invention is to facilitate understanding of information indicated by a light change pattern.

In order to achieve the above object, the display device according to the present invention is
Shooting means and
A display means for displaying an image taken by the shooting means, and a display means.
An information acquisition means for acquiring information indicating a state of a light emitting device that emits a predetermined light from an image of a predetermined light included in an image captured by the photographing means.
A display control means for controlling the display means so that an image of the color determined according to the state of the light emitting device corresponding to the information indicating the state of the light emitting device is synthesized and displayed on the image taken by the shooting means. When,
It is characterized by having.

According to the present invention, it becomes possible to easily understand the information indicated by the change pattern of light.

It is a figure which shows an example of the visible light communication system which concerns on embodiment of this invention. It is a figure which shows an example of the configuration of the monitored apparatus which concerns on the same embodiment. It is a figure which shows an example of the configuration of the server which concerns on the same embodiment. It is a flowchart which shows an example of the operation of the reception area image acquisition processing by the server which concerns on the same embodiment. It is a figure which shows an example of the reception area image information which concerns on the same embodiment. It is a flowchart which shows an example of the operation of the reception area image composition processing by the server which concerns on the same embodiment. It is a figure which shows an example of the correspondence relation of the apparatus state, the optical ID, and the color of a reception area image which concerns on the same embodiment. It is a figure which shows the 1st example of the synthetic image which concerns on the same embodiment. It is a figure which shows the 2nd example of the synthetic image which concerns on the same embodiment.

Hereinafter, a visible light communication system as an information processing system according to an embodiment of the present invention will be described with reference to the drawings.

FIG. 1 is a diagram showing a configuration of a visible light communication system. As shown in FIG. 1, the visible light communication system 1 is appropriately referred to as "monitoring target device 100" when the monitoring target devices 100a, 100b, 100c (hereinafter, each of the monitoring target devices 100a, 100b, 100c is not limited. ) And the server 200 are included. The monitored device 100a includes an LED (Light Emitting Diode) 102a, the monitored device 100b includes an LED 102b, and the monitored device 100c includes an LED 102c (hereinafter, when each of the LEDs 102a, 102b, 102c is not limited). Is appropriately referred to as "LED 102"). The server 200 includes a shooting unit 201. The monitored device 100 corresponds to a light emitting device, and the server 200 corresponds to a light receiving device.

In the present embodiment, the LED 102 in the monitored device 100 transmits information by emitting light corresponding to the information to be transmitted. On the other hand, in the server 200, the photographing unit 201 in the server 200 takes an image and acquires the information of the transmission target from the image of the light included in the image obtained by the image.

FIG. 2 is a diagram showing an example of the configuration of the monitored device 100. As shown in FIG. 2, the monitored device 100 includes an LED 102, a control unit 103, a memory 104, a communication unit 108, and a drive unit 112.

The control unit 103 is configured by, for example, a CPU (Central Processing Unit). The control unit 103 controls various functions included in the monitored device 100 by executing software processing according to a program stored in the memory 104 (for example, a program for realizing the operation of the monitored device 100).

The memory 104 is, for example, a RAM (Random Access Memory) or a ROM (Read Only Memory). The memory 104 stores various information (programs and the like) used for control and the like in the monitored device 100. The communication unit 108 is, for example, a LAN (Local Area Network) card. The communication unit 108 communicates with another communication device.

The control unit 103 includes a light emission control unit 126. The light emission control unit 126 recognizes the state (device state) of the monitored device 100, and determines the optical ID (Identifisation) according to the device state. Here, the device state is indicated by blue (B), yellow (Y), and red (R) for each state of operation, lack of members, and abnormal stop. Further, the light emission control unit 126 encodes the determined optical ID information into a bit data string. Further, the light emission control unit 126 performs digital modulation based on the bit data string, and determines as a light emission pattern that emits a predetermined light as arbitrary information indicating a temporal change in the hue emitted by the LED 102. Further, the light emission control unit 126 outputs the determined light emission pattern information to the drive unit 112. As a modulation method, for example, 4PPM (Pulse Position Modulation) using a carrier wave having a frequency of 28.8 (kHz) is adopted.

The drive unit 112 drives the red (R), green (G), and blue (B) lights to be turned on while changing in time in a predetermined light emission cycle, based on the signal from the light emission control unit 126. A signal is generated and output to the LED 102. The LED 102 emits light whose hue changes with time according to the drive signal output from the drive unit 112. For example, in FIG. 1, the LED 102a emits red light, the LED 102b emits green light, and the LED 102c emits blue light.

FIG. 3 is a diagram showing an example of the configuration of the server 200. As shown in FIG. 3, the server 200 includes a photographing unit 201, a control unit 202, an image processing unit 204, a memory 205, an operation unit 206, a display unit 207, and a communication unit 208.

The photographing unit 201 includes the lens 203. The lens 203 is composed of a zoom lens or the like. The lens 203 moves by the zoom control operation from the operation unit 206 and the focusing control by the control unit 202. The movement of the lens 203 controls the shooting angle of view and the optical image taken by the shooting unit 201.

The photographing unit 201 is composed of a plurality of light receiving elements regularly arranged two-dimensionally on the light receiving surface. The light receiving element is, for example, a photographing device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The photographing unit 201 photographs (receives light) an optical image received through the lens 203 at a shooting angle of view within a predetermined range based on a control signal from the control unit 202 at a shooting cycle twice the light emission cycle of the LED 102. ), And the image signal within the shooting angle of view is converted into digital data to generate a frame. Further, the photographing unit 201 continuously performs photography and generation of frames in time, and outputs the continuous frames to the image processing unit 204.

The image processing unit 204 outputs the frame (digital data) output from the photographing unit 201 to the control unit 202 based on the control signal from the control unit 202. Further, when the control signal based on the recording instruction operation from the operation unit 206 is input, the image processing unit 204 is displayed within the shooting angle of view of the shooting unit 201 at the time of the recording instruction or on the display unit 207. It has a function of encoding and file an optical image within the display range by a compression coding method such as JPEG (Joint Photographic Experts Group).

The control unit 202 is configured by, for example, a CPU. The control unit 202 executes software processing according to a program stored in the memory 205 (for example, a program for realizing the operation of the server 200 shown in FIGS. 4 and 6 described later), so that the control unit 202 includes various types of the server 200. Control functions.

The memory 205 is, for example, a RAM or a ROM. The memory 205 stores various information (programs and the like) used for control and the like in the server 200.

The operation unit 206 is, for example, a touch panel formed on the upper surface of the display unit 207, and is an interface used for inputting the operation contents of the user. The display unit 207 is composed of, for example, an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), an EL (Electroluminescence) display, or the like. The display unit 207 displays an image according to the image signal output from the control unit 202. At this time, the control unit 202 extracts the frame output from the photographing unit 201 at a cycle longer than the photographing cycle by the photographing unit 201, and outputs the image signal corresponding to the extracted frame to the display unit 207. As a result, the image displayed on the display unit 207 is updated at a cycle longer than the shooting cycle by the shooting unit 201, so that the processing load related to the image display is reduced. The communication unit 208 is, for example, a LAN card. The communication unit 208 communicates with an external communication device.

The control unit 202 includes an information acquisition unit 234, an emission color acquisition unit 236, and an image composition unit 238. The information acquisition unit 234 is a pixel whose hue (H: Hue) is sequentially switched to any one of red (R), green (G), and blue (B) in a plurality of frames acquired continuously in time series. The area is detected as a color change area which is a light emitting point by the LED 102. Further, the information acquisition unit 234 controls to decode the bit data string corresponding to each color of red (R), green (G), and blue (B), and acquires the optical ID which is the information to be communicated.

The emission color acquisition unit 236 acquires an image (reception area image) of the color change region in a plurality of frames continuously acquired in time series and stores it in the memory 205.

The image composition unit 238 determines the color of the reception area image to be combined with the color change region in the image displayed on the display unit 207 according to the device state indicated by the optical ID. Further, the image synthesizing unit 238 reads the reception area image of the determined color from the memory 205, and performs a process of synthesizing the reception area image into the color change area in the image displayed on the display unit 207. The reception area image to be combined with the color change area in the image displayed on the display unit 207 may be the same size as the color change area in the image displayed on the display unit 207, or may be different in size. good. Further, it is desirable that the reception area image has an area slightly larger than the color change area displayed on the display unit 207 and such that the color change area is hidden. By doing so, the user does not directly see the color change area, and the color change area seems to emit light in a color that is easy to understand. Further, the reception area image to be combined with the color change area in the image displayed on the display unit 207 may have the same shape as the color change area in the image displayed on the display unit 207, or may have a different shape. Further, when the user operates the operation unit 206 to select a color change area in the image displayed on the display unit 207, the image composition unit 238 displays an image of optical ID information corresponding to the color change area. , Performs a process of synthesizing in the vicinity of the color change region in the image displayed on the display unit 207.

Next, the operation of the server 200 will be described. FIG. 4 is a flowchart showing an example of the reception area image acquisition process by the server 200.

The information acquisition unit 234 in the control unit 202 of the server 200 determines whether or not information is received by visible light communication (step S101). Specifically, the information acquisition unit 234 is a pixel whose hue is sequentially switched to any one of red (R), green (G), and blue (B) in a plurality of frames continuously acquired in time series. The area is detected as a color change area, the bit data string corresponding to each color of red (R), green (G), and blue (B) is controlled to be decoded, and an attempt is made to acquire an optical ID which is information to be communicated. .. The information acquisition unit 234 determines that the information is received by the visible light communication when the optical ID can be acquired, and when the optical ID cannot be acquired, the information acquisition unit 234 determines that the information is received by the visible light communication. Determines that no information has been received.

When the information is not received by the visible light communication (step S101; NO), a series of operations is completed. On the other hand, when the information is received by visible light communication (step S101; YES), the emission color acquisition unit 236 determines whether or not the color image of the current color change region has been acquired as the reception area image. Determination (step S102). The reception area image is required for each color change area, and means an image synthesized in the color change area in the image displayed on the display unit 207. Further, a red (R), yellow (Y), and blue (B) reception area image is required for one color change region.

When the image of the color of the current color change region has been acquired as the reception area image (step S102; YES), a series of operations is completed. On the other hand, when the image of the color of the current color change region has not been acquired as the reception area image (step S102; NO), the emission color acquisition unit 236 determines whether or not the color of the current color change region is green (G). (Step S103).

As described above, the emission colors of the LED 102 are red (R), green (G), and blue (B). On the other hand, a red (R), yellow (Y), and blue (B) reception area image is required for one color change region. That is, among the emission colors of the LED 102, green (G) is unnecessary for the reception area image, but the yellow (Y) reception area image cannot be acquired from the emission color of the LED 102. Therefore, when the color of the current color change region is green (G) (step S103; YES), the emission color acquisition unit 236 converts the hue of the color change region from green (G) to yellow (Y) (step S103; YES). Step S104). Further, the emission color acquisition unit 236 stores the converted yellow (Y) image in the memory 205 as a yellow (Y) reception area image in the color change region (step S105).

On the other hand, when the color of the current color change region is not green (G) (step S103; NO), that is, when the color of the current color change region is either red (R) or blue (B), light emission. The color acquisition unit 236 stores the red (R) image in the memory 205 as the red (R) reception area image in the color change region, and stores the blue (B) image in the blue (B) in the color change region. It is stored in the memory 205 as a reception area image (step S105).

By repeating the process of FIG. 4, a red (R) reception area image, a yellow (Y) reception area image, and a blue (B) reception area image are acquired for each color change region. As shown in FIG. 5, the emission color acquisition unit 236 has a red (R) reception area image and a yellow (Y) reception area at the coordinates of the color change region on the coordinate axis corresponding to the image displayed on the display unit 207. The image and the blue (B) reception area image are associated with each other and stored in the memory 205 as reception area image information.

FIG. 6 is a flowchart showing an example of the reception area image composition processing by the server 200. The operation shown in FIG. 6 is performed after the operation shown in FIG. 4 or in parallel with the operation shown in FIG.

The information acquisition unit 234 in the control unit 202 of the server 200 determines whether or not information is received by visible light communication (step S201). Specifically, as in step S101 of FIG. 4, the information acquisition unit 234 has hues of red (R), green (G), and blue (B) in a plurality of frames acquired continuously in time series. The area of the pixel that is sequentially switched to any of the above is detected as a color change area, and control is performed to decode the bit data string corresponding to each color of red (R), green (G), and blue (B), and the information to be communicated. Attempts to acquire the optical ID. The information acquisition unit 234 determines that the information is received by the visible light communication when the optical ID can be acquired, and when the optical ID cannot be acquired, the information acquisition unit 234 determines that the information is received by the visible light communication. Determines that no information has been received.

When the information is not received by the visible light communication (step S201; NO), a series of operations is completed. On the other hand, when the information is received by the visible light communication (step S201; YES), the image synthesizing unit 238 has already acquired the reception area image for the color change region corresponding to the visible light communication positively determined in step S201. It is determined whether or not there is (step S202). Specifically, the image composition unit 238 recognizes the coordinates of the color change region in the coordinate axis corresponding to the image displayed on the display unit 207. Further, the image synthesizing unit 238 is associated with the recognized coordinates in the memory 205, and is associated with the red (R) reception area image 302c, the yellow (Y) reception area image 302b, and the blue (B) reception area image 302a. Is determined whether or not all of them are stored. The image synthesizing unit 238 stores all the red (R) reception area image 302c, the yellow (Y) reception area image 302b, and the blue (B) reception area image 302a in association with the recognized coordinates. In this case, it is determined that the reception area image has been acquired for the color change area, and if a part or all of the reception area image is not stored, it is determined that the reception area image has not been acquired.

If the reception area image has not been acquired for the color change area (step S202; NO), a series of operations is completed. On the other hand, when the reception area image has already been acquired for the color change region (step S202; YES), the image synthesis unit 238 attempts to acquire the optical ID corresponding to the color change region. The specific process is the same as in step S201. When the optical ID can be acquired, the image synthesizing unit 238 selects a reception area image of a color corresponding to the acquired optical ID (step S203).

FIG. 7 is a diagram showing an example of the correspondence between the device state, the optical ID, and the color of the reception area image. In FIG. 7, when the device state is operating, the optical ID becomes 0 and the color of the reception area image becomes blue (B). When the device state is insufficient for the A member, the optical ID becomes 1 and the color of the reception area image becomes yellow (Y). When the device state is insufficient for the B member, the optical ID becomes 2 and the color of the reception area image becomes yellow (Y). When the device state is insufficient for the C member, the optical ID becomes 3 and the color of the reception area image becomes yellow (Y). When the device state is abnormally stopped, the optical ID becomes 4, and the color of the reception area image becomes red (R). When the power is off, the LED 102 does not emit light, so that the optical ID cannot be received and the color of the reception area image does not change (not lit). The correspondence information shown in FIG. 7 is stored in, for example, the memory 205.

In step S203, the image synthesizing unit 238 selects a reception area image of the color corresponding to the acquired optical ID for the color change region corresponding to the visible light communication positively determined in step S201 according to the correspondence shown in FIG. ..

It will be described again by returning to FIG. Next, the image synthesizing unit 238 synthesizes the reception area image selected in step S203 into the color change area of the image displayed on the display unit 207 (step S204). Specifically, the image synthesizing unit 238 sets the reception area image selected in step S203 in the color change region corresponding to the visible light communication positively determined in step S201 in the coordinate axis corresponding to the image displayed on the display unit 207. Is generated and output to the display unit 207 so that the image signals are combined. The display unit 207 displays an image obtained by synthesizing the reception area image with the displayed image.

By performing the process of step S204, for example, as shown in FIG. 8, when the device state of the monitored device 100a is in operation, the image displayed on the display unit 207 corresponds to the LED 102a. The blue (B) reception area image 302a is combined with the color change area. Further, when the device state of the monitored device 100b is insufficient for the A member, in the image displayed on the display unit 207, the yellow (Y) reception area image 302b is displayed in the color change region corresponding to the LED 102b. It is synthesized. Further, when the device state of the monitored device 100c is abnormally stopped, the red (R) reception area image 302c is combined with the color change area corresponding to the LED 102c in the image displayed on the display unit 207. Will be done. When the device state of the monitored device 100 is the power off, the portion of the LED 102 in the monitored device 100 does not change (not lit) in the image displayed on the display unit 207.

It will be described again by returning to FIG. Next, the image composition unit 238 determines whether or not the user operates the operation unit 206 to select the color change region included in the image displayed on the display unit 207 (step S205). Specifically, the operation unit 206 outputs information on the position where the user has contacted to the control unit 202. The image composition unit 238 converts the contact position information into coordinates in the coordinate axes corresponding to the image displayed on the display unit 207. Further, the image synthesizing unit 238 determines whether or not the acquired coordinates match or approximate any of the coordinates of the color change area stored in association with the reception area image in the memory 205. When the acquired coordinates match or approximate any of the coordinates of the color change area stored in association with the reception area image in the memory 205, the user operates the operation unit 206 in the image composition unit 238. Therefore, it is determined that the color change area included in the image displayed on the display unit 207 has been selected.

If the user operates the operation unit 206 and does not select the color change area included in the image displayed on the display unit 207 (step S205; NO), a series of operations ends. On the other hand, when the user operates the operation unit 206 to select the color change area included in the image displayed on the display unit 207 (step S205; YES), the image composition unit 238 acquired in step S203. The optical ID corresponding to the color change region is recognized, and an image showing information on the device state corresponding to the optical ID in FIG. 7 is generated. Further, the image synthesizing unit 238 synthesizes an image showing information on the device state in the vicinity of the color change region of the image displayed on the display unit 207 (step S206).

Specifically, the image composition unit 238 recognizes the coordinates of the color change region selected by the operation of the operation unit 206 on the coordinate axis corresponding to the image displayed on the display unit 207. Further, the image synthesis unit 238 generates an image signal and outputs it to the display unit 207 so that an image showing information on the device state is synthesized in the vicinity of the recognized coordinates. At this time, the image synthesizing unit 238 displays the device state information so that the already synthesized reception area image and the image showing the information of other device states do not overlap with the image showing the device state information to be synthesized this time. Determine the display position, size, etc. of the image to be shown. The display unit 207 displays an image obtained by synthesizing an image showing information on the device state in the vicinity of the image in the color change region in the displayed image.

By performing the process of step S206, for example, as shown in FIG. 9, the device state of the monitored device 100c is abnormally stopped, and the user selects the reception area image 302c in the color change region corresponding to the LED 102c. In this case, in the image displayed on the display unit 207, the image 304 of the characters "abnormal stop" is combined in the vicinity of the reception area image 302c.

As described above, in the present embodiment, the monitored device 100 emits light corresponding to the optical ID indicating its own device state. When displaying an image corresponding to a frame obtained by shooting, the server 200 updates the image to be displayed at a cycle longer than the shooting cycle. Further, the server 200 acquires an optical ID according to the color change of the color change area in the frame, and displays an image (reception area image) of the color corresponding to the optical ID in the color change area in the displayed image. Synthesize. As a result, even when the update cycle of the displayed image is lengthened to reduce the processing load, the user can accurately determine the state of the monitored device 100 based on the color of the reception area image.

Further, when the color change area in the displayed image is selected by the user, the server 200 displays the image 304 of the character of the optical ID corresponding to the color change area. Therefore, the user can recognize the details of the state of the monitored device 100. If a plurality of color change areas in the displayed image are selected by the user, as a result, a plurality of images 304 of characters having optical IDs corresponding to the color change areas are displayed. At this time, when the displayed images 304 of the characters of the optical ID overlap each other, the images 304 of the characters of the optical ID are displayed so as not to overlap each other. Further, when the displayed optical ID character images 304 overlap each other, the reception area image is combined with the color change area of the image displayed on the display unit 207 even when the color change area is selected by the user. ..

The present invention is not limited to the description and drawings of the above-described embodiment, and it is possible to appropriately modify the above-described embodiments and drawings.

For example, in the above-described embodiment, the server 200 acquires the reception area image by performing the operation shown in FIG. However, the server 200 may prepare a reception area image of each color shown in FIG. 7 in advance, and select a reception area image of a color corresponding to the optical ID in step S203 of FIG.

Further, for example, in the above-described embodiment, the case where visible light such as red, green, and blue light is used for communication has been described, but visible light of other colors may be used, and further, visible light such as infrared light may be used. Light other than light may be used. Further, the light emission pattern is not limited to the one in which the hue changes with time, and may be the one in which the brightness (brightness) and the saturation change with time. Even in such a case, the monitored device 100 emits light corresponding to the light ID indicating its own device state, as in the above embodiment. On the other hand, when displaying the image corresponding to the frame obtained by shooting, the server 200 updates the image to be displayed at a cycle longer than the shooting cycle, and responds to the color change of the color change region in the frame. An optical ID is acquired, and an image of a color corresponding to the optical ID is combined with a color change region in the displayed image.

Further, the light source in the monitored device 100 is not limited to the LED 102. For example, a light source may be configured in a part of an LCD, a PDP, an EL display, or the like that constitutes a display device.

Further, the server 200 may be any device as long as the photographing unit 201 is provided and photographing is possible. The photographing unit 201 may be provided outside the server 200.

Further, in the above embodiment, the program to be executed is a computer-readable recording such as a flexible disc, a CD-ROM (Compact Disc Read --Only Memory), a DVD (Digital Versatile Disc), or an MO (Magneto --Optical Disc). By storing it in a medium, distributing it, and installing the program, a system that executes the above-mentioned processing may be configured.

Further, the program may be stored in a disk device or the like owned by a predetermined server on a network such as the Internet, and may be superimposed on a carrier wave for downloading or the like.

If the above functions are shared by the OS (Operating System) or realized by collaboration between the OS and the application, only the parts other than the OS may be stored and distributed in the medium. Well, you may download it.

Although the preferred embodiment of the present invention has been described above, the present invention is not limited to the specific embodiment, and the present invention includes the invention described in the claims and the equivalent range thereof. Will be. The inventions described in the original claims of the present application are described below.

(Appendix 1)
Shooting means and
A display means for displaying an image taken by the shooting means, and a display means.
An information acquisition means for acquiring arbitrary information from an image of a predetermined light included in an image captured by the photographing means, and an information acquisition means.
A display control means for controlling the display means so that an image of a predetermined color corresponding to the arbitrary information is combined and displayed with the image taken by the shooting means.
A display device characterized by comprising.

(Appendix 2)
The display control means is characterized in that it controls to synthesize and display an image of a predetermined color corresponding to the arbitrary information at the position of the image of the predetermined light in the image taken by the photographing means. The display device according to Appendix 1.

(Appendix 3)
The arbitrary information is information indicating the state of the light emitting device that emits the predetermined light.
The display device according to Appendix 1 or 2, wherein the predetermined color corresponding to the arbitrary information is a color determined according to the state of the light emitting device.

(Appendix 4)
The display control means is any one of Supplementary note 1 to 3, wherein the display means controls the display means to synthesize and display an image showing the arbitrary information on the image taken by the shooting means. Display device described in.

(Appendix 5)
An information processing system that transmits arbitrary information between a light emitting device and a display device using light as a communication medium.
The light emitting device is
A light emitting means for emitting light corresponding to the above-mentioned arbitrary information is provided.
The display device is
Shooting means and
A display means for displaying an image taken by the shooting means, and a display means.
An information acquisition means for acquiring the arbitrary information from an image of a predetermined light included in an image captured by the photographing means, and an information acquisition means.
A display control means for controlling the display means so that an image of a predetermined color corresponding to the arbitrary information is combined and displayed with the image taken by the shooting means.
An information processing system characterized by being equipped with.

(Appendix 6)
It is an information processing method in an information processing system that transmits arbitrary information between a light emitting device and a display device using light as a communication medium.
A light emitting step in which the light emitting device emits light corresponding to the arbitrary information to the light emitting unit.
The display device
A shooting step that causes the shooting unit to shoot,
An information acquisition step of acquiring the arbitrary information from an image of a predetermined light included in an image captured in the photographing step, and an information acquisition step.
A display control step of synthesizing an image of a predetermined color corresponding to the arbitrary information with the image taken in the shooting step and displaying the image on the display unit.
An information processing method characterized by including.

(Appendix 7)
A computer of a device having a shooting unit and a display unit,
An information acquisition means for acquiring arbitrary information from an image of a predetermined light included in an image captured by the photographing unit.
A display control means for controlling the display unit so that an image of a predetermined color corresponding to the arbitrary information is synthesized and displayed on the image captured by the photographing unit.
A program characterized by functioning as.

1 ... Visible light communication system, 100, 100a, 100b, 100c ... Monitored device, 102, 102a, 102b, 102c ... LED, 103, 202 ... Control unit, 104, 205 ... Memory, 108, 208 ... Communication unit, 112 ... Drive unit, 126 ... Light emission control unit, 200 ... Server, 201 ... Imaging unit, 203 ... Lens, 204 ... Image processing unit, 206 ... Operation unit, 207 ... Display unit, 234 ... Information acquisition unit, 236 ... Emission color acquisition Part 238 ... Image composition part, 302a ... Blue reception area image, 302b ... Yellow reception area image, 302c ... Red reception area image, 304 ... Character image

Claims (6)

Shooting means and
A display means for displaying an image taken by the shooting means, and a display means.
An information acquisition means for acquiring information indicating a state of a light emitting device that emits a predetermined light from an image of a predetermined light included in an image captured by the photographing means.
A display control means for controlling the display means so that an image of the color determined according to the state of the light emitting device corresponding to the information indicating the state of the light emitting device is synthesized and displayed on the image taken by the shooting means. When,
A display device characterized by comprising. The display control means controls to synthesize and display an image of a color determined according to the state of the light emitting device at the position of the image of the predetermined light in the image taken by the photographing means. The display device according to claim 1. The display control means 1 or 2 is characterized in that the display means controls to synthesize and display an image showing information indicating the state of the light emitting device with an image taken by the photographing means. The display device described in. An information processing system that transmits information indicating the state of the light emitting device using light as a communication medium between the light emitting device and the display device.
The light emitting device is
A light emitting means for emitting light corresponding to the information indicating the state of the light emitting device is provided.
The display device is
Shooting means and
A display means for displaying an image taken by the shooting means, and a display means.
An information acquisition means for acquiring information indicating a state of the light emitting device from an image of a predetermined light included in an image captured by the photographing means, and an information acquisition means.
A display control means for controlling the display means so that an image of the color determined according to the state of the light emitting device corresponding to the information indicating the state of the light emitting device is synthesized and displayed on the image taken by the shooting means. When,
An information processing system characterized by being equipped with. It is an information processing method in an information processing system that transmits information indicating the state of the light emitting device using light as a communication medium between the light emitting device and the display device.
A light emitting step in which the light emitting device emits light corresponding to information indicating the state of the light emitting device to the light emitting unit.
The display device
A shooting step that causes the shooting unit to shoot,
A display step for displaying an image captured by the photographing unit on the display unit,
An information acquisition step of acquiring information indicating the state of the light emitting device from an image of a predetermined light included in the image captured in the photographing step, and an information acquisition step.
Display control that controls the display unit to synthesize and display an image of a color determined according to the state of the light emitting device corresponding to the information indicating the state of the light emitting device to the image taken in the shooting step. Steps and
An information processing method characterized by including. A computer of a device having a shooting unit and a display unit,
A display means for displaying an image captured by the photographing unit on the display unit,
An information acquisition means for acquiring information indicating a state of a light emitting device that emits a predetermined light from an image of a predetermined light included in an image taken by the photographing unit.
A display control means for controlling the display unit so that an image captured by the photographing unit is combined with an image of a color determined according to the state of the light emitting device corresponding to information indicating the state of the light emitting device and displayed. ,
A program characterized by functioning as.

Images