JP6742725B2 - Control device, control method, and computer program - Google Patents

Description

The present invention relates to a technique of associating an image capturing device with a sensor that detects an event related to an image captured by the image capturing device.

In recent years, IoT (Internet Of Things) has attracted attention. In IoT, many sensors are connected to a network, and it becomes possible to obtain information about a device at a remote place. Since it is difficult to grasp the situation only with information such as numerical values obtained from the sensor, by using a technique of transmitting video data to a remote place (see Patent Document 1, for example), the video captured by the imaging device can also be networked. May be obtained via. In such a case, it is necessary to associate the sensor with the photographing device. That is, when an image is to be viewed based on the information obtained from a certain sensor, it is necessary to know in advance which image capturing device has captured the image corresponding to the position where the sensor is installed. Therefore, conventionally, the association has been recorded by a human hand according to the installation of the sensor and the imaging device.

JP, 2012-114649, A

However, there has been a problem that as the number of installed sensors and image capturing devices increases, the time and cost required to register these associations increase.
In view of the above circumstances, it is an object of the present invention to provide a technique that enables more easily associating an image capturing device with a sensor that detects an event related to an image captured by the image capturing device. ..

According to one embodiment of the present invention, a sensor that is installed in advance and a notification device that notifies intermediate identification information that is identification information having a unique value that does not overlap with others are connected to the communication device. The first communication unit that receives the sensor identification information that is the identification information of the sensor that has been detected and the intermediate identification information that is notified by the notification device that is connected to the communication device, and an output that is in accordance with the intermediate identification information. Image data that is data of a video image captured by the image capturing device from an image capturing device that captures an image including the notification device that performs an output recorded as a video image in the image capturing device or a sound emitted from the notification device, and The second communication unit that receives the image capturing device identification information that is the image capturing device identification information, and the notification based on the image of the notification device captured in the image data received by the second communication unit. An image analysis unit that acquires the intermediate identification information notified by the device, and the sensor identification information received from the communication device that receives the same intermediate identification information as the intermediate identification information acquired by the image analysis unit, The image capturing device identification information of the image capturing device that captured the image data analyzed by the image analyzing unit, and the correspondence relationship between the image capturing device and a sensor that detects an event related to the image captured by the image capturing device. And a relationship analysis unit that records the information as associated information.

One embodiment of the present invention includes an output unit that outputs an image or sound recorded in a photographing device, and intermediate identification information that is identification information that has a unique value that does not overlap with others when a predetermined condition is satisfied. An output control unit that controls the output of the output unit according to the above, and a communication unit that performs communication, and the output control unit sets the intermediate identification information to an event related to a video image captured by the image capturing device. It is a notification device for transmitting via a communication unit to a communication device to which a sensor for detecting is detected.

One embodiment of the present invention is that a sensor installed in advance and a notification device that notifies intermediate identification information having a unique value that does not overlap with other devices are connected to a sensor connected to the communication device. A first communication step of receiving sensor identification information, which is identification information, and intermediate identification information notified by a notification device connected to the communication device, and an output according to the intermediate identification information, which is output to the imaging device. Video data, which is data of a video image captured by the image capturing device from an image capturing device that captures an image including the notification device that performs an output recorded as a video or a sound emitted from the notification device, and identification of the image capturing device A second communication step of receiving the image capturing device identification information, which is information, and a notification by the notification device based on the image of the notification device captured in the image data received in the second communication step. A video analysis step of acquiring intermediate identification information, the sensor identification information received from the communication device that receives the same intermediate identification information as the intermediate identification information acquired in the video analysis step, and the video analysis step The photographing device identification information of the photographing device that photographed the video data analyzed in step 1 is used as information indicating the correspondence relationship between the photographing device and a sensor that detects an event related to the image photographed by the photographing device. And a relationship analysis step of recording the data.

One embodiment of the present invention is a notification method performed by a notification device including an output unit which outputs an image or sound recorded in a photographing device and a communication unit which performs communication, and a predetermined condition is satisfied. In the case of a video captured by the imaging device, an output control step of controlling the output of the output unit according to the intermediate identification information which is identification information having a unique value that does not overlap with others, and the intermediate identification information. And a transmitting step of transmitting via a communication unit to a communication device to which a sensor that detects an event related to is connected.

One embodiment of the present invention captures an image including a notification device connected to a communication device which receives sensor identification information indicating the sensor from a communication device to which a sensor installed in advance is connected, or a sound emitted from the notification device. A communication unit that receives image data, which is data of an image captured by the image capturing apparatus, and image capturing apparatus identification information that is identification information of the image capturing apparatus, from the image capturing apparatus; An image analysis unit that acquires the sensor identification information notified by the notification device based on the image of the notification device captured in the image data; the sensor identification information acquired by the image analysis unit; The correspondence between the image capturing device and the image capturing device identification information of the image capturing device that has captured the image data analyzed by the image analyzing unit, and the correspondence between the image capturing device and a sensor that detects an event related to the image captured by the image capturing device is shown. And a relationship analysis unit that records the information in association with each other, and the notification device is a control device that performs an output corresponding to the sensor identification information and that is output as an image in the imaging device.

According to one embodiment of the present invention, an output unit which outputs an image or sound recorded in a photographing device, and a communication device to which the own device is connected when a predetermined condition is satisfied is connected to the communication device. A communication unit that receives sensor identification information that is identification information of the sensor, and an output control unit that controls the output of the output unit according to the sensor identification information received by the communication unit. is there.

One embodiment of the present invention captures an image including a notification device connected to a communication device which receives sensor identification information indicating the sensor from a communication device to which a sensor installed in advance is connected, or a sound emitted from the notification device. From the image capturing device, the communication step of receiving image data, which is the image data of the image captured by the image capturing device, and the image capturing device identification information that is the identification information of the image capturing device; and the communication step received in the communication step. An image analysis step of acquiring the sensor identification information notified by the notification device based on the image of the notification device captured in the image data; the sensor identification information acquired in the image analysis step; The correspondence relationship between the photographing device and the photographing device identification information of the photographing device that photographed the video data analyzed in the video analyzing step, and the sensor that detects an event related to the video photographed by the photographing device is shown. And a relationship analysis step of recording the information in association with each other, wherein the notification device performs an output corresponding to the sensor identification information and output as an image recorded in the imaging device. ..

One embodiment of the present invention is a notification method performed by a notification device including an output unit that outputs an image or sound recorded in a photographing device, and when a predetermined condition is satisfied, the device itself is connected. A communication step of receiving sensor identification information, which is identification information of a sensor connected to the communication apparatus, from the communication apparatus, and controlling the output of the output unit according to the sensor identification information received in the communication step. An output control step, and a notification method.
One aspect of the present invention is a computer program for causing a computer to function as the above control device.
One aspect of the present invention is a computer program for causing a computer to function as the notification device.

According to the present invention, it is possible to more easily associate an image capturing device with a sensor that detects an event related to an image captured by the image capturing device.

It is a system configuration diagram showing an example of a system configuration of a video providing system 800 in the first embodiment. It is a figure which shows the detail of a structure of the notification apparatus 100 in 1st embodiment. It is a figure which shows the detail of a structure of the control apparatus 500 in 1st embodiment. It is a figure which shows the specific example of a sensor identification information table. It is a figure which shows the specific example of an intermediate|middle identification information table. It is a figure which shows the specific example of a relationship information table. 9 is a sequence chart showing a flow of processing when the sensor identification information record 81 is registered in the sensor identification information table in the operation of the video providing system 800 in the first embodiment. 7 is a sequence chart showing a flow of processing when the intermediate identification information record 82 is registered in the intermediate identification information table in the operation of the video providing system 800 in the first embodiment. 9 is a sequence chart showing the flow of processing when the relationship information record 83 is registered in the relationship information table in the operation of the video providing system 800 according to the first embodiment. It is a system configuration diagram showing an example of a system configuration of a video providing system 800a in the second embodiment. It is a figure which shows the detail of a structure of the notification apparatus 100a in 2nd embodiment. It is a figure which shows the detail of a structure of the control apparatus 500a in 2nd embodiment. It is a sequence chart which shows the flow of processing when sensor identification information is notified to notice device 100a among operation of picture offer system 800a in a second embodiment. 12 is a sequence chart showing the flow of processing when the relationship information record 83 is registered in the relationship information table, among the operations of the video providing system 800a in the second embodiment.

[First embodiment]
FIG. 1 is a system configuration diagram showing an example of the system configuration of a video providing system 800 according to the first embodiment. The image providing system 800 is communicably connected to a terminal device (not shown) via a network. The image providing system 800 provides the terminal device with the sensor information acquired by the sensor and the image captured by the image capturing device (the image includes an image and a sound). The image is a still image or a moving image. The terminal device is configured using a communicable information processing device such as a personal computer, a smartphone, or a tablet. The terminal device displays the sensor information and the image provided by the image providing system 800. The user of the terminal device can select the displayed sensor information and video by operating the terminal device.

The image providing system 800 includes a notification device 100, a plurality of sensors 200, a gateway (Gate Way: abbreviated as “GW”) 300, a plurality of image capturing devices 400, and a control device 500. The control device 500 is communicatively connected to the plurality of gateways 300 via the first network 600. The control device 500 is communicatively connected to the plurality of imaging devices 400 via the second network 700. The first network 600 and the second network 700 may be constructed by any network. For example, these networks may all consist of the Internet.

The notification device 100 generates the intermediate identification information, and uses the imaging device 400 by a means different from the communication using the electromagnetic wave propagating the generated intermediate identification information in the conductor and the electromagnetic wave propagating in the air (excluding light). Notify to be recorded. In other words, the intermediate identification information is notified by a means that can be received (recorded) in the image capturing device 400 including the image sensor and the microphone.

The sensor 200 transmits the detected information (hereinafter referred to as “detection information”) to the control device 500 via the gateway 300 and the first network 600. One sensor 200 may be connected to one gateway 300, or a plurality of sensors 200 may be connected. Any type of sensor may be applied to the sensor 200. A plurality of types of sensors may be applied to the sensor 200. The sensor 200 may be, for example, a sensor that measures temperature, a sensor that measures atmospheric pressure, a sensor that measures sound volume, or a sensor that measures wind speed. Good. Multiple sensors 200 may be grouped into one or multiple groups.

Unique identification information (hereinafter referred to as “sensor identification information”) is assigned to the sensor 200. When transmitting the detection information to the control device 500, the sensor 200 also transmits the sensor identification information assigned to itself. When transmitting the detection information to the control device 500, the sensor 200 may also transmit the date and time (time stamp) when the detection information was obtained. The sensor 200 generates and transmits sensor information including, for example, detection information, sensor identification information, and a time stamp. When the plurality of sensors 200 are grouped as described above, the sensor identification information may be configured to further indicate the group to which the sensor 200 belongs. For example, the sensor identification information may have a hierarchical structure according to the grouping. For example, the sensor identification information “1-3” may be assigned to the third sensor 200 in the group 1.

The gateway 300 is a communication device that relays communication between the notification device 100 and the sensor 200 connected to itself and the control device 500. For example, when the gateway 300 receives data (for example, intermediate identification information) from the notification device 100, the gateway 300 transmits the received data to the control device 500. For example, when the gateway 300 receives the sensor information from the sensor 200, the gateway 300 transmits the received sensor information to the control device 500. Note that the gateway 300 may be any device as long as it is a communication device capable of executing the above-described processing, and is not limited to a so-called “gateway”.

The image capturing device 400 captures an image of the surrounding area where the image capturing device 400 is installed. The image capturing device 400 transmits the video data to the control device 500 via the second network 700. One image capturing device 400 may be connected to the second network 700, or a plurality of image capturing devices 400 may be connected. Unique identification information (hereinafter, referred to as “imaging device identification information”) is assigned to the imaging device 400. When transmitting the image data to the control device 500, the image capturing device 400 also transmits the image capturing device identification information assigned to itself. The plurality of imaging devices 400 may be grouped into one or a plurality of groups. When a plurality of image capturing devices 400 are grouped, the image capturing device identification information may be configured to further indicate a group to which the image capturing devices 400 belong. For example, the imaging device identification information may have a hierarchical structure according to the grouping. For example, the imaging device identification information “1-3” may be assigned to the third imaging device 400 in group 1.

The control device 500 acquires the identification information notified by the notification device 100 captured by the image capturing device 400 by performing image analysis or audio analysis on the video data received from the image capturing device 400. The control device 500 associates the sensor 200 with the imaging device 400 based on the identification information acquired by the image analysis or the voice analysis and the identification information included in the data transmitted from the gateway 300.

FIG. 2 is a diagram illustrating details of the configuration of the notification device 100 according to the first embodiment. Hereinafter, the configuration of the notification device 100 will be described in detail with reference to FIG. The notification device 100 is configured by an information processing device that can communicate. The notification device 100 is preferably configured to have a size that can be carried by a person. For example, the information processing device that constitutes the notification device 100 includes a CPU, a memory, an auxiliary storage device, and the like connected by a bus, and executes the notification program. Note that all or part of each function of the notification device 100 may be realized by using hardware such as ASIC, PLD, and FPGA. Further, the notification device 100 may be realized by dedicated hardware. The notification program may be recorded in a computer-readable recording medium. The notification program may be provided via a telecommunication line.

The notification device 100 includes an output unit 101, a communication unit 102, an intermediate identification information generation unit 103, and an output control unit 104.
The output unit 101 operates according to the control of the output control unit 104. The output unit 101 notifies the information to be recorded by the image capturing apparatus 400 by means different from the communication using the electromagnetic wave propagating in the conductor and the electromagnetic wave propagating in the air (excluding light). The output unit 101 may be configured using a light emitting device, for example. In this case, the output unit 101 notifies the information by light emission so as to be recorded by the imaging device 400. More specifically, the output unit 101 may notify the information by light emission, for example, by applying the technique described in Reference Document 1 as described below.
Reference 1: Japanese Patent No. 4423302 SUMMARY OF THE INVENTION Any device may be used as the light emitting device forming the output unit 101. For example, the output unit 101 may use an LED (Light Emitting Diode) as a light emitting element.

The communication unit 102 is configured using a communication device such as a communication interface. The communication unit 102 communicates with the gateway 300. The communication unit 102 may perform wired communication or wireless communication.

The intermediate identification information generation unit 103 generates intermediate identification information according to a predetermined algorithm. The intermediate identification information is identification information having a unique value that does not overlap with other intermediate identification information. Even with the same notification device 100, different intermediate identification information is generated when connected to one gateway 300 and when connected to another gateway 300. Even if the same notification device 100 is connected to the same gateway 300, the intermediate identification information generated when connected at one timing and the intermediate identification information generated when connected at another timing , Are different values. The intermediate identification information is identification information that does not overlap with other intermediate identification information for at least a predetermined period. However, the intermediate identification information may be generated as identification information in which the theoretical probability of overlapping with other intermediate identification information is lower than a predetermined standard (which is low enough to hardly occur).

When a predetermined condition is satisfied, the output control unit 104 controls the output mode of the output unit 101 to output the intermediate identification information. The predetermined condition may be, for example, that the notification device 100 is connected to the gateway 300, that the notification device 100 is powered on, or that the predetermined condition provided in the notification device 100. The button may be operated, or another condition may be satisfied. The output control unit 104 realizes the notification according to the intermediate identification information by controlling the output (for example, blinking pattern) of the output unit 101 according to the above-described reference document 1.

FIG. 3 is a diagram showing details of the configuration of the control device 500 in the first embodiment. Hereinafter, the configuration of the control device 500 will be described in detail with reference to FIG.
The control device 500 is composed of one or a plurality of information processing devices. Specific examples of the information processing device include a mainframe, a workstation, a personal computer, and a PLC. For example, when the control device 500 is configured by one information processing device, the information processing device includes a CPU, a memory, an auxiliary storage device, and the like connected by a bus, and executes the video providing program. Note that all or some of the functions of the control device 500 may be realized by using hardware such as ASIC, PLD, and FPGA. Further, the control device 500 may be realized by dedicated hardware. The video providing program may be recorded in a computer-readable recording medium. The image providing program may be provided via an electric communication line. When the control device 500 is configured by a plurality of information processing devices, the sensor information acquisition unit 503, the video analysis unit 506, and the relationship analysis unit 507 may be installed in different devices, or the functional units described above may be installed. A plurality of functional units may be mounted on one device. For example, the sensor information acquisition unit 503 may be mounted on one information processing device, and the video analysis unit 506 and the relationship analysis unit 507 may be mounted on another one information processing device.

The control device 500 includes a first communication unit 501, a second communication unit 502, a sensor information acquisition unit 503, a sensor information storage unit 504, an identification information storage unit 505, a video analysis unit 506, a relationship analysis unit 507, and a relationship information storage. The unit 508 is provided.

The first communication unit 501 is configured using a communication device such as a communication interface. The first communication unit 501 communicates with the gateway 300 via the first network 600. The first communication unit 501 may perform wired communication or wireless communication. The first communication unit 501 receives sensor information including the detection information acquired by the sensor 200 from the gateway 300, for example. The first communication unit 501 receives, for example, the intermediate identification information transmitted by the notification device 100 from the gateway 300.

The second communication unit 502 is configured using a communication device such as a communication interface. The second communication unit 502 communicates with the imaging device 400 via the second network 700. The second communication unit 502 may perform wired communication or wireless communication. The second communication unit 502 receives, for example, video data (hereinafter referred to as “video data”) captured by the image capturing apparatus 400 from the image capturing apparatus 400.

The sensor information acquisition unit 503 acquires the sensor information transmitted from one or more sensors 200 from the information received from the gateway 300 via the first network 600. The sensor information acquisition unit 503 records the acquired sensor information in the sensor information storage unit 504.

The sensor information storage unit 504 is configured using a storage device such as a hard disk device or a semiconductor storage device. The sensor information storage unit 504 stores the sensor information acquired by the sensor information acquisition unit 503.

The identification information storage unit 505 is configured using a storage device such as a hard disk device or a semiconductor storage device. The identification information storage unit 505 stores information indicating the correspondence between the GW identification information and the intermediate identification information. The identification information storage unit 505 stores, for example, a table (hereinafter, referred to as “intermediate identification information table”) indicating the above correspondence. The identification information storage unit 505 also stores information indicating the correspondence between the sensor identification information and the GW identification information. The identification information storage unit 505 stores, for example, a table (hereinafter, referred to as a “sensor identification information table”) indicating the above-mentioned correspondence relationship. The information stored in the identification information storage unit 505 is represented by rows and columns. It does not have to be a table structure.

The video analysis unit 506 acquires the information notified by the notification device 100 by performing an analysis process on the video data captured by the imaging device 400. In the first embodiment, the notification device 100 notifies the intermediate identification information. Therefore, the video analysis unit 506 acquires the intermediate identification information by analyzing the video data. The video analysis unit 506 acquires the intermediate identification information by performing an analysis process on the output (for example, a blinking pattern) of the output unit 101 according to the above-described reference document 1, for example.

The relationship analysis unit 507 acquires information indicating the correspondence between the image capturing device identification information and the sensor identification information. A specific example of the processing of the relationship analysis unit 507 will be described. The relationship analysis unit 507 acquires GW identification information corresponding to the intermediate identification information acquired by analyzing the video data from the intermediate identification information table. The relationship analysis unit 507 acquires the sensor identification information corresponding to the acquired GW identification information from the sensor identification information table. The relationship analysis unit 507 determines that the acquired sensor identification information and the imaging device identification information included in the analyzed video data are identification information having a correspondence relationship. The relationship analysis unit 507 registers the sensor identification information and the image capturing apparatus identification information obtained in this way in the relationship information storage unit 508 in association with each other.

The relationship information storage unit 508 is configured using a storage device such as a hard disk device or a semiconductor storage device. The relationship information storage unit 508 stores information indicating the correspondence between the image capturing device identification information and the sensor identification information. The relationship information storage unit 508 stores, for example, a table indicating the above relationship (hereinafter, referred to as “relationship information table”). The information stored in the relationship information storage unit 508 does not have to be the structure of a table represented by rows and columns.

FIG. 4 is a diagram showing a specific example of the sensor identification information table. The sensor identification information table has a plurality of sensor identification information records 81. The sensor identification information record 81 has GW identification information and sensor identification information of each sensor 200 connected to the gateway 300 of the GW identification information. In the example of FIG. 4, for example, the sensor identification information “sen_id_000001” is registered in association with the GW identification information “gw_id_000001”. A plurality of sensor identification information may be associated with one GW identification information.

FIG. 5 is a diagram showing a specific example of the intermediate identification information table. The intermediate identification information table has a plurality of intermediate identification information records 82. The intermediate identification information record 82 has GW identification information and intermediate identification information output by the notification device 100 connected to the gateway 300 of the GW identification information. In the example of FIG. 5, for example, the intermediate identification information “int_id_000001” is registered in association with the GW identification information “gw_id_000001”. One piece of intermediate identification information is associated with one piece of GW identification information.

FIG. 6 is a diagram showing a specific example of the relationship information table. The relationship information table has a plurality of relationship information records 83. The relationship information record 83 includes image capturing device identification information and sensor identification information of a sensor that detects an event related to the image captured by the image capturing device 400 of the image capturing device identification information. In the example of FIG. 6, for example, the sensor identification information “sen_id_000001” is registered in association with the imaging device identification information “cam_id_000001”. A plurality of sensor identification information may be associated with one piece of imaging device identification information.

FIG. 7 is a sequence chart showing a flow of processing when the sensor identification information record 81 is registered in the sensor identification information table in the operation of the video providing system 800 according to the first embodiment. First, the sensor 200 generates sensor information at a predetermined timing (step S101). The sensor information includes detection information detected by the sensor 200, a time stamp indicating the date and time when the detection was performed, and sensor identification information of the sensor 200. The sensor 200 transmits the generated sensor information to the gateway 300 to which the sensor 200 is connected (step S102).

Upon receiving the sensor information, the gateway 300 executes a relay process (step S103). In the relay process, the gateway 300 adds the GW identification information of its own device to the received sensor information. The gateway 300 transmits the sensor information to which the GW identification information is added to the control device 500 (step S104).

Upon receiving the sensor information and the GW identification information, the sensor information acquisition unit 503 of the control device 500 registers the received sensor information in the sensor information storage unit 504 (step S105). In addition, the sensor information acquisition unit 503 registers the sensor identification information included in the received sensor information and the received GW identification information in the sensor identification information table in association with each other (step S106).

FIG. 8 is a sequence chart showing the flow of processing when the intermediate identification information record 82 is registered in the intermediate identification information table in the operation of the video providing system 800 according to the first embodiment. First, the output control unit 104 of the notification device 100 determines whether a predetermined condition is satisfied (step S201). The output control unit 104 waits for the process until a predetermined condition is satisfied (step S201-NO). When the predetermined condition is satisfied (step S201-YES), the intermediate identification information generation unit 103 generates intermediate identification information. The output control unit 104 acquires the intermediate identification information generated by the intermediate identification information generation unit 103 (step S202). The output control unit 104 transmits the acquired intermediate identification information to the gateway 300 via the communication unit 102 (step S204). At this time, the output control unit 104 may transmit the intermediate identification information in any data format. For example, the output control unit 104 may transmit the intermediate identification information using the data format used when the sensor 200 transmits the sensor information. More specifically, the output control unit 104 may store the intermediate identification information in an area where the value of the sensor identification information is stored in the data format used when the sensor 200 transmits the sensor information. In this case, the output control unit 104 transmits the following data.

{
"Type": "mapping",
"Id": "[intermediate identification information]",
"Timestamp": "[acquisition date and time]"
}
In the above data, the value of the intermediate identification information is stored in the [intermediate identification information] portion, and the value indicating the date and time when the intermediate identification information is acquired is stored in the [transmission date and time] portion. Note that the above data is an example, and the lines of “type” and “timestamp” are not essential, and the names and values of each item of data may be different.

When the gateway 300 receives the intermediate identification information, the gateway 300 executes a relay process (step S205). In the relay process, the gateway 300 adds the GW identification information of its own device to the received intermediate identification information. The gateway 300 transmits the intermediate identification information added with the GW identification information to the control device 500 (step S206).

Upon receiving the intermediate identification information and the GW identification information, the sensor information acquisition unit 503 of the control device 500 registers the received intermediate identification information and the GW identification information in the intermediate identification information table in association with each other (step S207).

FIG. 9 is a sequence chart showing a flow of processing when the relationship information record 83 is registered in the relationship information table in the operation of the video providing system 800 according to the first embodiment. First, the image capturing apparatus 400 captures an image (step S301). Upon taking an image, the image taking device 400 transmits the video data generated by the image taking and the image taking device identification information assigned to the device itself to the control device 500 (step S302).

Upon receiving the video data and the shooting device identification information, the video analysis unit 506 of the control device 500 executes an analysis process on the received video data. The video analysis unit 506 acquires the intermediate identification information notified by the output unit 101 of the notification device 100 captured in the video by performing the analysis process (step S303). The video analysis unit 506 outputs the intermediate identification information acquired by the analysis process and the imaging device identification information received together with the video data to the relationship analysis unit 507.

The relationship analysis unit 507 acquires the GW identification information corresponding to the intermediate identification information output from the video analysis unit 506 from the intermediate identification information table (step S304). The relationship analysis unit 507 acquires the sensor identification information corresponding to the acquired GW identification information from the sensor identification information table (step S305). The relationship analysis unit 507 registers the imaging device identification information output from the video analysis unit 506 and the sensor identification information acquired in the process of step S305 in association with each other in the relationship information table (step S306).

By thus referring to the relationship information record registered in the relationship information table, it is possible to easily know the correspondence relationship between the imaging device and the sensor that detects an event related to the image captured by the imaging device. It becomes possible. The relationship information table may be used in any way. For example, by providing the relationship information table to a terminal device (not shown), the user of the terminal device can easily determine the imaging device corresponding to the sensor indicating an abnormal value. For example, the video providing system 800 can quickly provide the video data of the imaging device corresponding to the sensor indicating the abnormal value to the terminal device.

In the video providing system 800 configured as described above, based on the information relayed by the gateway 300, the intermediate identification information notified by the notification device 100 captured by the imaging device 400 and the same gateway as the notification device 100. Correspondence with the sensor identification information of the sensor 200 connected to the 300 becomes possible. Further, by analyzing the video data of the image capturing device 400, it becomes possible to associate the intermediate identification information notified by the notification device 100 captured by the image capturing device 400 with the image capturing device identification information of the image capturing device 400. .. Then, through the intermediate identification information, it is possible to associate the image capturing device identification information of the image capturing device 400 with a sensor that detects an event related to an image captured by the image capturing device 400. Therefore, it becomes possible to more easily associate the image capturing device with the sensor that detects an event related to the image captured by the image capturing device.

Further, in the video providing system 800 configured as described above, it is not necessary for each sensor 200 to include the output unit 101 included in the notification device 100, and one notification device is connected to one gateway. This makes it possible to associate the sensor with the imaging device. Therefore, as compared with the case where the sensor 200 itself includes the output unit 101 included in the notification device 100 to notify the sensor identification information, it is possible to reduce the number of required output units 101 and reduce the cost. It becomes possible.

In addition, in the video providing system 800 configured as described above, the gateway 300 and the notification device 100 are configured as separate devices. Therefore, after the registration of the sensor 200 connected to a certain gateway 300 to the relationship information table is completed, the used notification device 100 is removed from the gateway 300 and connected to another gateway 300 to execute the registration process. Is possible. That is, the notification device 100 can be reused for a plurality of gateways 300. Therefore, the cost can be reduced.

[Second embodiment]
FIG. 10 is a system configuration diagram showing an example of the system configuration of the video providing system 800a in the second embodiment. The image providing system 800a according to the second embodiment is characterized in that the notification device 100a is provided instead of the notification device 100, the gateway 300a is provided instead of the gateway 300, and the control device 500a is provided instead of the control device 500. This is different from the image providing system 800 according to the embodiment. Regarding other configurations, the image providing system 800a in the second embodiment and the image providing system 800 in the first embodiment are the same. Hereinafter, the video providing system 800a will be described with respect to differences from the video providing system 800 in the first embodiment.

Upon receiving the sensor information from the sensor 200 connected to the gateway 300a, the gateway 300a acquires the sensor identification information included in the sensor information. Then, the gateway 300a transmits the acquired sensor identification information to the notification device 100a connected to the own device.

FIG. 11 is a diagram showing details of the configuration of the notification device 100a in the second embodiment. Hereinafter, the configuration of the notification device 100a will be described in detail with reference to FIG. The notification device 100a according to the second embodiment differs from the notification device 100 according to the first embodiment in that the notification device 100a does not include the intermediate identification information generation unit 103 and that the output control unit 104 includes an output control unit 104a.

The output control unit 104a receives the sensor identification information from the gateway 300 via the communication unit 102. The received sensor identification information is the sensor identification information of the one or more sensors 200 connected to the same gateway 300 as the own device. The output control unit 104a controls the output unit 101 so as to output the received sensor identification information instead of the intermediate identification information. When there are a plurality of received sensor identification information, the output control unit 104a controls the output unit 101 to output the plurality of sensor identification information according to a predetermined rule. Therefore, the notification device 100a in the second embodiment notifies the sensor identification information instead of the intermediate identification information.

FIG. 12 is a diagram showing details of the configuration of the control device 500a in the second embodiment. Hereinafter, the configuration of the control device 500a will be described in detail with reference to FIG. The control device 500a in the second embodiment is not provided with the identification information storage unit 505, is provided with a video analysis unit 506a instead of the video analysis unit 506, and is provided with a relationship analysis unit 507a instead of the relationship analysis unit 507. This point is different from the control device 500 in the first embodiment.

The image analysis unit 506a acquires the sensor identification information instead of the intermediate identification information by analyzing the image data. Unlike the intermediate identification information in the first embodiment, a plurality of sensor identification information in the second embodiment may be notified. Therefore, the image analysis unit 506a acquires all the sensor identification information notified by the image capturing notification device 100a by analyzing the image data according to a predetermined rule. The video analysis unit 506a outputs, to the relationship analysis unit 507a, the imaging device identification information of the imaging device 400 that is the transmission source of the analyzed video data and the one or more sensor identification information acquired by the analysis process.
The relationship analysis unit 507a registers the image capturing device identification information and the one or more sensor identification information output from the video analysis unit 506a in the relationship information table.

FIG. 13 is a sequence chart showing a flow of processing when the notification device 100a is notified of the sensor identification information in the operation of the video providing system 800a according to the second embodiment. A part of the process flow of FIG. 13 is the same as a part of the process flow of FIG. 7. Therefore, description of the processes common to those in FIG. 7 will be omitted.

The gateway 300a transmits the sensor information to which the GW identification information is added to the control device 500 (step S104), and then transmits the sensor identification information included in the sensor information to the notification device 100a (step S111). When receiving the sensor identification information from the gateway 300a, the output control unit 104a of the notification device 100a notifies the received sensor identification information by controlling the output unit 101 according to the received sensor identification information (step S112). ).

FIG. 14 is a sequence chart showing a flow of processing when the relationship information record 83 is registered in the relationship information table in the operation of the video providing system 800a in the second embodiment. A part of the process flow of FIG. 14 is the same as a part of the process flow of FIG. Therefore, description of the processes common to those in FIG. 9 will be omitted.

Upon receiving the video data and the photographing device identification information, the video analysis unit 506a of the control device 500a executes an analysis process on the received video data. The video analysis unit 506a acquires one or a plurality of pieces of sensor identification information notified by the output unit 101 of the notification device 100 captured in the video by performing an analysis process (step S311). The video analysis unit 506a outputs the sensor identification information acquired by the analysis process and the imaging device identification information received together with the video data to the relationship analysis unit 507a.

The relationship analysis unit 507a associates the imaging device identification information output from the video analysis unit 506a with the sensor identification information acquired in the process of step S311 and registers them in the relationship information table (step S312).

The video providing system 800a according to the second embodiment configured in this manner also provides the same effects as the video providing system 800 according to the first embodiment.

In addition, in the video providing system 800a according to the second embodiment configured as described above, it is not necessary to use the intermediate identification information. Therefore, the control device 500 can acquire the correspondence relationship between the imaging device 400 and the sensor 200 only by analyzing the video data transmitted from the imaging device 400 without analyzing the information transmitted from the gateway 300a. Become.

[Modification]
The first network may be constructed as a closed network. The second network may also be constructed as a closed network.
The notification device 100 according to the first embodiment does not necessarily have to include the intermediate identification information generation unit 103. For example, the notification device 100 may include a storage device that stores the intermediate identification information given in advance. In this case, the output control unit 104 acquires the intermediate identification information by reading the intermediate identification information from the storage device. In this case, the storage device may store a plurality of intermediate identification information in advance. The output control unit 104 of the notification device 100 receives an intermediate information different from the intermediate identification information read immediately before every time the gateway 300 to which the own device is connected changes, or each time the predetermined condition in step S201 is satisfied. The identification information may be read from the storage device.

The blinking pattern of the output unit 101 does not have to be limited to the technique disclosed in Reference 1 above. For example, the technique disclosed in the technique disclosed in Reference Document 2 below may be used.
Reference 2: FAQ No.1007798 (NEC format infrared remote control format [common]) http://japan.renesas.com/support/faqs/faq_results/Q1000000-Q9999999/mpumcu/com/remo_012j.jsp
When the technology disclosed in Reference 2 is used for output control of the output unit 101, the video analysis unit 506 is also configured to perform video analysis based on the technology disclosed in Reference 2.

The output unit 101 does not necessarily need to notify in a blinking pattern. For example, when the output unit 101 is configured as a display, the output unit 101 may notify the intermediate identification information by displaying a barcode (including a two-dimensional barcode) indicating the intermediate identification information. The output unit 101 may notify the intermediate identification information by displaying a color arrangement pattern or characters or images indicating the intermediate identification information.

The output unit 101 does not necessarily have to make the notification by the method of recording as an image. For example, the output unit 101 may be configured as a speaker that outputs sound. In this case, the output control unit 104 notifies the intermediate identification information by controlling the voice output from the output unit 101. The sound output from the output unit 101 is collected by the microphone of the image capturing apparatus 400 and recorded as audio data of video data. The video analysis unit 506 acquires the notified intermediate identification information by analyzing the sound included in the video data.
The video data does not necessarily include the image and the sound, and may be configured to include only the image. In this case, the output unit 101 makes a notification by a method of recording as an image.

The video analysis unit 506 may limit the video data to be analyzed, based on the timing at which the intermediate identification information is received from the gateway 300 (hereinafter, referred to as “reception timing”). For example, only the video data captured within a predetermined time before and after the reception timing may be the target of the analysis process. With such a configuration, the processing of the video analysis unit 506 can be reduced.
The notification device 100 may be configured integrally with the gateway 300. The notification device 100a may be configured integrally with the gateway 300a. The notification device 100 and the notification device 100a may be configured integrally with the sensor 200.
The control device 500 does not necessarily have to include the sensor identification information storage unit 504. That is, the control device 500 does not have to execute the process of step S105 in FIG. In this case, as a device different from the control device 500, a device that provides sensor information and video data to a terminal device (not shown) may be provided.
The sensor identification information table of the control device 500 may be manually registered by the administrator of the control device 500. In this case, the sensor information does not necessarily have to be transmitted to the control device 500.
The processing flow of each sequence chart shown in the first embodiment and the second embodiment is merely an example, and the order of the processing may be partially reversed. For example, in the process of FIG. 13, the order of the process of step S104 and the process of step S111 may be reversed.

The embodiment of the present invention has been described in detail above with reference to the drawings, but the specific configuration is not limited to this embodiment, and includes a design and the like within a range not departing from the gist of the present invention.

100... Notification device, 101... Output unit, 102... Communication unit, 103... Intermediate identification information generation unit, 104... Output control unit, 200... Sensor, 300... Gateway, 400... Imaging device, 500... Control device, 501... No. One communication unit, 502... Second communication unit, 503... Sensor information acquisition unit, 504... Sensor information storage unit, 505... Identification information storage unit, 506... Video analysis unit, 507... Relationship analysis unit, 600... First network , 700...Second network, 800...Video providing system

Claims (7)

The identification information of the sensor connected to the communication device from the communication device to which the pre-installed sensor and the notification device that notifies the intermediate identification information that is the identification information having the unique value that does not overlap with others are connected. A first communication unit that receives a certain sensor identification information and intermediate identification information notified by a notification device connected to the communication device,
The image is captured by the image capturing device from an image including the notification device that outputs the image according to the intermediate identification information and is output as an image to be recorded in the image capturing device, or the image capturing device that captures the sound emitted from the notification device. A second communication unit that receives video data that is video data and imaging device identification information that is identification information of the imaging device;
An image analysis unit that acquires the intermediate identification information notified by the notification device, based on the image of the notification device captured in the image data received by the second communication unit,
The sensor identification information received from the communication device, which receives the same intermediate identification information as the intermediate identification information acquired by the image analysis unit, and the image capturing apparatus that captures the image data analyzed by the image analysis unit. A relationship analysis unit that records the image capturing device identification information in association with each other as information indicating a corresponding relationship between the image capturing device and a sensor that detects an event related to an image captured by the image capturing device,
A control device including. Sensor identification information, which is identification information of a sensor connected to the communication device, from a communication device to which a pre-installed sensor and a notification device that notifies intermediate identification information having a unique value that does not overlap with others are connected. And a first communication step of receiving intermediate identification information notified by a notification device connected to the communication device,
The image is captured by the image capturing device from an image including the notification device that outputs the image according to the intermediate identification information and is output as an image to be recorded in the image capturing device, or the image capturing device that captures the sound emitted from the notification device. A second communication step of receiving video data which is video data, and imaging device identification information which is identification information of the imaging device;
A video analysis step of acquiring intermediate identification information notified by the notification device, based on the video of the notification device captured in the video data received in the second communication step,
The sensor identification information received from the communication device that has received the same intermediate identification information as the intermediate identification information acquired in the image analysis step, and the image capturing device that has captured the image data analyzed in the image analysis step. A relationship analysis step of recording the image capturing device identification information in association with each other as information indicating a corresponding relation between the image capturing device and a sensor that detects an event related to an image captured by the image capturing device,
And a control method. From an image capturing device that captures an image including a notification device connected to a communication device that receives sensor identification information indicating the sensor from a communication device to which a sensor installed in advance is connected, or a sound emitted from the notification device A communication unit that receives video data that is video data captured by the device and imaging device identification information that is identification information of the imaging device;
An image analysis unit that acquires the sensor identification information notified by the notification device, based on the image of the notification device captured in the image data received by the communication unit,
The sensor identification information obtained by the video analysis unit and the photography device identification information of the photography device that photographed the video data analyzed by the video analysis unit are photographed by the photography device and the photography device. A relationship analysis unit that records in association with each other as information indicating a correspondence relationship with a sensor that detects an event related to an image,
A control device including. The control device according to claim 3 , wherein the notification device performs an output corresponding to the sensor identification information and is output as an image in the imaging device. From an image capturing device that captures an image including a notification device connected to a communication device that receives sensor identification information indicating the sensor from a communication device to which a sensor installed in advance is connected, or a sound emitted from the notification device A communication step of receiving video data, which is data of a video taken by the device, and imaging device identification information, which is identification information of the imaging device,
An image analysis step of acquiring the sensor identification information notified by the notification device, based on the image of the notification device captured in the image data received in the communication step,
The sensor identification information obtained in the video analysis step and the photography device identification information of the photography device that captured the video data analyzed in the video analysis step are photographed by the photography device and the photography device. A relationship analysis step of recording the information in association with each other as information indicating a relationship with a sensor that detects an event related to an image,
And a control method. The control method according to claim 7, wherein the notification device performs an output corresponding to the sensor identification information and is output as an image in the imaging device. A computer program for causing a computer to function as the control device according to any one of claims 1, 3, and 4 .

Images