JP2017108252A - Video provision system, video provision method, terminal device, information provision method and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To transmit much more video images captured by imaging apparatuses in a system that communicates video images captured by imaging apparatuses over a closed network.SOLUTION: A sensor 200 transmits sensor information to a monitoring system 400 over a third network 700. Upon receiving sensor information, a sensor information acquisition part 406 of the monitoring system outputs the sensor information to a control part 405, and the control part transmits the sensor information to a terminal device 100 over a first network 500. An imaging apparatus 300 forms a closed network over a fourth network 800 in response to a request from the monitoring system and transmits video data to the monitoring system over the closed network. A video relay part 409 receives video data from the imaging apparatus over the closed network and transmits the video data to the terminal device 100 over a second network 600. The monitoring system forms the closed network only in the timing of transmitting video data to the terminal device over the fourth network, and opens the closed network when the transmission of the video data is completed.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a technology for displaying a sensor output and a captured image on a terminal device.

  In recent years, IoT (Internet Of Things) has attracted attention. In IoT, many sensors are connected to a network, and information about the device can be acquired at a remote location. Since it is difficult to grasp the situation with only the information about the numerical values obtained from the sensor, the video imaged by the imaging device may be acquired via the network. Such video may not be viewed by a third party. In such a case, a technique for constructing a closed network with an overlay network may be applied to maintain security when transmitting video. As a technique using an overlay network, for example, a technique disclosed in Patent Document 1 has been proposed.

JP 2012-114649 A

  When the number of imaging devices is large, a large number of closed networks are formed. However, the number of closed networks that can be terminated by the server device has an upper limit that depends on the performance of the server. For this reason, there is a case where a system in which a large number of imaging devices are connected cannot be constructed.

  In view of the above circumstances, an object of the present invention is to provide a technique that enables transmission of images from more imaging devices in a system that communicates images captured by an imaging device via a closed network.

  According to one aspect of the present invention, when a request for video data captured by an imaging device is received from a terminal device, the video relay unit relays the video data to the terminal device, and the imaging device A video providing system including a communication control unit that constructs a closed network in a communication path including a path and opens the closed network after relaying of the video data is completed.

  One aspect of the present invention is the video providing system described above, which is information transmitted from a sensor that detects an event related to a video captured by the imaging device, and represents a result of detection of the event. A control unit that transmits sensor information, which is information including detection information, to the terminal device via a first network; and the video relay unit, wherein the video relay unit is different from the first network. The video data is relayed to the terminal device via a second network.

  One aspect of the present invention is the video providing system described above, which is information transmitted from a sensor that detects an event related to a video captured by the imaging device, and represents a result of detection of the event. A sensor information acquisition unit configured to receive sensor information including detection information from the sensor via a third network; and the video relay unit includes a fourth network different from the third network from the imaging device. The video data is received through the network.

  According to one aspect of the present invention, when a request for video data captured by an imaging device is received from a terminal device, the video relay unit relays the video data to the terminal device and the imaging device. A video providing method comprising the steps of: constructing a closed network in a communication path including a path; and releasing the closed network after relaying of the video data is completed.

  One aspect of the present invention is a computer program for operating a computer as the video providing system.

One aspect of the present invention includes a control unit that displays on a screen a detection information display unit that indicates a detection result by a sensor that detects an event, and a button for instructing display of an image captured by an imaging device. The control unit is a terminal device that displays the button in association with the detection information display unit that indicates a detection result by a sensor that detects an event related to an image displayed by an operation on the button.
One aspect of the present invention includes a control unit that causes a detection information display unit that indicates a detection result by a sensor that detects an event to be displayed on a screen, and the control unit detects the detection information according to an operation on the detection information display unit. It is a terminal device that requests an image captured by an imaging device that captures an event related to the detection result indicated by the display unit to the image providing system that provides the image.
According to one aspect of the present invention, a detection information display unit that indicates a detection result by a sensor that detects an event, and a button for instructing display of an image captured by the imaging device are displayed on the screen of the terminal device. A display control step of transmitting information to the terminal device, wherein the detection information indicating a detection result by a sensor that detects an event related to an image displayed by an operation on the button in the display control step; An information providing method for transmitting information to be displayed in association with a display unit to the terminal device.
One aspect of the present invention includes a display control step of transmitting information for displaying a detection information display unit indicating a detection result by a sensor that detects an event on a screen of a terminal device to the terminal device, and the detection information display unit Control data defined to request a video providing system that provides the video for a video captured by an imaging device that is imaging an event related to the detection result indicated by the detection information display unit according to an operation. And a control step of transmitting to the terminal device.

  One embodiment of the present invention is a computer program for operating a computer as the terminal device.

  According to the present invention, in a system that communicates video captured by an imaging device via a closed network, it is possible to transmit video from more imaging devices.

It is a system configuration | structure figure showing the example of the system configuration | structure of the monitoring system 400 which is one Embodiment of a video provision system. It is a sequence chart which shows the specific example of the flow of the process in which the process at the time of sensor information accumulation | storage and the analysis process are performed among operation | movement of the monitoring system. 4 is a sequence chart showing a first specific example of a processing flow when video data is provided to the terminal device 100 among operations of the monitoring system 400. 10 is a sequence chart illustrating a second specific example of a flow of processing when video data is provided to the terminal device 100 among operations of the monitoring system 400. 10 is a sequence chart showing a third specific example of the flow of processing when video data is provided to the terminal device 100 in the operation of the monitoring system 400. 10 is a sequence chart showing a fourth specific example of the flow of processing when video data is provided to the terminal device 100 in the operation of the monitoring system 400. 6 is a diagram illustrating a specific example of a screen displayed on the display unit 104 of the terminal device 100. FIG. 6 is a diagram illustrating an example of a screen when an image captured by the imaging apparatus 300 is displayed on the display unit 104 of the terminal apparatus 100. FIG.

  FIG. 1 is a system configuration diagram illustrating an example of a system configuration of a monitoring system 400 that is an embodiment of a video providing system. The monitoring system 400 is communicably connected to the terminal device 100 via the first network 500 and the second network 600. The monitoring system 400 is communicably connected to one or more sensors 200 via the third network 700. The monitoring system 400 is communicably connected to one or more imaging devices 300 via the fourth network 800. The first network 500, the second network 600, the third network 700, and the fourth network 800 may be constructed by any network. For example, these networks may all be configured on the Internet.

  The terminal device 100 is configured using a communicable information processing device such as a personal computer, a smartphone, or a tablet. The terminal device 100 includes a CPU (Central Processing Unit), a memory, an auxiliary storage device, and the like connected by a bus. The terminal device 100 includes a first communication unit 101, a second communication unit 102, an input unit 103, a display unit 104, a storage unit 105, and a control unit 106. The control unit 106 acquires and displays the video provided by the monitoring system 400 by executing the video display program. Note that all or part of the functions of the video display program may be realized by using hardware such as an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a field programmable gate array (FPGA). The video display program may be recorded on a computer-readable recording medium. The computer-readable recording medium is a portable medium such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, a semiconductor storage device (for example, SSD: Solid State Drive), a hard disk built in a computer system, or a semiconductor storage. A storage device such as a device. The video display program may be transmitted via a telecommunication line.

  The first communication unit 101 is configured using a communication device such as a communication interface. The first communication unit 101 communicates with the monitoring system 400 via the first network 500. The first communication unit 101 may perform wired communication or wireless communication.

  The second communication unit 102 is configured using a communication device such as a communication interface. The second communication unit 102 communicates with the monitoring system 400 via the second network 600. The second network 600 is a network different from the first network 500. The second communication unit 102 may perform wired communication or wireless communication. The second network 600 is a highly secure communication network (for example, a closed network) provided for corporations by a communication company, for example. The second network 600 is a communication path using a dedicated line, SSL (Secure Sockets Layer), for example.

  The input unit 103 is configured using an existing input device such as a keyboard, a pointing device (such as a mouse or a tablet), a button, or a touch panel. The input unit 103 is operated by the user when inputting a user instruction to the terminal device 100. The input unit 103 may be an interface for connecting the input device to the terminal device 100. In this case, the input unit 103 inputs an input signal generated in response to a user input in the input device to the terminal device 100.

The display unit 104 is an image display device such as a CRT (Cathode Ray Tube) display, a liquid crystal display, or an organic EL (Electro Luminescence) display. The display unit 104 displays an image showing a detection result of the sensor 200 and an image showing an analysis result in the monitoring system 400. The display unit 104 may be an interface for connecting the image display device to the terminal device 100. In this case, the display unit 104 generates a video signal for displaying the image and outputs the video signal to an image display device connected to the display unit 104.
The storage unit 105 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The storage unit 105 stores data according to control by the control unit 106.

  The control unit 106 controls the operation of the terminal device 100. For example, the control unit 106 generates an image according to the definition of the video display program, and causes the display unit 104 to display the generated image. For example, the control unit 106 generates transmission data according to a user operation on the input unit 103, and transmits the generated transmission data via the first network 500 or the second network 600. For example, the control unit 106 changes the image displayed on the display unit 104 in accordance with a user operation on the input unit 103. For example, the control unit 106 generates an image based on data received via the first network 500 or the second network 600 and causes the display unit 104 to display the generated image. When control unit 106 receives sensor information (including information detected by sensor 200, detection time, and identification information of sensor 200) via first network 500, control unit 106 stores the received sensor information in storage unit 105. Record. The control unit 106 transmits the analysis result information (the analysis result by the analysis unit 407, the detection time of the detection information to be analyzed, the identification information of the sensor 200 that has detected the detection information to be analyzed) via the first network 500. Is received), the received analysis result is recorded in the storage unit 105.

  The sensor 200 transmits the detected information (hereinafter referred to as “detection information”) to the monitoring system 400 via the third network 700. One sensor 200 may be connected to the third network 700, or a plurality of sensors 200 may be connected. Any type of sensor may be applied to the sensor 200. A plurality of types of sensors may be applied to the sensor 200. The sensor 200 may be, for example, a sensor for measuring temperature, a sensor for measuring atmospheric pressure, a sensor for measuring volume, or a sensor for measuring wind speed. Good. A plurality of sensors 200 may be grouped into one or a plurality of groups via a relay device such as a gateway device.

  Unique identification information (hereinafter referred to as “sensor ID”) is assigned to the sensor 200. When the sensor 200 transmits the detection information to the monitoring system 400, the sensor 200 also transmits the sensor ID assigned to it. When transmitting the detection information to the monitoring system 400, the sensor 200 may also transmit the date and time (time stamp) when the detection information was obtained. The sensor 200 generates and transmits sensor information including, for example, detection information, a sensor ID, and a time stamp. When a plurality of sensors 200 are grouped as described above, the sensor ID may be configured to further indicate the group to which the sensor 200 belongs. For example, the sensor ID may have a hierarchical structure according to grouping. For example, a sensor ID “1-3” may be assigned to the third sensor 200 in group 1.

  The imaging device 300 captures a surrounding image where the imaging device 300 is installed. The imaging device 300 records the captured video data in a storage device included in the imaging device 300. The imaging apparatus 300 forms a closed network via the fourth network 800 in response to a request from the monitoring system 400. The closed network is formed as an overlay network in the fourth network 800, for example. The imaging apparatus 300 transmits video data to the monitoring system 400 via the formed closed network. One imaging device 300 may be connected to the fourth network 800, or a plurality of imaging devices 300 may be connected. Unique identification information (hereinafter referred to as “camera ID”) is assigned to the imaging apparatus 300. When the imaging apparatus 300 transmits video data to the monitoring system 400, the imaging apparatus 300 also transmits a camera ID assigned to itself. A plurality of imaging devices 300 may be grouped into one or a plurality of groups via a relay device such as a gateway device. When a plurality of imaging devices 300 are grouped, the camera ID may be configured to further indicate a group to which the imaging device 300 belongs. For example, the camera ID may have a hierarchical structure according to grouping. For example, a camera ID “1-3” may be assigned to the third imaging device 300 in group 1.

  The monitoring system 400 is configured by one or a plurality of information processing apparatuses. Specific examples of the information processing apparatus include a mainframe, a workstation, a personal computer, and a PLC (Programmable Logic Controller). For example, when the monitoring system 400 is configured by a single information processing device, the information processing device includes a CPU, a memory, an auxiliary storage device, and the like connected by a bus, and executes a video providing program. All or some of the functions of the monitoring system 400 may be realized using hardware such as an ASIC, PLD, or FPGA. Moreover, the monitoring system 400 may be realized by dedicated hardware. The video providing program may be recorded on a computer-readable recording medium. The video providing program may be provided via a telecommunication line. When the monitoring system 400 includes a plurality of information processing devices, the control unit 405, the sensor information acquisition unit 406, the analysis unit 407, the communication control unit 408, and the video relay unit 409 may be mounted on different devices. Alternatively, a plurality of functional units among the functional units may be mounted on one device. For example, the control unit 405, the sensor information acquisition unit 406, and the analysis unit 407 may be mounted on different information processing devices, and the communication control unit 408 and the video relay unit 409 may be mounted on one information processing device.

  The monitoring system 400 includes a first communication unit 401, a second communication unit 402, a third communication unit 403, a fourth communication unit 404, a control unit 405, a sensor information acquisition unit 406, an analysis unit 407, a communication control unit 408, and a video relay. Unit 409 and storage unit 410.

  The first communication unit 401 is configured using a communication device such as a communication interface. The first communication unit 401 communicates with the terminal device 100 via the first network 500. The first communication unit 401 may perform wired communication or wireless communication. The first communication unit 401 transmits sensor information including detection information acquired by the sensor 200 to the terminal device 100, for example. For example, the first communication unit 401 transmits the analysis result of the analysis unit 407 to the terminal device 100.

  The second communication unit 402 is configured using a communication device such as a communication interface. The second communication unit 402 communicates with the terminal device 100 via the second network 600. The second communication unit 402 may perform wired communication or wireless communication. For example, the second communication unit 402 transmits video data captured by the imaging device 300 (hereinafter referred to as “video data”) to the terminal device 100.

  The third communication unit 403 is configured using a communication device such as a communication interface. The third communication unit 403 communicates with the sensor 200 via the third network 700. The third communication unit 403 may perform wired communication or wireless communication. The third communication unit 403 receives sensor information including detection information acquired by the sensor 200 from the sensor 200, for example.

  The fourth communication unit 404 is configured using a communication device such as a communication interface. The fourth communication unit 404 communicates with the imaging device 300 via the fourth network 800. The fourth communication unit 404 may perform wired communication or wireless communication. For example, the fourth communication unit 404 receives video data captured by the imaging device 300 from the imaging device 300.

The control unit 405 executes processing necessary for providing detection information and video data to the terminal device 100. The control unit 405 may further execute processing necessary for providing the analysis result to the terminal device 100. Specific operations of the control unit 405 will be described later.
The sensor information acquisition unit 406 acquires sensor information from one or more sensors 200 via the third network 700. The sensor information acquisition unit 406 outputs the acquired sensor information to the control unit 405.

  The analysis unit 407 performs an analysis process on the detection information acquired by the sensor information acquisition unit 406. The analysis unit 407 outputs the analysis result information (including the analysis result, the detection time of the detection information to be analyzed, and the sensor ID of the sensor 200 that has detected the detection information to be analyzed) to the control unit 405. . As a specific example of the analysis process performed by the analysis unit 407, there is a process of determining whether the detection information is information indicating that the detection information is normal or whether the detection information is information indicating that an abnormality has occurred. As a specific example of the analysis process performed by the analysis unit 407, there is a process of determining whether there is a possibility of a future abnormality although it is normal at the present time. More specifically, the analysis unit 407 may perform the determination by determining whether or not the detection information satisfies a condition (for example, a threshold value) set in advance for each type of sensor 200 and sensor ID. The detection information to be analyzed by the analysis unit 407 may be the detection information (current detection information) acquired by the sensor information acquisition unit 406, or the current or past specified by the control unit 405. It may be detection information, or may be detection information instructed by a user of the terminal device 100 or an administrator of the monitoring system 400. The past detection information is acquired by reading from the storage unit 410.

  The communication control unit 408 constructs a closed network in a communication path (fourth network 800) including a path between the video relay unit 409 and the imaging device 300. The closed network constructed by the communication control unit 408 is a communication path that suppresses acquisition of video data by a third party who does not have a valid authority. The communication control unit 408 may further perform QoS (Quality of Service) control for preferentially transferring packets used for communication in the closed network. For the closed network constructed by the communication control unit 408, communication using an encrypted communication method (for example, VPN: Virtual Private Network) such as SSL (Secure Sockets Layer) and TLS (Transport Layer Security) is applied. Also good. For example, the communication control unit 408 may store in advance a table in which the IP address of each imaging device 300 is associated with the camera ID of each imaging device 300. The communication control unit 408 may acquire the IP address of the camera ID instructed by the control unit 405 by referring to the table and construct a closed network.

  The video relay unit 409 receives video data from the imaging device 300 via a closed network constructed by the communication control unit 408. The video relay unit 409 transmits the received video data to the terminal device 100 via the second network 600. The video relay unit 409 may provide video data to the terminal device 100 by operating as, for example, a WEB server. More specifically, the video relay unit 409 may notify the terminal device 100 of a URL (Uniform Resource Locator) indicating a video data file via the control unit 405. In this case, the video relay unit 409 provides video data in response to reception of a request for the URL of the video data file (for example, a GET method of the HTTP protocol). The video relay unit 409 performs format conversion processing when the format of video data received via the closed network is different from the format of video data reproducible in the terminal device 100. Examples of video data formats that can be played back by the terminal device 100 include MP4 and Flash Video. The video relay unit 409 may perform image processing on the video data. For example, the video relay unit 409 may perform image processing for changing brightness or contrast on the video. The video relay unit 409 may determine whether or not the video to be relayed is dark, and may perform image processing so as to increase the brightness when it is determined that the video is dark. The video relay unit 409 may determine whether or not the video of the relay target video is unclear, and may perform image processing to increase the contrast when it is determined that the image is unclear.

  The storage unit 410 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The storage unit 410 stores data according to the control of the control unit 405. The storage unit 410 stores sensor information acquired by the sensor information acquisition unit 406, for example. The storage unit 410 may further store the analysis result obtained by the analysis unit 407.

  FIG. 2 is a sequence chart showing a specific example of the flow of processing in which the sensor information is accumulated and the analysis processing is performed in the operation of the monitoring system 400. The sensor 200 generates sensor information at a predetermined timing (step S101). The predetermined timing may be a timing having a predetermined time interval, a timing at which a predetermined time arrives, or a timing at which an instruction is received from another device such as the monitoring system 400. Or other timing may be sufficient. The sensor 200 transmits sensor information to the monitoring system 400 via the third network 700 (step S102). The transmitted sensor information includes detection information, sensor ID, and time stamp.

  When the sensor information acquisition unit 406 of the monitoring system 400 receives the sensor information via the third network 700, the sensor information acquisition unit 406 outputs the received sensor information to the control unit 405. When acquiring the sensor information from the sensor information acquisition unit 406, the control unit 405 records the acquired sensor information in the storage unit 410 (step S103). By repeatedly executing the recording in step S103, a history of sensor information is recorded in the storage unit 410. Further, the control unit 405 transmits the acquired sensor information to the terminal device 100 via the first network 500 (step S104). When receiving the sensor information, the control unit 106 of the terminal device 100 displays the received sensor information on the display unit 104 (step S105). The sensor information may be displayed, for example, in a form in which a time-series change appears as a graph, or may be displayed in a form in which only the latest value appears like a meter.

  The analysis unit 407 of the monitoring system 400 requests the control unit 405 for the sensor information acquired by the sensor information acquisition unit 406 at a predetermined timing. The predetermined timing may be a timing having a predetermined time interval, a timing at which a predetermined time arrives, or a timing at which an instruction is received from another device such as the terminal device 100. Alternatively, it may be the timing when an instruction from the administrator of the monitoring system 400 is given, or another timing. The analysis unit 407 may specify a sensor ID when making a request. The analysis unit 407 may specify a time zone when making a request. The control unit 405 reads sensor information from the storage unit 410 in response to a request from the analysis unit 407, and outputs the read sensor information to the analysis unit 407. When the sensor ID is designated, the control unit 405 outputs only the sensor information corresponding to the designated sensor ID to the analysis unit 407. When the time zone is designated, the control unit 405 outputs only the sensor information having the time stamp of the time included in the designated time zone to the analysis unit 407. On the other hand, when the time zone is not designated, the control unit 405 may output the latest sensor information among the sensor information of each sensor ID to the analysis unit 407, or the first acquisition of sensor information after the request is performed by the analysis unit. The sensor information may be output to 407, or only sensor information that has not been analyzed by the analysis unit 407 may be output to the analysis unit 407. The process of outputting only sensor information that has not been subjected to analysis processing can be performed by recording, for each sensor information, whether the control unit 405 has performed analysis by the analysis unit 407 in the storage unit 410.

  The analysis unit 407 performs an analysis process based on the sensor information acquired from the control unit 405 (step S106). The analysis unit 407 notifies the control unit 405 of the analysis result information. The analysis result information includes the analysis result, the sensor ID and time stamp of the sensor information to be analyzed. The control unit 405 records the analysis result information notified from the analysis unit 407 in the storage unit 410. In addition, the control unit 405 transmits the analysis result information notified from the analysis unit 407 to the terminal device 100 (step S107). When receiving the analysis result information, the control unit 106 of the terminal device 100 displays an image corresponding to the analysis result included in the received analysis result information on the display unit 104 (step S108). For example, the analysis result may be displayed as an image or a character indicating normality or abnormality of the detection information, or may be displayed as a color indicating normality or abnormality of the detection information.

  The control unit 405 deletes the sensor information recorded in the storage unit 410 at a predetermined timing. The predetermined timing may be a timing at which a predetermined time (for example, 24 hours) has elapsed since each sensor information was recorded in the storage unit 410, for example. For example, when the size of the storage area occupied by the sensor information exceeds a threshold value, sensor information of a predetermined data amount may be deleted collectively from the oldest one. The deletion of the sensor information may be performed according to any other rule.

  FIG. 3 is a sequence chart showing a first specific example of the flow of processing when video data is provided to the terminal device 100 among the operations of the monitoring system 400. When the user of the terminal device 100 performs an image display operation by operating the input unit 103 (step S201), the control unit 106 determines a camera ID of a video to be displayed according to the image display operation (step S202). .

  The camera ID may be directly designated by the user, for example, or may be selected by the control unit 106 according to the user's operation. For example, the control unit 106 may determine the camera ID associated with the button pressed by the user during the image display operation as the camera ID of the video to be displayed. In this case, the control unit 106 stores in advance a table in which buttons and camera IDs are associated with each other. For example, the control unit 106 determines the camera ID associated with the sensor ID of the sensor information displayed in association with the button pressed by the user during the image display operation as the camera ID of the video to be displayed. Good. In this case, the control unit 106 stores in advance a table in which sensor IDs and camera IDs are associated with each other. The image pickup apparatus 300 with the determined camera ID shows a video around the area where the sensor 200 indicated by the sensor ID of the sensor information displayed in association with the pressed button is installed, and an object to be detected by the sensor 200. It is desirable to capture images.

  The control unit 106 determines video time information (step S203). The video time information is information that uniquely indicates a required video imaging time zone. For example, the video time information may be information indicating a video start time (image capturing time at the video start time) and an end time (image capturing time at the video end time), or the video start time and time length. Or information indicating the latest video. When the video time information is information indicating the latest video, the video captured by the imaging device 300 with the specified camera ID is provided in real time or in a form close to real time (for example, video delayed by a transmission delay). The The video time information may be specified by the user of the terminal device 100, for example. In this case, the control unit 106 determines the video time information based on the content specified by the user operating the input unit 103. The video time information is, for example, fixedly set in advance in the control unit 106, and may be determined by the control unit 106 based on the set time. For example, the control unit 106 may fixedly determine the time from a predetermined time before the present to the present as the video time information. The control unit 106 may determine the video time information based on the camera ID. For example, the control unit 106 determines video time information as information indicating the latest video for a camera ID associated with a sensor ID for which an analysis result indicating abnormality has not been obtained for a predetermined time until now. Also good. On the other hand, with respect to the camera ID associated with the sensor ID for which an analysis result indicating an abnormality is obtained within a predetermined time period until now, the control unit 106 displays a video based on the time when the analysis result indicating an abnormality is obtained. Time information may be determined. More specifically, a predetermined time (for example, 5 seconds, 30 seconds, 1 minute, etc.) before and after the time when the analysis result indicating the abnormality is obtained may be determined as the video time information. The time from the time that is a predetermined time (for example, 5 seconds, 30 seconds, 1 minute, etc.) after the obtained time to the time when the analysis result is obtained may be determined as the video time information.

  The control unit 106 transmits a video request including the determined camera ID and video time information to the monitoring system 400 via the first network 500 (step S204). When receiving the video request via the first network 500, the control unit 405 of the monitoring system 400 performs processing for constructing a closed network with the imaging device 300 based on the received video request (step S205). ). Hereinafter, a specific example of processing when constructing a closed network will be described.

  First, the control unit 405 instructs the communication control unit 408 to construct a closed network with the imaging device 300 indicated by the camera ID included in the received video request. The communication control unit 408 acquires the IP address of the imaging device 300 indicated by the instructed camera ID. The acquisition of the IP address may be realized by the monitoring system 400 storing in advance a table in which the camera ID and the IP address are associated with each other, or the camera may be compared with other devices having the above table. You may implement | achieve by inquiring an IP address by transmitting ID. The communication control unit 408 constructs a closed network with the imaging device 300 via the fourth network 800 using the acquired IP address.

  The control unit 405 requests information (hereinafter referred to as “video acquisition information”) for acquiring requested video data by outputting a video request to the video relay unit 409. The video acquisition information is, for example, a URL indicating video data. The video relay unit 409 requests video data corresponding to the video time information included in the video request to the imaging device 300 corresponding to the camera ID (step S206). Upon receiving a video data request from the monitoring system 400, the imaging apparatus 300 starts transmission of video data corresponding to the requested video time information to the monitoring system 400 (step S207). When receiving video data from the imaging apparatus 300, the video relay unit 409 performs format conversion processing, display size change processing, and image processing on the received video data as necessary (step S208). The display size after conversion may be determined according to the specifications of the requesting terminal device 100. The video relay unit 409 buffers video data transmitted to the terminal device 100. For example, the video relay unit 409 may buffer video data in a storage area that can be disclosed by its own WEB server function. The video relay unit 409 determines the video acquisition information of the buffered video and outputs the determined video acquisition information to the control unit 405. The control unit 405 transmits the video acquisition information to the terminal device 100 that is the transmission source of the video request via the first network 500 (step S209).

  When receiving the video acquisition information, the control unit 106 of the terminal device 100 generates information (hereinafter referred to as “video data request”) for requesting acquisition of video data based on the video acquisition information. The video data request is information indicating a data acquisition request such as an HTTP protocol GET method. When the GET method of the HTTP protocol is used, a URL indicating video data may be used as the video acquisition information. The control unit 106 transmits the generated video data request to the monitoring system 400 via the second network 600 (Step S210). When receiving the video data request via the second network 600, the video relay unit 409 transmits the video data requested by the video data request to the terminal device 100 via the second network 600 (step S211). The transmission of the video data may be realized as streaming or as a file download. The control unit 106 of the terminal device 100 causes the display unit 104 to display the video data received via the second network 600 (step S212). Thereafter, when transmission of video data to the terminal device 100 is completed, the communication control unit 408 and the imaging device 300 of the monitoring system 400 open the closed network in the fourth network 800. The closed network may be released at any timing as long as the processing in step S207 is completed. Through this process, the communication resources of the video relay unit 409 are also released.

  FIG. 4 is a sequence chart showing a second specific example of the flow of processing when video data is provided to the terminal device 100 among the operations of the monitoring system 400. In the second specific example, unlike the first specific example, the video time information determination process is executed in the monitoring system 400 instead of the terminal device 100.

  When the user of the terminal device 100 performs an image display operation by operating the input unit 103 (step S301), the control unit 106 determines a camera ID of a video to be displayed according to the image display operation (step S302). . The processing when the camera ID is determined is the same as the first specific example shown in FIG.

  The control unit 106 transmits a video request including the determined camera ID to the monitoring system 400 via the first network 500 (step S303). In the second specific example, video time information transmitted from the terminal device 100 to the monitoring system 400 does not include video time information.

  When receiving the video request from the terminal device 100, the control unit 405 of the monitoring system 400 determines video time information (step S304). The video time information is, for example, fixedly set in advance in the control unit 405, and may be determined by the control unit 405 based on the set time. For example, the control unit 405 may fixedly determine the time from a predetermined time before the present to the present as the video time information. The control unit 405 may determine the video time information based on the camera ID. For example, the control unit 405 refers to the analysis result information recorded in the storage unit 410 and relates to a camera ID associated with a sensor ID for which an analysis result indicating abnormality has not been obtained for a predetermined time until now. The video time information may be determined as information indicating the latest video. On the other hand, with respect to the camera ID associated with the sensor ID for which an analysis result indicating abnormality is obtained within a predetermined time until now, the control unit 405 displays a video based on the time when the analysis result indicating abnormality is obtained. Time information may be determined. More specifically, a predetermined time (for example, 5 seconds, 30 seconds, 1 minute, etc.) before and after the time when the analysis result indicating the abnormality is obtained may be determined as the video time information. The video time information may be determined from a time that is a predetermined time (for example, 5 seconds, 30 seconds, 1 minute, etc.) before the time when the analysis result is obtained. In this case, the control unit 106 stores in advance a table in which sensor IDs and camera IDs are associated with each other.

  When determining the video time information, the control unit 405 starts to construct a closed network with the imaging device 300 (step S305). The processes after step S305 (steps S305 to S312) are the same as the processes of steps S205 to S212 in FIG. Therefore, explanation is omitted.

  FIG. 5 is a sequence chart showing a third specific example of the flow of processing when video data is provided to the terminal device 100 in the operation of the monitoring system 400. In the third specific example, unlike the first specific example, the history of sensor information is selected by the user.

  First, the user of the terminal device 100 performs a selection operation on a history of desired video at the time when the detection information related to the history is obtained from the history of sensor information displayed on the display unit 104 (step). S401). The selection operation may be performed, for example, by pressing an image indicating desired sensor information or an analysis result among a plurality of sensor information indicating the history displayed on the display unit 104 or an image indicating the analysis result. The selection operation may be performed, for example, by pressing a button displayed in association with a plurality of pieces of sensor information indicating a history or a plurality of analysis results on the display unit 104. When the selection operation is performed on the history, the control unit 106 determines the camera ID based on the sensor information of the selected history (step S402). In this case, the control unit 106 stores in advance a table in which sensor IDs and camera IDs are associated with each other. The processes after step S402 (steps S402 to S412) are the same as the processes of steps S202 to S212 in FIG. 3, respectively. Therefore, explanation is omitted. In addition, the process after step S402 may be performed similarly to the process of step S302-S312 unlike the flow shown by FIG.

  FIG. 6 is a sequence chart showing a fourth specific example of the flow of processing when video data is provided to the terminal device 100 among the operations of the monitoring system 400. In the fourth specific example, the terminal device 100 determines whether to display a video according to the analysis result received from the monitoring system 400, and performs subsequent processing according to the determination result.

  First, the analysis unit 407 of the monitoring system 400 executes an analysis process based on the sensor information acquired from the control unit 405 (step S501). The analysis unit 407 notifies the control unit 405 of the analysis result information. The analysis result information includes the analysis result, the sensor ID and time stamp of the sensor information to be analyzed. The control unit 405 transmits the analysis result information notified from the analysis unit 407 to the terminal device 100 (step S502).

  When receiving the analysis result information, the control unit 106 of the terminal device 100 causes the display unit 104 to display an image corresponding to the analysis result included in the received analysis result information (step S503). For example, the analysis result may be displayed as an image or a character indicating normality or abnormality of the detection information, or may be displayed as a color indicating normality or abnormality of the detection information. Based on the analysis result included in the received analysis result information, the control unit 106 determines whether it is necessary to display a video related to the obtained analysis result (step S504). Specifically, the control unit 106 determines whether or not the analysis result included in the received analysis result information satisfies a predetermined condition. The predetermined condition may be that the analysis result indicates abnormality, for example. The predetermined condition may be, for example, that the analysis result indicates an abnormality over a predetermined time (for example, 10 seconds, 1 minute) or a predetermined number of times (for example, 2 times, 5 times). When it is determined that display of video is not necessary (predetermined conditions are not satisfied) (NO in step S504), the control unit 106 does not execute the processing from step S505 onward until the next analysis result information is received. stand by. When it is determined that display of video is necessary (a predetermined condition is satisfied) (step S504—YES), the control unit 106 determines a camera ID and video time information (step S505). The processes after step S506 (steps S506 to S514) are the same as the processes of steps S204 to S212 in FIG. Therefore, explanation is omitted. Note that the processing for determining the video time information may be executed in the monitoring system 400, unlike the flow shown in FIG.

FIG. 7 is a diagram illustrating a specific example of a screen displayed on the display unit 104 of the terminal device 100. A plurality of detection information display units 901 and video buttons 902 are displayed on the display unit 104.
The detection information display unit 901 shows information detected by the sensor 200. The detection information display unit 901 may be displayed in a different manner depending on whether the analysis result is normal or abnormal. For example, a part or all of the color of the detection information display unit 901 may be different depending on whether the analysis result is normal or abnormal, the thickness of the line may be different, and the presence or absence of blinking May be different.

  The video button 902 is a button for displaying video captured by the imaging device 300 when pressed by the user. The video button 902 is displayed in association with a detection information display unit 901 indicating detection information of the sensor 200 related to the video displayed when the video button 902 is pressed. In other words, the imaging device 300 with the camera ID associated with the video button 902 has a video of the vicinity where the detection information sensor 200 indicated by the detection information display unit 901 displayed in association with the pressed video button 902 is installed. It is desirable to capture an image showing the object detected by the sensor 200. The “image display operation” in the sequence charts of FIGS. 2 and 3 may be performed, for example, when the video button 902 is pressed. The associated display may be realized, for example, by being displayed at a location (near) where the distance is close, or may be realized by being connected and displayed by a geometric shape such as a line, It may be realized by display (for example, the same color is displayed, the background is the same color).

A graph 903 shows a time-series change of a numerical value that is detection information by the sensor 200.
The system image display area 904 is an area in which an image representing the configuration of the monitoring target system provided with the plurality of sensors 200 is displayed.
The history display area 905 is an area in which the history of sensor information and analysis result information in the plurality of sensors 200 is displayed. For example, in the history display area 905, a predetermined number of sensor information and analysis result information from the latest history are displayed vertically. The “history selection operation” in the sequence chart of FIG. 5 may be performed by pressing sensor information or analysis result information displayed in the history display area 905, for example.

  FIG. 8 is a diagram illustrating an example of a screen when the video imaged by the imaging device 300 is displayed on the display unit 104 of the terminal device 100. When an image is displayed on the display unit 104 of the terminal device 100, a pop-up area 906 may be displayed on the upper layer of the screen shown in FIG. In the pop-up area 906, a video display area 907 and a numerical value display unit 908 are provided. An image received via the second network 600 is displayed in the image display area 907. The numerical information display unit 908 displays sensor information of the sensor 200 at the same time that the video displayed in the video display area 907 of the same pop-up area 906 is captured. Such synchronization of video and sensor information (displaying video and sensor information obtained at the same time) may be performed as follows, for example.

  First, the control unit 106 receives video data from the monitoring system 400 via the second network 600. Information capable of deriving the time at which each frame was captured is added to the video data. For example, the time when the first frame was imaged and information related to the time elapsed between the frames may be added to the video data. For example, the time taken for the frame may be given at predetermined intervals. The control unit 106 acquires the imaging time of the video frame displayed on the display unit 104. The control unit 106 acquires, from the storage unit 105, sensor information having a time stamp at the same time among sensor information having a sensor ID associated with the camera ID of the displayed video. Then, the control unit 106 generates an image of the numerical value display unit 908 based on the acquired sensor information. In this case, the control unit 106 stores in advance a table in which sensor IDs and camera IDs are associated with each other.

  The synchronization process may be performed as follows. The control unit 106 acquires the imaging time of the video frame displayed on the display unit 104 by the above-described processing. The control unit 106 requests the monitoring system 400 for sensor information having a time stamp of the same time among sensor information having a sensor ID associated with the camera ID of the displayed video. The control unit 405 of the monitoring system 400 reads the requested sensor information from the storage unit 410. The control unit 405 transmits the read sensor information to the terminal device 100 that is the request source. The control unit 106 receives sensor information. Then, the control unit 106 generates an image of the numerical value display unit 908 based on the received sensor information. In this case, the control unit 106 stores in advance a table in which sensor IDs and camera IDs are associated with each other.

In the monitoring system 400 configured as described above, in the network (fourth network 800) through which video data is transmitted, a closed network is not always formed, but video data is transmitted to the terminal device 100. A closed network is formed only at the timing. When the transmission of the video data is completed, the closed network is released. Since the network resources for constructing the closed network are released by releasing the closed network, it is possible to construct a new closed network. Therefore, in a system that communicates video captured by an imaging device via a closed network, it is possible to transmit video from more imaging devices.
In the monitoring system 400, video data is transmitted via a closed network. Therefore, it is possible to maintain high security with respect to video data.

Further, a network (first network 500) in which sensor information is transmitted to the terminal device 100 is different from a network (second network 600) in which video data is transmitted to the terminal device 100. Therefore, transmission of small-capacity sensor information that has high priority and occurs frequently can be prevented from being delayed or congested due to transmission of large-capacity video data.
Also, the network (third network 700) through which sensor information is transmitted to the monitoring system 400 is different from the network (fourth network 800) through which video data is transmitted to the monitoring system 400. Therefore, transmission of small-capacity sensor information that has high priority and occurs frequently can be prevented from being delayed or congested due to transmission of large-capacity video data.

  Further, on the screen displayed on the display unit 104 of the terminal device 100, display of sensor information (for example, detection information display unit 901), and a button (for example, video button 902) for displaying an image related to the sensor information. Are displayed in association with each other. Therefore, when the user of the terminal device 100 wants to view a video related to certain sensor information, it is not necessary to store information such as the camera ID of the camera that is capturing the video related to the sensor information. That is, it is possible to easily view a desired video by intuitively pressing a button displayed in association with the display of sensor information.

[Modification]
The number of networks between the terminal device 100 and the monitoring system 400 is not necessarily two. For example, the terminal device 100 and the monitoring system 400 may be physically connected by a single network, and a plurality of logical networks may be constructed on this network. In this case, the sensor information and the video data may be transmitted through different logical networks. Such a logical network may be configured using a technique such as VLAN (Virtual LAN). Further, the terminal device 100 and the monitoring system 400 may be physically and logically connected by a single network. In this case, sensor information and video data are transmitted over the same network.
The first network may be constructed as a closed network. The second network may also be constructed as a closed network. The third network may also be constructed as a closed network.
The sensor information acquisition unit 406 may record sensor information in the storage unit 410. In this case, the control unit 405 does not necessarily need to record sensor information in the storage unit 410. The control unit 405 may acquire the sensor information by requesting the sensor information from the sensor information acquisition unit 406, for example. The sensor information acquisition unit 406 may acquire sensor information from the storage unit 410 in response to a request received from the control unit 405, and output the acquired sensor information to the control unit 405.

  In the sequence chart of FIG. 2, the control unit 405 transmits the sensor information to the terminal device 100 individually, but the control unit 405 may transmit a plurality of pieces of sensor information to the terminal device 100 together. In addition, the control unit 405 may collectively transmit sensor information received during a predetermined period in the past (for example, up to 5 seconds until now) to the terminal device 100.

  The analysis unit 407 may notify the analysis result information to the control unit 405 only when the analysis result indicates abnormality. The control unit 405 may transmit the analysis result information to the terminal device 100 only when the analysis result indicates abnormality.

  The image display operation in step S201 in FIG. 3 may be executed by the user in response to the occurrence of an abnormality displayed in the analysis result display in step S108 in FIG. May be executed by In addition, the control unit 106 may execute the processing after step S202 based on a predetermined condition regardless of whether or not an image display operation is performed.

The process for determining the camera ID in FIG. 3 and the like is not necessarily executed in the terminal device 100. For example, the terminal device 100 may be configured to transmit to the monitoring system 400 identification information indicating a button pressed by the user or sensor ID of sensor information displayed in association with the pressed button. In this case, the control unit 405 of the monitoring system 400 may determine the camera ID associated with the identification information indicating the button or the sensor ID as the camera ID of the video to be displayed. In this case, the control unit 405 stores in advance a table in which identification information indicating a button or a sensor ID and a camera ID are associated with each other.
In FIG. 8, as a specific example of the numerical value display unit 908 in the pop-up area 906, an example of display in a form in which only the latest value appears like a meter is shown, but it is not limited to such an example. For example, the numerical information display unit 908 may display the sensor information in a form in which a time-series change appears as a graph.
The video button 902 may not be displayed on the screen displayed on the display unit 104 of the terminal device 100. In this case, the detection information display unit 901 may realize a function equivalent to the video button 902. That is, the detection information display unit 901 may function as an operable button. When the detection information display unit 901 is operated, a video in the vicinity of where the sensor 200 of the detection information indicated by the detection information display unit 901 is installed, or a video in which a target to be detected by the sensor 200 is captured. Is requested to the monitoring system 400.
The screen displayed on the display unit 104 of the terminal device 100 may be provided to the terminal device 100 by the control unit 405 of the monitoring system 400 instead of being generated by executing a program installed in the terminal device 100. . For example, when the screen is displayed by a WEB browser, the control unit 405 may transmit screen information (for example, data defined by HTML) such that the screen is displayed to the terminal device 100.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes designs and the like that do not depart from the gist of the present invention.

DESCRIPTION OF SYMBOLS 100 ... Terminal device, 101 ... 1st communication part, 102 ... 2nd communication part, 103 ... Input part, 104 ... Display part, 105 ... Memory | storage part, 106 ... Control part, 200 ... Sensor, 300 ... Imaging device, 400 ... Monitoring system 401 ... First communication unit 402 ... Second communication unit 403 ... Third communication unit 404 ... Fourth communication unit 405 ... Control unit 406 ... Sensor information acquisition unit 407 ... Analysis unit 408 ... Communication control unit, 409 ... Video relay unit, 410 ... Storage unit, 500 ... First network, 600 ... Second network, 700 ... Third network, 800 ... Fourth network

Claims (10)

When a request for video data captured by the imaging device is received from the terminal device, the communication path including the route between the video relay unit that relays the video data to the terminal device and the imaging device is closed. A communication control unit for constructing a network and opening the closed network after relaying of the video data is completed;
A video providing system. Sensor information that is information transmitted from a sensor that detects an event related to an image captured by the imaging device and includes detection information that represents a result of detection of the event is transmitted via the first network. A control unit for transmitting to the terminal device;
The video relay unit,
The video providing system according to claim 1, wherein the video relay unit relays the video data to the terminal device via a second network different from the first network. Sensor information that is information transmitted from a sensor that detects an event related to an image captured by the imaging device and includes detection information that represents a result of detection of the event is transmitted via a third network. It further comprises a sensor information acquisition unit that receives from the sensor,
The video providing system according to claim 1, wherein the video relay unit receives the video data from the imaging device via a fourth network different from the third network. When a request for video data captured by the imaging device is received from the terminal device, the communication path including the route between the video relay unit that relays the video data to the terminal device and the imaging device is closed. Building a net,
Releasing the closed network after the relay of the video data is completed;
A method for providing images.   A computer program for causing a computer to operate as the video providing system according to any one of claims 1 to 3. A control unit that displays on the screen a detection information display unit that indicates a detection result by a sensor that detects an event, and a button for instructing display of an image captured by the imaging device;
The said control part is a terminal device which displays the said button in association with the said detection information display part which shows the detection result by the sensor which detects the event relevant to the image | video displayed by operation with respect to the button. A control unit that displays on the screen a detection information display unit that indicates a detection result by a sensor that detects an event,
In accordance with an operation on the detection information display unit, the control unit provides an image that is captured by an imaging device that captures an event related to a detection result indicated by the detection information display unit, and provides the video A terminal device that requests the system. Information for displaying on the screen of the terminal device, a detection information display unit indicating a detection result by the sensor that detects the event, and a button for instructing display of an image captured by the imaging device is transmitted to the terminal device Display control step to
In the display control step, information for displaying the button in association with the detection information display unit indicating a detection result by a sensor that detects an event related to an image displayed by an operation on the button is displayed on the terminal device. Information providing method to be transmitted. A display control step for transmitting to the terminal device information for displaying a detection information display unit indicating a detection result by a sensor for detecting an event on the screen of the terminal device;
In response to an operation on the detection information display unit, a video provided by the imaging device that captures an event related to a detection result indicated by the detection information display unit is requested from a video providing system that provides the video. A control step for transmitting the control data defined in 1 to the terminal device;
A method for providing information.   A computer program for causing a computer to operate as the terminal device according to claim 6.

Images