JP6957090B2 - Disaster response verification system - Google Patents

Description

The present invention makes it possible to easily record a disaster, and to display thumbnails in chronological order so that the records can be easily confirmed collectively according to each event and time series. The present invention relates to a disaster response verification system that enables synchronous reproduction of each event from time and makes it possible to easily verify and analyze a response in the event of a disaster.

In Japan, where there are many storms and floods, earthquakes and tsunamis, disaster trends differ from region to region, so disaster prevention plans for each local government are formulated for each region. In the event of a disaster, the disaster response headquarters of each local government must make prompt and accurate decisions in accordance with the disaster prevention manual, but various events occur and it is not possible to take the prescribed response according to the manual. In many cases.

In addition, disaster prevention plans are similarly formulated not only by local governments but also by private companies that are engaged in public works projects. Furthermore, based on the increase in disasters in recent years, the importance of BCP (Business Continuity Plan) is highly recognized, and private companies are also formulating disaster prevention plans.

On the other hand, in disaster prevention plans, it is required to take lessons from disaster response as a lesson and to make it a more effective disaster prevention plan, and it is required to accumulate and inherit disaster response records.

That is, the problems that occur in the process of disaster response are likely to be repeated in the next disaster. It is increasingly recognized that it is important to accumulate and pass on records of issues and responses in order to improve disaster response capabilities.

In this case, in the event of a disaster, staff members tend to be overwhelmed by the work of disaster countermeasures, and it tends to be postponed to share the issues and the contents of the responses as an organization. Therefore, there is a need and a request to set up a recording team, but in reality, it is difficult to handle in the event of a disaster.

In addition, in the disaster prevention plan, when the disaster response is completed, the content of the report to the national government and the governor is decided in detail, but there are cases where information is missing because the response to the disaster is often prioritized. It is often seen.

Therefore, it is conceivable to save various images as video records for disaster response.

Regarding this, for example, as a technique related to video recording and reproduction thereof, Patent Document 1 describes a storage device for accumulating a plurality of videos, a display device for displaying the video, and a plurality of videos for synchronizing each video. A storage control unit that stores time stamp information and control information that controls to change the playback format such as the playback speed of the video, and each video are associated with each division area of the display device, and the time stamp information and control are performed. A video display system including a playback control unit that reproduces information based on information is disclosed.

Further, Patent Document 2 also discloses a configuration in which multi-camera video data shot by a plurality of cameras and time-synchronized with each other is synchronizedly reproduced based on the shooting time.

Japanese Unexamined Patent Publication No. 2013-172193 JP-A-2002-344897

In this case, it is necessary to report to the national government and the governor without delay after the end of the disaster, but even if there is video information, it is not possible to organize the information, so it is not possible to associate the information with each other. It is not possible to facilitate the analysis and verification of disaster response.

The present invention makes it possible to easily keep a record at the time of a disaster, easily check the record collectively according to each event and time series, and synchronously reproduce each event from a desired time. The purpose is to provide a disaster response verification system that enables easy verification and analysis of disaster response.

The present invention is a disaster response verification system for verifying a response in the event of a disaster, and the disaster response verification system is an artificial act performed in a predetermined space in connection with a disaster and the artificial act. A first imaging device that captures the result and outputs it as one or more first video data, a second imaging device that captures a disaster-related point and outputs it as one or more second video data, and the above-mentioned first. The storage device that stores the video data of 1 and the second video data together with the shooting time information via a network, and the storage of a plurality of video data including the first video data and / or the second video data. Synchronize the plurality of video data with a control device that can be read from the device and play back by synchronizing the plurality of video data based on the shooting time information of the first video data and / or the second video data. The control device includes a display device that displays the data in the display unit in a state of being the same, and the control device divides and reproduces the display unit in the display device in synchronization with the display device, and the plurality of video data are reproduced by an operator's command. The images constituting each of the video data of the above are displayed side by side in chronological order for each shooting time, and the images having the same shooting time are arranged in parallel or in the same row among each of the plurality of video data. The display is displayed, and the plurality of video data can be played back in synchronization by dividing the display unit from a desired time according to the operator's selection.

Further, the disaster response verification system of the present invention further accumulates one or more third video data displaying disaster-related observation data in the storage device via the network together with shooting time information, and the control device. , the first image data, the second video data and / or reading the plurality of video data composed of the third image data from said storage device, said first image data, the second Each video data is synchronized and reproduced based on the video data and / or the shooting time information of the third video data, the display device displays the plurality of video data in a synchronized state, and the control device displays the plurality of video data in a synchronized state. The plurality of video data are reproduced in the display device by dividing the display unit in synchronization, and the images constituting each of the plurality of video data are arranged in chronological order for each shooting time according to the command of the operator. Images having the same shooting time are displayed side by side in the same row or in the same row among the plurality of video data, and the plurality of video data can be displayed as desired by the operator. It is characterized in that the display unit is divided from the time and can be played back in synchronization.

In addition, the first video data of the present invention can be used for disasters by photographing the writing surface of a writing board on which the collected disaster-related information can be described by a writing instrument and / or a group of paper pieces on which the collected disaster-related information is described. It is characterized in that it is a photograph of the artificial act performed in a predetermined space and the result of the artificial act.

Further, the writing board of the present invention is characterized by being a whiteboard and / or a blackboard on which the disaster-related information can be written on the writing surface by a writing instrument.

Further, the writing board of the present invention is characterized in that the disaster-related information can be written on the writing surface by a writing instrument and / or the disaster-related information can be displayed by pasting a piece of paper.

In addition, the disaster-related points of the present invention include disaster-related suspected points where disasters are suspected, disaster-related sign confirmation points where signs of disasters can be confirmed, and / or disaster-related events where events caused by disasters can be confirmed. It is characterized by including the point of occurrence.

Further, the third video data of the present invention is a video data obtained by capturing a display unit of a terminal device displaying disaster-related observation data, and a video displayed on the display unit of the terminal device without using a camera. The video signal displayed on the display unit via the encoder is output as video data to the storage device as it is, and / or the disaster-related observation data itself obtained through the network. ..

Further, the photographing device of the present invention is characterized in that it detects a change in the image being photographed and outputs the image data to the storage device when there is a change in the image.

Further, the disaster response verification system of the present invention creates a search index associated with the shooting time information included in the video data for the video data received from the shooting device, and creates the search index. It is characterized by accumulating in the storage device at the same time.

Further, the disaster response verification system of the present invention can also store information data related to various disaster-related alerts received from outside the disaster response verification system, and the content of the alert and the time information of the issuance of the alert. It is characterized in that a search index associated with is created and stored in the storage device together with the search index.

Further, the photographing apparatus of the present invention, depending on the type of image to be photographed, characterized in that the imaging intervals of the images forming the image data taken can be variable for each of the video.

Further, the disaster response verification system of the present invention can analyze the first video data and / or the second video data to issue various alerts, and can issue the contents of the alert and the issuance of the alert. A search index associated with time information is created and stored in the storage device together with the search index.

In addition, the disaster response verification system of the present invention directly captures the first video data and / or the second video data output from the first shooting device and / or the second shooting device in real time. It is characterized in that it can be displayed on the display device.

Further, the disaster response verification system of the present invention can analyze the first video data and / or the second video data and display various alerts on the real-time video displayed on the display device. It is characterized by.

According to the disaster response verification system of the present invention, a record at the time of a disaster can be easily recorded, and thumbnails can be displayed in chronological order in parallel so that the record can be easily confirmed collectively according to each event and time series. It is possible to synchronize and reproduce each event from a desired time, and it is possible to easily verify and analyze the response at the time of a disaster.

That is, according to the present invention, the result of an artificial act performed in a predetermined space in connection with a disaster, such as writing the ever-changing disaster-related information on a whiteboard at the disaster countermeasures headquarters or the like, is photographed. A thumbnail display in which the first video data and the second video data obtained by shooting a disaster-related point where the disaster situation can be confirmed are accumulated, and the images constituting the plurality of video data are arranged in chronological order for each shooting time. Are displayed side by side in parallel, and a plurality of video data can be synchronously reproduced by dividing the display unit from a desired time according to the operator's selection, so that it is possible to easily verify and analyze the response in the event of a disaster.

In addition, not only the second video data of disaster-related points where the disaster situation can be confirmed, but also the results of artificial actions performed in a predetermined space related to a disaster such as a whiteboard are photographed. Since it is accumulated as the first video data, it becomes easy to associate the information with each other, and it becomes easier to verify and analyze the response in the event of a disaster.

Further, according to the present invention, the observation data related to the disaster as the third video data can be displayed in chronological order in parallel and synchronized with the thumbnails in the same manner as the first video data and the second video data. , It is possible to easily verify and analyze the response in the event of a disaster.

Further, according to the present invention, as disaster-related points that are the target of the second video data, a disaster occurrence suspected point where a disaster occurrence is suspected, a disaster occurrence sign confirmation point where a disaster occurrence sign can be confirmed, and a shelter It is possible to take a picture of the disaster-related event occurrence point where the event caused by the disaster can be confirmed and record it as video data, and it is possible to easily verify and analyze the response in the event of a disaster. It can also be used for disaster prediction.

Further, according to the present invention, since the first video data and the second video data are performed by a very simple means of installing a photographing device, it is possible to leave a record without difficulty even in the event of a disaster. As a result, it is possible to easily verify and analyze the response in the event of a disaster after a disaster.

Further, when the third video data is video data obtained by photographing the display unit of the terminal device displaying the observation data related to the disaster, the video displayed on the display unit of the terminal device can be displayed on the encoder without going through the camera. It can be used in both cases where the video signal displayed on the display unit is output as video data to the storage device as it is, or when it is the disaster-related observation data itself obtained through the network. It is very convenient and can easily verify and analyze the response in the event of a disaster.

In addition, the shooting device can detect changes in the video being shot and output video data to the storage device when there is a change in the video, preventing an increase in the amount of video data and saving data resources. Excessive use is prevented and long-term recording can be accumulated.

In addition, the shooting device can detect changes in the video being shot and output video data to the storage device when there is a change in the video, and the disaster response verification system can use the video data received from the shooting device. , A search index associated with the shooting time information included in the video data is created and stored in the storage device together with the search index. Therefore, the search index facilitates the video at the time when the video has changed. It is possible to search and easily verify and analyze the response in the event of a disaster.

Further, according to the disaster response verification system of the present invention, it is possible to store information data related to various disaster-related alerts received from outside the system, and a search index associated with the content of the alert and the time information of the issuance of the alert. Is created and stored in the storage device together with the search index, so the search index makes it possible to easily search for the video of the time when the video changed and the video related to the alert, and respond in the event of a disaster. It can be easily verified and analyzed.

Further, according to the disaster response verification system of the present invention, since photographing apparatus, according to the type of image to be photographed is the imaging interval of each image constituting the video data recordable variable for each image, video It prevents an increase in the amount of data, prevents excessive use of data resources, and enables the accumulation of records for a long period of time.

Further, according to the disaster response verification system of the present invention, various alerts can be issued by analyzing the first video data and the second video data, and are associated with the content of the alert and the time information of the alert issuance. Since the search index is created and stored in the storage device together with the search index, the video related to the alert can be easily searched by the search index, and the response in the event of a disaster can be easily verified and analyzed. It is possible.

Further, according to the disaster response verification system of the present invention, the first video data or the second video data output from the first shooting device and the second shooting device is directly displayed on the display device in real time. It is possible to display images, which makes it very easy to grasp the situation and respond to disasters in the event of a disaster.

Further, according to the disaster response verification system of the present invention, in this real-time live video display, the first video data and the second video data are analyzed, and various alerts are sent to the real-time video displayed on the display device. Since it can be displayed, it becomes easier to grasp the situation and respond to the disaster in the event of a disaster.

It is a functional block diagram which concerns on embodiment of the disaster response verification system of this invention. It is a figure which shows an example of each photographing apparatus and a subject, (a) is an image | photograph of a whiteboard by a 1st imaging device, (b) is an image of a mountainside road by a 2nd imaging device, (c) is (D) shows the shooting of the river by the other second imaging device, and (d) shows the shooting of the rain radar image by the third imaging device. It is a figure which shows another example of the subject of the 1st photographing apparatus, and is the figure which shows the sticky note group inside the tray. It shows the chronological order and parallel display of thumbnails on the display device. FIG. 5 is a diagram showing a state in which the display of FIG. 4 is switched to the synchronous playback display. It is the figure of the state which switched the display of FIG. 4 to a live image display. FIG. 5 is a diagram showing a state in which an alert is displayed in the synchronous playback display of FIG. FIG. 6 is a diagram showing a state in which an alert is displayed in the live video display of FIG. It is a figure which showed the modification of the time series order parallel display of the thumbnail of FIG. It is a figure which shows an example of the state which switched the display of FIG. 9 to a synchronous reproduction display. It is a figure which shows another example of the state which switched the display of FIG. 9 to a synchronous reproduction display.

Hereinafter, a mode for implementing the disaster response verification system according to the present invention will be described with reference to the drawings.

The disaster response verification system of the present invention makes it possible to easily record a disaster response and to display thumbnails in chronological order so that the records can be easily confirmed collectively according to each event and time series. In addition, it is possible to synchronize and reproduce each event from a desired time, and it is possible to easily verify and analyze the response at the time of a disaster.

[Overview of disaster response verification system]
The outline of the disaster response verification system according to the embodiment of the present invention will be described with reference to FIGS. 1 and 2. FIG. 1 is a functional block diagram according to an embodiment of the disaster response verification system of the present invention. FIG. 2 is a diagram showing an example of each photographing device and a subject. FIG. 2A shows a whiteboard photographed by the first photographing device, and FIG. 2B shows a mountainside road photographed by the second photographing device. (C) shows the photography of the river by another second imaging device, and (d) shows the imaging of the rain radar image by the third imaging device.

As shown in FIG. 1, the disaster response verification system 1 is a photographing device (first photographing device 3, the first photographing device 3) that photographs a disaster-related image and transmits the image data via a communication network 11 that can be used even in the event of a disaster. The second imaging device 5 and the third imaging device 6) are communicably connected to the disaster response verification device 2 that accumulates the video data transmitted from the imaging device and enables reproduction.

The photographing device is composed of at least a first photographing device 3 and a second photographing device 5, and may also include a third photographing device 6.

As shown in FIG. 2A, the first photographing device 3 photographs the writing surface 16a of the writing board 16 such as a blackboard or a white board on which disaster-related information is written in a timely manner, which is installed in the disaster countermeasures headquarters or the like. A video camera or the like that can be installed as appropriate corresponds to this, and the first video data is transmitted to the disaster response verification device 2.

As shown in FIGS. 2 (b) and 2 (c), the second photographing device 5 corresponds to a video camera or the like that can be appropriately installed to photograph disaster-related points, and photographs disaster-related points to verify disaster response. The second video data is transmitted to 2.

As shown in FIG. 2D, the third photographing device 6 corresponds to a video camera or the like that can be appropriately installed to photograph the display unit 17a of the terminal device 17 such as a PC capable of displaying disaster-related observation data. The display unit 17a on which the disaster-related observation data is displayed is photographed, and the third video data is transmitted to the disaster response verification device 2.

Further, the Internet 12 and the administrative disaster-related information transmission device 15 are connected to the communication network 11. The disaster response verification device 2 can receive disaster-related information such as various alarms via the Internet 12, and similarly, emergency such as special warnings, national protection information (missile information, etc.), large tsunami warnings, and earthquake early warnings. Disaster-related information can also be received from the disaster-related information transmission device 15 of each ministry and agency that transmits information.

[Disaster response verification device]
First, the disaster response verification device 2 will be described with reference to FIG. The disaster response verification device 2 is composed of a computer, accumulates video data transmitted from the photographing device via the communication network 11 and enables playback, and can also display live video in real time. The control device 21, the display device 22, the input device 23, the timing device 24, and the storage device 25 are provided.

The control device 21 plays a central role in the disaster response verification device 2 and further, the disaster response verification system 1, and commands to each device both inside and outside the disaster response verification device 2 and thumbnails of each video data. It is responsible for controlling each device such as time-series order parallel display, synchronous playback display, and real-time live image display control.

In addition, the control device 21 can analyze the video data transmitted from the photographing device and issue various alerts. That is, for example, when shooting a river, usually, when the movement of the image is detected at a point where water does not flow, a flood warning is issued, or the image being shot has an area of a predetermined ratio or more. It is possible to issue a flood warning when the change in is detected. In addition, at points where sediment-related disasters are suspected, it is possible to issue a sediment-related disaster warning by detecting the movement of the slope.

The display device 22 is composed of a display, and is used to reproduce video data stored in the disaster response verification device 2 or to display thumbnails in chronological order in parallel according to a command from the control device 21. It is also possible to display a real-time live image from the shooting device by the command of. Further, when a 4K display having four times as many pixels as full high-definition is used, it is possible to display a large number of images with high image quality.

The input device 23 is composed of a keyboard, a mouse, and the like, and inputs and outputs video data from a photographing device that is not connected to the communication network 11, disaster-related observation data, and the like so as to be later taken into the disaster response verification device 2. It has a port, input / output terminal, memory card slot, etc.

The timekeeping device 24 adds the shooting time information to the transmitted video data by a timer when the shooting device does not have a shooting time measurement function. As a result, thumbnails of each video are displayed in chronological order and synchronized playback is realized. This timer is synchronized with the timers of other devices and devices by NTP (Network Time Protocol).

The storage device 25 is transmitted from the first video data transmitted from the first shooting device 3, the second video data transmitted from the second shooting device, the third shooting device, and the like via the communication network. The third video data is stored together with the shooting time information by the command of the control device 21, and the video database 25a (video DB 25a) for storing the video data and the shooting time data of each video is provided.

The video DB 25a includes not only video data and shooting time data of each video, but also disaster-related observation data itself collected when using the disaster response verification system 1, and disaster-related data from the Internet 12 and the disaster-related information transmission device 15. Various alerts such as warnings and alarms and related data can also be accumulated.

The control device 21 makes the video data received from the shooting devices 3, 5 and 6 correspond to the shooting time information, various alerts obtained from the outside, and the contents of various alerts analyzed by the control device 21 itself. A search index is created, and the video DB 25a stores and stores the search index together with each video data and shooting time information. As a result, videos related to various alerts can be easily searched, and the response in the event of a disaster can be easily verified and analyzed.

[First imaging device]
The first photographing apparatus 3 will be described with reference to FIG. 2 and FIG. FIG. 3 is a diagram showing another example of the subject of the first photographing device, and is a diagram showing a group of sticky notes inside the tray. As described above, as shown in FIG. 2A, the first photographing device 3 photographs the writing board 16 such as the whiteboard and the blackboard installed in the disaster countermeasures headquarters and outputs the first video data. It is a thing.

It is assumed that not only a single number of the first photographing devices 3 but also a plurality of the first photographing devices 3 are arranged, and in that case, a plurality of the first video data will also exist.

The first photographing device 3 is appropriately installed at a position where the writing surface 16a of the writing board 16 on which disaster-related information is written in a timely manner by a person concerned or the like can be photographed.

Since the first photographing device 3 may be arranged at a position where the writing surface 16a can be photographed, the first photographing device 3 may be installed in the front direction of the writing surface 16a of the whiteboard as shown in FIG. 2A, or may be white. It is also possible to take a picture of the writing surface 16a from above by being fixed to the upper end 16b at the center of the left and right of a writing board such as a board via a clip or the like (board camera).

The first photographing device 3 has a function of transmitting captured video data, and the photographed data is transmitted to the disaster response verification device 2 by using this transmission function. Therefore, a webcam or a smartphone with a shooting function can be used as the first shooting device 3.

In this case, for shooting and output by the first shooting device 3, the CPU of the computer in the first shooting device 3 uses predetermined data stored in ROM, RAM, a hard disk, or the like, and a predetermined computer program is used. The shooting operation is performed based on the above.

Further, it is desirable that the first photographing device 3 includes a time measuring unit 3a that adds shooting time information to the captured video data. The timekeeping unit 3a is composed of a timer, which realizes time-series order display and synchronous reproduction of thumbnails of each video. It is desirable that this timer is synchronized with the timer of another device or device by NTP (Network Time Protocol).

Further, by photographing the writing surface 16a of the writing plate 16, the first photographing device 3 is related not only to the result of an artificial act such as disaster-related information described on the writing surface 16a but also to the writing surface 16a. Persons write and discuss, and also perform artificial acts performed in a predetermined shooting space in connection with disasters such as the situation of the disaster countermeasures headquarters and the movement of people in the event of an earthquake or aftershock. It can be output as 1 video data.

By photographing not only the contents described on the writing surface 16a but also the situation of the persons concerned in and around the writing surface 16a and the place where the writing board 16 is installed and accumulating it as video data. It records the situation and atmosphere of the disaster response headquarters in a realistic manner, facilitating verification and analysis of disaster response.

Further, the writing board 16 not only writes disaster-related information on the writing surface 16a with a writing instrument, but also displays disaster-related information by attaching a piece of paper such as a sticky note on which the disaster-related information is written to the writing surface 16a. Is also possible.

In addition, the first photographing device is not only a writing board having a writing surface such as a whiteboard or a blackboard, but also a sticky note or a document on which the collected disaster-related information is described is thrown into a predetermined place. In the case where information is transmitted by overlapping, it is also possible to take a picture of the predetermined place and output it as the first video data.

That is, as shown in FIG. 3, for example, by photographing the sticky notes 18a thrown (stacked) inside the tray 18 as a predetermined place and the document group, the disaster-related information described in those paper pieces is described. It is possible to photograph the result of a sticky note. Further, it is the same as the writing board 16 in that an artificial act performed around a predetermined place such as a tray in connection with a disaster can be output as the first video data.

[Second imaging device]
The second photographing apparatus 5 will be described with reference to FIG. As described above, the second photographing device 5 photographs the disaster-related points and outputs the second video data as shown in FIGS. 2 (b) and 2 (c).

It is assumed that the second photographing apparatus 5 is arranged not only in a single unit but also in a plurality as shown in FIGS. 2 (b) and 2 (c). In that case, a plurality of second video data are also present. It becomes.

The second photographing device 5 is appropriately installed at a position where a disaster-related point can be photographed. It is also possible to use a fixed-point camera that has been installed since normal times. That is, the second photographing device 5 photographs a disaster-related point, and the disaster-related points converted into data as the second video data include a disaster occurrence suspected point, a disaster occurrence sign confirmation point, and a disaster-related event. The generation point is included, and it is possible to output it as video data from the second photographing device.

A point where a disaster is suspected is a point where a disaster is suspected, and a point where a flood of a river or a sediment-related disaster is suspected can be mentioned. In addition, the disaster occurrence sign confirmation point is a point where the sign of the occurrence of a disaster can be confirmed, and examples thereof include an increase in river water, an increase / decrease in groundwater, and a crack in a mountain slope. Furthermore, the disaster-related event occurrence point is a point where the event caused by the disaster can be confirmed, and examples thereof include evacuation shelters set up by the disaster, traffic jams caused by the disaster, fires, and collapse of buildings.

For example, in FIG. 2, the second photographing device 5 photographs the road on the mountainside between the coast and the mountain where a sediment-related disaster is assumed as a disaster occurrence sign confirmation point in FIG. In FIG. 3C, another second imaging device is used to photograph a river that may be flooded as a disaster occurrence sign confirmation point.

It should be noted that the disaster occurrence suspicious points, disaster occurrence sign confirmation points, and disaster-related event occurrence points that constitute this disaster occurrence-related point are defined as having parts where each concept overlaps with each other, and the disaster occurrence sign confirmation point is a disaster. It goes without saying that they are in a relationship of shifting to each other, such as changing to a point of suspected occurrence or a point of occurrence of a disaster-related event.

The second photographing device 5 has a function of transmitting captured video data, and the photographed data is transmitted to the disaster response verification device 2 by using this transmission function. Therefore, a webcam or a smartphone with a shooting function can be used as the second shooting device 5.

In this case, the shooting and output by the second shooting device 5 is performed by the CPU of the computer in the second shooting device 5 stored in the ROM, RAM, hard disk, or the like, as in the case of the first shooting device 3. The data is used to perform such a shooting operation based on a predetermined computer program.

Further, it is desirable that the second photographing device 5 includes a time measuring unit 5a for adding the photographing time information to the photographed video data, similarly to the first photographing device 3. The timekeeping unit 5a is composed of a timer, which realizes time-series order display and synchronous reproduction of thumbnails of each video. It is desirable that this timer is synchronized with the timer of another device or device by NTP (Network Time Protocol).

[Third imaging device]
The third photographing apparatus 6 will be described with reference to FIG. As described above, as shown in FIG. 2D, the second photographing device 5 photographs the display unit 17a of the terminal device 17 such as a PC capable of displaying disaster-related observation data, and the disaster response verification device 2 The third video data is transmitted to the user.

It is assumed that not only a single third imaging device 6 but also a plurality of third photographing devices 6 are arranged, and in that case, a plurality of third video data are also present.

The third photographing device 5 is appropriately installed at a position where the display unit 17a of the terminal device 17 such as a PC capable of displaying disaster-related observation data can be photographed.

The third video data captured by the third photographing device 5 is, for example, a visualized disaster such as a weather map, a rain amount radar map, a rain cloud radar map, a thunder radar map, an earthquake map, etc. transmitted via the Internet. Related observation data can be mentioned. Further, as long as it can be visualized (as long as it can be visually confirmed), the disaster-related observation data may be numerical values or text information itself. If the front portion 17a of the terminal device 17 is photographed by the third photographing device, it can be output to the disaster response verification device 2 and can be easily recorded.

The third imaging device 6 has a function of transmitting captured video data, and the captured data is transmitted to the disaster response verification device 2 by using this transmission function. Therefore, a webcam or a smartphone with a shooting function can be used as the third shooting device 6.

In this case, in the shooting and output by the third shooting device 6, the CPU of the computer in the third shooting device 6 is the ROM, RAM, hard disk, etc., similarly to the first shooting device 3 and the second shooting device 5. The shooting operation is performed based on a predetermined computer program by using the predetermined data stored in the.

Further, it is desirable that the third photographing device 6 includes a time measuring unit 6a for adding the photographing time information to the photographed video data, similarly to the first photographing device 3 and the second photographing device 6. The timekeeping unit 6a is composed of a timer, which realizes time-series order display and synchronous reproduction of thumbnails of each video. It is desirable that this timer is synchronized with the timer of another device or device by NTP (Network Time Protocol).

The third video data is obtained by photographing the display unit 17a of the terminal device 17 by the third photographing device 6, and the terminal connected to the network 11 without going through the third photographing device 6. Even if the video displayed on the display unit of the device 7 is output as it is as the third video data, the video signal displayed on the display unit is output as it is via the encoder 7b stored (or externally connected) in the terminal device 7. good. Further, it is desirable that the terminal device 7 includes (or is externally connected to) the time measuring unit 7a, and the configuration thereof is the same as that of the time measuring unit 6a of the third photographing device 6.

Similarly, the third video data may be the disaster-related observation data itself obtained by the terminal device 7 or the disaster response verification device 2 through the Internet 12 connected to the network 11.

[Common items for each shooting device]
Each of the shooting devices 3, 5 and 6 can change the shooting interval of each image constituting the shot video data for each video according to the type of each video to be shot.

That is, for example, the video of a writing board such as a whiteboard shot as the first video data is described only through artificial movements, so that the shooting interval of each image constituting the video is up to that point. Since it is not necessary to narrow the number of shots, it is considered to reduce the number of shooting frames per predetermined time.

Similarly, in the case of shooting a disaster-related point that is very unlikely to be related to a disaster as the second video data, it is considered to reduce the number of shot frames in order to protect the data resource. Further, as the third video data, when the disaster-related data on the Internet 12 is taken in, if the update frequency of the disaster-related data is, for example, every 5 minutes, it is sufficient to acquire the data once every 5 minutes.

On the contrary, when a disaster is clearly predicted, it is considered to increase the number of shot frames in order to keep a record of the disaster academically and feed it back to the disaster countermeasures later.

Further, it is possible by setting that each of the photographing devices 3, 5 and 6 detects a change in the image being photographed and outputs the image data to the disaster response verification device 2 when there is a change in the image. ..

In that case, the disaster response verification device 2 creates a search index associated with the shooting time information included in the video data for each video data received from the shooting devices 3, 5 and 6, and performs this search. It can be stored in the video DB 25a of the storage device 25 together with the index for searching, and can be easily searched by this search index.

[Addition after video data]
The disaster response verification device 2 can later capture various video data from a photographing device that is not connected to the communication network 11, disaster-related observation data, and the like, and is capable of capturing input / output ports, input / output terminals, and memory card slots. It is possible to capture video data even after a disaster occurs.

Even in that case, the shooting time information added to the video data by the timer or the like provided by the shooting device not connected to the communication network 11 is used for synchronous playback in the disaster response verification device 2 and for searching based on the shooting time information. It is possible to create an index.

[How to use the disaster response verification system and its display]
Next, in addition to FIGS. 1 and 2, FIGS. 4 to 8 are used as an example of how to use the embodiment of the disaster response verification system 1 of the present invention and its display when the mobile terminal device 3 is used. I will explain. FIG. 4 shows the time-series order parallel display of thumbnails in the display device. FIG. 5 is a diagram showing a state in which the display of FIG. 4 is switched to the synchronous playback display. FIG. 6 is a diagram showing a state in which the display of FIG. 4 is switched to the live video display. FIG. 7 is a diagram showing a state in which an alert is displayed in the synchronous reproduction display of FIG. FIG. 8 is a diagram showing a state in which an alert is displayed in the live video display of FIG.

In the following description, as an example, as shown in FIG. 2, the whiteboard is photographed by the first imaging device in FIG. 2A, and Yamabe is photographed by the second imaging device in FIG. 2B. The road is photographed, the river is photographed by the other second photographing device in the figure (c), and the figure (d) shows four images when the rain radar image is photographed by the third photographing device. It assumes data.

[Synchronous display and synchronous playback of thumbnails in chronological order]
The disaster response verification system 1 makes it possible to easily record a disaster and display thumbnails in chronological order so that the records can be easily confirmed collectively according to each event and time series, and is also desired. It is possible to play back each event synchronously from the time.

To be described in detail, the disaster response verification system 1 synchronizes a plurality of video data and divides the display unit on the display device 23 so that the display unit can be reproduced as shown in FIG. 5 (synchronous reproduction). Then, as shown in FIG. 4, it is possible to display the images constituting each of the plurality of video data in chronological order for each shooting time (thumbnail chronological order parallel display) by the command of the operator. It has become.

That is, in FIG. 5, the display unit of the display device 22 is divided into four parts corresponding to the four video data and displayed, and the control device 21 displays the first video data and the second video data. Further, a plurality of video data composed of the third video data are read from the video DB 25a of the storage device 25, and the shooting time information of the first video data, the second video data, and the third video data is obtained. Multiple video data are synchronized and played based on (synchronous playback).

In this case, the display on the upper left is the playback display 31a of the whiteboard (reproduction display of the first video data), and the display on the upper right is the reproduction display 32a (second video data) of the fixed point camera 1 that captured the road on the mountainside. The lower left display is the playback display 33a (reproduction display of the second video data) of the fixed point camera 2 that captured the river, and the lower right display captures the weather information using the rain radar. This is the playback display 34a (reproduction display of the third video data).

On the other hand, FIG. 4 shows thumbnails displayed in chronological order in parallel. The time-series order parallel display of the thumbnails can be selected by switching to the synchronous playback of FIG. 5 according to the operator's command, and the images constituting each of the plurality of video data are arranged horizontally in the time-series order for each shooting time. A time-series order display of thumbnails of the same line is created, and the time-series order display of the thumbnails is displayed side by side vertically among a plurality of video data. Images with the same time are displayed side by side in the same row.

In FIG. 4, the time-series order display of the four-line thumbnails is arranged vertically, and the time-series order display 31 of the thumbnails of the whiteboard (the time-series order display of the thumbnails of the first video data) is displayed at the top. Arranged, the time-series order display 32 of the thumbnails of the fixed-point camera 1 that photographed the mountainside road was arranged in the second row from the top (the time-series order display of the thumbnails of the second video data), and the third row from the top. Time-series order display 33 of thumbnails of fixed-point camera 2 that photographed rivers (time-series order display of thumbnails of second video data) is arranged, and time-series order display of thumbnails of weather information using rain radar is arranged at the bottom. 34 (displayed in chronological order of thumbnails of the third video data) are arranged.

Further, in the middle of the left and right sides of FIG. 4, a selection frame 36 is arranged so as to vertically display images of the same time of each thumbnail in chronological order, and the operator can use the input device 23 to left and right the selection frame 36. By moving to and selecting and determining an image at a desired time, the plurality of video data of FIG. 5 can be synchronously reproduced by dividing the display unit from the desired time.

The shooting date and time of the video data is displayed at the upper part of each image constituting the time-series order display 31 of the thumbnails of the whiteboard on the uppermost stage.

Further, in FIG. 4, 7 frames of images are displayed on the left and right sides of the bank, but the time-series order display of the thumbnails is not limited to 7 frames, and a large number of frames can be cut out from the video and displayed. In that case, the frame outside the screen can be confirmed by horizontal scrolling or the like.

Similarly, the time-series order parallel display of thumbnails is only four in parallel corresponding to four video data, and the time-series order display of a desired number of thumbnails depending on the number of video data and selection. Can be displayed in parallel. In that case, it is also possible to display the thumbnails outside the screen in chronological order by vertical scrolling. Therefore, for example, it is possible to select and reproduce only a plurality of first video data, or to select and reproduce only a plurality of second video data.

In FIG. 4, the images constituting each of the plurality of video data are arranged horizontally in chronological order for each shooting time to create a chronological order display of the accompanying thumbnails, and a plurality of chronological order displays of the thumbnails are displayed. The images were displayed side by side in parallel vertically among the video data of the above, and the images were displayed in parallel in the same row with the images having the same shooting time among each of the plurality of video data. However, the vertical-horizontal relationship, that is, the row-column relationship is reversed, and the images constituting each of the plurality of video data are arranged in the vertical direction in chronological order for each shooting time, and the thumbnails in the same column are displayed in chronological order. Create and display the thumbnails in chronological order on the left and right side by side between multiple video data, and display the images with the same shooting time side by side in parallel between each of the multiple video data. It is also assumed.

Further, the time-series order parallel display of the thumbnails in FIG. 4 is a thumbnail display in which an image is cut out at a timing of several hours from the video data sent from each of the shooting devices 3, 5 and 6, but the video data in each shooting device is used. If the shooting interval of each image that composes is long, for example, every few minutes to several hours, instead of cutting out the images at regular intervals like thumbnail images, all the images that make up the shot video are captured. It is also possible to display thumbnails, and all desired settings can be freely set.

Further, even when images are taken at very short intervals such as several frames per second in each of the shooting devices 3, 5 and 6, the thumbnails are displayed in chronological order in parallel, which is very short. If you want to observe the relationship between each image and each thumbnail in chronological order display at the timing, you can verify and analyze from a microscopic point of view by setting it freely.

Further, even when a plurality of video data are divided into display units from a desired time and played back synchronously as shown in FIG. 5, the playback speed (display time) of each frame of the image constituting each video data can be set and the number of times can be set. It is also possible to set the number of skipped frames so that the frames can be skipped and played.

In both the synchronous playback display as shown in FIG. 5 and the time-series order parallel display of thumbnails as shown in FIG. 4, each video data is within the set period even if the captured images at the same time do not exist. If there are other frames inside, desired settings such as displaying the image of the nearest time can be made.

[Real-time live video display]
Further, as shown in FIG. 6, the disaster response verification system 1 can also display a real-time live image on the display device 22. It is also possible to display the video data (31b, 32b, 33b, 34b) output from each of the photographing devices 3, 5 and 6 as they are by the command of the operator.

[Various alert display]
Further, as shown in FIGS. 7 and 8, the control device 21 may use the Internet 12 or the Internet 12 or the Internet 12 for each video data received from each of the shooting devices 3, 5 and 6, regardless of the synchronous playback display or the real-time live video display. It is possible to display various alerts obtained from the outside, such as from the disaster-related information transmitting device 15, and various alerts issued by analysis of the control device 21 itself.

That is, in FIG. 7, a heavy rain / flood warning issued by the Japan Meteorological Agency is arranged in the center of the screen, and the control device 21 analyzes the second video data from the fixed point camera 1 on the reproduction display 32a of the fixed point camera 1. However, the change in the slope is detected and the text "Sediment disaster has occurred!" Is displayed on the screen.

Further, in FIG. 8, a heavy rain / flood warning issued by the Japan Meteorological Agency is arranged in the center of the screen, and in the real-time live image display 33b of the fixed-point camera 2, the control device 21 is the second image from the fixed-point camera 2. It analyzes the data, detects flooding in the river, and displays the words "Be wary of flooding of the river!" On the screen.

Of course, it is also considered to describe various alarms in the time-series parallel display of thumbnails (not shown).

[Display when outputting video data by detecting video changes]
The display when each photographing device detects a change in the image and outputs the image data will be described with reference to FIGS. 9 to 11. FIG. 9 is a diagram showing a modified example of the time-series order parallel display of the thumbnails of FIG. FIG. 10 is a diagram showing an example of a state in which the display of FIG. 9 is switched to the synchronous playback display. FIG. 11 is a diagram showing another example of a state in which the display of FIG. 9 is switched to the synchronous playback display.

When each of the photographing devices 3, 5 and 6 detects a change in the image and outputs the image data in that case, as shown in FIG. 9, there is no change in the image in the time-series order parallel display of the thumbnails. In that case, it is possible to display without an image like a blank.

Therefore, in the time zone in which the image is blank, that is, the image (image) has not changed, the reproduction display 33a (reproduction display of the second image data) portion of the fixed point camera 2 in FIG. 10 becomes blank. ing.

On the other hand, as shown in FIG. 11, it is also possible to fill in the blanks by using the same reproduction display 33a (reproduction display of the second video data) portion of the fixed point camera 2 as the image of the previous frame. Therefore, similarly, in the blank portion of the thumbnail in chronological order parallel display of FIG. 9, it is also considered to fill the blank portion by using the previous frame which is the same image as the blank portion (not shown).

As described above, even if there is no image taken at the same time strictly, if there is another frame in each video data within the set period, the image at the nearest time is displayed. It is the same in that it is solved by the setting of.

The present invention can be embodied in many forms without departing from its essential properties. Therefore, it goes without saying that the above-described embodiments are merely explanatory and do not limit the present invention.

Further, the functional block shown in the functional block diagram of FIG. 1 shows the functional configuration of the disaster response verification system of the present invention, and does not limit a specific implementation form. That is, it is not necessary to implement the hardware corresponding to the functional blocks in the figure, and it is of course possible to have a configuration in which the functions of a plurality of functional units are realized by executing a program by one processor. Further, a part of the functions realized by the software in the embodiment may be realized by the hardware, and further, a part of the functions realized by the hardware may be realized by the software.

1 Disaster response verification system 2 Disaster response verification device 3 First imaging device 3a Timekeeping unit 5 Second imaging device 5a Timekeeping unit 6 Third imaging device 6a Timekeeping unit 7 Terminal device 7a Timekeeping unit 7b Encoder 11 Communication network 12 Internet 15 Disaster-related information transmission device 16 White board (writing board)
16a Writing surface 16b Upper left and right center upper end 17 Terminal device 17a Display unit 18 Tray 18a Sticky note 21 Control device 22 Display device 23 Input device 24 Timekeeping device 25 Storage device 25a Video database (video DB)
31 Time-series order display of thumbnails on the whiteboard (Time-series order display of thumbnails of the first video data)
31a Whiteboard playback display (first video data playback display)
31b Whiteboard live video display (live video display of the first video data)
32 Time-series order display of thumbnails of fixed-point camera 1 (time-series order display of thumbnails of second video data)
32a Playback display of fixed-point camera 1 (playback display of second video data)
32b Live video display of fixed point camera 1 (live video display of second video data)
33 Fixed-point camera 2 thumbnail chronological order display (second video data thumbnail chronological order display)
33a Playback display of fixed-point camera 2 (playback display of second video data)
33b Live video display of fixed point camera 2 (live video display of second video data)
34 Time-series order display of thumbnails of weather information (time-series order display of thumbnails of third video data)
34a Reproduction display of weather information (reproduction display of third video data)
34b Live video display of weather information (live video display of third video data)
36 selection frame

Claims (14)

It is a disaster response verification system for verifying the response in the event of a disaster.
The disaster response verification system is a first imaging device that captures an artificial act performed in a predetermined space related to a disaster and the result of the artificial act and outputs it as one or more first video data. When,
A second imaging device that captures disaster-related points and outputs them as one or more second video data,
A storage device that stores the first video data and the second video data together with shooting time information via a network.
A plurality of video data composed of the first video data and / or the second video data is read from the storage device and used as the shooting time information of the first video data and / or the second video data. Based on the control device that can synchronize and reproduce the plurality of video data,
It is provided with a display device that displays the plurality of video data in a synchronized state on the display unit.
The control device divides the display unit in the display device and reproduces the plurality of video data in synchronization with each other.
According to the command of the operator, the images constituting each of the plurality of video data are displayed side by side in chronological order for each shooting time, and the images are images having the same shooting time among the plurality of video data. Are displayed side by side in the same row or in the same column, and the plurality of video data can be played back in synchronization by dividing the display unit from a desired time according to the operator's selection. system. The disaster response verification system also stores one or more third video data displaying disaster-related observation data in the storage device via the network together with shooting time information.
The control device reads out the plurality of video data including the first video data , the second video data, and / or the third video data from the storage device, and reads the first video data, the first video data, and the third video data. Each video data is synchronized and played back based on the shooting time information of the second video data and / or the third video data.
The display device displays the plurality of video data in a synchronized state, and displays the plurality of video data in a synchronized state.
The control device divides the display unit in the display device and reproduces the plurality of video data in synchronization with each other.
According to the command of the operator, the images constituting each of the plurality of video data are displayed side by side in chronological order for each shooting time, and the images are images having the same shooting time among the plurality of video data. 1 is characterized in that the plurality of video data are displayed side by side in the same row or in the same column, and the plurality of video data can be reproduced in synchronization by dividing the display unit from a desired time according to the operator's selection. Disaster response verification system described in. The first video data is determined in relation to a disaster by photographing the writing surface of a writing board on which the collected disaster-related information can be described by a writing tool and / or a group of paper pieces on which the collected disaster-related information is described. The disaster response verification system according to claim 1 or 2, wherein the artificial act performed in the space and the result of the artificial act are photographed. The disaster response verification system according to claim 3, wherein the writing board is a whiteboard and / or a blackboard on which the disaster-related information can be written on the writing surface by a writing instrument. The writing board is characterized in that the disaster-related information can be written on the writing surface by a writing instrument and / or the disaster-related information can be displayed by pasting a piece of paper. The disaster response verification system described in 4. The disaster-related points include a disaster-related suspected point where a disaster is suspected, a disaster-related sign confirmation point where signs of a disaster can be confirmed, and / or a disaster-related event occurrence point where an event caused by a disaster can be confirmed. The disaster response verification system according to any one of claims 1 to 5, characterized in that. The third video data is
Video data of the display of the terminal device displaying disaster-related observation data,
Video data in which the video displayed on the display unit of the terminal device is directly output to the storage device as video data displayed on the display unit via the encoder without going through the camera.
The disaster response verification system according to claim 2, wherein the disaster response verification system itself is the disaster-related observation data obtained through the network. Of claims 1 to 7, the photographing device detects a change in the image being photographed and outputs the image data to the storage device when there is a change in the image. The disaster response verification system according to any one. The disaster response verification system creates a search index associated with the shooting time information included in the video data for the video data received from the shooting device, and stores the video data together with the search index in the storage device. The disaster response verification system according to claim 8, wherein the data is accumulated. The disaster response verification system can also store information data related to various disaster-related alerts received from outside the disaster response verification system, and a search associated with the content of the alert and the time information of the issuance of the alert. The disaster response verification system according to any one of claims 1 to 9, wherein an index is created and stored in the storage device together with the search index. The imaging device, depending on the type of image to be photographed, among claims 1 to 6, characterized in that the imaging intervals of the images forming the image data taken can be variable for each of the image , Any one of the disaster response verification systems. The disaster response verification system can analyze the first video data and / or the second video data to issue various alerts, and is associated with the content of the alert and the time information of the issuance of the alert. The disaster response verification system according to any one of claims 1 to 11, wherein a search index is created and stored in the storage device together with the search index. The disaster response verification system displays the first video data and / or the second video data output from the first shooting device and / or the second shooting device as it is on the display device in real time. The disaster response verification system according to any one of claims 1 to 12, characterized in that it is possible. The disaster response verification system is capable of analyzing the first video data and / or the second video data and displaying various alerts on the real-time video displayed on the display device. Item 13. The disaster response verification system according to item 13.

Images