JPH10257483A - Disaster state management system, information management device and video camera apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a disaster state management system that realizes electronically a function of 'fire watch' for a disaster without increasing the number of existing communication channels. SOLUTION: A video camera apparatus 2 with a ratio communication function designates part of moving image areas as a still image and outputs relative position information of the designated image area on a moving image to an information management device 10 through a radio channel for video image transmission with the moving image. The information management device 10 extracts an image area of the received moving image specified by relative position information as a still image and converts the still image into digital information in a form capable of image processing. Control instruction information for remote shot from the information management device 10 to the video camera apparatus 2 and reply information from the video camera apparatus 2 to the information management device 10 are respectively converted into a DTMF signal and the signal is transmitted through a radio channel for voice signal transmission.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technology for acquiring image and voice information, image processing, information analysis, and information transmission in the fields of disaster prevention, emergency, and the like. The present invention relates to a technique for acquiring a still image from a video, analyzing characteristics of the still image, and generating support information for taking necessary disaster response measures or the like based on the analysis result.

[0002]

2. Description of the Related Art In Japan, natural disasters occur relatively more frequently than in other countries, such as earthquakes, typhoons, and tsunamis. In particular, in the event of an urban earthquake, damage from wide-area fires and tsunamis as secondary disasters is expected in addition to the damage caused by the earthquake itself. For this reason, in the fields of disaster prevention, emergency, etc., it is important to take appropriate emergency measures in the event of a disaster and to create a system to minimize damage.

[0003] In this type of field, a plurality of related administrative organizations are currently connected to each other by a wired or wireless communication network to secure communication means, and necessary measures can be taken promptly in the event of a disaster. In addition, each prefecture and municipalities are provided with a disaster management radio network and a municipal radio network, and the municipalities can be notified of the residents by means of a loudspeaker installed on the street corner. However, these communication means are still mainly manual telephone calls and lack quickness and accuracy.

[0004] In addition, when a disaster actually occurs, it is important to determine whether the damage can be minimized by accurately and quickly grasping the situation of the disaster and taking into account the circumstances of the disaster occurrence area. It depends on what action can be taken. Conventionally, when a large-scale disaster occurs, a helicopter equipped with a shooting device such as a video camera shoots an image of the sky above the disaster occurrence area and transmits the shot image to the ground base station using wireless communication means. And so on. In this case, the ground base station instructs the imaging range and the like while communicating with the operator of the imaging device wirelessly, and visually grasps the disaster situation from the transmitted image of the range, and, if necessary, They contact disaster prevention agencies and arrange fire and ambulance vehicles. An analog radio channel for moving images is used for transmitting images captured by the imaging device to the ground base station, and a wireless channel for transmitting audio signals is used for voice communication. V for the wireless channel for audio signal transmission
A dedicated frequency in the HF band is allocated, and four waves in the SHF band are allocated to the moving image analog wireless channel.

[0005]

However, it is only possible to grasp the situation of the disaster from one side only by contacting the video and audio signals taken by the helicopter, so that the person in charge takes measures against the disaster. It is generally difficult to make an appropriate decision for the purpose. In addition, in determining the type of disaster, for example, in the event of a fire, whether to give priority to preventing fire spread or giving top priority to human life, the current situation of the disaster should be correctly grasped, and the local situation should be fully understood. Must be done with consideration. If you set up a well-known "fire view tower" in each area and always have an observer,
It would be possible to take appropriate measures in the event of a local disaster or local disaster. However, it is not feasible to have a supervisor always deployed, and we do not systematize the correct information transmission and prompt communication settings to related organizations in the event of a disaster. As long as it is extremely difficult.

It is also expected that the disaster situation will be quantified by utilizing still images and other digital information and computer system technology, and that the measures to be taken will be as objective as possible. In addition, a communication channel for transmitting digital information must be separately provided. However, in the case of a wireless channel, for example, it is extremely difficult to secure a new channel under the current situation where frequency allocation is restricted.

Accordingly, an object of the present invention is to provide a function such as "watching the fire" of a disaster electronically by using an existing communication channel and a computer or communication means organically coupled to each other, and It is an object of the present invention to provide a disaster situation management system capable of quickly and accurately transmitting accurate information to related organizations, and a component device thereof.

[0008]

The disaster situation management system provided by the present invention includes at least one photographing device for photographing a moving image in a disaster occurrence area, and an information management device including a computer. The information management device specifies a partial image area of the captured moving image as a still image, and the relative position information of the specified image area on the moving image together with the moving image in a computer-readable form. And a still image extraction unit configured to extract, as a still image, an image area that can be specified by the relative position information in the moving image acquired from the imaging device, Means for converting the converted still image into digital information in a form capable of image processing, and performing image processing on the disaster occurrence area based on the converted digital information.

[0009] Instead of or together with the designation, the photographing device replaces a part of the image region of the photographed moving image with a separately prepared still image and sets the relative position of the replaced still image on the moving image. The position information may be output to the information management device together with the moving image in a computer-readable form.

At least one of the photographing apparatuses decodes a predetermined PB signal and reproduces information corresponding to the PB signal, and controls a photographing mechanism and a photographing operation of the apparatus based on the reproduced information. A photographing apparatus with a communication function including control means. In this case, the information management device includes a unit that converts control instruction information for causing the imaging device with a communication function to capture a required image into the PB signal, and a communication channel for transmitting the converted PB signal to an audio signal. And communication setting means for transmitting the communication setting through the communication setting means. The information management device also has, between one or more other disaster prevention related information processing systems connected to the communication line, at least digital information in a form that can be processed by the own system, a sound signal,
And a communication control means for establishing a communication channel for performing at least one of the mutual transmissions of the PB signal.

[0011] The present invention also relates to a predetermined PB (push).
(Button) signal, and reproduces information corresponding to the PB signal, and at least audio transmission between the photographing apparatus and photographing control means that can control a photographing mechanism of the apparatus based on the reproduced information. Communication setting means for establishing a communication channel for communication, and means for converting control instruction information for causing the image capturing device to capture a required image into the PB signal and transmitting the signal to the communication setting means. There is also provided an information management device (first information management device) configured to remotely control the operation of the imaging device based on a signal.

According to the present invention, there is provided information acquisition means for acquiring at least one moving image of a disaster occurrence area including a still image region in a part of the image region together with relative position information of the still image on the moving image. A still image extracting unit that extracts, as a still image, an image region that can be specified by the relative position information in the acquired moving image, and a unit that converts the extracted still image into digital information in a form capable of image processing. A second information management apparatus including: a disaster-related information generating unit configured to generate disaster-related information on the disaster occurrence area based on the digital information; and a visualizing unit configured to visualize the generated disaster-related information. I do.

Further, a geographic image storage means for storing a geographic image for each area, and a moving image of a disaster occurrence area in which a still image area is included in a part of the image area, is stored in a relative image area of the still image. Information acquisition means for acquiring the position information and at least the photographing condition data including the photographing position and photographing direction of the still image, and extracting an image region specified by the relative position information in the acquired moving image as a still image Means for extracting a still image, means for converting the extracted still image into digital information in a form capable of image processing, and comparing the image feature represented by the converted digital information with a predefined region feature to determine the disaster occurrence area Area specifying means for specifying a geographic image, a first search means for searching for a corresponding geographic image from the geographic image storage means using the specified disaster occurrence area as a key, And visualizing means for visualizing a form image in consideration of the photographing condition data, also the third information management apparatus having provided.

In the third information management device, it is possible to further increase the added value of information. In other words, the layout of buildings, natural objects, ground, traffic, rivers and ports for each region,
Area information storage means that stores area-specific information such as the number of inhabitants, disaster prevention capacity storage means that stores quantified disaster prevention capacity for each area, and weather information for each area that can be updated freely Weather information storage means, a second search means for searching for at least one of a disaster prevention capability, weather information, and a geographic image corresponding to a search for a corresponding geographic image by the first search means; A disaster type identification unit for identifying the type of the disaster by comparing the image feature represented by the image feature with a predetermined image feature for each disaster, and the information searched out by the type of the identified disaster and the second search unit. And a disaster situation predicting means for quantifying a predicted situation of the spread of damage caused by the disaster using the prediction parameter as a prediction parameter, wherein the visualizing means maps the predicted situation of the spread of the quantified damage on the geographic image. Configured to ring. The quantified damage spread prediction status is updated at any time as new prediction parameters are acquired.

[0015] The disaster history acquisition that accumulates the digital information, the disaster occurrence area, the disaster type, the prediction parameter, and the damage prediction status updated as needed in a computer-readable storage medium in time series. The provision of further means enables an objective analysis of the disaster to be performed ex post.

[0016]

Embodiments of the present invention will be described below in detail with reference to the drawings. FIG. 1 is a configuration diagram of a disaster situation management system according to an embodiment of the present invention. This disaster situation management system 1 receives an image, for example, an NTSC signal from an imaging device 2 with a wireless communication function via an SHF band (15 GHz) antenna 4 as an information sensor system,
A VHF band (400 MHz band) antenna 6 is provided between a video receiving device 5 for demodulating and reproducing the signal and the photographing device 2.
And a wireless communication device 7 for mutually transmitting a voice signal and a DTMF signal (dual tone multi-frequency signal, the same applies hereinafter), which is an example of a PB signal.

Further, a line controller 8 for establishing a communication channel with a disaster prevention radio channel, a dedicated line, a public line, or a communication satellite only between a wire line or a network L composed of a wire line and a radio line. Is provided. Then, through the line control device 8, a voice signal, a fixed or portable image capturing device 3 with a wired communication function, and a plurality of related systems, such as a disaster prevention related information processing system installed in a fire department or a local government, are provided. DTMF signals, analog information such as moving images, and digital information such as still images are input to the information management device 10 and the media conversion device 9.

The DTMF signal used in this embodiment is control instruction information generated from the information management device 10 to the photographing devices 2 and 3 and response information transmitted from the photographing devices 2 and 3 to the information management device 10. The information transmitted together with the audio signal between the information management apparatus 10 and the related system is
This signal is converted into a combination of B signals, and is transmitted to a communication channel for transmitting a voice signal regardless of the presence of a voice signal for communication setting. As for the DTMF signal, the description in the Electronic Information and Communication Handbook (p. 3678, published in March 1988) can be referred to.

The media conversion device 9 converts a moving image, a still image, control information, and the like transmitted in a plurality of forms from the related system or the photographing device 3 through the line control device 8 into an information form that can be handled by the own system. In addition, it separates a still image, edits a moving image frame, and the like. The operation states of the line control device 8 and the media conversion device 9 are such that information decoded by the still image decoding device 11 and the moving image decoding device 12 selected according to the form of the input image is transmitted through the distribution device 13. It can be confirmed by visually grasping on the monitor 14. The output of the distribution device 13 is also recorded on the VTR 15 so that the recorded contents can be reproduced later.

Next, an embodiment of the photographing apparatus 2 with a wireless communication function will be described. The photographing device 2 is usually used by being mounted on a flying object, such as a helicopter, which can be movably positioned above the disaster occurrence area when a disaster occurs. As shown in FIG. 2, the imaging device 2 of the present embodiment captures a moving image of a VHF band antenna 21 connected to the wireless communication device 101, an SHF band antenna 22 connected to the video transmission device 113, and a target. Light camera C1 for photographing, and an infrared camera C2 for photographing an infrared photograph (still image) of a target object. Wireless communication device 10
1 establishes a wireless channel (first wireless channel) for transmitting an audio signal with the VHF band antenna 6 installed on the ground side, and the video transmission device 113 is installed on the ground side. A wireless channel (second wireless channel) for video transmission is established with the SHF band antenna 4.

The voice signal and the DTMF signal received from the VHF band antenna 21 are demodulated by the radio communication device 101. Each demodulated signal is input to an online (OL) control device 103 via an online (OL) connection device 102. The data is also input to the monitor device 105 via the N-BOX 104. Further, it is also input to the image / audio distribution device 109. The OL connection device 102 is a device that matches protocols between the wireless communication device 101 and the OL control device 103 that are bidirectionally connected. Specifically, it performs mutual conversion between a communication procedure adopted by the wireless communication device 101 and a protocol using a DTMF signal adopted by the OL control device 103.

The OL control device 103 includes the OL connection device 1
02, a gimbal control device 106 is bidirectionally connected. The gimbal control device 106 controls a known gimbal unit 107 for driving the visible light camera C1 and the infrared camera C2. A position / posture detecting device 111 is connected to the input side, and an image editing device 110 and a mixer 112 are connected to the output side.
The position / posture detection device 111 acquires information on the helicopter altitude, attitude, direction, and speed at the time of photographing from the instrument of the helicopter, and acquires the position information of the helicopter at the time of photographing from the GPS receiver attached to the instrument. Things.

The internal configuration of the OL control device 103 is as shown in FIG.
The DTMF signal guided from the connection device 102 is analyzed to detect control instruction information, specifically, control commands for various cameras C1 and C2, instruction information such as shooting longitude / latitude / altitude / moving speed, and other additional information. The contents of the detected command are referred to the command list 203 and the command analysis unit 2
02, and the contents of the specified command are specified by the command execution unit 204. The command list 203 is a diagram illustrating an example of the contents of a list in which commands represented by DTMF signals and their contents are stored in association with each other, as shown in FIG. 4, for example. According to FIG. 4, the infrared camera C2 is turned on.
The command for driving corresponds to the DTMF signal recognized as “01”. The same can be said for the contents of other commands. The execution result of the command execution unit 204 is notified to the imaging target area specifying unit 205.

The photographing target area specifying unit 205 three-dimensionally specifies the photographing target area from the contents of the embodied command and the data such as the current altitude and posture of the helicopter obtained from the position / posture detecting device 111. Then, information on a frame position (relative position of the still image with respect to the moving image) representing the replacement position or the designated position of the still image to be transmitted is created. Note that, when specifying a shooting target area from a flying object such as a helicopter, for example, JP-A-8-2855
No. 90, "Position specifying method and apparatus"
Technology can be used. Information on the created frame position is sent to the image editing device 110. Also,
Information such as the photographing altitude acquired from the position / posture detection device 111 is sent to the mixer 112. Further, the information of the specified imaging target area is notified to the gimbal control amount calculation unit 206, where the required gimbal control amount is calculated and sent to the gimbal control device 106. Gimbal control device 1
From 06, control result information, that is, information on command response, command normal execution / abnormal execution, etc., is input.

The control result acquisition section 207 acquires the control result information and notifies the DTMF signal generation section 208 of the information. D
The TMF signal generation unit 208 acquires the original command held in the command analysis unit 202, converts the acquired command and its control result information into a set, converts it into a DTMF signal, and sends the DTMF signal to the OL connection device 102. Send out. The converted DTMF signal is subjected to protocol conversion in the OL connection device 102 and then transmitted through the N-BOX 104, the wireless communication device 101, and the antenna 22.

FIG. 5 shows the relationship between the original command and its control result information. FIG. 5A shows received commands and the like.
FIG. 5B shows control result information sent from the information management apparatus 10 side. In FIG. 5A, the additional information is a continuous shooting control such as “moving rightward to zoom and shoot a target at a predetermined magnification, and reducing and shooting after a certain time has elapsed.” Is performed to perform the following. The control result information is result information indicating whether or not the respective control contents have been performed normally.

Returning to FIG. 2, the images captured by the cameras C1 and C2 are input to an image processing device 108 via a gimbal unit 107, where gamma correction and band correction are performed, and a synchronization signal is added. Thus, the signal is converted into an NTSC signal that can be transmitted to the outside. Converted NTS
The C signal is input to the image distribution device 109 and distributed to the pilot monitor device 105, a VTR (not shown), and the image editing device 110.

The image editing device 110 includes a moving image frame,
That is, it is a device for editing the position and the like of each image area (frame) included in the NTSC frame. In particular,
The still image flag is inserted into the image area at the frame position sent from the OL control device 103 in the NTSC signal distributed from the image distribution device 109. The still image flag is N
When the TSC signal is reproduced, this is designation information for causing the image area in which the still image flag is inserted to be processed as a still image. When it is requested to acquire a separately prepared still image or one or more infrared photographs (still images) photographed by the infrared camera C2, these still images are photographed by the infrared camera C2 and captured. Is replaced with an arbitrary still image of the NTSC frame. If necessary, an audio signal is also superimposed on the vertical synchronization component of the NTSC frame. This audio signal is a unidirectional audio signal.

NTSC edited by the image editing device 110
FIG. 6 shows an example of the frame. FIG. 6 shows a 30 Hz NTS
This shows an example in which a still image flag is inserted into the image area of the 29th frame of the C signal and the image area of the 30th frame is replaced with a still image. It should be noted that there may be a plurality of still image flags and still images to be replaced, and the insertion position and the replacement position may be arbitrary. The output of the image editing device 110 is sent to the mixer 112.

The mixer 112 includes, in the NTSC frame edited by the image editing device 110, shooting position information from the position / posture detection device 111, shooting height, shooting attitude, shooting direction, and shooting speed from the OL control device 103. This is a device that superimposes data and outputs it to the video transmission device 113. Since the photographing position information and the photographing altitude information are digital information, as shown in FIG.
After that, the signal is converted to an analog video signal, and then sent to the mixing processing unit 302. The mixing processing unit 302 has at least N
It is configured to include a frame memory having a capacity capable of temporarily holding one frame of the TSC signal, and superimpose video signals. The NTSC signal output from the mixer 112 is
After being amplified by the video transmission device 113, it is transmitted from the SHF band antenna 21.

The N-BOX 104 is a DT to be transmitted.
A function of superimposing the MF signal and the communication voice signal;
This is a device having a function of suppressing the signal strength of the DTMF signal and relatively increasing the signal strength of the voice signal when converting the voice signal received together with the MF signal into audible sound. Thus, it is possible to prevent the audible sound from being difficult to hear due to the mixing of the DTMF signal.

The monitor device 105 has audio input / output means such as an interphone and a receiver, and an image display means. The image distributed from the image / audio distribution device 111 is displayed on the image display means and transmitted from the N-BOX 104. The audio signal (the audio signal in which the DTMF signal is suppressed) is converted into an audible sound by the receiver. The interphone inputs a communication voice signal, and the input communication voice signal is transmitted from the VHF band antenna 21 via the N-BOX 104 and the wireless communication device 101.

Next, the simple installation type or portable type imaging device 3 with a communication function will be described. This photographing device 3
When a disaster occurs, the monitoring console 503 and the information management device 10, which will be described later, use the remote control instead of or together with the photographing device 2. Usually, the situation of the disaster occurrence area is photographed from the vicinity of the disaster occurrence area or from a certain height.

FIG. 8 is a basic configuration diagram of the photographing apparatus 3. The photographing apparatus 3 has at least a photographing apparatus main body C3 in which a visible light camera and an infrared camera are integrated, and further includes a disaster prevention radio, a dedicated line, and a public line (ISDN). , And a line control device LC for controlling connection to the mobile radio network.
Control device 40 connected to enable communication in two directions
1 and a control device 4 for controlling the operation of the photographing device main body C3 based on the control instruction information output from the OL control device 401.
02, an image editing device 403 for inputting a video image captured by the camera body C3 and editing the image, and a video transmission device 404 for transmitting the image editing result to the line control device LC. The OL control device 401 and the image editing device 403
The OL control device 103 and the image editing device 1 described above, respectively.
10 is a device having the same function as that of FIG.

FIG. 8 shows the basic configuration. In addition to the configuration shown in the figure, a monitor for monitoring an image captured by the image capturing apparatus body C3, and an image capturing operation such as an image capturing position and an image capturing direction of the image capturing apparatus. GPS receiver and azimuth sensor for acquiring condition data, and image editing device 403 for capturing condition data
May be configured to include a mixer (having the same function as the above-described mixer 112) for superimposing on the output of the mixer 112. When the communication setting with the monitoring console of the present system is performed by using a voice signal using a voice signal, the above-described N-BOX 104 is provided between the line control device LC and the OL control device 401, and the voice signal is transmitted. When converting into audible sound, the signal strength of the DTMF signal may be suppressed.

Next, the information management device 10 will be described. The information management device 10 of the present embodiment performs communication settings with various photographing devices 2 and 3 and other related systems,
This is a device that performs control for acquiring disaster-related information or acquiring information, and converts the acquired information into digital information and performs necessary processing. In this information management apparatus 10, the parts other than the data input means, the display means, and the line control mechanism can be realized by causing a stand-alone computer to read a predetermined program and execute it. The embodiment shows an example in which a required computer program is read into a plurality of computers and distributed and executed. For convenience, such a system type will be generically described as an “information management device”.

FIG. 9 shows a basic configuration example of the information management apparatus 10 according to the present embodiment. The information management device 10 includes a video signal acquired from the photographing device 2 via the SHF band antenna 4 and the video receiving device 5, that is, a moving image, a still image (substituted), Frame position information indicating the relative position of a still image (specified / replaced image), an NTSC signal on which imaging condition data such as an imaging position is superimposed, and a VHF band antenna and a wireless communication device are received. The DTMF signal / audio signal and the same kind of information received from the imaging device 3 and related systems are input.

The image separating device 501 functioning as a still image extracting means is a device for mainly separating an input NTSC signal into a moving image and a still image and extracting photographing condition data such as a photographing position. . The separation of the still image is performed by extracting the frame position information superimposed on the NTSC signal, analyzing the relative position of the still image on the moving image,
This is realized by extracting the still image at the relative position within the blanking time. The moving image is transmitted to the private network LL as it is. The still image and the shooting condition data are protocol-converted by the communication server 502 into a format that can be processed by the own device, and the private network LL is used.
Sent to

On the other hand, the DTMF signal / audio signal obtained from the photographing devices 2 and 3 and the related system is an N-BOX 50
4 and the response information analysis unit 505. N
-BOX 504 is an N-
It is the same component as the BOX 104, superimposes the DTMF signal to the destination and the communication voice signal, and suppresses the signal strength of the DTMF signal when converting the voice signal received with the DTMF signal from the destination to audible sound. This is a device for relatively increasing the signal strength of the audio signal. The response information analysis unit 505 specifies the response information represented by the DTMF signal, for example, the contents of the control result information from the imaging device 2 with reference to a list storage unit (not shown). The list stored in the list storage unit is, for example, of the same type as the command list shown in FIG. 4, and can specify control result information corresponding to response information represented by a DTMF signal. The control result information is notified to the monitoring console 503.

The monitoring console 503 includes voice input / output means such as an interphone and a receiver, data input means including a keyboard and a pointing device, image display means including a display device for a monitor, a telephone, a digital communication device, and the like. And means for setting up contact with related organizations. Since each means is publicly known, detailed description is omitted. The monitoring console 503 also has, for example, a DTMF signal generation unit that converts control instruction information for remotely controlling the imaging devices 2 and 3 into a DTMF signal.

Processing result information of the disaster processing server 508 and the MMDB server 509, which will be described later, such as a moving image from the image separating device 501 and a still image from the communication server 502, is displayed on the image display means. The audio signal (the audio signal in which the DTMF signal is suppressed) transmitted from the N-BOX 504 is converted into an audible sound by the receiver. The interphone directly sends a voice signal for contacting the operator of the imaging device 2 to the N
-Input to the BOX 504.

The command input means receives an input of control instruction information and creates a corresponding command.
In the present embodiment, the input of the control instruction information addressed to the photographing apparatuses 2 and 3 is performed, for example, as shown in FIGS. 10A to 10J and FIGS.
This is visually performed by displaying a symbol as in (e) on a display device. FIG. 10A shows an icon representing the basic photographing size, FIG.
(C) is a three-fold enlarged icon, (d) is a four-fold enlarged icon, (e) is an N-fold enlarged icon, and (f) is a zoom icon. (G) to (j) are icons for instructing movement of the shooting range, (g) is to the right, (h) is to the left,
(I) indicates an upward direction, and (j) indicates a downward direction. Also,
12A shows a 360-degree direction meter, FIG. 12B shows an inclination angle, FIG. 12C shows a preset photograph, FIG.
(E) shows an arbitrary enlargement of the photographing range centered on the current photographing point. An operator simply selects such an icon by using a pointing device or operating a joystick to create a corresponding command. The created command is
In the DTMF signal generation unit, a predetermined DTMF signal, for example, FIG.
Is converted into a DTMF signal as shown in FIG.
It is guided to the wireless communication device 7 and the media conversion device 9 via the communication device 04. The wireless communication device 7 modulates the output signal of the N-BOX 504 and transmits the modulated signal to the imaging device 2 via the VHF band antenna 6. On the other hand, the information guided to the media conversion device 9 is:
The signal is converted into a signal according to the form of information transmission to the other party, and transmitted to the other party through the line control device 8.

A display control device 50 which is an example of the visualization means
Reference numeral 6 denotes a device that causes the display device 507 to display image information, character information, and the like input through the private network LL. As the display device 507, a plasma display or a large panel screen is used so that many people can visually grasp the occurrence or spread of a disaster.

The disaster-related information generating means and the image processing means are provided with various functions of the disaster processing server 508 for managing the disaster processing DB (database) D1, and the MMDB server 5 for managing the MMDB (multimedia database) D2.
09 and various functions of a network server (NC server) 510 that manages the contact database D3. MMDB server 509
Is mainly for providing the disaster processing server 508 with the relevant information according to the request. In addition, the NC server 510 is based on the processing result of the disaster processing server 508 and the judgment result of the operator, etc., and is used as a contact or report destination, a contact method or report method such as emergency mail / telephone / image transmission / facsimile, and a contact or report. And the like, and is controlled by the monitoring console 503 to perform a contact or report arrival confirmation process. Each of the databases D1 to D3 referred to here has a function of storing, updating, and retrieving information, but each function may be present on the server 508 to 510 connected thereto. Needless to say.

FIG. 12 shows an example of the functional blocks of the disaster processing server 508 and the contents of the databases D1 and D2 according to the present embodiment. The disaster processing database D1 includes a still image storage unit D11 that stores a still image acquired through the local network LL in a readable manner at any time, for example, a region feature storage unit D12 that stores a pixel pattern as a region feature in association with a region. For example, a disaster feature storage unit D13 in which a pixel pattern or a pixel color based on an infrared image as a disaster-specific image feature is stored in association with a fire, a flood, an earthquake, and the like, and a history storing the processing history of the disaster processing server 508 for each disaster. An information storage unit D14 and other information storage units are formed. The reason for using the infrared image is that an image having a color pattern corresponding to the fire power is obtained when a fire occurs. The disaster processing database D1 includes a history information storage unit D1.
For example, it also has a data writing mechanism (disaster history acquisition means) for storing the storage information of No. 4 in a computer-readable storage medium such as a flexible disk or a porcelain disk. As a result, the history information can be analyzed at an arbitrary time by another device or system.

The MM database D2 has a region information storage unit D2 storing region-specific information such as structures, natural objects, ground, traffic, rivers, ports and harbors, and the number of residents for each region.
1. Disaster prevention capacity quantified by numerical data, for example, for each region, specifically, the resources of the fire brigade in the region (the number of fire brigade members + the number of fire trucks, the number of rescue brigade members, the possibility of supporting other regions, Regional resources that are easy to support
.), For example, a weather information storage unit D23 for storing weather information obtained by quantifying, by numerical data, weather information for each region obtained from a weather satellite, a geographic image for each region, for example, for screen display , A geographic image storage unit D24 storing other map data, and other information storage units. The weather information storage unit D23 is updated as needed by the MMDB server 509, and always stores the latest information. Further, the contact database D3 stores report destinations of countries and prefectures, report destinations of agreement fire departments, emergency mail addresses, and the like.

The disaster processing server 508 includes an image feature extracting unit 601, a disaster area specifying unit 602, and a disaster type specifying unit 60.
3. It has the functions of a prediction operation unit 604 and a mapping processing unit 605. The image feature extraction unit 601 extracts a pixel density pattern, a pixel color, a combination pattern thereof, and the like of the input still image, and extracts the disaster area identification unit 602.
And a function of sending the information to the disaster type identification unit 603. If necessary, the still image may be binarized, and the image feature may be represented by the pixel pattern after binarization, thereby simplifying the processing.

The disaster area specifying unit 602 performs processing for specifying a disaster occurrence area in the procedure shown in FIG. That is, with the input of the image feature from the image feature extraction unit 601, it is searched whether or not there is a local region having the corresponding pixel pattern in the local feature storage unit D12 (step S11,
S12). Whether or not the corresponding pixel pattern exists can be based on, for example, whether or not the similarity with the input pixel pattern is equal to or greater than a predetermined threshold. Then, when a corresponding pattern exists, an area corresponding to the pattern is specified as a disaster area (Step S).
14). If there is no corresponding regional feature, a manual process is performed (step S15). The manual processing refers to inputting a corresponding area from the data input unit of the monitoring console 503. If the corresponding area is known without image feature extraction, manual processing can be selected from the beginning instead of the area feature search processing (steps S11 and S12). When the disaster area is specified in this manner, the disaster area specifying unit 602 calculates the information of the disaster area by using the prediction calculation unit 604 and the mapping processing unit 6.
05 and the monitoring console 503 (step S16), and is stored in the history information storage unit D14 of the disaster processing database D1. If there is a next image feature to be processed, the process returns to step S11, and if not, the process ends (step 18).

The disaster type identification unit 603 performs a disaster type identification process (steps S21 to S28) according to the procedure shown in FIG. This procedure is a process for identifying a disaster occurrence area (step S
11 to S18), and only the part of the disaster-specific feature search process (steps S22 to S25) is different.

The prediction calculation unit 604 uses the disaster occurrence area identified by the disaster identification processing unit 602 and the disaster type identification unit 603 and the disaster type as key information for predictive parameter search, and uses the key information of the prediction parameter search to calculate the spread prediction situation of the damage caused by the disaster. Quantify.
The damage spread prediction status includes both the damage scale prediction and the prediction of the disaster spread itself. FIG. 15 shows a procedure for quantifying the prediction situation.

Referring to FIG. 15, the disaster area and the disaster type specified as described above are input (steps S31 and S32), and at least one of these pieces of information is used as a key to obtain area-specific information and weather information. Information and disaster prevention capability are stored in the local information storage unit D of the MM database D2.
21, D22, and D23 (steps S33 to S33).
S35). Thereafter, a measure evaluation value, which is an example of a value obtained by quantifying the disaster scale and the damage prediction, is calculated (step S36).
If a support resource is required (step S37: Ye
s) The local resources that can be easily supported are stored in the disaster prevention capacity storage unit D2.
3 and return to step S36. That is, the countermeasure evaluation value is recalculated in consideration of the acquired support resources. If there is another prediction parameter, the prediction parameter is acquired (step S40), and the process returns to step S36. If there is no other prediction parameter (step S3
9: No), and outputs the prediction calculation result to the mapping processing unit 605 and the monitoring console 503 (step S40).
The process is stored in the history information storage unit D14, and the process ends (step S41).

The processing result of the disaster processing server 508 is stored in the monitor screen of the monitoring console 503 or the display device 506 for each step.
Is displayed. For example, when the disaster occurrence area is specified in the mapping processing unit 605, M
The corresponding geographic image is retrieved from the geographic image storage unit D24 of the M database D2, converted into image display data, and transmitted to the display control device 505. Each time a disaster type is specified and a countermeasure evaluation value is calculated, these are converted into objects, mapped to corresponding positions on a geographic image, and converted into image display data as needed, and the display control device 50
Send it out to 5. Therefore, in addition to automatically causing the disaster processing server 508 to execute the above-described series of processes, the disaster processing server 508 can also be executed by a manual operation of the operator. In this case, for example, the processing is sequentially switched on the monitor screen of the monitoring console 503. In any case, by performing the above-described image processing, the geographic image of the disaster occurrence area, the disaster occurring at the corresponding location of the geographic image, and the disaster are displayed on the monitor screen or the display device 506 of the monitoring console 503. Since the damage scale prediction caused by the type and the disaster spread prediction status are displayed, the person in charge can visually grasp the disaster status.

FIG. 16A shows a state in which the disaster occurrence area is mapped on the geographic image as described above, and FIG. 16B shows a state in which the damage scale prediction and the disaster spread prediction situation are mapped. FIG. Although not shown, the shooting direction of the shooting device 2 is mapped into a symbol on the geographic images of FIGS. 16A and 16B by utilizing the shooting condition data acquired from the shooting device 2. When monitoring a moving image at the same time, the disaster situation can be grasped more objectively.

As described above, in the disaster situation management system according to the present embodiment, without adding a new communication channel,
It is possible to electronically realize the function of "looking at the fire" of a disaster. That is, the imaging devices 2 and 3 respectively designate a part of the image area of the captured moving image as a still image,
Alternatively, the information management apparatus 10 replaces a still image prepared separately, transmits relative position information on a moving image of a designated or replaced image region and shooting condition data together with the moving image using a communication channel for video transmission, and On the side, the moving image, the still image, and the shooting condition data are separated and extracted from the received video signal, and the image processing for the disaster occurrence area is performed based on the separated and extracted information. Can be transmitted using an existing communication channel.

The photographing devices 2 and 3 and the information management device 10
The control instruction information and the response information transmitted to and from each other are converted into DTMF signals and transmitted using a communication channel for audio signal transmission, and when the audio signals are converted into audible sounds, the DTMF signals are converted to audible sounds. Since the signal strength is suppressed, control instruction information for remotely controlling the imaging devices 2 and 3 can be transmitted from the information management device 10 using the existing communication channel.

Further, the buildings, natural objects, ground,
Area information such as traffic / river / port layout, number of inhabitants, etc., disaster mitigation capacity quantified for each area, weather information for each area that can be updated, and geographical images are stored, and image features of still images Based on the accumulated information, it is possible to automatically specify the disaster occurrence area, specify the type of disaster, and quantify the prediction of the spread situation of damage caused by the disaster.
The decision of countermeasures in the event of a disaster by the person in charge becomes much easier than before, and the identified disaster-prone area and the extent of damage spread are visualized and visually grasped by displaying on a display device etc. Therefore, the above determination can be made more accurate. Such a function can be expected to have tremendous effects in preserving human life, property and resources.

In the present embodiment, two types of photographing devices have been described, but the type and number of photographing devices are arbitrary. Each database D in the information management device 10
The stored contents of 1 to D3 can also be arbitrarily changed without departing from the gist of the present invention. Further, when the photographing condition data is not used as a parameter in the image processing,
Transmission from the photographing device can be omitted.

[0058]

As is apparent from the above description, according to the present invention, the function of "watching the fire" of a disaster can be realized by using an existing communication channel and a computer or communication means organically coupled to each other. Electronically, it is easy to quickly and accurately transmit accurate information at the time of disaster occurrence to related organizations.

[Brief description of the drawings]

FIG. 1 is a configuration diagram showing an embodiment of a disaster situation management system according to the present invention.

FIG. 2 is a specific configuration diagram of an imaging device with a wireless communication function according to the embodiment.

FIG. 3 is an online control device (O) provided in the photographing device;
FIG. 2 is a detailed configuration diagram of an L control device).

FIG. 4 is an explanatory diagram showing an example of the contents of a command list stored in the imaging device.

5A and 5B are explanatory diagrams of a command system. FIG. 5A illustrates commands transmitted from the information management apparatus to the photographing apparatus.
(B) shows an example of response information returned from the imaging device to the information management device.

FIG. 6 is an explanatory diagram showing an example of an NTSC frame structure edited by an image editing device provided in the photographing device.

FIG. 7 is a detailed configuration diagram of a mixer included in the photographing device.

FIG. 8 shows an NTS output from the mixer according to the embodiment.
FIG. 4 is a partially enlarged view of a C signal.

FIG. 9 is a basic configuration diagram of an imaging device with a wired communication function according to the embodiment.

FIGS. 10A to 10J are explanatory diagrams showing examples of shooting icons displayed on a monitor screen of a monitoring console when command creation is performed according to the embodiment.

FIGS. 11A to 11E are explanatory diagrams showing another example of a shooting icon displayed on a monitor screen of a monitoring console when a command is created according to the embodiment.

FIG. 12 is a functional block diagram of the disaster processing server according to the embodiment.

FIG. 13 is an explanatory diagram of a procedure of a disaster area specifying process by the disaster processing server.

FIG. 14 is an explanatory diagram of a procedure of a disaster type specifying unit by the disaster processing server.

FIG. 15 is an explanatory diagram of a procedure of a damage spread situation prediction process by the disaster processing server.

16A is an explanatory diagram showing an example of a screen displayed on a display device or the like when a disaster occurrence area is specified by the disaster processing server, and FIG. 16B is a diagram showing a damage spread situation prediction process; FIG. 9 is an explanatory diagram showing a change example of the screen in the case.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Disaster situation management system 2 Imaging device with wireless communication function 3 Imaging device with wired communication function 4 Ground-side SHF band antenna 5 Image receiving device 6 Ground-side VHF band antenna 7 Ground-side wireless communication device 8 Line communication device 9 Media conversion device 10 Information management device 11 Still image decoding device 12 Moving image decoding device 21 VHF band antenna (for on-board installation) 22 SHF band antenna (for on-board installation) 103, 401 Online control unit 104 N-BOX for shooting unit 106 Gimbal Control device 108 Image processing device 110, 403 Image editing device 111 Position / posture detection device 112 Mixer 113, 403 Video transmission device C1 Visible light camera C2 Infrared camera C3 Camera main body 402 Control device 501 Image separation device 503 Monitoring console 504 System side For N-BOX 505 Information analysis unit 506 display control unit 507 display unit 508 Disaster processing server 509 the multimedia database server 510 network server D1 Disaster processing database D2 multimedia database D3 contact database

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Hatsuo Kimura 3-3-3 Toyosu, Koto-ku, Tokyo Inside NTT Data Communication Corporation (72) Inventor Tosuji Katsumata Toyosu, Koto-ku, Tokyo No. 3-3-3 NTT Data Communication Co., Ltd. (72) Inventor Noriyasu Goda 3-3-3 Toyosu Toyosu, Koto-ku, Tokyo Inside NTT Data Communication Co., Ltd. (72) Inventor Katsuhiko Tanaka 3-3-3 Toyosu, Koto-ku, Tokyo Inside NTT Data Communication Co., Ltd. (72) Inventor Osamu Tada 3-3-3 Toyosu Toyosu, Koto-ku, Tokyo NTT Within Data Communication Co., Ltd. (72) Inventor: Tokuo Akiyama NTT Data Communication Co., Ltd. 3-3-1 Toyosu, Koto-ku, Tokyo

Claims (12)

[Claims] 1. An information management device comprising at least one photographing device for photographing a moving image in a disaster occurrence area, and an information management device comprising a computer, wherein the photographing device converts a partial image area of the photographed moving image into a still image And the relative position information on the moving image of the specified image area is output to the information management device together with the moving image in a computer-readable form, and the information management device is obtained from the photographing device. A still image extracting unit that extracts an image area of the moving image that can be specified by the relative position information as a still image, and a unit that converts the extracted still image into digital information in a form capable of image processing. And performing image processing on the disaster occurrence area based on the converted digital information. 2. The image capturing apparatus according to claim 1, wherein a part of an image area of the captured moving image is replaced with a separately prepared still image, and relative position information of the replaced still image on the moving image is computer-readable. The disaster situation management system according to claim 1, wherein the disaster situation management system is configured to output the information to the information management device together with the moving image. 3. At least one of the photographing devices decodes a predetermined PB signal and reproduces information corresponding to the PB signal, and executes a photographing mechanism and a photographing operation of the own device based on the reproduced information. A photographing device with a communication function, comprising: a control unit for controlling, the information management device converts the control instruction information for causing the photographing device with the communication function to photograph a required image into the PB signal, 3. The disaster situation management system according to claim 1, further comprising: communication setting means for transmitting the converted PB signal through a communication channel for transmitting a voice signal. 4. At least one of digital information, a voice signal, and the PB signal in a form that can be processed by the own system with one or a plurality of other disaster prevention related information processing systems connected to a communication line. 4. The disaster situation management system according to claim 1, further comprising communication control means for establishing a communication channel for performing mutual transmission of the information. 5. A photographing apparatus comprising: means for decoding a predetermined PB signal to reproduce information corresponding to the PB signal; and a photographing apparatus comprising photographing control means capable of controlling a photographing mechanism of the apparatus based on the reproduced information. Communication setting means for establishing at least a communication channel for voice transmission between; and means for converting control instruction information for causing the image capturing apparatus to capture a required image into the PB signal and transmitting the signal to the communication setting means. An information management apparatus, comprising: a remote controller for controlling an operation of the image capturing apparatus based on the PB signal. 6. An information acquisition means for acquiring at least one moving image of a disaster occurrence area including a still image region in a part of the image region together with relative position information of the still image on the moving image. A still image extracting unit for extracting, as a still image, an image region of the moving image that can be specified by the relative position information; a unit for converting the extracted still image into digital information in a form capable of image processing; An information management device, comprising: disaster-related information generating means for generating disaster-related information on the disaster occurrence area based on the information; and visualizing means for visualizing the generated disaster-related information. 7. A geographic image storage means for storing a geographic image for each area, and a moving image of a disaster occurrence area in which a still image area is included in a part of the image area is stored as a relative image on the moving image of the still image. Information acquisition means for acquiring position information and at least imaging condition data including an imaging position and an imaging direction of the still image; and extracting an image area specified by the relative position information from the acquired moving image as a still image A still image extracting unit, a unit for converting the extracted still image into digital information in a form capable of image processing, and a disaster occurrence area by comparing image features represented by the converted digital information with predetermined regional features. Area search means for searching for a corresponding geographic image from the geographic image storage means using the specified disaster occurrence area as a key; An information management apparatus, comprising: a visualization unit that visualizes an image in a form in which the imaging condition data is considered. 8. Buildings, natural objects, ground, traffic,
Area information storage means that stores area-specific information such as the location of rivers / ports and the number of residents, disaster prevention capacity storage means that stores quantified disaster prevention capacity for each area, and weather information for each area A weather information storage means which is stored in an updatable manner; and a second means for searching for at least one of the disaster prevention capability, weather information, and area-specific information when the first search means searches for the corresponding geographic image. Search means, disaster type identification means for identifying the type of the disaster by comparing the image feature represented by the digital information with a predetermined image feature for each disaster, and the type of the identified disaster and the second search means Disaster status prediction means for quantifying the spread prediction status of the damage caused by the disaster using the information retrieved in step 1 as a prediction parameter, and the visualization means predicts the spread of the quantified damage. Information management apparatus according to claim 7, characterized in that it is configured to map the status on the geographic image. 9. The information management apparatus according to claim 8, wherein the quantified damage spread prediction status is updated as needed with the acquisition of a new prediction parameter. 10. A disaster history acquisition for accumulating the digital information, the disaster occurrence area, the disaster type, the prediction parameter, and the damage prediction status updated as needed in a computer-readable storage medium in a time-series manner. 10. The information management device according to claim 9, further comprising a unit. 11. A photographing apparatus used in the disaster situation management system according to claim 1, wherein a first communication channel for transmitting an audio signal is established with the information management apparatus. Communication setting means, a photographing machine body for photographing a target object, and photographing control means for controlling operation and posture of the photographing machine body by predetermined control instruction information, wherein the photographing control means comprises: An image capturing apparatus configured to convert a PB signal obtained from the first communication channel via communication setting means into the control instruction information. 12. An imaging device used in the disaster situation management system according to claim 1, wherein a second communication channel for image transmission is established with the information management device. Communication setting means, a photographing device main body for photographing a target object, and when the photographing device main body has taken a moving image, a part of the moving image is designated as a still image, and on the moving image of the designated still image Means for transmitting the relative position information of the above to the second communication channel together with the moving image in a computer-readable form.