JP2006041770A - Image distribution method, image display method, wide area supervisory method employing them, image distribution apparatus and image display apparatus, and wide area supervisory system employing them - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To distribute and display compressed image data optimum in response to a status without pressing a transmission line and a computer. <P>SOLUTION: An image distributor photographs a photographing object, captures an image of the photographing object, compresses the photographed images by each different resolution and different transmission rate, converts the photographed images into a plurality of compressed image data, selects an optimum compression image data in response to a request, distributes the selected compression image data via an external network, and an image display apparatus discriminates a status of each of a plurality of the compressed image data distributed from the external network on the basis of the safety and the importance of the photographing object, selects the optimum compression image data to be displayed, decompresses the selected compression image data by each different resolution and different transmission rate, composes the decompressed images, and displays the result. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image distribution method, an image display method, an image distribution device, and an image display device for images taken by a camera or the like, and is useful for, for example, a wide area monitoring system that monitors and controls rivers and the like in real time. .

  Conventionally, transmission data such as images has a large data capacity, and is transmitted using a dedicated image line separately from a digital data line. However, the current mainstream is to transmit all data as IP packets by increasing the speed and capacity of transmission lines with the spread of optical fiber lines and Gigabit class Ethernet (registered trademark).

JP 2001-292439 A JP 2004-77978 A

  For example, when the transmission line is used in a wide area monitoring system that monitors and controls rivers and the like, all data such as image data and monitoring control data is transmitted on the same line. Although the monitoring control data has a small absolute amount, the transmission of the image data increases as the image data increases, and there is a possibility that monitoring and control at real time or at a minimum fixed period cannot be performed. In particular, in a wide area monitoring system, there is a tendency to provide a large number of surveillance cameras for safety confirmation so that remote operation is possible, and it is expected that the transmission amount of image data will increase in the future. Furthermore, the use of a monitoring camera on the Web (which enables transmission over the Internet) enables a plurality of monitoring operators to receive image data. For example, when two monitoring operators receive the data, they are placed on the line. Twice the amount of image data will flow, and will increasingly press the line.

  As a method for controlling the amount of data to be transmitted, for example, there is a technique as disclosed in Patent Document 1. In Patent Document 1, an imaging unit on the facility side includes an abnormal state identification unit, an imaging data compression unit, a setting unit for setting a compression rate of imaging data from a plurality of compression ranks, and imaging data. Data storage unit, instructing the compression unit to compress the imaging data with the compression rank set according to the abnormal situation identified by the abnormal state identification unit, and compressing on the imaging unit side Determine the rate and send the imaging data to the network, and control on the imaging unit side so that the total amount of imaging data sent to the network does not exceed the transmission capacity of the network I am doing so.

  The above technology, on the facility side, determines the individual abnormal situation and controls the amount of image transmission sent to the network, which has the advantage of distributing the workload, but the situation of the entire wide area such as rivers Therefore, the importance of each image cannot be determined. Also, in a system that monitors a wide area such as a river management facility, the transmission load is not high at normal times, but monitoring access is concentrated during a specific period such as rain, and the transmission load tends to be high. It is necessary to set each image transmission amount after judging the situation. Further, a large number of pieces of image information are collected on the monitoring side, and it is necessary to display a large number of these pieces of image information at the same time. However, decoding (decompression of compressed data) is necessary for displaying compressed images, and many images are displayed. When it comes to information, there is a problem that the load of decoding work increases, and the number of images that can be displayed by one computer is limited.

  The present invention has been made in view of the above problems, and uses an image distribution method, an image display method, and an image distribution method capable of distributing and displaying optimum compressed image data according to the situation without squeezing a transmission line and a computer. It is an object to provide a wide area monitoring method, an image distribution apparatus, an image display apparatus, and a wide area monitoring system using them.

(1) An image distribution method according to the present invention for solving the above-described problems is as follows.
Shooting the shooting target, capturing the image of the shooting target, compressing the shot image for each different resolution and display rate, and converting it to a plurality of compressed image data,
It is characterized in that optimum compressed image data according to a request is selected from a plurality of compressed image data, and the compressed image data is distributed via an external network.
As a compression format of a captured image, particularly a moving image, a streaming compression format that can be restored and reproduced in real time on the display side is used.

(2) An image distribution method according to the present invention for solving the above-described problems is as follows.
In the image delivery method described in (1) above,
It is characterized in that optimal compressed image data is selected from a plurality of compressed image data and distributed in accordance with a preset importance level of a photographing target.

(3) An image distribution method according to the present invention for solving the above-described problems is as follows.
In the image delivery method according to (1) or (2) above,
When the photographing target is in an operating state, compressed image data having a detailed resolution and display rate is selected from a plurality of compressed image data and distributed.

(4) An image distribution method according to the present invention for solving the above-described problems is as follows.
In the image delivery method according to any one of (1) to (3) above,
Calculating the safety level of the subject,
According to the calculated safety level, optimum compressed image data is selected from a plurality of compressed image data and distributed.

(5) An image distribution method according to the present invention for solving the above-described problem is as follows.
In the image delivery method described in (4) above,
The safety degree includes time information until reaching a dangerous state.

(6) An image display method according to the present invention for solving the above-described problems is
Based on the calculated safety level of the shooting target and the importance level of the preset shooting target, or the calculated safety level of the shooting target or the preset importance level of the shooting target, a plurality of distributed from the external network Judge the situation for each compressed image data, select the optimal compressed image data to be displayed from the plurality of compressed image data,
Restore one or more selected compressed image data at different resolutions and display rates,
One or more restored images are combined and displayed.

(7) An image display method according to the present invention for solving the above-described problems is
In the image display method according to (6) above,
The safety degree includes time information until reaching a dangerous state.

(8) An image display method according to the present invention for solving the above problems
In the image display method according to (6) or (7) above,
A priority order for each of the plurality of compressed image data is set according to the safety level and the importance level, and optimum compressed image data is selected based on the priority order.

(9) An image display method according to the present invention for solving the above-described problem is
In the image display method according to any one of (6) to (8),
One or a plurality of compressed image data to be selected is selected according to the display capability of the screen display device.

(10) An image display method according to the present invention for solving the above-mentioned problems is as follows.
In the image display method according to any one of (6) to (9),
When a predetermined photographing target is selected by the operator, or when the photographing target is in an operating state, compressed image data having a detailed resolution and display rate for the photographing target is selected and displayed preferentially. And
For example, when the operator selects a shooting target to be monitored, selects a shooting target to be operated, or when the shooting target is in an operating state, the shooting target is preferentially displayed.

(11) An image display method according to the present invention for solving the above-described problems is as follows.
In the image display method according to any one of (6) to (10) above,
When compressed image data of the same photographing target is requested from another operator at the same time, the restored image is distributed and displayed on the screen display device of the other operator via the internal network. And

(12) A wide area monitoring method according to the present invention for solving the above-described problems is as follows.
Using the image delivery method according to any one of (1) to (5) above, delivering a plurality of shooting target images existing in a wide area,
The plurality of imaging targets are monitored using the image display method according to any one of (6) to (11).

(13) An image distribution apparatus according to the present invention for solving the above-described problems is provided.
A photographing means for photographing the photographing object;
A plurality of image capture means for capturing images captured by the imaging means, compressing the captured images to different resolutions and display rates, and converting the images into compressed image data;
Image distribution means for selecting optimum compressed image data according to a request from a plurality of compressed image data and distributing the image via a network is provided.

(14) An image distribution apparatus according to the present invention for solving the above-described problems is provided.
In the image delivery device described in (13) above,
The image distribution means selects and distributes the optimum compressed image data from a plurality of compressed image data according to the preset importance of the photographing target.

(15) An image distribution apparatus according to the present invention for solving the above-described problems is provided.
In the image delivery device described in (13) or (14) above,
The image distribution means selects and distributes compressed image data having a detailed resolution and display rate from a plurality of compressed image data when the imaging target is in an operating state.

(16) An image distribution apparatus according to the present invention for solving the above-described problem is provided.
In the image delivery device according to any one of (13) to (15),
Having a safety level calculating means for calculating the safety level of the photographing object;
The image distribution unit selects and distributes optimum compressed image data from a plurality of compressed image data according to the safety degree calculated by the safety degree calculation unit.

(17) An image distribution apparatus according to the present invention for solving the above-described problems is provided.
In the image delivery device described in (16) above,
The safety degree includes time information until reaching a dangerous state.

(18) An image display device according to the present invention for solving the above-described problems is provided.
Based on the calculated safety level of the shooting target and the importance level of the preset shooting target, or the calculated safety level of the shooting target or the preset importance level of the shooting target, a plurality of distributed from the external network A situation determination means for determining a situation for each compressed image data, and selecting optimum compressed image data to be displayed from the plurality of compressed image data;
A plurality of image decoding means for restoring one or a plurality of compressed image data selected by the situation judging means at different resolutions and display rates;
And image synthesizing means for synthesizing and displaying one or a plurality of images restored by the image decoding means.

(19) An image display apparatus according to the present invention for solving the above-described problems is provided.
In the image display device according to (18) above,
The safety degree includes time information until reaching a dangerous state.

(20) An image display device according to the present invention for solving the above-described problems is provided.
In the image display device according to (18) or (19),
The situation determination means sets priority for each of the plurality of compressed image data based on the safety level and the importance level, and selects optimal compressed image data based on the priority level.

(21) An image display device according to the present invention for solving the above-described problems is provided.
In the image display device according to any one of (18) to (20),
The situation determination means selects one or a plurality of compressed image data to be selected according to the display capability of the screen display device.

(22) An image display device according to the present invention for solving the above-described problems is provided.
In the image display device according to any one of (18) to (21),
When a predetermined photographing target is selected by the operator, or when the photographing target is in an operating state, the situation determination unit preferentially selects compressed image data having a detailed resolution and display rate for the photographing target. It is characterized by displaying.

(23) An image display device according to the present invention for solving the above-described problems is provided.
In the image display device according to any one of (18) to (22),
When the compressed image data of the same subject is requested by another operator at the same time, the image restored by the image decoding means is distributed and displayed on the screen display device of the other operator via the internal network. It is characterized by making it.

(24) A wide-area monitoring system according to the present invention that solves the above problems
Using the plurality of image delivery devices according to any one of (13) to (17) above, delivering a plurality of shooting target images existing in a wide area,
The plurality of imaging targets are monitored using the image display device according to any one of (18) to (23).

  According to the present invention, compressed image data having a resolution and a display rate that are optimal for display is determined by determining the situation of the object to be photographed, and thus the load on the computer that decodes the transmission line and the compressed image data is reduced. Even when access is concentrated, monitoring and control can be performed at regular intervals. In particular, the optimal resolution and display rate of compressed image data are selected and distributed according to the situation, environment, etc. (specifically, safety level, importance level, etc.) of the shooting target. It is possible to display the image, and the object to be monitored is not overlooked.

  In addition, if necessary, the photographing target selected by the operator can be preferentially displayed, and it is possible to cope with a case where the system cannot automatically determine. Furthermore, when the display of the same object to be photographed is simultaneously requested by another operator, the data restored by the image display device is distributed to other image display means via the internal network, so that the transmission line ( It is possible to avoid congestion of the same compressed image data in the external network) and to prevent duplication of decoding processing of the compressed image data, thereby reducing the load on the transmission line and the computer.

1 to 4, an image distribution method, an image display method, a wide area monitoring method using the image distribution apparatus, an image distribution apparatus, an image display apparatus, and a wide area monitoring system using them will be described below with reference to FIGS. An example will be described in detail.
In the present invention, description will be made using a river management facility as an example, but the present invention can be applied to other things such as a plant monitoring system.

FIG. 1 is a schematic diagram showing an example of an embodiment of a wide area monitoring system according to the present invention.
As shown in FIG. 1, the wide area monitoring system according to the present invention uses a network (external network 1a, internal network 1b) serving as a transmission line, and uses a river management facility (drainage station B) located in a wide area from the monitoring office A. -D, Xiamen E-H, etc.) are monitored and controlled.

  An optical fiber cable network is used as the external network 1a that connects the monitoring office A to the drainage stations B to D, Xiamen E to H, and the like for speeding up and capacity increase. The external network 1a is connected to the internal network 1b via the router 2 and the firewall 3. The internal network 1b on the monitoring office A side is protected by the router 2, the firewall 3, and the like, and is configured so that the internal network 1b on the monitoring office A side cannot be easily accessed from the outside. As an internal network 1b for connecting terminals and servers in the monitoring office A, Gigabit class Ethernet (registered trademark) is used, and a large amount of image data can be transmitted.

  In the monitoring office A, the internal network 1b restores (decompresses) the compressed image data, and combines with the web server 4 (image display device) that combines and outputs the restored one or more images. A multi-display 5 for displaying the output image, a monitoring terminal 6 for operating and controlling the monitoring target of the river management facility, a database 7 for accumulating inspection histories, operation histories and related books of equipment used in the river management facility, A server 8 that provides information on devices stored in the database 7 is connected, and mutual information input / output is performed via the internal network 1b, and monitoring and control necessary for river management are performed. The web server 4 also has a function of collectively managing management information (for example, water level) transmitted from each river management facility via the external network 1a and displaying it in a web browser format. In addition, the status of each river management facility can be easily managed.

  The multi-display 5 has a wide area monitoring screen 5a and an operation screen 5b. The wide area monitoring screen 5a displays a wide area river management facility in a simplified manner so that the wide area river management facility can be monitored. As a simple display, for example, a thumbnail display that displays a monitoring target as a symbol is used, and a number of monitoring target states can be displayed simultaneously. The operation screen 5b displays a river management facility in operation, a river management facility with high priority for monitoring and operation, a river management facility selected by the operator, etc., and changes in the situation, for example, the safety level of the monitoring target According to the change in the number of river management facilities, one or more high-priority river management facilities are automatically combined and displayed, thereby improving the operability for the operator. Such display control is performed in the web server 4, and the output is displayed on the multi-display 5 (for details, refer to FIG. 2 and the description thereof). On the wide area monitoring screen 5a, for example, monitoring images of 60 river management facilities are simply displayed. On the operation screen 5b, for example, monitoring images of 4 river management facilities in 60 locations are displayed in detail, and a large number of monitoring images are displayed. It is possible to simultaneously monitor and operate river management facilities.

  In Xiamen E, the external network 1a is connected to the internal network 1c via the router 21. In the internal network 1c, a plurality of CCTVs (photographing means) 23 for photographing the lock gate 22 to be photographed, a plurality of water level gauges 24 for measuring the water level around the lock gate 22, and images from the CCTV 23 are compressed. And a web server 25 (image distribution device) that calculates the safety level of the lock 22 based on data from the water level gauge 24 and the like. Since Xiamen F to H have the same configuration as Xiamen E, detailed illustration and description are omitted.

  In the drainage station B, the external network 1a is connected to the internal network 1d via the router 31. The internal network 1d is a network in which a plurality of CCTVs 32 for photographing a drainage pump station to be photographed, a PLC (Programmable Logic Controller) 35 for controlling a power generation facility 33 and a pump 34 of the drainage pump station, and images from the CCTV 32 are compressed. Is connected to a web server 36 that transmits information to be measured and controlled at the drainage station, and a machine terminal 37 that operates and controls the equipment at the drainage station, and further operates and controls the equipment at the drainage station. A wireless LAN 39 that connects the portable terminal 38 and the internal network 1d wirelessly is connected. In the machine terminal 37 and the portable terminal 38, information (history, books, etc.) stored in the database 7 can be easily called through the server 8 by using a device code or the like. Easy operation of the equipment. In addition, since the drainage machine stations C and D are the same structure as the drainage machine station B, detailed illustration and description are abbreviate | omitted.

  Next, FIG. 2 shows a schematic configuration of the image distribution apparatus and the image display apparatus constituting the wide area monitoring system according to the present invention, and the details thereof will be described.

  As described with reference to FIG. 1, the management office A side and the river management facility side are connected to each other via the network 1 to transmit necessary management information. At this time, the management information is transmitted not only with a small transmission load such as control data and measurement data but also with a large transmission load such as image data. In particular, in a wide area monitoring system, a large number of image data is transmitted in order to remotely monitor and control a large number of river management facilities existing in a wide area. The present invention relates to image data to be transmitted, taking into account the safety level, importance, and priority of comparison with other river management facilities to be imaged. By setting an appropriate compression rate for each transmission, the load on the network and the computer is reduced. Then, in order to reduce the load, a device specific to each of the image distribution device and the image display device is taken.

  Specifically, the image distribution device 25 in Xiamen E captures images of Xiamen 22 (photographing target) captured by a plurality of CCTVs 23, and compresses the captured images to different resolutions and display rates. A plurality of image capture means 26 for converting into image data, and an image distribution means 27 for selecting the optimum compressed image data according to the request from the plurality of compressed image data and distributing the image via the network 1 . The image capture means 26 converts, for example, into compressed image data in a streaming format. By providing a plurality of images for each different resolution and display rate, the load when converting to compressed image data is reduced, and a plurality of compressions are performed simultaneously. By converting to image data, compressed image data according to the request can be immediately distributed. For example, an image photographed from one CCTV 23 of Xiamen 22 is distributed as compressed image data 11 with a low compression ratio that becomes a detailed monitoring image, and an image photographed from the other CCTV 23 has a high compression ratio that becomes a simple monitoring image. Even when the compressed image data 12 is distributed, it is possible to immediately switch to compressed image data having a resolution and display rate corresponding to the type of the image capture means 26.

  Note that the image distribution unit 27 may select and distribute optimal compressed image data from a plurality of compressed image data according to the preset importance of the lock 22. In addition, when the lock gate 22 is in an operating state (opening operation, closing operation), compressed image data with detailed resolution and display rate may be selected from a plurality of compressed image data and distributed. Further, the safety level of the lock 22 is calculated by the safety level calculation means 28 from the measured value and change of the water level gauge 24, the gate opening degree of the lock 22 and the alarm signal, etc., and according to the calculated safety level. Alternatively, optimal compressed image data may be selected from a plurality of compressed image data and distributed. In this case, the safety level preferably includes time information (urgent level) until reaching a dangerous state such as a predicted time to reach the operation water level.

  Further, in the web server 4 (image display device), the situation for each of a plurality of compressed image data distributed from the network 1 based on the calculated safety degree of the lock 22 and the preset importance of the lock 22. The situation determination means 13 for selecting the optimum compressed image data to be displayed from the plurality of compressed image data, and the one or more compressed image data selected by the situation judgment means 13 with different resolutions and display rates. A plurality of image decoding means 14 and 15 for restoring each time, and an image synthesizing means 16 for synthesizing and displaying one or a plurality of images restored by the image decoding means 14 and 15, the output of which is a multi-display 5 is displayed. As the image decoding means, at least two types for the detailed monitoring image and the simple monitoring image are provided.

  In the situation determination means 13, the priority order of the plurality of compressed image data may be set according to the safety level and importance level of the lock 22, and the optimum compressed image data may be selected based on the priority order. . For example, the priority order is calculated from the time to reach the operation water level in each lock 22 and the importance of lock 22. When selecting one or a plurality of compressed image data, the display capacity of the web server 4 or the multi-display 5, specifically, the processing capacity of the web server 4 or the size of the displayable area of the multi-display 5 is selected. Accordingly, the optimum compressed image data is selected. The degree of importance of Xiamen 22 may be transmitted from the Xiamen E side together with the compressed image data, or may be recorded in advance on the web server 4 side. The safety level (for example, water level, gate opening, alarm signal, etc.) of Xiamen 22 is collected periodically from Xiamen E together with the compressed image data, and is time information until reaching a dangerous state. It is desirable to include (urgency).

  Further, in the web server 4, when a predetermined lock 22 is operated by an operator, or when the lock 22 is in an operating state, the situation determination means 13 displays the detailed resolution and display in the lock 22. Select the compressed image data of the rate and display it with priority. However, even when the lock gate 22 is preferentially displayed, if an image of another lock gate 22 is selected by the operator, the compressed image data of the detailed resolution and display rate in the lock gate 22 is displayed. Select and give priority to display. When the compressed image data of the same lock 22 is requested by another operator at the same time, the image restored by the image decoding means 14 and 15 is sent to the monitoring office A via the internal network 1b. It may be distributed and displayed on the screen display device of the operator.

  Thus, at the image distribution device 25 side, as compressed image data to be transmitted, at least two types for the detailed monitoring image and for the simple monitoring image are created, and when the operation is performed in the monitoring office A, Using compressed image data for detailed monitoring images, using compressed image data for simple monitoring images when monitoring, for example, using a simple monitoring image when monitoring a large number of river management facilities, The transmission capacity of the entire network can be greatly reduced, and when a detailed monitoring image is required, it can be switched immediately. Also, based on the safety level due to the water level, etc., the situation of the river management facility is judged, and in the safe state, the simple monitoring image is used, the transmission capacity is reduced, and when the danger level increases, the detailed monitoring image is used for transmission. The image required by the operator can be appropriately displayed.

  Further, when simultaneously operating a large number of locks 22, a detailed monitoring image is transmitted from the locks 22 with high importance and urgency of the locks 22 and displayed preferentially. In this case, the image of the lock 22 with high importance and urgency is displayed in detail, and the others are simply displayed, so that the quality of the transmission image for the important lock 22 can be ensured.

  Furthermore, a mode for forcibly transmitting detailed monitoring images is provided, and when the importance and urgency judgments of the system and the operator's judgments are inconsistent, the detailed monitoring images are transmitted and prioritized by the operator's operation. Is possible.

  In addition, when a large number of operators request transmission of the same image at the same time, the compressed image data transmitted from the Xiamen E side is restored by the web server 4 of the monitoring office A, and the web server 4 is connected to the internal network. It distributes to other terminals in the monitoring office A via 1b. In this case, the compressed image data between Xiamen E and the monitoring office A is not congested, and the transmission path is not compressed.

  Next, the situation determination means 13 in the web server 4 will be described in detail with reference to FIG.

  In order to determine the optimum resolution and display rate of the compressed image data to be transmitted, it is necessary to grasp the situation and environment of the lock gate 22 or the like that is the shooting target of the compressed image data. Therefore, input signals from each river management facility, specifically, input signals such as water level, gate opening, warning signal, flow direction, and rainfall are periodically collected, and the status of the web server 4 is judged via the network. Input to the means 13 (steps S1, S2).

  Then, from the river information such as the water level and rainfall provided by the river information system, the water level after 30 minutes and 1 hour is predicted (steps S3 and S4), and the operation water level and switching speed set in each river management facility. Based on the set values, etc., the urgency is calculated from the predicted change in the water level until the operation water level is reached (steps S5 and S6), and the facility importance set for each river management facility The risk level of each river management facility is calculated based on the degree and the calculated urgency level (steps S7 and S8).

  Then, while comparing the risk levels of the river management facilities, prioritizing the river management facilities to be monitored, and taking into account the display capability of the terminal, one image of the river management facility to be displayed Alternatively, a plurality of selections are made (steps S9 and S10).

  Then, the selected image is restored and combined and displayed on the multi-display (step S11).

Here, the risk level is calculated by weighting the time until the operation water level is reached, the importance level of each river management facility, and the like.
Assume the importance of the facility as I, rank it according to the estimated damage due to flooding, and set as follows.
In case of large damage: I = 3
In case of damage: I = 2
Small damage: I = 1

Also, the urgency level is set to U, ranking is performed according to the expected time until the start of operation due to water increase, and the following is set.
For urgency (0.5 hours or less): U = 3
In case of urgency (0.5 to 1 hour): U = 2
In case of low urgency (1 hour or more): U = 1

Further, the risk level is D, and the facility importance level I and the urgency level U are calculated using the following formula.
D = a * I + b * U
Here, a and b are weighting factors.

  For example, if a = b = 1, the damage is large, and the degree of urgency is low, D1 = 3 + 1 = 4. If a = b = 1, the damage is low and the degree of urgency is high, D2 = 1 + 2 = 3. In this case, since D1> D2, the priority of D1 (large damage, low urgency) is higher, and the screen is preferentially displayed.

FIG. 4 shows a display example of a screen displayed on the multi-display.
Here, a case where three 17-inch displays (multi-display play 5) having a maximum display resolution of SXGA (1280 × 1024 dots) are displayed using one image display device (web server 4) is shown. The number and combination of the web server 4 and the multi display play 5 may be any combination depending on the purpose.

The three displays mainly display the following screens alone or in combination.
(1) Overall monitoring screen (see Fig. 4 (a))
(2) CCTV monitoring screen (see 45 in FIGS. 4B and 4C)
(3) Facility monitoring screen (see Fig. 4 (c))
(4) Operation screen (see 49 in FIG. 4C)

Further, each screen will be described.
As shown in Fig. 4 (a), the overall monitoring screen is intended for information sharing, and as many river management facilities as possible can be seen on the entire screen so that the operating status of each river management facility and an overview of CCTV can be seen on a single screen. It is shown. Here, the image from CCTV is displayed using the simple monitoring image 41a (SQCIF size, jpeg image of about 1 frame per second). In addition, you may make it display a thing with a low risk priority and a low priority compared with another imaging | photography object using the further simple monitoring image 41b.

  Further, as shown in FIG. 4B, the CCTV monitoring screen has a monitoring operation area 43 for constantly displaying images from the CCTV at the top of the screen. 20F / S) size can be displayed on a maximum of 8 screens. For example, when CCTV is automatically selected, four CCTV images to be displayed are selected and displayed according to the level of urgency. In this case, for example, if the shooting target is Xiamen, a combination of CCTV images such as QVGA × 2 screen and QVGA × 1 screen + QCIF × 4 screen are determined in advance. Further, when a CCTV image to be displayed is newly updated, an alarm is displayed in the status display area 42. In the lower part of the screen, an urgent image list is displayed in the monitoring list display area 44.

  As shown in FIG. 4 (c), the facility monitoring screen displays a plan view (or 3D diagram) of the river management facility (see area 46) and is displayed so that the state of the river management facility can be confirmed. ing. Normally, only the monitoring screen such as the area 46 is displayed, but the operation button screen 49 is popped up at the time of operation, and further, the CCTV image of the river management facility is also displayed. In this case, a CCTV image of QVGA size × 2 screens is displayed as an operation display screen. Further, depending on the situation, a graph 47 showing the fluctuation of the water level and a related book 48 for operation are displayed in a pop-up so that the operator can easily operate.

  Normally, the entire monitoring screen is displayed across three displays, or the entire monitoring screen is displayed across two displays, and the facility monitoring screen or CCTV monitoring screen is displayed on the other display. The operation screen is displayed as a pop-up on these screens as necessary.

  Regarding the display resolution and frame rate (display rate) of CCTV, the resolution is VGA (640 × 480 dots), QVGA (320 × 240 dots), CIF (352 × 288 dots), QCIF (176 × 144 dots). ), About four types of SQCIF (128 × 96 dots) are used. As the frame rate, 20 to 30 F / S for a full moving image, 10 to 20 F / S for a moving image, 1 to 10 F / S for a semi-moving image, and 1 F / S for a still image are used. These can be summarized by use as shown in Table 1 below.

  For example, referring to FIG. 4B, when a CCTV image is arranged on an SXGA screen and a VGA size display is performed, a considerable load is applied to the CPU of the computer. CCTV image display is desirable. In addition, when displaying in QVGA size, up to about 8 movies can be displayed, and in the case of SQCIF size, the frame rate is one frame per second, so the load on the CPU is lightened. For example, the number of river management facilities that can be displayed on the wide area monitoring screen can be displayed. In consideration of the load at the time of compressing and restoring the transmission image, it is desirable to provide a number of image capturing means and image decoding means corresponding to the types of resolution and frame rate.

  Usually, CCTV shooting targets are Xiamen, Airfield, etc. If Xiamen, Xiamen back, Xiamen table, operation room, etc. are taken as targets, and 2 or 3 CCTVs are provided. 4 to 8 CCTVs are provided for photographing the machine field pump room, generator room, horizontal conveyor, inclined conveyor, dust remover, ponnai, drainage gate, etc. For example, when a machine is monitored using a CCTV monitoring screen as shown in FIG. 4B, a CCTV of QVGA × 1 screen, QCIF × 4 screen, and 5 screens in total can be displayed in the monitoring operation area 43. However, when there are eight CCTVs in the machine, not all CCTV images can be displayed in one screen. In that case, five CCTVs are selected and made displayable, or all CCTVs are automatically switched so that all CCTVs can be cyclically displayed.

  In the monitoring list display area 44 shown in FIG. 4B, for example, a list as shown in Table 2 is listed.

  As shown in Table 2, the facility names are listed in order according to the level of urgency (in order of shortest prediction time), and the CCTV images of the top four facilities on the list are displayed in the area 43 at the top of the screen. The degree of urgency is determined from the predicted time until the operation water level is reached, and the predicted time is predicted to change the water level using linear prediction. At the end of the closing operation of the gate, the operator puts a check in the confirmation column and the operation is completed (the gate is fully closed, etc.). . Note that facilities whose urgency level is less than 30 minutes are displayed in yellow so that the operator can easily recognize them. When the urgency level (priority order) changes or the CCTV image displayed in the monitoring operation area 43 is changed, an alarm is displayed in the status display area 42 and the change is made after confirmation by the operator. Is done.

  In the case of using the wide area monitoring system according to the present invention, for example, it is assumed to operate based on the following scenario.

1) For river water level, use information such as the water level from each river facility and gate opening. Normally, the water level rises from the upstream side and reaches the operation water level of each river management facility in turn. In the meantime, the river management facilities that should be operated (to be monitored) from the importance level and the safety level are listed in order in the monitoring list display area 44. The CCTV image selected in the facility monitoring area 44 is displayed in the monitoring operation area 43.
2) When the water level of the river management facility reaches the operation water level, operations such as locks are performed on each facility monitoring screen (see FIG. 4C). The facility monitoring screen is displayed by linking from the wide area monitoring screen (see FIG. 4A), or linked from the urgency list display (see Table 2) of the CCTV monitoring screen (see FIG. 4B). To display. In addition, in order to switch the river monitoring facility to be operated easily, each facility monitoring operation screen may be switched by a tab method.
3) If there is an abnormality (failure) in the facility, the facility is placed at the top of the urgency list.
4) When a facility having an abnormality (failure) is selected, the state of the facility is displayed overlapping the image of the monitoring operation area.
5) When the confirmation is completed, the overlapped display screen is closed.
6) The facility for which the operation has been completed is subjected to a corresponding confirmation check, and is placed from the top to the bottom of the urgency list.
7) Display the next emergency facility in the CCTV monitoring operation area.
8) By repeating the procedure as described above, it is possible to perform operations while constantly monitoring a plurality of facilities.

It is the schematic which shows an example of embodiment of the wide area monitoring system which concerns on this invention. It is a block diagram of the image delivery apparatus and image display apparatus which comprise the wide area monitoring system which concerns on this invention. It is a flowchart explaining the situation judgment of the image display apparatus which comprises the wide area monitoring system which concerns on this invention. It is a display example of the screen which the image display apparatus which comprises the wide area monitoring system which concerns on this invention displays.

Explanation of symbols

1 network (the entire network including 1a, 1b, 1c, 1d)
1a WAN (Wide area work such as optical fiber network)
1b, 1c, 1d LAN (local area network)
4 Web server 5 Multi-display 25 Web server

Claims (24)

Shooting the shooting target, capturing the image of the shooting target, compressing the shot image for each different resolution and display rate, and converting it to a plurality of compressed image data,
An image distribution method comprising: selecting optimal compressed image data according to a request from a plurality of compressed image data, and distributing the compressed image data via an external network. The image distribution method according to claim 1,
An image distribution method comprising: selecting and distributing optimal compressed image data from a plurality of compressed image data in accordance with a preset importance of an imaging target. In the image delivery method according to claim 1 or 2,
An image distribution method comprising: selecting and distributing compressed image data having a detailed resolution and display rate from a plurality of compressed image data when the photographing target is in an operating state. The image delivery method according to any one of claims 1 to 3,
Calculating the safety level of the subject,
An image distribution method comprising: selecting and distributing optimal compressed image data from a plurality of compressed image data according to the calculated safety degree. The image delivery method according to claim 4.
The image distribution method according to claim 1, wherein the safety level includes time information until reaching a dangerous state. Based on the calculated safety level of the shooting target and the importance level of the preset shooting target, or the calculated safety level of the shooting target or the preset importance level of the shooting target, a plurality of distributed from the external network Judge the situation for each compressed image data, select the optimal compressed image data to be displayed from the plurality of compressed image data,
Restore one or more selected compressed image data at different resolutions and display rates,
An image display method comprising combining and displaying one or more restored images. The image delivery method according to claim 6.
The image display method according to claim 1, wherein the safety level includes time information until reaching a dangerous state. In the image delivery method of Claim 6 or Claim 7,
An image display method, wherein priority is set for each of the plurality of compressed image data based on the safety level and the importance level, and optimal compressed image data is selected based on the priority level. The image delivery method according to any one of claims 6 to 8,
One or a plurality of compressed image data to be selected is selected according to the display capability of the screen display device. The image delivery method according to any one of claims 6 to 9,
When a predetermined photographing target is selected by the operator, or when the photographing target is in an operating state, compressed image data having a detailed resolution and display rate for the photographing target is selected and displayed preferentially. Image display method. The image delivery method according to any one of claims 6 to 10,
When compressed image data of the same photographing target is requested from another operator at the same time, the restored image is distributed and displayed on the screen display device of the other operator via the internal network. Image display method. Using the image distribution method according to any one of claims 1 to 5, a plurality of shooting target images existing in a wide area are distributed,
A wide-area monitoring method, wherein the plurality of imaging targets are monitored using the image display method according to any one of claims 6 to 11. A photographing means for photographing the photographing object;
A plurality of image capture means for capturing images captured by the imaging means, compressing the captured images to different resolutions and display rates, and converting them into compressed image data;
An image distribution apparatus comprising: an image distribution unit that selects optimal compressed image data according to a request from a plurality of compressed image data and distributes the image via a network. The image distribution apparatus according to claim 13.
The image distribution device, wherein the image distribution unit selects and distributes the most suitable compressed image data from a plurality of compressed image data in accordance with a preset importance of the photographing target. The image delivery apparatus according to claim 13 or 14,
The image distribution device, wherein the image distribution unit selects and distributes compressed image data having a detailed resolution and display rate from a plurality of compressed image data when the photographing target is in an operating state. The image delivery apparatus according to any one of claims 13 to 15,
Having a safety level calculating means for calculating the safety level of the photographing object;
The image distribution device, wherein the image distribution unit selects and distributes optimum compressed image data from a plurality of compressed image data according to the safety degree calculated by the safety degree calculation unit. The image distribution apparatus according to claim 16.
The image distribution apparatus according to claim 1, wherein the safety degree includes time information until reaching a dangerous state. Based on the calculated safety level of the shooting target and the importance level of the preset shooting target, or the calculated safety level of the shooting target or the preset importance level of the shooting target, a plurality of distributed from the external network A situation determination means for determining a situation for each compressed image data, and selecting optimum compressed image data to be displayed from the plurality of compressed image data;
A plurality of image decoding means for restoring one or a plurality of compressed image data selected by the situation judging means at different resolutions and display rates;
An image display device comprising: an image composition unit that composes and displays one or a plurality of images restored by the image decoding unit. The image display device according to claim 18, wherein
The image display apparatus according to claim 1, wherein the safety level includes time information until reaching a dangerous state. The image display device according to claim 18 or 19,
The status determination means sets priority for each of the plurality of compressed image data based on the safety level and the importance level, and selects optimal compressed image data based on the priority level. apparatus. The image display device according to any one of claims 18 to 20,
The situation determination means selects one or a plurality of compressed image data to be selected according to the display capability of the screen display device. The image display device according to any one of claims 18 to 21,
When a predetermined photographing target is selected by the operator, or when the photographing target is in an operating state, the situation determination unit preferentially selects compressed image data having a detailed resolution and display rate for the photographing target. An image display device characterized by displaying. The image display device according to any one of claims 18 to 22,
When the compressed image data of the same subject is requested by another operator at the same time, the image restored by the image decoding means is distributed and displayed on the screen display device of the other operator via the internal network. An image display device characterized in that A plurality of image distribution apparatuses according to any one of claims 13 to 17 are used to distribute a plurality of images to be photographed in a wide area,
24. A wide-area monitoring system that monitors the plurality of imaging objects by using the image display device according to claim 18.

Images