JP2003284062A - Monitoring system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To constitute rationally a system which stores image information obtained by photographing a plurality of regions needing monitoring, and synchronously regenerating the image information. <P>SOLUTION: A plurality of photographing units T are connected with a monitoring unit W via a communication network N. When the monitoring unit T locates an object to be monitored, the monitoring unit W makes the plurality of photographing units T controlled by a previously set group perform photographing. Its image information is stored in a hard disk 111 of the photographing unit T. After the storage is started, the image information stored in the respective photographing units T is displayed simultaneously on a monitor 120 of the monitoring unit W by transmitting a demand information from the monitoring unit W. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention transmits image information consisting of a moving image captured by a camera or a still image updated with the passage of time to a terminal via a network, and display means provided in the terminal. Relates to a surveillance system configured to display.

[0002]

2. Description of the Related Art As a technique related to the monitoring system configured as described above, there are those disclosed in Japanese Patent Laid-Open Nos. 10-178683 and 10-322682. The former of these conventional examples is such that when an abnormality is detected in a building, the video data of the surveillance camera is held on the surveillance camera side for a certain period of time, and the video data of a certain period before and after the occurrence of the abnormality is transferred to a telephone line, etc. Are transmitted to a monitoring center in the order of occurrence of abnormalities via the monitor, and the transmitted image is stored and held in the monitoring center and displayed on the display means. In the latter of the conventional examples, the moving object is detected when the norm of the motion vector is determined to be equal to or greater than the preset threshold value by processing the image captured by the camera. The ISDN connection is performed to send out the compression-encoded image.

[0003]

Considering a system in which moving objects are monitored or image information of the objects to be monitored when any abnormality is detected is transmitted to a monitoring terminal via a network for monitoring, the moving objects are monitored. Not only when the target is monitored, there are many cases where the user wants to confirm the surrounding situation by image information. Specifically, when the water level at a specific point in a river rises above a preset level during rainfall, not only the water level at this specific point but also the water level at other points should be the same. There is a case where it is desired to grasp at a timing, and when a person, an automobile, or the like enters an area requiring monitoring, not only the situation in the area but also the situation in an area other than the area may be grasped.

In consideration of monitoring a plurality of places in this way, the image information from a plurality of cameras is displayed on the monitor so that the situation of a plurality of places can be grasped in real time by the image information. When a situation that requires monitoring occurs, it is considered necessary not only to monitor in real time but also to save the image information and confirm the situation by reproducing the image information. Therefore, when a situation that requires monitoring occurs, it may be possible to control the saving of image information from multiple cameras. However, simply saving the image information can save the required image information from the multiple image information saved during playback. There is room for improvement because it takes time and effort to extract and reproduce each image information in a form that is easy to monitor.

An object of the present invention is to save image information taken by a plurality of cameras at a timing requiring monitoring,
The point is to reasonably configure a system that can reproduce each image information in a form that is easy to monitor.

[0006]

The features, actions and effects of the monitoring system according to claim 1 of the present invention are as follows. [Characteristics] Image information composed of a moving image captured by a camera or a still image updated with the passage of time is transmitted to a terminal via a network and displayed on a display means provided in the terminal. In the surveillance system, the plurality of cameras, an availability determination means for determining availability of monitoring of a monitoring target in an imaging area of each camera, and an image storage means for storing image information captured by the plurality of cameras are provided. When the necessity determination means determines the necessity of monitoring, shooting is performed by a plurality of cameras managed as one preset group, and
A storage control unit that performs a process of storing the image information captured by these cameras in the image storage unit is provided, and when the display request information is input from the terminal after the storage, the image storage unit is stored. The point is that a display processing unit for displaying the stored image information of one group on the display unit of the terminal is provided.

[Operation / Effect] According to the above feature, when the necessity determination means determines the necessity of monitoring, the storage control means performs shooting with a plurality of cameras managed as one preset group. When the display request information for displaying the image information is input from the terminal after the saving, the image information taken by the plurality of cameras is saved in the image saving means. The display processing means displays the plurality of image information stored in the storage means on the display means of the terminal. That is, when the monitoring target is a moving object or person, the area where the existence of the monitoring target is determined, the periphery of this area,
It is possible to simultaneously capture and save the area existing on the lower side of the moving direction of the monitoring target, and display the image information saved in this way, for example, in the form of synchronized playback on one monitor. Will also be possible. As a result, a system has been rationally configured that can automatically save image information captured by a plurality of cameras at a timing requiring monitoring and reproduce each image information in a form that facilitates monitoring and confirmation.

The features, actions and effects of the monitoring system according to claim 2 of the present invention are as follows. [Characteristics] In the surveillance system according to claim 1, each of the plurality of cameras is provided with an image storage unit for storing image information captured by the camera, and the display processing unit receives the display request information. Is configured to extract the image information stored in the plurality of image storage means included in the target group, and set the processing mode to transmit this image information to the requesting terminal via the network. There is a point.

[Operation / Effect] According to the above characteristics, the image information captured by a plurality of cameras is stored in the image storage means provided in each camera, and the image information stored in this way is displayed. In this case, the image display processing means transmits the image information through the network only when the request information is input. Therefore, for example, the image display processing means compares the image information captured by a plurality of cameras with the network at the same time. Therefore, the network traffic is not increased. As a result, a system was constructed which, while using a plurality of cameras, can perform monitoring and confirmation without burdening the network.

The features, actions and effects of the monitoring system according to claim 3 of the present invention are as follows. [Features] In the monitoring system according to claim 1, the image storage means is provided on the side of the terminal, and the storage control means sets in advance when the necessity determination means determines the necessity of monitoring. The processing mode is set so that the image information from the plurality of cameras managed by the one group is transmitted to the image storage means of the terminal via the network and stored.

[Operation / Effect] According to the above feature, the storage control means transmits the image information captured by the plurality of cameras to the terminal side via the network and stores the image information in the image storage means. To display image information,
Only by extracting the image information to be displayed, the image can be displayed on the display means of the terminal. As a result, a system was constructed that can display promptly when performing monitoring and confirmation.

[0012]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings. [First Embodiment] As shown in FIG. 1, there may be a ship or driftwood such as a river, a waterway, a road or an indoor passage, or a vehicle traveling on a road or a person moving in an indoor passage. The monitoring area 101 is set as a monitoring area 101, and it is assumed that a ship, driftwood, a vehicle traveling on a road, a person moving on a road or an indoor passage, or the like is a monitoring target.
In order to capture and store 01 from a plurality of positions, a plurality of image capturing units T (a high-order concept of the first image capturing unit T1 to the fourth image capturing unit T4) having a camera Cam and a processing terminal 111 are provided. The monitoring system is configured to include a monitoring unit W that is connected to the unit T via the communication network N and displays the image information stored in the imaging unit T.

In this surveillance system, the image information captured by the image capturing unit T is processed by the processing terminal 1 provided in the image capturing unit T.
It is stored in a hard disk 111 (an example of an image storage unit) of 10 and is transmitted to the monitoring unit W to be displayed on a monitor 120 (an example of a display unit) of the monitoring unit W.

The communication network N is an Ethernet type LA using an optical fiber for managing a monitoring unit.
N (Local Area Network) is used. Also, although this communication network is a LAN, WAN (Wide Are
a)) or the Internet using a commercial telephone line, or a LAN or WAN connected by the Internet.

Although only four photographing units T are shown in FIG. 1, this monitoring system includes a large number of photographing units T, and the large number of photographing units T are managed by being divided into preset groups. Is configured.
In addition, in this monitoring system, a process of determining the presence or absence of the monitoring target in the monitoring area 101 is performed by processing the image information captured by the camera Cam, and when it is determined that the monitoring target exists, a preset group is set. The image information captured by the cameras Cam of the plurality of monitoring units T included in the processing unit 110 is stored in the hard disk 111 of the processing terminal 110, and after this storage, the plurality of monitoring units T are based on the request from the monitoring terminal W. The photographed image information is transmitted to the monitoring terminal W via the communication network N, and the screen of the monitor 120 is divided and displayed in a synchronized state. The configuration and processing form will be described below.

The photographing unit T includes a processing terminal 110 having the hard disk 111 built therein, the camera Cam, and a pan head 112 for setting a photographing angle of the camera Cam. Further, the processing terminal 110 has a function of determining the presence or absence of a monitoring target in the imaging area and transmitting the determination result to the monitoring terminal W, and when the monitoring unit W requests, the requested image information. To send to the communication network N
It functions as a server having an I (Common Gateway Interface). The monitoring unit W is a monitoring terminal 121 (an example of a storage control unit / display processing unit) that is a general-purpose computer, a keyboard 122, a mouse 123 as a pointing device, and the monitor 120 that displays image information, operation information, and the like. It is configured with. Further, the monitoring unit W has a function (a function of a storage control unit) of performing shooting with a plurality of shooting units T included in a preset group, and requests transmission of image information stored in the shooting unit T. It has a function (function of display processing means) of sending out request information and displaying the image information transmitted from the photographing unit T.

As shown in FIG. 2, the processing terminal 110 of the photographing unit T receives M video signals from the camera Cam.
From the camera Cam, an encoder 130 that compresses and encodes a moving image of 30 frames per second in PEG2 format (a format established by the Moving Picture Experts Group), a loop buffer 131 that temporarily stores image information from this encoder 130, and a camera Cam. Event discriminating unit 1 for discriminating presence / absence of a monitoring target in the photographing region by image processing based on the video signal of
32 (an example of an availability determination unit) and an event determination unit 132
A detection information generation unit 133 to which information from the camera is input, a calendar / timer unit 134 that sends date and time information to the detection information generation unit 133, and a camera C to the detection information generation unit 133.
A camera information unit 135 that sends information specifying am, an image control unit 136 that receives image information from the loop buffer 131 and that accesses information to the hard disk 111, and an information access system for the information control unit 136. And a communication interface 137 which forms a camera platform control unit 1 for controlling the camera platform 112.
It is configured with 38. Note that these constituent elements are configured by hardware or software, or a combination of hardware and software.

As shown in FIG. 3, the monitoring terminal 121 of the monitoring unit W includes a communication interface 140 for accessing information to the communication network N, and an information control unit for controlling access to the communication interface 140 for information. 141, and a detection event discriminating unit 1 configured to access information to the information control unit 141 and includes a hard disk or a semiconductor memory.
42, a group table 143, and a detection table 144, a request information generation unit 145 that sends request information to the processing terminal 110, and control information input from the keyboard 122 and mouse 123 to the monitoring terminal 121. A control interface 146 for permitting, a decoder 147 for decoding a moving image compressed and encoded in the MPEG2 format transmitted from the communication interface 140, a frame buffer 148, and a video control for outputting image information from the frame buffer 148 to the monitor 120. Part 1
And 49. Note that these constituent elements are configured by hardware or software, or a combination of hardware and software.

The process of saving the image information of the monitoring target is performed as follows. That is, as shown in FIG. 4, the processing terminal 110 detects a pattern of an object existing within a preset shooting area based on image information from the camera Cam, detection of movement of the shot image within the shooting area, and the like. If it is determined that the monitoring target exists, the detection information generation unit 133 adds the shooting date / time information based on the information from the calendar timer unit 134, and adds the information from the camera information unit 135 to the information. Based on this, the detection information with the information for identifying the camera Cam (shooting unit T) is generated, and the detection information is sent to the monitoring terminal 1 via the communication network N.
21 is performed.

Next, in the monitoring terminal 121 which has received the detection information, the detection event discriminating unit 142 should specify the camera Cam that has generated the detection information from the information included in the detection information, and should take an image based on the group table 143. A process of extracting a group, specifying a plurality of photographing units T included in the group, and transmitting control information for photographing to each photographing unit T via the communication network N is performed. In the figure, it is assumed that the plurality of photographing units T for performing photographing as described above are the first photographing unit T1 to the fourth photographing unit T4.

After the control information is output in this way,
In each of the photographing units T (T1 to T4), the camera Cam
A process of saving the image information photographed in (3) in the hard disk 111 is performed. Loop buffer 1 when performing this shooting
By storing the image information that is temporarily stored in 31, the same timing as the event detection timing,
Alternatively, the image information is saved from the timing before this, and the header of the image information saved as a file is added with the file name and the information for identifying the group, and the information of this header is added to the detection table. The information is transmitted to the monitoring terminal 121 via the communication network N, and the monitoring terminal 121 stores the detection ID, the shooting date and time, the unit (shooting unit T), and the file name in a table in the detection table 144. To do.

The hard disks 1 of the plurality of monitoring units T are managed in group units set in this way.
After the process of storing the image information in 11 is started, the process of displaying the stored image information on the monitor 120 of the monitoring terminal W is performed as follows. That is, as shown in the schematic diagram of FIG. 5 and the flowchart of FIG. 6, when the display is performed, the detection information stored in the detection table 144 is first detected by operating the keyboard 122 or the mouse 123.
The list of D is displayed as a list and displayed on the monitor 120 (# W01, # W02 steps). In this state of displaying the list, a request is made by designating what is to be displayed from the list, and this detection ID is obtained. A plurality of corresponding photographing units T and a save file name are extracted from the detection table 144, and request information for designating a file name and transmitting image information to the corresponding photographing unit T is transmitted via the communication network N. Transmission processing is performed (# W03-
# W05 step).

After transmitting the request information, the monitoring unit T receiving the request information reads the image information of the requested file name from the hard disk 111 and transmits it to the monitoring unit W via the communication network N. Be seen. The image information transmitted in this way is compressed in the MPEG2 format as described above, and when the monitoring terminal 121 of the monitoring unit W receives this image information, the image information of the transmitted image information is received. The screen of the monitor 120 is divided by the number corresponding to the number, and the image information decoded by the decoder 147 is displayed in each divided area (# W06, # W07 steps).

As described above, in the first embodiment, the plurality of photographing units T are configured to determine the presence or absence of the monitoring target, and when the presence of the monitoring target is determined, the monitoring unit W sets in advance. By allowing multiple shooting units T managed by a group to shoot at the same time,
Since the monitoring target, the surroundings of the monitoring target, and the area where the monitoring target may move are captured at the same time, and the captured image information is stored on the side of the capturing unit T. Information capable of designating the image information captured by the image capturing unit T, while not increasing traffic in the communication network N as compared with transmitting all captured image information to the monitoring unit W via the communication network N. Is transmitted to the side of the monitoring unit W and stored as a detection table, so that the monitoring unit W can request the monitoring target to be displayed based on the information of the detection table 144. In this case, a plurality of pieces of image information are displayed on the monitor 120 at the same time so that they can be monitored.

[Second Embodiment] As shown in FIGS. 7 and 9, a plurality of photographing units A, B and C, a first monitoring unit D and a second monitoring unit E are connected by a communication network N. Monitoring system is configured.

In this monitoring system, the drainage station 1 and the two gutters 2 and 3 in the river R are monitored, and the photographing units A, B and C are arranged, and the management office 4 is provided with the first monitoring unit. D is arranged, and the second monitoring unit E is arranged in the management center 5 distant from them. The communication network N is an Ethernet LAN using optical fibers managed by the company or organization managing the drainage pumping station 1.
Is used. Also, this communication network N is a LAN
(Local Area Network), but WAN (Wide A
area network) or the Internet using a commercial telephone line, or a LAN or WAN connected by the Internet.

The river R has three tributaries Ra, Rb, and Rc. Of the three tributaries Ra, Rb, and Rc, the tributary Ra that is prone to backflow of water due to the water level difference when the river R is flooded.
The drainage pump station 1 is installed in the other two tributaries Rb and Rc
The above-mentioned gutters 2 and 3 are installed at the positions where the flow of water is controlled, and the drainage pumping station 1 and the gutters 2 and 3 can be easily moved to and from the drainage pumping station. A management office 4 that controls the generators and pumps of 1 and the opening / closing control of the gutters 2 and 3 is arranged, and a management center 5 that comprehensively manages the water supply is arranged at a position relatively distant from them. There is. Then, as described above, the drainage station 1 is provided with the photographing unit A,
The other two gutters 2 and 3 are provided with photographing units B and C, the management office 4 is provided with the first monitoring unit D, and the management center 5 is provided with the second monitoring unit E.

As shown in FIG. 8, the drainage pump station 1 stores water from the tributary Ra in a water absorption tank 6, and the water in the water absorption tank 6 is regulated by a drainage pump 7 to a level higher than that of the water absorption tank 6. After being pumped up to the water tank 8, it is a general one configured to be sent out to the river R from the gate 8G.
A gate 6G is provided between and, and a dust remover 9 and a conveyer 10 that sends out a removed substance removed by the dust remover 9 are provided to a path for sending water from the water absorption tank 6 to the drainage pump 7. Further, each of the gutters 2 and 3 is a general one having an openable and closable gate which is arranged at the portion of the bank of the river R.

The respective photographing units A, B and C automatically transmit the images photographed by the cameras to the first management unit D and the second management unit E, and at the same time, the information transmitted from the first management unit D is changed. A basic processing form is configured to perform necessary processing based on the above. That is, as shown in FIG. 9, each of the photographing units A, B, and C includes a CCD-type camera 12 supported by a platform 11, a microphone 13 that captures sound, and a speaker 14 that emits sound. Image from 12 and microphone 13
From the communication network N, and
The camera platform 11 is provided with a processing terminal 15 as a transmission processing device that outputs the sound from the communication network N to the speaker 14.
A logic controller 16 for controlling
Further, the photographing units A, B and C are equipped with more cameras 12 than the illustrated number, and the photographing units A and B have a support terminal 18 and a monitor for confirming the images photographed by the cameras 12 of the units. 19 and.

In the photographing unit A, a camera 12 is arranged at each position capable of photographing the drainage pump 7 provided in the drainage station 1, the dust removing device 9, the generator (not shown), and the like. Microphone 13 corresponding to camera 12
And a speaker 14, and a support terminal 18 and a monitor 19 for controlling the drainage pump 7, the dust removing device 9, the generator, and the conveyor 10 for sending the removed substances from the dust removing device 9 in the drainage station 1. Control panel and drainage station 1
Various devices are placed at the site where maintenance is performed.
The photographing units B and C have a camera 12 arranged at a position where the gutters 2 and 3 can be photographed.

The pan / tilt head 11 has a built-in electric motor so as to perform a pan operation for rotating the camera 12 around the vertical axis and a tilt operation for swinging the camera 12 around the horizontal axis, which will be described later. As described above, the angle can be adjusted by remote control from the first monitoring unit D or the second monitoring unit E. Although the control mode is not described, the camera 12 includes a zoom lens, and the focal length and focus of the zoom lens can be adjusted by remote control from the first monitoring unit D or the second monitoring unit E. Is also configured.

The first monitoring unit D includes an image storage server 21 and a monitoring terminal 22 that functions as a display processing device.
And a remote control terminal 23 functioning as a display processing device.

The image storage server 21 comprises a server main body which is a general-purpose computer having a large-capacity hard disk 24, and a monitor 25 as a display means, and a camera provided in each of the photographing units A, B and C. A process of storing an image sent from the communication network 12 via the communication network N in the hard disk 24;
The images stored in the monitor terminal 22 and the network N
It is configured to be able to perform a process of sending to a terminal connected to.

Monitoring terminal 22 of the first monitoring unit D
Is a terminal body consisting of a general-purpose computer and a monitor 25.
And a microphone 26. The remote control terminal 23 of the first monitoring unit D is a terminal main body made of a general-purpose computer and a monitor 25 as a display means.
And a microphone 26. Although not shown in the drawing, each of the image storage server 21, the monitoring terminal 22, and the remote control terminal 23 is provided with a keyboard for inputting information and a mouse as a pointing device. The control terminal 23 is provided with a speaker that emits sound in a form built in each main body or a form attached to the outside.

The second monitoring unit E comprises a monitoring terminal 22 having a monitor 25 and a microphone 26 as display means, and a remote control terminal 23 having the monitor 25 and the microphone 26, respectively. The configuration is the same as that of the first monitoring unit D except that the image storage server 21 is not provided.

In this surveillance system, the images photographed by the cameras 12 of the respective photographing units A, B and C are displayed on the monitor 25 of the surveillance terminal 22 of the first surveillance unit D or the second surveillance unit E. At the same time as enabling the monitoring by the image, the remote control terminal 23 controls the drainage pump 7 of the pumping station 1, the gates 6G and 8G, the dust removing device 9 and the generator, and the opening and closing of the gutters 2 and 3. The control is made possible by remote control. When an operator is present at the drainage pump station 1 and the gutters 2, 3 when performing this remote control, a voice input from the microphone 26 of the remote control terminal 23 is used. The instruction can be transmitted to the operator through the speaker 14 of the photographing units A, B, and C.

Further, in this monitoring system, the monitoring terminal 2
2. The screen shown in FIG. 10 is displayed on the monitor 25 of each remote control terminal 23. That is, on the screen, an image display area 28, a camera list 29 that lists and displays information that identifies the installation location of the camera 12, an angle area 30 that indicates a camera angle, the volume of the speaker 14, and the volume of the microphone 13 are collected. The volume control unit 31 that displays the adjustment knobs that enable the respective controls, the abnormality notification unit 32 that indicates the occurrence of an abnormality, the selection of the number of divisions (the number of images displayed) in the image display area 28, and the camera 12 display. An operation area 33 is formed in which switches are displayed to enable operations such as setting of angles and switching between moving images and still images.
Then, by operating the cursor on a required portion of the operation area 33 displayed on the screen of the monitor 25 and clicking the return key of the keyboard or the switch of the mouse, the number of divisions in the image display area 28 can be set and , The angle of the camera 12 can be set, etc.
The cameras 12 displayed in the list in the camera list 29
By specifying the cursor with the cursor and performing the same operation as described above, the camera 12 from which the image is to be obtained can be selected, and the volume of the volume can be changed by the operation of dragging the cursor to the position of the knob displayed on the volume control unit 31. G to make adjustments
UI (Graphical User Interface) type control is enabled.

The image display area 28 has a full size of 7
The number of pixels is 20 × 480 dots, and the number of pixels can be set to 320 × 240, 160 × 120, and 80 × 60 dots by dividing.

[Transmission Processing of Moving Image and Still Image] FIG.
As shown in FIG. 3, the monitor terminal 22 and the remote control terminal 23 are set with a reception thread for displaying moving images and still images on the monitor 25 by the browser and plug-in software as described above. Unit A,
On the B and C sides, a moving image transmission thread and a still image transmission thread are set.

Here, if a moving image is requested from the receiving thread side by socket connection to the photographing unit (# 0
1), a transmission thread is generated at the request of the connection management thread of the moving image transmission thread (# 02), and a connection is established between this transmission thread and the reception thread (# 03),
In addition, a transmission system for transmitting the moving image from the moving image buffer of the stream buffer to the receiving thread via the transmitting thread is formed (# 04). After forming the transmission system in this way, the transmission thread continuously transmits the moving image from the moving image buffer of the stream buffer to the receiving thread, so that the moving image of the moving image is displayed on the monitor 25 of the monitoring terminal 22 or the remote control terminal 23. It becomes possible to display.

When a still image is requested from the receiving thread side by socket connection to the photographing unit (# 0
5), a transmission thread is generated at the request of the connection management thread of the still image thread (# 06), a connection is established between this transmission thread and the reception thread (# 07), and a still image buffer of the stream buffer is created. To form a transmission system for transmitting the still image to the reception thread via the transmission thread (# 08). After forming the transmission system in this way, the transmission thread measures (at a preset interval) the still image from the still image buffer of the stream buffer and transmits the still image. The still image can be displayed in the form of being updated at the set intervals on the monitor 25.

In particular, when switching from a moving image to a still image and from a still image to a moving image, the transmission path of the transmission thread in the connected state is cut off first.
Processing for newly establishing a required transmission path is performed.

[Transmission Processing of Still Images of Different Sizes] In the above-described transmission processing of moving images and still images, a basic image transmission mode is shown. However, when displaying still images, The size (number of pixels) is also frequently changed, and the form of the transmission process at the time of this change can be shown as follows.

In FIG. 12, for example, a processing form in the case where the terminal X (for example, the monitoring terminal 22) and the terminal Y (for example, the remote control terminal 23) request the same image of the camera 12 as two terminals. Is shown. In this process, when a connection request is received from the reception threads of the terminals X and Y (# 01), the transmission threads corresponding to the respective terminals X and Y are requested by the connection management thread of the still image transmission thread. Generate (# 02), establish a connection between these transmission threads and the corresponding receiving threads (# 03),
At the same time, a transmission system for transmitting a still image of the number of pixels requested from the still image buffer of the stream buffer to the receiving thread via the transmitting thread is formed (# 04). After forming the transmission system in this way, the transmission thread continuously transmits the still image of the requested number of pixels from the still image buffer of the stream buffer to the reception thread, so that the still image is displayed on the monitors 25 of the terminals X and Y. Can be displayed. Also, in the figure, 720 × 480 dots, 320 × 240 dots, 16
0x120 dots. A state in which a still image with a pixel number of 80 × 60 dots is generated and stored from a moving image is shown, and a still image with a pixel number of 720 × 480 dots is displayed on the terminal X from a state of 320 × 240.
The transmission form of a still image at the time of switching to the number of pixels of a dot is shown.

[Image Information Storage Processing When Event Occurs] In the system of the present invention, when the necessity determination means K in the photographing unit determines the necessity of monitoring in the monitoring area as shown in FIG. The storage control means L stores image information (basically moving images) from the camera 12 of the photographing unit and preset image information (basically moving images) from a plurality of cameras 12 in the image storage server. When the monitoring terminal 22 requests the reproduction of the image information via the communication network N after the transfer of the image information to the image data storage device 12, the image information is stored in the plurality of image transmission means M. The image information is transmitted to the monitoring terminal 22 in a state in which it can be synchronously reproduced.

That is, when the specific configuration of this monitoring system is configured as shown in FIG. 15 and FIG. 15, for example, a non-contact type sensor 51 for detecting the water level on the tributary Ra is used as the propriety determination means K. , Or camera 12 (Cam
The sensor 51 or the availability determination unit 50 determines whether or not the water level exceeds a predetermined level by including the availability determination unit 50 that determines the water level by processing the image from 1). The image information (DATA1) from the camera 12 (Cam1) is transmitted through the communication network N, and at the same time, the camera 12 (Cam2) of the camera unit (cam2) set in advance is changed from the camera unit including the camera 12 (Cam1). , Cam3, Cam4) image information (DATA2, DATA3, DATA4)
The control information is transmitted so as to perform the transmission. In addition, in the image storage server 12, the storage control means stores the image information captured by the plurality of cameras 12 in the respective cameras 12 (Cam) to the hard disk 24 as the image storage means.
1, Cam2, Cam3, Cam4) is attached with the information that can be identified and stored, and after starting the storage of the image information in this manner, the transmission of the information requesting reproduction from the monitoring terminal 22 via the communication network N is performed. If there is, the image transmission means M is configured to be capable of transmitting a plurality of pieces of image information to the monitoring terminal 22 in a synchronously reproducible state. Then, the monitor terminal 22 is configured so that the display screen of the monitor 25 is divided and each image information can be streamed and reproduced on the divided screen.

The processing terminal 15 receives an image sent from the camera 12 as a video signal in the MPEG2 format (Moving Pictu).
An encoder 42 that compresses and encodes a moving image of 30 frames per second in a format established by the re Experts Group), and a loop buffer type moving image stream buffer 43 that stores the moving image that is compression encoded by the encoder 42. , MPE stored in the moving image stream buffer 43
I frame is extracted from G image and JPEG format (Joint
A still image generation unit 44 that generates a still image of a format defined by Photographic Experts Group), a loop buffer type still image stream buffer 45 that stores the still image generated by the still image generation unit 44, and a moving image. A calendar timer 46 for giving shooting timing information is provided to each of the stream buffer 43 for still images and the stream buffer 45 for still images, and the above-described description has been made corresponding to the stream buffer 43 for moving images and the stream buffer 45 for still images. Transmission unit 4 in which a transmission thread is generated
7 and 47, a still image stream buffer 45, and a connection management unit 48 for designating and sending an image from any one of the moving image stream buffer 43, and the images from the respective transmission units 47 and 47. Is communication interface 4
It is configured to send to the communication network N via 9.

Further, the adequacy determining unit serving as the adequacy determining unit K determines whether or not the image capturing is possible by a process of extracting an action object from the image information captured by the camera 12 or a process of recognizing a preset pattern. 50, and whether or not an object (including a person) has entered the photographing area of the camera 12 using ultrasonic waves or infrared rays, and whether or not the water level has exceeded a preset level.
And a signal system for transmitting a detection signal from the sensor 51 to the connection management unit 48, and control for starting photographing by the camera 12 preset based on the signal from the sensor 51. A camera designation information output unit 52 that outputs information is provided.

Although the control form will not be described in detail, when it is determined that the water level of the tributary Ra exceeds a preset level based on the image processing of the image from the camera 12 or the detection signal from the sensor 51. At the same time when the transmission of the image information from the camera 12 is started, the camera designation information output unit 52
Preset camera 12 from (Cam2, Cam
3, Cam4), a process of transmitting a signal for starting image capturing and transmitting image information to the image capturing unit having each camera 12 via the communication network N is performed. In this way, when it is necessary to take an image with the camera 12, the size of the image of the object to be observed is adjusted by zooming the lens of the camera 12, or the image of the object to be observed is taken in the center of the image capturing area. The angle is changed so that it can be changed.

The order of the processing at the time of compression encoding by the encoder 42 is as follows.
0x480 dot pixels) is divided into blocks of NxN pixels, and the discrete cosine transform (Disc
rete Cosine Transform), the DCT coefficient obtained by this discrete cosine transform is processed by each element of the quantization table, and the processing by each step of Huffman coding (statistical coding) of the quantized DCT coefficient is executed. I
(Intra-picture) frame is generated, P (Predictive picture) frame for predicting and compensating for motion is generated, and B (Bidirectionally p) for interpolating I and P frames is generated.
redictive picture) Generates a frame.

Each frame generated by this compression encoding can be schematically represented as shown in FIG. 13, the data amount of the I frame is larger than that of the P and B frames, and this I frame is in the JPEG format. It has basically the same structure as a compression-coded image. Then, in the still image generation unit 44, the moving image stream buffer 4
As described above, the I frame is extracted from 3 and the number of different pixels is four (720 × 480, 320 × 240, 160 × 1).
The still image stream buffer 45 has a function of generating a still image of 20, 80 × 60 dots), and the still image stream buffer 45 has four types of pixel numbers (720 × 480, 320 × 240,
A still image of 160 × 120, 80 × 60 dots) is saved.

Further, it is possible to show an outline of the control in the processing terminal 15 as in the flow chart of FIG. That is, for example, when it is determined that the water level exceeds a preset level by the permission determination unit 50 or the sensor 51 and the image information needs to be transmitted, alarm information is output (steps # 101 to # 103). Also, the information for instructing the transmission of the image information from a plurality of preset cameras 12 is output, and the transmission of the image information photographed by the camera 12 of this photographing unit is started (steps # 104, # 105). The alarm information is transmitted to a preset terminal with the information for specifying the monitoring area attached, and the terminal to which the alarm information is transmitted notifies the abnormality notification section 32 on the screen of the monitor 25. A warning message is displayed.

When the transmission of the image information is started, the information for identifying the camera 12, the identification information including the information for identifying the monitoring area, and the time information indicating the shooting time are added to the moving image for the moving image described above. The compressed and encoded moving image (image information) is transmitted from the stream buffer 43. Further, in this system, by utilizing the fact that the moving image stream buffer 43 is configured as a loop buffer type, the output timing of the information to be transmitted is used as a reference, before the preset time, and A basic processing mode is set to start transmission of image information captured at the same timing based on timer information of compression-coded image information. Although the image storage server 21 is preset as the transmission destination of the image information, the image storage server 21
It is possible to set so that the streaming transmission of the moving image can be performed to a monitoring terminal other than the above, and it is possible to perform the monitoring by the moving image in real time, and it is stored in the moving image stream buffer 43. It is also possible to start the transmission from the image of the shooting timing arbitrarily set from the moving image.

Next, the transmission of the image information is continued until the timing at which it is determined that there is no need for monitoring based on the information from the sensor 51 or the like, or the timing at which the monitoring terminal 22 gives an instruction to stop the image capturing, and the image capturing is continued. The transmission of the image information is terminated when the situation of stopping the transmission is reached (# 106 to # 10).
8 steps).

That is, when a situation occurs in which the photographed image information is transmitted, the processing terminal 15 outputs alarm information so that the person performing the monitoring can be alerted and the image information can be displayed. When the situation of transmitting the data occurs, the image information captured by the cameras 12 at the same timing is automatically stored in the image storage server 2.
It is possible to perform the processing of transmitting to 1 and saving.

An outline of the image storage server 21 to which the image information is transmitted can be shown in FIG.
That is, in the image storage server 21, the communication network 5 and the communication interface 5 capable of accessing information are connected.
5, an image information receiving unit 56 that receives image information from the communication interface 55, and an image information receiving unit 56.
The group information adding unit 57 that groups and saves the moving image information received from the plurality of cameras 12 in a group (generates a folder and saves the folder), and the group information adding unit 57 adds the group information. The hard disk 24 as an image storing means for storing the image information
And a decoder 59 for decoding the image information stored in the hard disk 24, as well as an image transmitting means M for reading a plurality of image information of a requested group from the hard disk 24 through the communication network N and transmitting the image information to the request source. A frame buffer 60 for temporarily storing the image information from the decoder 59, and a video control unit 61 for displaying the image information from the frame buffer 60 on the monitor 25.

Further, in this image storage server 21,
It is possible to show an outline of the processing form when the image information is stored as shown in the flowchart of FIG. That is,
The image information receiving unit 56 assembles information transmitted in packet units from the communication network N, independently generates image information corresponding to the plurality of cameras 12, and starts accumulation of image information from each camera 12. (Step # 201), the information contained in the group is extracted from the image information thus accumulated, and then the information for identifying the group and the information for identifying the event are stored in the header portion of each image information. At the same time, a process is performed in which a folder to which the information for identifying the group and the information for identifying the event are attached is generated, and the plurality of pieces of image information extracted as described above are stored in the folder and stored in the hard disk 24 ( # 201 to # 204 steps).

Although not shown in this flowchart,
It is also possible to display the image information stored in the image storage server 21 on the monitor 25 of the image storage server 21, and in this case, a list of folders is displayed on the monitor 25 and the list is displayed. By selecting a folder of a group to be displayed from, using the keyboard or the mouse, the image information of the group is decoded by the decoder 59 and then stored in the frame buffer 60 in frame units. The video control unit 61 sequentially reads and sends it to the monitor 25 as a moving image (the decoding process will be described later).

[Playback / Display System of Image Information File] In the system of the present invention, the monitoring terminal 22 and the remote control terminal 23 are also provided.
Monitor 25 images from communication network N
FIG. 19 shows an outline of a configuration that enables processing to be displayed for
Can be shown as follows.

That is, the reproduction / display system includes a decoder 66 as a decoding unit for decoding the compression-encoded image sent from the communication interface 65, and a frame buffer 67 for storing the image from the decoder 66 in frame units. A video control unit 68 for sequentially reading out the images in the frame buffer 67 and outputting the images to the monitor 25,
When an image is displayed on the monitor 25 by the video control unit 68, image information (layout information) such as the image display area 28, the camera list 29, the operation area 33, and the image display area 28 as described above. Information of the number of pixels of the image to be displayed (image size information) is output to the monitor 25 and a plurality of images are displayed on the monitor 25 based on the reproduction management information.
And a screen setting section 69 as a display control means for displaying, and a group designating means 70 for designating a group (event) to be reproduced.

In the decoder 66, the signal represented by the Huffman code is restored to a quantized DCT coefficient, this value is multiplied by the value in the quantization table to obtain the DCT coefficient, and this DCT coefficient is calculated.
It has a function of imaging by executing each step of converting the coefficient into an inverse DCT.

As described above, the flow of information when the image information obtained by shooting the same monitoring target by a plurality of cameras 12 is stored in the hard disk 24 of the image storage server 21 and the image information stored in the hard disk 24 in this way are described. It is possible to represent the flow of information when performing playback by designating from the monitoring terminal 22 (which can also be controlled by the remote control terminal 23), as shown in FIG. That is, when the image information is reproduced on the monitoring terminal 22,
After sending the request information for the information of the list of stored folders, by performing the operation of transmitting the information designating the image information to be reproduced based on the folder displayed on the monitor 25 of the monitoring terminal 22, When the requested folder is extracted from the hard disk 24 and the screen is divided, image information is streamed and transmitted from the image storage server 21 to monitor 25 of the monitoring terminal 22.
On the other hand, the monitoring targets captured by the plurality of cameras 12 can be displayed in a synchronized state.

In the case where the plurality of cameras 12 are arranged at positions relatively separated from each other and the image storage server 21, the monitoring terminal 22 and the remote control terminal 23 are arranged at positions separated from the cameras 12 as described above. However, when the necessity of monitoring is determined in any of the plurality of cameras 12 by connecting these via the communication network N and configuring the system, the plurality of cameras 12 set in advance is set.
Starts shooting and saves it in the image saving server 21. At the time of saving, a folder is created so that the plurality of cameras 12 can be recognized as one group, and the reproduction start timing is set to the same time. By making the frame rates of the respective image information equal, it is possible to perform synchronized reproduction. Further, when the necessity of monitoring is determined, the alarm information is output from the camera unit side so that the monitoring terminal can recognize the necessity of monitoring. When the image stored in the image storage server 21 is reproduced, the monitoring terminal 2
By designating and requesting a group from 2, the image information of the designated group is stream-transmitted from the image storage server 21 and synchronously reproduced on the monitor 25.

[Other Embodiments] In addition to the above embodiments, the present invention uses a still image that is updated at regular intervals instead of the moving image, or uses a moving image and a still image together. It is also possible.

[Brief description of drawings]

FIG. 1 is an overall configuration diagram of a monitoring system according to a first embodiment.

FIG. 2 is a block diagram showing a configuration of a processing terminal according to the first embodiment.

FIG. 3 is a block diagram showing a configuration of a monitoring terminal according to the first embodiment.

FIG. 4 is a schematic diagram showing a flow of information when storing image information according to the first embodiment.

FIG. 5 is a schematic diagram showing a flow of information when displaying image information according to the first embodiment.

FIG. 6 is a flowchart of an image display routine according to the first embodiment.

FIG. 7 is an overall configuration diagram of a monitoring system formed in a river according to the second embodiment.

FIG. 8 is a plan view of the drainage pump station according to the second embodiment.

FIG. 9 is a diagram showing an outline of a configuration of a monitoring system according to a second embodiment.

FIG. 10 is a diagram showing a screen of the monitor according to the second embodiment.

FIG. 11 is a block diagram showing the configuration of transmission processing according to the second embodiment.

FIG. 12 is a block diagram showing a configuration of still image transmission processing according to the second embodiment.

FIG. 13 is a schematic diagram showing an MPEG format of the second embodiment.

FIG. 14 is a schematic diagram showing the arrangement of cameras and the flow of image information according to the second embodiment.

FIG. 15 is a block diagram showing a configuration of a photographing unit side according to a second embodiment.

FIG. 16 is a flowchart of a shooting processing routine according to the second embodiment.

FIG. 17 is a block diagram showing the configuration of an image storage server according to the second embodiment.

FIG. 18 is a flowchart of a file generation routine of the second embodiment.

FIG. 19 is a block diagram showing the configuration of a terminal according to the second embodiment.

FIG. 20 is a diagram showing a flow of information according to the second embodiment.

[Explanation of symbols]

111/24 image storage means 120/25 display means 121.22 display processing means 132.50 Acceptability determination means N network Cam camera

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Katsuaki Nakazawa             4-2-15, Hakurocho, Chuo-ku, Osaka-shi, Osaka Prefecture               Kubota Comps Co., Ltd. (72) Inventor Takafumi Morishita             4-2-15, Hakurocho, Chuo-ku, Osaka-shi, Osaka Prefecture               Kubota Comps Co., Ltd. (72) Inventor Akio Kuroda             4-2-15, Hakurocho, Chuo-ku, Osaka-shi, Osaka Prefecture               Kubota Comps Co., Ltd. F-term (reference) 5C054 AA01 CH08 DA09 EA01 EA05                       EA07 GB01 HA18 HA19 HA20

Claims (3)

[Claims] 1. A moving image captured by a camera, or
A monitoring system configured to transmit image information composed of a still image updated over time to a terminal via a network and display the image information on a display means provided in the terminal, wherein the plurality of cameras and Is provided with an availability determination unit that determines whether or not the monitoring target is monitored within the image capturing area of the camera, and an image storage unit that stores image information captured by a plurality of cameras, and the availability determination unit determines the necessity of monitoring. In this case, a storage control means is provided for performing shooting with a plurality of cameras managed as one preset group and for saving the image information shot by these cameras in the image storage means. , After this save,
A monitoring system comprising display processing means for displaying the image information of one group stored in the image storage means on the display means of the terminal when the display request information is input from the terminal. 2. Each of the plurality of cameras is provided with an image storage unit for storing image information captured by the camera, and the display processing unit is a target group when the display request information is input. 2. The monitoring method according to claim 1, wherein the processing form is set so that the image information stored in the plurality of image storage means included in the image information is extracted, and the image information is transmitted to the requesting terminal via the network. system. 3. The image storage means is provided on the side of the terminal, and the storage control means manages in one preset group when the necessity determination means determines the necessity of monitoring. 2. The monitoring system according to claim 1, wherein the processing mode is set so as to transmit image information from the plurality of cameras to the image storing means of the terminal via the network and store the image information.