JP2004248147A - Moving picture change detection display system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily make change detection settings in a moving picture change detection display system. <P>SOLUTION: If the change quantity of a moving picture meets a reference continuously over a given time when change detection results indicate no change, it is set that the change detect results indicate a change. If the change quantity of the moving picture does not meet the reference continuously over the given time when the change detection results indicate a change, it is set that the change detect results indicate no change. The change detection results are displayed on a monitor 1-7cl, together with the change quantity of the moving picture and an index indicating whether the change quantity of the moving picture meets the reference. <P>COPYRIGHT: (C)2004,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a moving image change detection display system, and more particularly to a technique for displaying the progress and results of a change detection process of an image.
[0002]
[Prior art]
2. Description of the Related Art In a monitoring system, a function has been put to practical use in which a change in a monitoring image is automatically obtained by image processing and an image at the time of the change is stored and stored. Here, in order to set the change detection sensitivity, there is a case in which a function of displaying the progress of the change detection and adjusting it interactively is implemented. For example, in a certain network camera, a change detection parameter can be adjusted while looking at an indicator indicating the degree of change. On the other hand, a video editing system has a function of determining a scene change by image processing and visually displaying a scene change time and an image at the time of change on an edit screen (see Patent Documents 1 and 2).
[0003]
[Patent Document 1]
JP-A-11-032301
[Patent Document 2]
JP-A-9-65287
[0004]
[Problems to be solved by the invention]
However, when the change detection processing of a moving image depends on a plurality of detection parameters, simply displaying the final detection result or a simple change detection amount does not mean how the plurality of detection parameters affect the detection result. It is difficult to adjust the change detection parameter because it is not known. Further, the video editing system has a function of displaying a scene start image and a representative image based on cut detection, but the magnitude of the amount of change in the detection processing is not known.
[0005]
The present invention has been made under such a situation, and an object of the present invention is to make it possible to easily perform a change detection setting in a moving image change detection display system.
[0006]
[Means for Solving the Problems]
In order to solve the above-mentioned problem, in the present invention, a moving image change detection display system is configured as in the following (1).
[0007]
(1) a moving image change detection unit that determines that a change detection result has changed when the amount of change in the moving image continuously satisfies a criterion for a predetermined time or more;
Display means for simultaneously displaying the change amount of the moving image, an index indicating whether the change amount of the moving image satisfies the criterion, and the change detection result,
A moving image change detection display system comprising: a setting unit configured to perform setting related to change detection.
[0008]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described in detail with reference to examples of a moving image change detection and display system. The present invention is not limited to the form of a system, but can be implemented in the form of a method and further in the form of a program for realizing the method, supported by the description of the embodiment.
[0009]
【Example】
(Example 1)
First Embodiment As a first embodiment, a moving image change detection is performed in a camera server, and an image, a progress of the change detection, and a change detection result are transmitted to an image change detection setting client (hereinafter, abbreviated as a setting client) and displayed. The change detection display system "will be described.
[0010]
FIG. 1 shows a hardware configuration of the camera server and the setting client in the present embodiment. The hardware comprises a camera server 1-1 and a setting client 1-14, both of which are connected via a network 1-15.
[0011]
The camera server 1-1 acquires an image of the camera 1-13 and transmits it to the client 1-14 via the network 1-15. Further, a change detection process can be internally performed, and an image when a change is detected can be stored.
[0012]
In the setting client 1-14, software for displaying a received image and software for setting a change detection parameter of the camera server operate. The progress of the change detection process and the change detection result are also displayed in real time. The setting client 1-14 transmits setting values to the camera server 1-1 by the setting software. The camera server 1-1 receives the set value, and thereafter performs a change detection process based on the set value.
[0013]
The camera server 1-1 includes a CPU 1-2, a RAM 1-3, a ROM 1-4, and a secondary storage 1-5. A video RAM 1-6 is provided for screen display, and a monitor 1-7 is connected. A peripheral device interface 1-8 is provided for connection of peripheral devices, and a keyboard 1-10 for operation, a pointing device 1-11 such as a mouse, and a camera 1-13 with or without a camera platform are provided. Connecting.
The camera 1-13 is connected to a peripheral device interface 1-8 for transmitting / receiving digital signals or a video capture card 1-12 for receiving video signals. Further, a network interface 1-9 is provided for connection with the network 1-15. The peripheral device interface 1-8 has standards such as PS / 2, RS-232C, USB, and IEEE1394, but the present embodiment does not depend on such standards.
[0014]
The CPU 1-2, RAM 1-3, ROM 1-4, secondary storage 1-5, VRAM 1-6, peripheral device interface 1-8, network interface 1-9, and video capture card 1-12 are connected to an internal bus.
[0015]
The configuration of the camera server as described above can be easily realized by using a commercially available personal computer and camera. Further, since the server body can be operated from the outside via a network, a so-called set-top box having no VRAM 1-6, monitor 1-7, keyboard 1-10, and mouse 1-11 may be used. No problem.
[0016]
The setting client 1-14 has almost the same configuration as that of the camera server, except that the input device to be connected is different (cl is added to the end to indicate that it is a client device). CPU1-2cl, RAM1-3cl, ROM1-4cl, secondary storage 1-5cl, VRAM1-6cl, monitor 1-7cl, peripheral device interface 1-8cl, network interface 1-9cl, keyboard 1-10cl, pointing device 1- 11cl. The setting client can be easily realized by using a commercially available personal computer. The secondary storage 1-5cl stores software for performing the above-described video display, change detection setting, and change detection history display. The GUI of the application software is displayed on the monitor 1-7cl, and the user interactively operates the keyboard 1-10cl and the mouse 1-11cl.
[0017]
In order to acquire an image from the camera server, for example, when a URL-encoded command is transmitted by HTTP, a plurality of frames of images are returned. Further, although the network 1-15 is assumed to be the Internet based on the IP protocol, any realizing method can be used as long as it is a transmission path capable of transmitting and receiving digital signals and having a sufficient capacity for image communication.
[0018]
The above is a configuration in which the camera server and the setting client operate on separate hardware connected to the network, but a configuration in which the camera server and the setting client operate on the same hardware may be used.
[0019]
Next, an example of a functional configuration of the camera server will be described with reference to FIG. In FIG. 2, only parts related to image processing will be described, and description of parts related to camera control, system control, and the like will be omitted.
[0020]
In FIG. 2, an image signal input from a camera 1-13 is digitized by an A / D converter 2-2, and is encoded by an encoder 2-3. Here, the encoding method includes JPEG and MPEG, but the present embodiment does not depend on the encoding method. Next, an image change detection process is performed in the change detection unit 2-5. The stored image at the time of the change detection is stored and managed in the secondary storage 1-5. The encoded image and the progress and result of the change detection processing are transmitted from the transmission unit 2-4 in response to a request from the setting client. Further, the receiving unit 2-6 receives the encoding setting, the change detection setting, the live image request, and the change detection information request transmitted from the setting client.
[0021]
The method of the change detection processing includes a difference between adjacent frames and a background difference. As the feature amount of the difference between adjacent frames, an absolute value of a brightness difference of the same coordinate pixel, an absolute value of a difference between DCT coefficients in a JPEG coded block, and the like are used. There is a method in which there is a change when the threshold value is exceeded. Depending on the method of the difference, whether the image after encoding is input to the change detection unit 2-5 or the image before encoding is different, the path of the image input to the change detection unit 2-5 is shown in FIG. This is indicated by a solid line and a dashed line.
[0022]
Although the present embodiment does not depend on the change detection method, for convenience of explanation, it is assumed that an adjacent frame difference method is used to obtain the absolute value of the DCT coefficient difference in JPEG encoded block units. In this case, the occurrence of change detection is determined by three threshold values of sensitivity, area ratio, and duration.
[0023]
The sensitivity defines a threshold value at which a change occurs in the block when the sum of absolute values of DCT coefficient differences in JPEG encoded block units exceeds a certain threshold value. The lower the threshold value, the smaller the change is detected. The area ratio means that a change is detected when the ratio of the total area of the block in which the change has occurred to the change detection area area defined in the image exceeds a certain threshold value.
[0024]
The continuation time means that when the change detected by the area ratio continues beyond a certain threshold value, the change detection result is finally changed, and a change detection event occurs here for the first time. I do. Conversely, if the state where the area ratio is equal to or less than the threshold value continues for more than the duration while the change detection is in a state of change, the change detection result is finally determined to be no change.
[0025]
The block in which the change has occurred, the value of the area ratio, and the final change detection result can be transmitted from the camera server to the setting client similarly to the image.
[0026]
Next, FIG. 3 shows an example of a functional configuration of the setting client in this embodiment. The setting client includes a receiving unit 3-1, a display operation unit 3-2, a change detection setting unit 3-3, and a transmitting unit 3-4, and receives and displays a live image and a display function. And a display function, and a change detection parameter setting function. The setting client is, for example, application software installed on the personal computer and the same computer, but it goes without saying that the setting client does not depend on specific hardware or operation software.
[0027]
The image signal is received by the receiving unit 3-1 and is decoded and displayed by the display operation unit 3-2. The change detection result is also received by the receiving unit 3-1 and displayed on the display operation unit 3-2. After receiving the change detection setting information, the change detection setting unit 3-3 uses the change detection setting information for initializing the detection setting, and then displays the setting information on the display operation unit 3-2.
[0028]
The setting made in the display operation unit 3-2 is, for example, to specify a change detection area on an image or to specify a detection sensitivity. When the designation is performed, the setting information is transmitted to the change detection setting unit 3-3, and is transmitted to the camera server via the transmission unit 3-4.
[0029]
Note that the protocol for acquiring the change detection information and the change detection setting information includes a method implemented on the TCP protocol and a method implemented on the HTTP protocol, but the present embodiment depends on the information acquisition method and the protocol. The description is omitted because it is not a thing.
[0030]
Next, an example of a GUI (graphical user interface) of the setting client will be described with reference to FIGS.
[0031]
FIG. 4 shows an example of the display operation unit (display operation screen) 3-2 of the setting client, which is a window displayed by application software installed in the window system. The window includes a window frame 4-1 and a client area 4-2. The client area 4-2 displays an image received from the camera server. A frame 4-3 indicating a change detection target area is displayed in the image. The size of the frame 4-3 can be changed by dragging the latch 4-4 with a mouse cursor (not shown). The position of the frame can be changed by dragging a mouse cursor (not shown) on the frame. The changed value is transmitted to the camera server by the apply button 4-6.
[0032]
The change detection processing is performed on the change detection target area in the camera server, and the location where the change has occurred is transmitted to the client as the block 4-5 position. In the present embodiment, as described above, the block display is performed to detect a change in JPEG blocks, but if a change is detected in pixels, the presence or absence of a change is displayed for each pixel. Reference numeral 4-7 denotes a button for closing the window.
[0033]
Next, FIG. 5 shows an example of a change detection setting unit (change detection setting screen) 3-3 for performing various settings for change detection. 5-1 is an outer frame of the window. 5-2 is a check box for selecting whether to enable or disable the change detection function. Reference numeral 5-3 denotes an edit box with up and down arrows for designating pan, tilt, and zoom when a controllable camera is targeted. Reference numeral 5-4 denotes a sensitivity setting, the value of which is indicated by a numeral, and can be adjusted by a slide bar. Reference numeral 5-7 denotes a threshold value of the area ratio. Like the sensitivity, the value is indicated by a numeral and adjusted using a slide bar.
[0034]
5-6 shows the current area ratio, that is, the ratio of the detected area to the detection target area as a graph that changes to the left and right in real time, and there is a mark at the position of the area ratio threshold value. You can see at a glance whether the threshold has been exceeded. Reference numeral 5-8 denotes an edit box with up and down arrows for displaying and setting the threshold value of the duration. Reference numeral 5-9 denotes a button for transmitting the setting value to the camera server, and reference numeral 5-10 denotes a button for closing the window 5-1 after the setting is completed.
[0035]
Next, a change detection display method in this embodiment will be described with reference to FIG. FIG. 6A is a rectangle 5-6 displaying the area ratio. More specifically, this rectangle includes a rectangular outer periphery 6-1, an area ratio threshold value display section 6-2, and an area ratio display section 6-3. The width of the area ratio display section 6-3 corresponds to the area ratio, and changes in real time.
[0036]
Next, a method of obtaining a change detection result from the area ratio and the duration and a display method of the area ratio display unit 6-3 will be described with reference to FIG. In the figure, assuming that the area ratio changes based on the threshold value as indicated by the thick line 6-4, the following four states exist.
State 1: No change detected. Area ratio is below threshold.
State 2: No change detected. The area ratio is larger than the threshold, but the state where the area ratio is larger than the threshold is less than the duration.
State 3: Change detected. The area ratio is larger than the threshold.
State 4: Change detected. The state where the area ratio is equal to or less than the threshold and the area ratio is equal to or less than the threshold is shorter than the duration.
[0037]
In states 1 and 2, no change detection result is detected, and in states 3 and 4, a change detection result is detected. On the other hand, state 2 and state 4 are transitional states. Therefore, the area ratio display section in each state is displayed in different colors as shown in the figure. For example, state 1 is displayed in green, state 2 is displayed in yellow-green, state 3 is displayed in red, state 4 is displayed in orange, and so on. As a result, the area ratio in the course of the change detection is displayed in a rectangular width, and the transition state of the change detection result is displayed in a rectangular color, so that the progress and the result of the change detection can be intuitively understood. Here, it is also possible to represent the rectangle with different patterns instead of different colors.
[0038]
Next, an operation procedure of the camera server will be described with reference to FIGS. The camera server comprises a main process for processing a request from a setting client and a sub-process for acquiring an image and detecting a change. FIG. 7 shows the operation procedure of the main process of the camera server, and FIG. 8 shows the operation procedure of the sub-process. Other processing procedures of the server include image storage and processing specific to the operation system, but the description is omitted.
[0039]
In the main process of FIG. 7, after the start, an initialization process is performed in step 701 (in the figure, denoted as S701, the same applies hereinafter), and a sub process is started in step 702. The sub-process will be described with reference to FIG. In step 703, an event is waited, and when an event occurs, the process branches to Y and the processes in step 704 and thereafter are performed. In step 704, it is determined whether the event is a connection request event of the setting client. If so, the process proceeds to step 705 to determine whether to permit the connection. This is because the connection may not be permitted when the number of connections is limited or the connection service time is limited. If the connection is not permitted, the process branches to N, and the process proceeds to step 706 to notify the connection rejection.
[0040]
If the connection is permitted, the flow branches to Y and the process proceeds to step 707 to register the client. This allocates a management number to a client, registers an IP address, and initializes management data such as connection time. Next, in step 708, a connection permission notice is issued to the setting client. Here, for example, a management number assigned to the setting client is also notified at the same time. After the processing is completed, the process returns to step 703 to wait for the next event.
[0041]
If the event is not a connection request event in step 704, the process branches to N, and in step 709, it is determined whether the event is a connection termination request. If so, the process branches to Y and proceeds to step 710 to notify the client of the connection end. Next, the process proceeds to step 711 to delete the management data of the setting client. After the processing is completed, the process returns to step 703 to wait for the next event.
[0042]
If it is determined in step 709 that the event is not a connection end request event, the process branches to N. In step 712, it is determined whether the event is an image request event. If so, the process branches to Y and proceeds to step 713 to acquire the encoded image by the image acquisition process, and transmits the image to the setting client requested in step 714. Further, in step 715, change detection information such as a change detection block, an area ratio, and a detection result is transmitted to the setting client. After the processing is completed, the process returns to step 703 to wait for the next event.
[0043]
If the event is not a video request event in step 712, the flow advances to step 716 to determine whether the event is a change detection information request event. If so, the process branches in the Y direction and proceeds to step 717 to transmit a change detection set value as detection information. After the processing is completed, the process returns to step 703 to wait for the next event.
[0044]
If the event is not a change detection information request event in step 716, the flow advances to step 718 to determine whether the event is a change detection setting update request event. If so, the process branches in the Y direction, and in step 719, the change detection setting is updated. After the processing is completed, the process returns to step 703 to wait for the next event.
[0045]
Next, the operation procedure of the sub process of the camera server will be described with reference to FIG. The sub-process performs image acquisition and encoding, change detection processing, transmission of change detection information, and event transmission.
[0046]
After the start, in step 801 an image is obtained from the camera 1-13, and in step 802 the image is coded and the coded image is stored in the image buffer. If an image request event occurs in the main process, the image in the image buffer is transmitted. Next, in step 803, it is determined whether or not to perform a change detection process. Whether or not to perform the change detection process can be designated by a “validate change detection” check box 5-2 on the setting screen of the setting client. If so, the processing branches to Y and the processing of step 804 and subsequent steps is performed. If not, the process branches to N and returns to step 801.
[0047]
The process has two buffers, a detection buffer 1 and a detection buffer 2, for a change detection process. In step 804, data is copied from the detection buffer 1 to the detection buffer 2. Next, in step 805, the current image is stored in the detection buffer 1. Next, in step 806, a change is detected. As described above, there are several types of change detection, and the ratio of the detected area to the detection target area, that is, the area ratio is obtained as the change amount. These information are transmitted to the setting client in step 715.
[0048]
The process further proceeds to step 807, where it is determined whether or not the change detection result of step 806 has changed compared to the previous time. If there is a change from change detection to no change detection, or from no change detection to change detection, the process proceeds to step 808 to issue an event such as change detection and no change detection. If there is no change in the change detection result in step 807, the process branches to N and proceeds to step 809.
[0049]
In step 809, it is determined whether or not to end. If any exception processing occurs, or if there is a termination instruction from the main process, the process branches to Y and terminates. If not, the process branches to N and returns to step 801 to continue the process.
[0050]
Next, the processing procedure of the setting client process will be described with reference to FIG. After the start, initialization is performed in step 901, and a connection request is made to the camera server in step 902. In step 903, a response from the camera server is waited. If the connection fails, the process branches to N and proceeds to step 904 to perform termination processing and terminate. If the connection is successful, the process branches in Y, and in step 905, a sub-process for receiving an image is started.
[0051]
The image receiving process is a process for exclusively receiving and decoding an image separately from the main process, and preventing the reaction speed of the event processing in the main process from being reduced by using a separate process. The detailed description is omitted because it is not affected by the mounting method.
[0052]
Next, the process proceeds to step 906 to wait for an event. If an event has occurred, the process branches in the Y direction to determine in step 907 whether or not the event is an image reception event. If so, the process branches in Y and an image is displayed in step 909. Thereafter, the flow returns to step 906 to wait for the next event.
[0053]
If it is determined in step 907 that the event is not an image reception event, the flow branches to N, and the flow advances to step 911 to determine whether the event is a change detection information reception event. If so, the process branches in the Y direction, and in step 912, the detection information display is updated. The change detection information is data such as a detection block position, a detection area ratio, and a detection result. Thereafter, the flow returns to step 906 to wait for the next event.
[0054]
If the event is not a change detection information reception event in step 911, the flow advances to step 913 to determine whether the event is a change detection setting reception event. If so, the process branches in the Y direction and proceeds to step 914 to update the change detection setting information. The change detection setting information includes pan, tilt, and zoom of the camera, a detection target area, and threshold values of sensitivity, area ratio, and duration. As a result, the detection target area display 4-3, the camera parameter designation section 5-3, the sensitivity setting section 5-4, the threshold value setting section 5-7 for the area ratio, and the duration setting section 5-8 are updated. . Thereafter, the flow returns to step 906 to wait for the next event.
[0055]
If the event is not a change detection information reception event in step 913, the process advances to step 915 to determine whether the event is a change detection setting transmission event. This event occurs when the apply button 5-9 is pressed. If so, the process branches in the Y direction and proceeds to step 916 to transmit the change detection setting. Thereafter, the flow returns to step 906 to wait for the next event.
[0056]
If the event is not a change detection information transmission event in step 915, the process branches to N, proceeds to step 917, performs other event processing, and returns to step 906 to wait for the next event. Other event processing includes an end event that occurs when the end button 5-10 is pressed or the window is forcibly closed, and an OS-defined event. In the case of an end event, end processing is performed and the software is ended.
[0057]
Next, an algorithm for obtaining a change detection result from the area ratio and the duration will be described with reference to FIG. This algorithm is implemented as step 806 on the camera server side, but can also be implemented on the setting client side in step 912 when the change detection information is received.
[0058]
After the start, in step 1001, MD = 0 is initialized. MD represents the final result of change detection, where 0 indicates no change detection and 1 indicates change detection. Next, in step 1002, it is determined whether or not the area ratio is larger than the threshold. If the area ratio is larger than the threshold value, Y branch is performed, and it is determined in step 1003 whether Ton = 0.
[0059]
Ton is a time at which the area ratio becomes larger than the threshold, and is referred to as an ON start time. Similarly, Toff is a time at which the area ratio becomes equal to or less than the threshold, and is referred to as an OFF start time. Ton and Toff become 0 when initialized. If Ton = 0 in step 1003, that is, if the state is initialized, the Y branch is performed, and in step 1004, Ton = Tnow. Tnow is the current time. If the ON start time has already been set, the process branches to N and proceeds to step 1005.
[0060]
If Tnow-Ton is equal to or longer than the duration Td in step 1005, the process branches to Y, and MD = 1 is set in step 1006. This is because if the area ratio was greater than the threshold for more than the continuous time, or if the area ratio was momentarily less than the threshold, the change was not detected as a result of the discontinuity for more than the continuous time. It shows that it was determined. Finally, in step 1007, the OFF start time is initialized to Toff = 0, and the processing ends. If Tnow-Ton is less than the duration Td in step 1005, the process branches to N and ends.
[0061]
If the amount of change is equal to or smaller than the threshold value in step 1002, the process branches to N. In step 1008, it is determined whether Toff = 0. If so, the Y branch is performed and Toff = Tnow, that is, the current time is substituted for the OFF start time, and the process proceeds to step 1010. Even if Toff = 0 is not satisfied in step 1008, the process proceeds to step 1010.
[0062]
In step 1010, if Tnow-Toff is equal to or longer than the duration Td, the process branches to Y, and in step 1012, Ton = 0 is initialized. This is because the area ratio was continuously below the threshold for more than the duration, or the area ratio did not continue for more than the duration even if the area ratio became larger than the threshold instantaneously. Indicates that it was determined to be none. If Tnow-Toff is less than the duration Td in step 1010, the process branches to N and sets MD = 1 in step 1011. This indicates that the state where the change is detected continues because the time during which the area ratio becomes equal to or less than the threshold is short.
[0063]
As is clear from the above description, according to the present embodiment, the camera server that acquires the image and performs the change detection process, acquires and displays the image and the change detection result via the network, and sets the change detection setting. In a change detection display system including a setting client that is interactively provided, means for visually indicating a transition state of a change detection result determined by a change amount and a duration is provided. As a result, an image change detection display system that can easily perform the change detection setting is constructed. In the present embodiment, the area ratio is used as the amount of change for convenience of explanation. However, as long as the amount of change is related to the final determination of change detection, the same display method can be applied other than the area ratio. Needless to say.
[0064]
(Example 2)
In contrast to the first embodiment, (1) the change amount and the change detection result are separately displayed on the area ratio display unit 5-6 of the setting client. (2) At this time, the change amount is smaller than the threshold value of the change amount. (3) The function of displaying the maximum value of the change amount during the period in which the change detection transition state is in the third state described in the first embodiment is performed. This will be described as Example 2. Since the hardware configuration and the functional configuration in the present embodiment are the same as those in the first embodiment, the description thereof will be referred to.
[0065]
FIG. 11 shows a method of displaying a change detection result in the “moving image change detection display system” of the present embodiment. In the figure, the first to fourth states described in the first embodiment correspond to the diagrams (a) to (d), respectively. Here, the current area ratio is displayed as a rectangle as shown in FIG. When the area ratio becomes larger than the threshold value, the color or pattern of the rectangle displaying the area ratio changes as shown at 11-3 in FIG.
[0066]
Further, when the state is in the state 3 or 4, it means that the change is detected. Therefore, the change detection result display and the peak display are combined as shown in 11-5 in FIG. 11C and 11-7 in FIG. Display a rectangle. The color of the rectangle is different from the rectangle displaying the area ratio. The position of the rectangle is displayed at the position corresponding to the maximum value of the area ratio in state 3.
[0067]
As another peak display method, there is a method of displaying a peak display portion and an area ratio display portion adjacent to each other as shown in FIG. For example, in (c), the peak display unit 12-5 and the area ratio display unit 12-4 are adjacent to each other, and the right end of the peak display unit 12-5 indicates a peak value. In this method, it is possible to further emphasize that the motion detection result indicates that there is detection.
[0068]
The above display method will be described again with reference to FIG. 13 based on the relationship between the change in the area ratio, the threshold value of the area ratio, and the duration. FIG. 13 corresponds to FIG. 6 of the first embodiment, and a description of overlapping parts will be omitted. In FIG. 13, the color or pattern of the rectangular indicator is changed depending on whether the change in the area ratio is greater than or less than the threshold. For example, green is set below the threshold, yellow is set above the threshold, and the like. On the other hand, when the change detection result indicates that a change has been detected, a red rectangle is displayed at the peak position. As a result, the change detection result and the maximum value of the area ratio during the period in which the change detection is detected are simultaneously displayed. Note that the color of the peak display is not limited to red, but may be another color. It is also possible to highlight by changing the pattern or by blinking.
[0069]
Since the software configuration of this embodiment is the same as that of the first embodiment, the description is omitted. Further, regarding the operation procedure, in the operation procedure of the setting client, in the detection information display update processing step 912, only the area ratio display is changed to the above-described method, and the description is omitted.
[0070]
As is clear from the above description, according to the present embodiment, the area ratio used for change detection and the change detection result are displayed separately, and when the change detection result is detected, there is a change detection result. The maximum value of the area ratio during the period is displayed. As a result, the change detection amount, the transition state of the change detection result, and the final change detection result are displayed in an easily understandable manner, and the detection parameters can be set easily. In this embodiment, the area ratio is used as the change amount for the sake of explanation. However, it goes without saying that the same display method can be applied to any change amount other than the area ratio as long as the change amount is related to change detection determination.
[0071]
(Example 3)
In the second embodiment, the peak display for simultaneously displaying the change detection result and the maximum value of the area ratio during the period with the change detection is abolished, and instead, when the change detection is performed, the area ratio display unit 5-6 is displayed. An example in which surroundings are highlighted will be described as a third embodiment. Since the hardware configuration and the functional configuration in the present embodiment are the same as those in the first embodiment, the description thereof will be referred to.
[0072]
A change detection display method in the “moving image change detection display system” according to the third embodiment will be described with reference to FIG. In the figure, as in the second embodiment, the state 1 to the state 4, which are transition states of change detection, correspond to (a) to (d), respectively. Here, the area ratio is indicated by the case where the area ratio is equal to or smaller than the area ratio threshold value as in 14-1 and 14-6 and the case where the area ratio is larger than the area ratio threshold value as in 14-3 and 14-4. Display different colors and patterns.
[0073]
Further, when the change detection result indicates that there is a detection, the entire area ratio display section is highlighted as in 14-5 and 14-7. As a method of highlighting, there is a method of making the frame thicker, making the frame another color, or blinking the frame. Further, there is a method of changing or highlighting the color or pattern of the entire area excluding the area ratio display sections 14-4 and 14-6 and the area ratio threshold display section.
[0074]
In the present embodiment, the relationship between the change in the area ratio, the threshold value of the area ratio, and the duration is only “highlighting of the entire display area” instead of “peak display” in FIG. , Figures and descriptions are omitted.
[0075]
Since the software configuration of the present embodiment is the same as that of the first and second embodiments, the description is omitted. In addition, as for the operation procedure, in the operation procedure of the setting client, only the area ratio display is changed to the above-described method, and thus the description is omitted.
[0076]
As is clear from the above description, according to the present embodiment, the area ratio used for change detection and the change detection result are displayed separately, and when the change detection result is detected, the entire area ratio display area is displayed. Highlight. As a result, the change detection amount and the final change detection result are displayed in an easy-to-understand manner, and the detection parameters can be easily set. In the present embodiment, the area ratio is used as the change amount for the sake of explanation, but it goes without saying that a similar display method can be used other than the area ratio as long as the change amount is related to the change detection determination.
[0077]
In each of the above embodiments, the change detection result is determined for each partial region of the moving image, and the change detection area, which is the sum of the areas of the partial regions determined to have changed, is used as the change detection amount, and the change detection of the partial region is performed. The result may be superimposed on the image and displayed.
[0078]
In an embodiment of the present invention, a moving image change detection and display system is configured as in the following (1) to (12), and a moving image change detection and display method is configured as in the following (13) to (21). , And the program are shown in the following (22).
[0079]
(1) When the change detection result is no change and the change amount of the moving image continuously satisfies the criterion for a predetermined time or more, the change detection result is determined to be changed, and when the change detection result is changed, the moving image is displayed. A change detection means of a moving image, in which the change is not detected when the amount of change in the image does not satisfy the criterion continuously for a predetermined time or more,
Display means for simultaneously displaying the change amount of the moving image, an index indicating whether the change amount of the moving image satisfies the criterion, and the change detection result,
A moving image change detection display system, comprising: setting means for performing setting relating to change detection.
[0080]
(2) In the moving image change detection display system according to (1),
A camera server, and a setting client connected to the camera server via a network, wherein the camera server has the change detection unit, and the setting client has the display unit and the setting unit. Moving image change detection display system.
[0081]
(3) In the moving image change detection display system according to (1),
A camera server, and a setting client connected to the camera server via a network,
A moving image change detection display system, wherein the setting client includes the change detection means, the display means, and a setting means.
[0082]
(4) In the moving image change detection display system according to (2) or (3),
The setting means sets at least one of the pan, tilt, and zoom values of the camera connected to the camera server, and at least one of the detection target area and the detection sensitivity, the area ratio threshold, and the duration threshold. A moving image change detection display system characterized by setting.
[0083]
(5) In the moving image change detection display system according to (1),
The display means displays the change amount of the moving image in the width of a rectangle, and when a change detection result is detected, a rectangle different from the rectangle is located at the position of the maximum value of the change amount during the period of change detection. A moving image change detection display system characterized by displaying.
[0084]
(6) A moving image change detection display system which displays a moving image change amount, a threshold value of the change amount of the moving image, and a threshold value of a duration time,
When the change detection result is no change, the change detection result is considered to be changed when the state where the change amount is equal to or larger than the change amount threshold value continues for the duration time threshold or more, and when the change detection result is changed, A change detection unit that sets the change detection result to no change when the state in which the amount of change is less than the threshold value continues for a duration time threshold or more;
When the change detection result by the change detection means does not change and the change amount is less than the change amount threshold, the first state is set, and the change detection result does not change and the change amount is the change amount threshold. When the change detection result is greater than or equal to the second state, the change detection result is changed, and when the change amount is equal to or greater than the change amount threshold, the third state is set. Display means for displaying when the amount is less than the change amount threshold value a fourth state, and visually distinguishing and displaying the first to fourth states. system.
[0085]
(7) In the moving image change detection display system according to (6),
A moving image change detection display system, wherein a change is determined based on whether a change amount exceeds a change amount threshold value or less than a change amount threshold value.
[0086]
(8) In the moving image change detection and display system according to (6) or (7),
A moving image change detection system, wherein the first to fourth states are represented by different colors and patterns in the rectangle.
[0087]
(9) The moving image change detection display system according to (6) or (7),
A moving image change detection display in which a change amount at a certain time is displayed in a rectangular width, and when the change detection result of the moving image has a change, the thickness, color, and pattern of the outer periphery of the rectangle are changed. system.
[0088]
(10) In the moving image change detection display system according to (6) or (7),
A moving image change detection display system wherein a change amount at a certain time is displayed in a rectangular width, and when the change detection result of the moving image indicates a change, the outer periphery of the rectangle blinks.
[0089]
(11) In the moving image change detection display system according to (6) or (7),
A moving picture wherein a change amount at a certain time is displayed in a rectangular width, and when in the states 3 and 4, the maximum value of the change amount in the state 3 is displayed as a rectangle different from the rectangle. Image change detection display system.
[0090]
(12) In the moving image change detection display system according to any one of (1) to (11),
The change detection result is determined for each partial region of the moving image, and the change detection area, which is the sum of the areas of the partial regions determined to have changed, is used as the change detection amount, and the partial region change detection result is displayed superimposed on the image. Moving image change detection display system.
[0091]
(13) When the change detection result is no change and the change amount of the moving image continuously satisfies the criterion for a predetermined time or more, the change detection result is determined to be changed, and when the change detection result is changed, the moving image is displayed. When the amount of change in the image does not satisfy the criterion continuously for a predetermined time or more, a change detection step of a moving image to be performed without change detection,
A display step of simultaneously displaying the change amount of the moving image, an index indicating whether the change amount of the moving image satisfies the criterion, and the change detection result.
A moving image change detection display method, comprising: a setting step of performing setting relating to change detection.
[0092]
(14) In the moving image change detection and display method according to (13),
The display step displays the change amount of the moving image in a width of a rectangle, and when a change detection result is detected, a rectangle different from the rectangle is displayed at the position of the maximum value of the change amount during the period of the change detection. A moving image change detection display method characterized in that the moving image change detection display method is provided.
[0093]
(15) A moving image change detection and display method for displaying a change amount of a moving image, a threshold value of the change amount of the moving image, and a threshold value of a continuation time,
When the change detection result is no change, the change detection result is considered to be changed when the state where the change amount is equal to or larger than the change amount threshold value continues for the duration time threshold or more, and when the change detection result is changed, A change detection step of setting the change detection result to no change when the state in which the amount of change is less than the threshold value continues for a duration time threshold or more,
When the change detection result by the change detection means does not change and the change amount is less than the change amount threshold, the first state is set, and the change detection result does not change and the change amount is the change amount threshold. When the change detection result is greater than or equal to the second state, the change detection result is changed, and when the change amount is equal to or greater than the change amount threshold, the third state is set. And displaying the first to fourth states when the amount is less than the change amount threshold value, and displaying the first to fourth states visually. Method.
[0094]
(16) In the moving image change detection and display method according to (15),
A moving image change detection and display method, wherein a change is determined based on whether the change amount exceeds a change amount threshold value or less than the change amount threshold value.
[0095]
(17) In the moving image change detection and display method according to (15) or (16),
A moving image change detection display method, wherein the first to fourth states are represented by different colors and patterns in the rectangle.
[0096]
(18) The moving image change detection display method according to (15) or (16),
A moving image change detection display in which a change amount at a certain time is displayed in a rectangular width, and when the change detection result of the moving image has a change, the thickness, color, and pattern of the outer periphery of the rectangle are changed. Method.
[0097]
(19) In the moving image change detection and display method according to (15) or (16),
A moving image change detection display method, wherein a change amount at a certain time is displayed in a rectangular width, and when the change detection result of the moving image indicates a change, the outer periphery of the rectangle blinks.
[0098]
(20) In the moving image change detection and display method according to (15) or (16),
A moving image wherein a change amount at a certain time is displayed in a width of a rectangle, and when in the states 3 and 4, the maximum value of the change amount in the state 3 is displayed as a rectangle different from the rectangle. Image change detection display method.
[0099]
(21) In the moving image change detection and display method according to any one of (13) to (20),
The change detection result is determined for each partial region of the moving image, and the change detection area, which is the sum of the areas of the partial regions determined to have changed, is used as the change detection amount, and the partial region change detection result is displayed superimposed on the image. A moving image change detection display method.
[0100]
(22) A program for implementing the image change detection display method according to any one of (13) to (21).
[0101]
【The invention's effect】
As described above, according to the present invention, the progress of the change detection process, the transition state of the change detection result, and the final change detection result can be displayed in an easy-to-understand manner. It can be done easily.
[Brief description of the drawings]
FIG. 1 is a block diagram illustrating a hardware configuration according to a first embodiment.
FIG. 2 is a block diagram showing a functional configuration of a camera server.
FIG. 3 is a block diagram showing a functional configuration of a setting client.
FIG. 4 is a diagram showing an example of a display operation screen of a setting client.
FIG. 5 is a diagram illustrating an example of a change detection setting screen of a setting client.
FIG. 6 is an explanatory diagram of a change detection display.
FIG. 7 is a flowchart showing a main process of the camera server.
FIG. 8 is a flowchart showing a sub process of the camera server.
FIG. 9 is a flowchart showing a process of a setting client.
FIG. 10 is a flowchart showing processing for obtaining a change detection result.
FIG. 11 is a diagram illustrating a method of displaying a change detection result according to the second embodiment.
FIG. 12 is a diagram showing a display method of a change detection result.
FIG. 13 is an explanatory diagram of a change detection display.
FIG. 14 is a diagram illustrating a method of displaying a change detection result according to the third embodiment.
[Explanation of symbols]
1-1 Camera server
1-2 CPU
1-2cl CPU
1-7 Monitor
1-10cl keyboard
1-14 Setting Client

Claims (1)

When the amount of change in the moving image continuously satisfies the criterion for a predetermined time or more, a change detection unit of the moving image that determines that the change detection result has changed,
Display means for simultaneously displaying the change amount of the moving image, an index indicating whether the change amount of the moving image satisfies the criterion, and the change detection result,
A moving image change detection display system, comprising: setting means for performing setting relating to change detection.

Images