JP2009152834A - Image playback apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To extract a moving image efficiently from a recorded large volume of encoding image data to be played back. <P>SOLUTION: In order to detect a moving image, a desired search time range and a block equivalent to a motion detection area by dividing an image frame into grid blocks are designated, encoded image data and time of day information within the designated search time range are read from a recording part 230, and the encoded image data are decoded by a video decoding part 240. Then, motion detection is performed inside the designated block to generate a thumbnail image from the decoded image data where motion detection is performed, and either the time of day information or a thumbnail image corresponding to the decoded image data is converted into a GUI image, and displayed as a list to a control monitor 40. According to the list of the GUI images, on the basis of the designated time of day information, the encoded image data before and after the time of day are read from the recording part 230, are decoded and played back by the video decoding part 240. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image reproducing apparatus, and more particularly to an image reproducing apparatus that extracts and reproduces a moving image from recorded video data.

  Conventionally, in the field of video surveillance, not only the video taken by the surveillance camera is displayed on the monitor and monitored by a supervisor, but also the video taken is recorded in a recording device and later recorded in a large amount of video. There is known an image reproducing apparatus that can extract an image with movement such as the intrusion of a suspicious person from the image and view images before and after the extraction (see, for example, Patent Document 1).

According to the image reproducing apparatus described in Patent Document 1, in order to reproduce an image having a predetermined movement or more from compressed image data recorded on a hard disk, a recording is performed after designating a detection site and detection sensitivity. Only data necessary for motion detection is read out from the compressed image data, and a moving image is detected. Then, when a moving image is detected, the compressed compressed image data is read from the hard disk, decompressed, written to the image memory, arranged in a display format such as single screen display or thumbnail display, and output to the monitor. Is.
JP 2002-171383 A

  However, in the image reproduction device described in Patent Document 1, every time a moving image is detected, the corresponding compressed image data is read out, decompressed, and displayed on the monitor. When there are a plurality of images, it is difficult to grasp the entire designated time range at a time. In other words, when there are a plurality of parts for motion detection in the screen, for example, when three windows and doorways are separated from each other in the screen, it is necessary to appropriately specify the detection part and detection sensitivity. Eventually, moving images will be confirmed one by one, and it will take a lot of time and effort to extract and reproduce moving images.

  The present invention has been made in view of the above problems, and easily extracts video data that moves in a specified area from among a large amount of recorded video data within a specified time range. An object of the present invention is to provide an image reproducing apparatus capable of grasping the entire designated time range at a time.

The present invention provides the following means in order to solve the above problems.
An image reproduction apparatus that extracts and reproduces a moving image from recorded encoded image data,
Recording means for recording the encoded image data together with time information;
A time range specifying means for specifying a desired search time range;
In order to set the motion detection area in the image frame, the image frame is divided into grid-like blocks, and an area designating unit for designating a block corresponding to the motion detection area;
Decoding means for decoding the encoded image data;
The encoded image data and time information that fall within the specified search time range are read from the recording means, the read encoded image data are decoded by the decoding means, and the specified image data is specified by the decoding means. Motion detection means for performing motion detection in the generated block;
Image processing means for generating a thumbnail image from the decoded image data subjected to motion detection, and converting at least one of time information corresponding to the decoded image data and the generated thumbnail image into a GUI image;
Output control means for outputting the converted GUI image as a GUI image list;
Based on the time information designated in accordance with the output GUI image list, reproduction control means for reading the encoded image data before and after the time of the time information from the recording means, decoding the decoded image data, and reproducing the decoded image data When,
An image reproducing apparatus comprising:

  According to the image reproducing device of the present invention, the recorded encoded image data includes a desired search time range for detecting a moving image and a block corresponding to a desired motion detection area in the frame. It is possible to set and detect a moving image afterwards. In particular, since the motion detection area in the frame can be performed in units of blocks divided into a grid, detailed detection area designation can be performed, and efficient search can be performed when there are a plurality of monitoring points in the frame.

  Hereinafter, the best mode for carrying out the present invention will be described in detail with reference to the drawings. FIG. 1 shows a schematic configuration of a video surveillance system including an image recording / reproducing apparatus to which an image reproducing apparatus according to an embodiment of the present invention is applied. In FIG. 1, the video monitoring system 1 includes a monitoring camera 10, an image recording / reproducing apparatus 20 having the function of the image reproducing apparatus according to the present embodiment, an image display monitor 30, and a control monitor 40. Yes. An operation input device 21 is connected to the image recording / reproducing device 20.

  In FIG. 1, a monitoring camera 10 is a video camera installed at a position for shooting a place to be monitored, and outputs a shot video as an analog video signal.

  The image recording / reproducing apparatus 20 encodes and records the analog video signal supplied from the surveillance camera 10, decodes the encoded data in a desired time range from the recorded encoded data, and then performs a desired motion detection. A motion detection process is performed on the area, and the result is displayed on a GUI (Graphical User Interface), thereby reproducing and browsing a moving image.

  Specifically, the configuration of the image recording / reproducing apparatus 20 will be described. FIG. 2 shows a schematic block configuration of the image recording / reproducing apparatus 20. In the figure, an image recording / reproducing apparatus 20 is A / D converted by an A / D converter 210 for A / D (analog / digital) conversion of an analog video signal input via a video input terminal 211. For example, a video encoding unit 220 for encoding the digital video signal by the MJPEG (Motion Joint Photographic Group) system, a recording unit 230 for recording the encoded image data, and a recording unit 230 A video decoding unit 240 for decoding the encoded image data read out from the video data and outputting the decoded image data via the video output terminal 241 or for supplying the encoded image data to the control unit 250 described later.

  Further, the image recording / reproducing apparatus 20 controls the entire apparatus, performs a motion detection process from the decoded image data decoded by the video decoding unit 240, generates a thumbnail image and converts it to a GUI, A control unit 250 for generating a menu for making various settings of the recording / reproducing apparatus 20, a monitor interface unit 260 for outputting the generated menu from the monitor output terminal 261, and an operation signal input terminal 271 are provided. And an operation input interface unit 270 for receiving an operation signal input from the external operation input device via the external operation input device and supplying the operation signal to the control unit 250. Each unit is logically connected via a bus 280 as shown in FIG. The control unit 250 includes a storage function by the storage unit 250a in addition to a CPU (not shown) function.

  Here, the recording format of the encoded image data recorded in the recording unit 230 will be described. The encoded image data in the present embodiment has a JPEG format data structure, but when the digital video signal is encoded by the video encoding unit 220, or the encoded image data is recorded in the recording unit 230. Current time information (year / month / day / time) is associated with the encoded image data. The encoded image data and the current time information are both recorded in the recording unit 230. In this case, the current time information may be associated with a predetermined marker in the JPEG data, or may be associated with the outside of the JPEG data.

  Returning to the description of FIG. 1, the operation input device 21 includes a pointing device such as a mouse and a joystick, an input device such as a keyboard and a touch panel, and an operation unit (mainly an operation button) provided on the operation panel of the image recording / playback device 20. Applies. The image display monitor 30 is for displaying the video signal output from the image recording / reproducing apparatus 20. The control monitor 40 is for displaying a menu generated by the image recording / reproducing apparatus 20.

  As apparent from the description of the configuration described above and FIGS. 1 and 2, each of the video input terminal 211, the video output terminal 241, the monitor output terminal 261, and the operation signal input terminal 271 of the image recording / reproducing apparatus 20 includes The monitoring camera 10, the image display monitor 30, the control monitor 40, and the operation input device 21 are connected to each other.

  Next, various menus displayed on the control monitor 40 under the control of the control unit 250 of the image recording / reproducing apparatus 20 will be described. FIG. 3 shows an example schematically showing various menus displayed on the control monitor 40. The menu structure in this embodiment has a plurality of hierarchical structures, and the top menu is displayed as shown in FIG. The top menu 310 shown in FIG. 5A is provided with five submenu items for transitioning from the topmost first layer to the lower second layer menu. Then, any one of the submenu items is selected in accordance with the operation of the operation input device 21 by the operator, and a transition is made to the corresponding second hierarchical menu.

  Among these five submenu items, the search menu item 311 shown in FIG. 3A searches the encoded image data recorded in the recording unit 230 for a moving image in a predetermined time range. This is a menu item for setting the necessary parameters.

  Next, as an example, a description will be given of a second hierarchy menu that transitions when the search menu item 311 is selected from the top menu 310 of FIG. FIG. 4B shows an example of a search menu 320 that is a second hierarchy menu displayed after the search menu item 311 is selected from the top menu 310. The search menu 320 shown in FIG. 5B is provided with four submenu items for transitioning from the second hierarchy menu to the lower third hierarchy menu. Any one of the submenu items is selected according to the operation, and a transition is made to the corresponding third layer menu. In the present embodiment, these four submenu items are configured by a start time setting menu item 321, an end time setting menu item 322, an area setting menu item 323, and a search start item 324. In addition to these four submenu items, the search menu 320 is provided with a return item 325 for transitioning to the top menu 310 that is the first layer one level higher.

  The start time setting menu item 321 is a menu item for setting a search start time for determining a time range in which motion detection processing is executed from the encoded image data recorded in the recording unit 230, and is an end time setting. Similarly, the menu item 322 is a menu item for setting the search end time. The area setting menu item 323 is a menu item for setting a motion detection area in which a motion detection process should be performed by the control unit 250 in the frame of the decoded image data decoded by the video decoding unit 240. The search start item 324 is an item for causing the control unit 250 to start motion detection processing in the search time range and the motion detection area from the set search start time to the search end time.

  Next, an example of the third hierarchy menu displayed when the start time setting menu item 321 is selected in the search menu 320 is shown in FIG. 3C, and when the end time setting menu item 322 is selected. An example of the displayed third hierarchy menu is shown in FIG.

  FIG. 3C is an example of a start time designation menu 330 that is a third hierarchy menu displayed after the start time setting menu item 321 is selected. A search start time setting unit 331 and a return item 332 are provided in the start time designation menu 330 in FIG. Among these, the search start time setting unit 331 is a setting unit in which the search start time including the year, month, date, and time at which the search is to be started is specified by the operation input device 21, and the return item 332 is a start time specification. This is an item for making a transition from the menu 330 to the search menu 320, which is the second hierarchy one level higher.

  FIG. 3D is an example of an end time designation menu 340 that is a third hierarchy menu displayed after the end time setting menu item 322 is selected. In the end time designation menu 340 of FIG. 4D, a search end time setting unit 341 and a return item 342 are provided. Among these, the search end time setting unit 341 is a setting unit in which the search end time including the year, month, date, and time at which the search is to be ended is specified by the operation input device 21, and the return item 342 is an end time specification. This is an item for making a transition from the menu 340 to the search menu 320, which is the second hierarchy one level higher.

  Next, an example of the third hierarchical menu displayed when the area setting menu item 323 is selected in the search menu 320 of FIG. 3B is shown in FIG. FIG. 5E shows an example of an area setting screen 350 that is a third hierarchical menu displayed after the area setting menu item 323 is selected. As shown in FIG. 5E, the area setting screen 350 displays a frame in which a screen corresponding to a single frame of decoded image data is partitioned in a grid pattern. Then, using the region setting screen 350, a block corresponding to a motion detection region in which motion detection on the frame of the decoded image data is to be performed is selected according to the operation of the operation input device 21. Specifically, a pointer that can be freely moved in a grid frame on the area setting screen 350 is displayed, and a desired block is designated by operating the operation input device 21. In this case, on the area setting screen 350, it is preferable to display a still image with an angle of view captured by the monitoring camera 10 and display a grid-like frame on the still image.

  The transition from the state in which the area setting screen 350 shown in FIG. 3E is displayed to the search menu 320, which is the second higher hierarchy, is, for example, a predetermined operation unit (button) of the operation input device 21. ) Is possible by an operation such as pressing.

  Next, the motion detection process of the image recording / reproducing apparatus 20 in the present embodiment will be described with reference to the flowchart of FIG. As a premise that the control unit 250 starts this motion detection process, the search start time is set by the start time setting menu item 321, the end time setting menu item 322, and the region setting menu item 323 of the search menu 320 of FIG. The search end time and the motion detection area are set in advance and stored in the storage unit 250a.

  When the motion detection process by the control unit 250 is started, encoded image data corresponding to the search start time is read from the recording unit 230 and decoded into decoded image data by the video decoding unit 240 (S401). The decoded image data is stored in the storage unit 250a as a past image (S402). Next, encoded image data after 500 mS, for example, is read from the stored past image from the recording unit 230 and decoded into decoded image data by the video decoding unit 240 to be a current image (S403).

  Next, a difference value between the block data of the current image corresponding to one block which is the motion detection area and the block data at the same position of the past image stored in the storage unit 250a is calculated (S404), and this difference is calculated. It is determined whether or not the value is larger than a block threshold value set in advance by the control unit 250 (S405). If it is determined that the difference value is greater than the block threshold value (S405 Yes), this block is regarded as having motion and the number of blocks is counted (step S406). On the other hand, when it is determined that the difference value is equal to or smaller than the block threshold (No in S405), the block is regarded as having no motion, and the process proceeds to the determination process for the next block (S407 No → S404).

  Then, when the determination process for all the blocks in the motion detection area in the current image is completed (Yes in S407), the number of blocks counted in the process of step S406 is compared with the minimum number of detection areas set by the control unit 250. However, if it is determined that the number of blocks is equal to or less than the minimum number of detection areas (No in S408), it is determined that there is a false detection due to noise or disturbance (S409).

  On the other hand, if it is determined in step S408 that the number of blocks is larger than the minimum number of detected areas, it is considered that there is a motion and the time information corresponding to the current image is stored in the storage unit 250a (S410). Next, the current image is overwritten as a past image in the storage unit 250a (S411), and it is determined whether or not the search end time has been reached (S412). If the search end time has been reached (S412 Yes), the motion detection process ends, and if it has not reached (S412 No), the process proceeds to step S403.

  In the motion detection process described above, an example in which the time interval between the current image and the past image is set to 500 mS has been described. However, the time interval may be changed as appropriate according to the processing capability of the control unit 250 and the detection request accuracy. In the case where the motion detection process is performed in more detail, it is preferable to perform the comparison process for each frame.

  When the motion detection process is completed as described above, for all the time information stored in the storage unit 250a, the corresponding encoded image data is read from the recording unit 230 and decoded by the video decoding unit 240. A thumbnail image having a predetermined size is generated from the data. Then, the generated thumbnail image is associated with the corresponding time information, and at least one of the thumbnail image and the time information is converted into a GUI so that it can be selected by the operation input device 21 and controlled via the monitor interface unit 260. Displayed on the monitor 40.

  FIG. 5 schematically illustrates a state in which a search result obtained by executing the search process by the control unit 250 is displayed on the control monitor 40. As shown in the figure, the search result screen 510 displays a maximum of 12 pairs of thumbnail images 511 relating to motion-detected images and time information 512 that is the approximate shooting time of the images. When the number of pairs exceeds 12, as shown in the figure, page switching cursors 513a and 513b are displayed to indicate that there are pages before and after.

  In addition, the time information stored in the storage unit 250a after the motion detection process is completed may be temporarily recorded in the recording unit 230 or stored in the storage unit 250a without displaying a list. In this case, the search start time, search end time, and motion detection area information are also recorded or stored. These pieces of information can be displayed as a list later by operating the operation input device 21. In this case, the operator instructs the search to execute the motion detection process in the background, while performing other work such as monitoring the live video and checking the alarm image during that time, and the motion detection process Since the list can be displayed in a lump after the process is completed and other tasks are completed, an efficient operation can be performed.

  Further, a thumbnail image 511 may also be recorded in the recording unit 230. Recording each search result is highly convenient in applications such as searching again after changing the search conditions and comparing with the recorded results.

  When the desired thumbnail image 511 or the time information 512 is selected from the search result screen 510 in FIG. 5 by the operation input device 21, the control unit 250 displays the time before and after the time indicated by the time information 512, for example, The encoded image data from 30 seconds before the time information 512 is read from the recording unit 230, decoded by the video decoding unit 240, and displayed on the image display monitor 30.

  As described above in detail, according to the image recording / reproducing apparatus 20 of the present embodiment, a desired search time range for detecting a moving image and a desired in-frame for encoded image data that has already been recorded. A motion detection area is set, and an image with motion can be detected afterwards. In particular, since the motion detection area in the frame can be performed in units of blocks divided into a grid, detailed detection area designation can be performed, and efficient search can be performed when there are a plurality of monitoring points in the frame.

  Further, according to the image recording / reproducing apparatus 20 of the present embodiment, thumbnail images of motion-detected images are displayed together with time information and a GUI function so that a list of encoded image data recorded for a long time can be displayed. It is possible to easily reproduce and view an image with a desired monitoring point movement from the inside. This greatly contributes to easily detecting the occurrence of an abnormality at a monitoring point that is not predicted by the operator (monitoring person).

  In the present embodiment, an example in which one monitoring camera 10 is connected to the image recording / reproducing apparatus 20 has been described for convenience of explanation. However, the present invention is not limited to this, and a plurality of monitoring cameras 10 are connected to the image recording / reproducing apparatus 20. It is easy to configure.

  In the present embodiment, the case where the video monitoring system 1 is configured by connecting the image display monitor 30 and the control monitor 40 to the image recording / reproducing apparatus 20 has been described. However, the video output from the image recording / reproducing apparatus 20 is described. May be displayed on the control monitor 40. In this case, the decoded image data generated by the video decoding unit 240 is output from the monitor output terminal 261 by synthesizing the image using the monitor interface 260.

  Furthermore, in the present embodiment, an example using the monitoring camera 10 that outputs an analog video signal has been described. However, a digital video camera that outputs encoded image data by performing encoding processing such as the JPEG method inside the camera. Alternatively, a network camera that outputs encoded image data in an IP packet may be used. In these cases, since the video encoding unit is provided inside the camera, it is not necessary to provide the A / D conversion unit 210 and the video encoding unit 220 in the image recording / reproducing apparatus 20. However, when a network camera is used, it is necessary to provide a network interface unit at the input stage of the image recording / reproducing apparatus 20 so that IP packets can be received.

1 is a schematic configuration diagram of a video monitoring system including an image recording / reproducing apparatus to which an image reproducing apparatus according to an embodiment of the present invention is applied. 1 is a schematic block diagram of an image recording / reproducing apparatus to which an image reproducing apparatus according to an embodiment of the present invention is applied. It is the figure which showed typically the example of the various menus displayed on the monitor 40 for control from the image recording / reproducing apparatus to which the image reproducing apparatus which is embodiment of this invention is applied. It is a flowchart for demonstrating the motion detection process of the image recording / reproducing apparatus to which the image reproducing apparatus which is embodiment of this invention is applied. It is the figure which represented typically a mode that the search result in which the search process was performed by the image recording / reproducing apparatus to which the image reproducing apparatus which is embodiment of this invention was applied was displayed on the control monitor.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Video surveillance system 10 Surveillance camera 20 Image recording / reproducing apparatus 21 Operation input apparatus 30 Image display monitor 40 Control monitor 210 A / D conversion part 211 Video input terminal 220 Video encoding part 230 Recording part 240 Video decoding part 241 Video output Terminal 250 Control unit 250a Storage unit 260 Monitor interface unit 261 Monitor output terminal 270 Operation input interface unit 271 Operation signal input terminal 280 Bus

Claims (1)

An image reproduction apparatus that extracts and reproduces a moving image from recorded encoded image data,
Recording means for recording the encoded image data together with time information;
A time range specifying means for specifying a desired search time range;
In order to set the motion detection area in the image frame, the image frame is divided into grid-like blocks, and an area designating unit for designating a block corresponding to the motion detection area;
Decoding means for decoding the encoded image data;
The encoded image data and time information that fall within the specified search time range are read from the recording means, the read encoded image data are decoded by the decoding means, and the specified image data is specified by the decoding means. Motion detection means for performing motion detection in the generated block;
Image processing means for generating a thumbnail image from the decoded image data subjected to motion detection, and converting at least one of time information corresponding to the decoded image data and the generated thumbnail image into a GUI image;
Output control means for outputting the converted GUI image as a GUI image list;
Based on the time information designated in accordance with the output GUI image list, reproduction control means for reading the encoded image data before and after the time of the time information from the recording means, decoding the decoded image data, and reproducing the decoded image data When,
An image reproducing apparatus comprising:

Images