JP5906806B2 - Movie processing system and terminal device - Google Patents

Description

  The present invention relates to a moving image processing system and a terminal device for reproducing a target image from an accumulated moving image and outputting it to a medium.

  A system has been proposed in which a person such as an intruder (suspicious person) in a store or a building is photographed with a camera and the image is used for crime evidence or prevention. As a conventional system of this type, for example, there is one disclosed in Patent Document 1. In the system disclosed in Patent Document 1, when an intrusion sensor that detects the intrusion of a person outputs an intrusion detection signal, the surveillance camera starts photographing, the photographed moving image is stored in the storage unit, and the stored moving image is stored in the monitoring center. It is transferred to the monitoring center in response to a request from.

JP 2010-171632 A

  However, in the above-described conventional technology, when searching for a target image, for example, an image showing a suspicious person, from a video captured by a surveillance camera, the video is reproduced on a monitor screen by a playback device, There is a problem that it is necessary to search for a target image while looking at the image, and a long time is required to search for the target image.

In addition, when playing back multiple videos taken simultaneously with multiple cameras, it is necessary to search for the target image by performing fast-forwarding, rewinding, etc. of the video individually. When outputting to a medium such as a CD, the time and range of each camera are designated and output to the medium, and there is a problem that a complicated operation is required.
An object of the present invention is to solve such a problem.

Therefore, the present invention is a moving image storage system that includes a moving image storage device that accumulates and stores moving images taken by a camera together with the shooting date and time, and a terminal device connected to the moving image storage device, the moving image storage device Is displayed on the display unit of the terminal device, and the mark number and the marking by the data indicating the head and tail are given to the head and tail of the selected image of the video, the mark number and Marking data including data indicating the head and tail is registered in the image search list of the terminal device in association with the shooting date and time of the image, and the image search list is displayed on the display unit of the terminal device. display, de showing the marking data including data indicating the head of the selected mark number and the image from the list, the tail of the mark number is different from the mark number and the image Send shooting date corresponding to at least two marking data of the marking data including data on the moving storage device from the terminal device as the image designation data, the moving image storage device for data indicating the head and tail of the image designation data A corresponding image and an image between the images are transferred to the terminal device, and the terminal device displays the transferred image on a display unit.

  According to the present invention, the image search list is displayed on the display unit of the terminal device as necessary and the marking data is designated, so that the head and tail corresponding to the marking data are displayed between the images and the images. Since the image can be acquired from the storage server 3, it is possible to retrieve and display the target image in a short time by a simple operation of simply specifying the marking data. It becomes easy to reproduce the image in the meantime and record it on the medium.

System configuration diagram showing the first embodiment The block diagram which shows the structure of the storage server in 1st Example. The block diagram which shows the structure of the browsing PC in a 1st Example. The figure which shows the example of marking of the image by 1st Example

  Embodiments of a moving image processing system according to the present invention will be described below with reference to the drawings.

  FIG. 1 is a system configuration diagram showing a first embodiment, in which 1 is a surveillance camera, 2 is a storage device such as (Digital Video Recorder), 3 is a storage server, 4 is a viewing PC, and the storage device 2 The storage server 3 and the viewing PC 4 serving as a video clerk device are connected to a network (communication line) 5 and can communicate with each other.

The monitoring camera 1 is installed at a predetermined monitoring position in a store or a building, and is connected to the storage device 2. The moving image (video) shot by the monitoring camera 1 is sent to the storage device 2 together with an identifier (hereinafter, camera number) and shooting date / time data to identify the monitoring camera 1. Note that the shooting date / time data is added for each frame of a moving image. Moreover, although only one surveillance camera 1 is shown in the figure, a plurality of surveillance cameras 1 may be installed in the same store or building.
The storage device 2 is a device that temporarily stores a moving image (video) taken by the monitoring camera 1 together with camera number and shooting date / time data.

  FIG. 2 is a block diagram showing the configuration of the storage server 3. As shown in FIG. 2, the storage server 3 has a control unit 31, a storage unit 32, and a moving image storage unit 33. The control unit 31 is stored in the storage unit 32. The video data stored in the storage device 2 and the camera number and shooting date / time data are periodically acquired based on the control program and stored in the video storage unit 33.

  FIG. 3 is a block diagram showing the configuration of the viewing PC 4. The viewing PC 4 is a terminal device for viewing moving images accumulated and stored in the accumulation server, and acquires moving images from the input unit 41 such as a mouse and a keyboard and the accumulation server 3. A display unit (monitor) 42 for displaying an operation screen for performing the operation, an acquired moving image, and the like, a recording unit 43 for recording (outputting) the moving image on a medium such as a CD, and screen data and a control program necessary for the present invention. A storage unit 44 that stores marking data, image list data, and the like, which store marking data, camera numbers, and shooting dates and times, which are described later, and a control unit 45 that controls these are provided.

The operation of the above configuration will be described. The operations of the camera 1 and the storage device 2 described below are controlled by each control unit (not shown) based on a control program stored in a storage unit (not shown) provided in each.
The operations of the viewing PC 3 and the storage server 4 are controlled by the control units 31 and 45 based on the control programs stored in the storage units 32 and 44, respectively.

  First, the moving image (video) shot by the monitoring camera 1 is sent to the storage device 2 together with the camera number and shooting date / time data, and the storage device 2 converts the moving image sent from the monitoring camera 1 to the camera number and shooting date / time data. And memorize temporarily. The accumulation server 3 periodically sends a request for an uncollected video to the storage device 2, and the video, camera number, and shooting date / time data sent from the storage device 2 in response to the request are sent to the video storage unit 33. Accumulate and store.

  The operator of the viewing PC 4 operates the input unit 41 of the viewing PC 4 and requests the storage server 3 for a moving image that has not been marked. In this case, the date and time of shooting can be used as data for designating a moving image that has not been marked. In response to this request, the control unit 31 of the storage server 3 reads the corresponding moving image from the moving image storage unit 33 and transfers it to the viewing PC 4, and the viewing PC 4 displays the moving image sent from the storage server 3 on the display unit 42. . In view of this, the operator performs a marking process by operating the input unit 41 on an image that needs to be reproduced or recorded on a medium later, for example, an image showing a suspicious person.

  For example, the start mark is designated for the frame of the moving image by instructing from the menu or button on the screen that the “starting position” is displayed at the place where the suspicious person appears. Similarly, an end mark is designated for the corresponding frame of the moving image by instructing that it is the “end position” at the place where the suspicious person disappears. The designated mark is stored in the storage unit 44 as marking data. The marking data includes a corresponding moving image file name, distinction between start and end, the frame number of the moving image file, the elapsed time from the beginning, the actual time at the time of shooting, and the like. By referring to the marking data, it is possible to specify from which position of the file to which position is the designated range. Furthermore, sequential numbers are assigned to a pair of start and end marking operations and stored as marking data. Thereby, a plurality of markings can be performed on one file.

FIG. 4 is a diagram showing an example of marking of an image. Here, two units installed at different locations in the same store or building, for example, a location where a bank entrance is photographed and a location where an ATM booth is photographed. An example in which a marking process is performed on a scene (image) of a moving image of the monitoring camera 1 (hereinafter, referred to as cameras 1a and 1b) is shown. Each scene in the drawing is an image for each frame of the moving image.
In the example of FIG. 4, it is assumed that mark 1 is marked (applied) from “scene 2” to “scene n” with respect to a moving image (continuous image) captured by the camera 1a, and starts at “scene 2” at the head thereof. “Mark 1 Start” and “Scene n” at the end are marked with “Mark 1 End” at the end.

In addition, for a moving image (continuous image) taken by the camera 1b, the mark 2 is marked (applied) from “scene 4” to “scene n + 1”, and the “mark 4” starting at “scene 4” at the beginning of the mark 2 is marked. “Start 2” is marked with “Mark 2 End” at the end of “Scene n + 1” at the end.
In this case, the mark numbers “1” and “2” of the mark 1 and the mark 2 are sequential numbers (sequential numbers). For example, the other scenes of the moving images shot by the cameras 1a and 1b are marked next. In this case, “Mark 3 Start” is marked at the head, and “Mark 3 End” at the end is marked at the rear scene.

  As described above, when marking is performed at any time, the control unit 31 of the viewing PC 4 associates the data of the camera number and the shooting date and time with the marking data of “Mark 1 Start” and “Mark 1 End”, and “Mark 2 Start” ”And“ Mark 2 End ”, the camera number and the shooting date / time data are associated with each other and registered in the image search list in the storage unit 44. The same applies when “Mark 3 Start” and “Mark 3 End” are marked on other scenes.

  Next, when the image is reproduced or recorded on the medium, the operator of the viewing PC 4 operates the input unit 41 of the viewing PC 4 to instruct display of the image search list, whereby the control unit 45 When displayed on the display unit 42 for the image search list, the operator selects at least two marking data at the head and tail from the image search list. As a result, the camera number and shooting date / time data associated with the selected marking data are sent as image designation data from the viewing PC 4 to the storage server 3 together with the image transfer request, and the control unit 31 of the storage server 3 The moving image storage unit 33 is searched for an image between the leading and trailing marking data, the searched image is transferred to the viewing PC 4, and the control unit 45 of the viewing PC 4 displays the image on the display unit 42.

  For example, when marking data of “Mark 1 Start” indicating the mark number and the head and “Mark 1 End” indicating the mark number and the tail are selected, the corresponding camera number and shooting date / time data are stored in the storage server together with the image transfer request. Sent. Images from the “scene 2” to “scene n” of the moving image taken by the camera 1 a are transferred from the storage server 3 and displayed on the display unit 42. Similarly, when marking data of “Mark 2 Start” and “Mark 2 End” is selected, the corresponding camera number and shooting date / time data are sent to the storage server together with the image transfer request as image designation data, and the storage server 3 Retrieves images from “scene 4” to “scene n + 1” of the moving image shot by the camera 1b based on the camera number and shooting date / time data. The searched image is transferred from the storage server 3 to the browsing PC 4 and displayed on the display unit 42 of the browsing PC 4.

  In addition, for the two types of marks 1 and 2, when “Mark 1 Start” indicating the head of Mark 1 and “Mark 2 End” indicating the tail of Mark 2 are selected, “Mark 1 Start” is selected. The camera number and shooting date / time data corresponding to “Mark 1 End” and the camera number and shooting date / time data corresponding to “Mark 2 Start” and “Mark 2 End” are stored together with the image transfer request as image designation data in the storage server 3. As a result, the storage server 3 receives the images from the “scene 2” to “scene n” of the movie photographed by the camera 1a and the “scene 4” to “scene n + 1” of the movie photographed by the camera 1b. The images up to "" are retrieved, transferred from the storage server 3 to the viewing PC 4, and displayed on the display unit 42 of the viewing PC 4. In this case as well, the images from “Scene 2” to “Scene n” of the movie taken with the camera 1a and the images from “Scene 4” to “Scene n + 1” of the movie taken with the camera 1b are displayed on the same screen of the display unit. Is displayed.

  Alternatively, the moving images of both the cameras 1a and 1b may be reproduced while synchronizing the real time at the time of shooting, and the scenes 2 to N + 1 may be reproduced for both the moving images. In this case, one of the moving images is also reproduced outside the marked range, which may result in obtaining new information regarding the suspicious person. In other words, it is a video of the time zone in which it is determined that there is a suspicious person in the other video, so if important information that was not noticed when the video was confirmed alone was recorded, it is expected to be noticed Is done.

  In addition, for example, when “Mark 3 Start” and “Mark 3 End” are given to scenes other than the “Mark 1 Start” and “Mark 1 End” scenes of the moving image shot by the camera 1a, When marking data of “Mark 1 Start” and “Mark 3 End” is selected, camera number and shooting date / time data corresponding to “Mark 1 Start” and “Mark 1 End”, “Mark 2 Start”, “Mark The camera number and shooting date / time data corresponding to “2 End” and the camera number and shooting date / time data corresponding to “Mark 3 Start” and “Mark 3 End” are sent to the storage server 3 together with the image transfer request as image designation data. The images between the scenes corresponding to the image designation data are transferred from the storage server 3 and displayed on the display unit of the viewing PC 4 42. Also in this case, each image corresponding to the image designation data is displayed on the same screen of the display unit 42.

  That is, in this embodiment, by selecting a sequential mark number and start and end, it corresponds to the selected mark number and the head and tail data of the mark number among the moving pictures taken by a plurality of surveillance cameras 1. The transfer method is set in the viewing PC 4 so that an image to be transmitted and an image between the images are sent and stored in the storage unit 44, and the necessary image is acquired from the storage server 3 by the viewing PC 4 by this transfer method. Thus, it is reproduced and displayed on the display unit. The image displayed on the display unit can be repeatedly reproduced by operating the input unit of the viewing PC 4.

Or, for multiple selected mark numbers, if the start and end ranges for each mark number overlap, they are treated as consecutive marks, and if the specified marks correspond to multiple files, All of the plurality of files are reproduced and displayed for the continuous mark range.
When the image displayed on the display unit is output and recorded on a medium such as a CD, the medium is set in the recording unit 44 of the viewing PC 4 and the recording unit 44 is instructed to record by operating the input unit 41. Thus, an image can be recorded on the medium. In this case, an image to be recorded can be selected by specifying a mark number with the input unit 41.

  According to the first embodiment described above, the browsing PC 4 has a plurality of mark numbers (mark types) such as mark 1 and mark 2 on the head and tail images of the necessary images in the moving image and data indicating the head and tail. Is added to the marking data, the camera number and shooting date / time data are associated with the marking data, registered in the image search list, and the image search list on the display unit 42 of the viewing PC 4 as necessary. By displaying markings and specifying marking data, the head and tail images corresponding to the marking data and images between the images can be acquired from the storage server 3, so only marking data is specified. This makes it possible to search and display the target image in a short time with a simple operation. Reproduction or, it is easy to record the medium.

In addition, by designating a plurality of mark numbers (mark types) and data indicating the head and tail, it is possible to obtain a target image by jumping.
Also, when marking data indicating the mark number and the head and marking data indicating the mark number and the tail different from the mark number are specified, the head and tail images corresponding to the respective marking data and images between the images are stored. Since it can be acquired from the server 3, it is possible to retrieve and acquire a target image in a short time with a simple operation even for a moving image captured by a plurality of surveillance cameras 1.
Further, by selecting a plurality of marks designated for a plurality of files and reproducing the plurality of files in accordance with the selected marks, it is possible to obtain an effect that the information on the suspicious person can be more easily confirmed.

In the first embodiment described above, the case where the marking process is performed on the moving image captured by the two monitoring cameras 1 has been described as an example. However, the marking is performed on the moving image captured by the three or more monitoring cameras 1. By performing the processing and registering it in the image search list data, the target image can be searched, acquired, reproduced, and recorded on the medium as in the first embodiment.
For example, three surveillance cameras 1 are set as cameras 1a, 1b, and 1c, and the camera 1a is installed so as to photograph the vicinity of the bank entrance. The camera 1c is installed so as to shoot in a specific place.

In this way, after setting the three cameras 1a, 1b, and 1c at a plurality of locations and temporarily storing the moving images shot by these three cameras 1a, 1b, and 1c in the storage device 2, the moving image inspector of the storage server 3 The accumulated moving image is stored in the unit 33, and the accumulated moving image is displayed on the display unit 42 of the viewing PC 4 in the same manner as in the first embodiment, and the image of the target scene is subjected to the marking process by the operation of the input unit.
In this case, a scene in which a bank person entered the video shot with the camera 1a is recorded, and a scene in which the person goes to a specific place through a passage is recorded in the video shot with the camera 1b, and is shot with the camera 1c. It is assumed that a scene where a person is moving in a specific place is recorded in the moving image.

  In such a case, when confirming the general behavior of the person in the video, “Mark 1 Start” is added to the first scene (image) in which the person in the video of the camera 1a is shown, and the last scene (image) is selected. ) Is assigned “Mark 1 End”, “Mark 2 Start” is added to the first scene (image) in which the person in the video of the camera 1b is shown, and “Mark 2 End” is added to the last scene (image). In addition, “Mark 3 Start” is assigned to the first scene (image) in which a person in the moving image of the camera 1c is shown, and “Mark 3 End” is assigned to the last scene (image).

  As described above, when the marking process is performed on the moving images taken by the three cameras 1a, 1b, and 1c, the control unit 45 of the viewing PC 4 adds the camera number and the shooting to the marking data of “Mark 1 Start” and “Mark 1 End”. The date and time data are associated with each other, the camera number and the shooting date and time data are associated with the marking data of “Mark 2 Start” and “Mark 2 End”, and the marking data of “Mark 3 Start” and “Mark 3 End” are associated with the camera The number and shooting date / time data are associated with each other and registered in the image search list of the storage unit 44 as image search data.

  When playing back an image or recording it on a medium, as in the first embodiment, the operator of the viewing PC 4 operates the input unit 41 of the viewing PC 4 to instruct the display of the image search list, As a result, the image search list is displayed on the display unit 42, so that the operator selects the “Start” and “End” marking data of the marks 1, 2, and 3 from the image search list. As a result, the camera number and shooting date / time data associated with the selected marking data are sent to the storage server 3 together with the image transfer request as image designation data, and the storage server 3 searches the image in the same manner as described above. An image corresponding to the image designation data is transferred from the storage server 3 to the viewing PC 4, and the moving images taken by the cameras 1 a to 1 c are simultaneously displayed on the display unit 42 of the viewing PC 4. That is, since the images of the general action scenes of the person in the moving images taken by the cameras 1a to 1c are displayed at the same time, the action of the person can be confirmed. Of course, repeat (repetitive) reproduction is also possible, and recording on a medium such as a CD is also possible.

In the above description, marking is performed on a scene that is considered to be a target image for the time being, and operations such as deleting unnecessary marks can be easily performed later.
In addition, although “Start” and “End” are selected for selecting the mark, respectively, the mark may be selected by specifying a mark number. In this case, for example, when “Mark 1” is selected, the state is the same as when “Mark 1 Start” and “Mark 1 End” are selected.
The present invention is not limited to the above-described embodiments, and authoring can also be performed by applying it to the field of moving image creation.

1 surveillance camera 2 storage device 3 storage server 4 viewing PC
5 network

Claims (4)

A video processing system comprising a video storage device that accumulates and stores video captured by a camera together with the shooting date and time, and a terminal device connected to the video storage device,
Displaying the moving image stored in the moving image storage device on the display unit of the terminal device, to give a marking by the mark number and the data indicating the beginning and the end of the selected image of the moving image, Marking data including the mark number and data indicating the head and tail is registered in the image search list of the terminal device in association with the shooting date and time of the image,
Displaying the image search list on the display unit of the terminal device, marking data including the mark number selected from the list and data indicating the head of the image, a mark number different from the mark number, and Sending shooting date and time corresponding to at least two marking data of marking data including data indicating the tail of the image from the terminal device to the moving image storage device as image designation data,
The moving image storage device transfers an image corresponding to data indicating the head and tail of the image designation data and an image between the images to the terminal device, and the terminal device displays the transferred image on a display unit. A video processing system characterized by that. The moving image processing system according to claim 1,
The video storage device, a plurality of moving images taken by a plurality of cameras and coercive tube,
A moving image processing system, wherein a continuous mark number common to the plurality of moving images is assigned together with data indicating a head or tail. The moving image processing system according to claim 1,
Video processing system is pre SL terminal and displaying simultaneously on a display unit a plurality of images that have been transferred. A terminal device connected to a video storage device that accumulates and stores videos taken with the camera together with the shooting date and time,
The moving image stored in the moving image storage device is displayed on the display unit, and the mark number and the marking with the data indicating the head and the tail are given to the head and tail of the selected image of the moving image, and the mark number and head And marking data including data indicating the tail is registered in the image search list of the terminal device in association with the shooting date and time of the image,
Displaying the list for image search on the display unit, marking data including a mark number selected from the list and data indicating the head of the image, a mark number different from the mark number, and the tail of the image Sending the shooting date and time corresponding to at least two marking data of the marking data including the data to be shown as image designation data from the terminal device to the moving image storage device,
A terminal device, wherein an image corresponding to data indicating a head and a tail of the image designation data and an image between the images are acquired from the moving image storage device and displayed on the display unit.

Images