JP4663564B2 - Recorded image playback apparatus and recorded image playback method - Google Patents

Description

  The present invention relates to a recorded image reproduction apparatus and a recorded image reproduction method for recording an image input for each channel and reproducing a recorded image of a selected channel.

  2. Description of the Related Art Conventionally, as this type of recorded image playback device, a monitoring camera system in which recorded images are recorded so as to be searched with a tree structure including monitoring points, monitoring dates and times, and event information is known (see Patent Document 1). In this surveillance camera system, a user selects and reproduces an image having desired event information from a tree structure, for example.

JP 2000-224542 A

  However, the above-described conventional recorded image reproduction device has the following problems. In other words, the event information used for the search only uses an index indicating the event occurrence time and the event content. Therefore, it is possible to grasp the channel and time of occurrence of each event, but it is difficult to grasp at which time a plurality of events have occurred in a plurality of channels.

  Further, when performing a search based on a combination condition of a plurality of events, it is impossible to determine whether or not an image satisfying the condition exists unless the search is sequentially performed on the plurality of events. For this reason, a large amount of labor is required for the search.

  The present invention has been made in view of the above circumstances, and provides a recorded image reproduction apparatus and a recorded image reproduction method capable of easily understanding at which time a plurality of events have occurred in which channel. Objective. It is another object of the present invention to provide a recorded image reproduction apparatus and a recorded image reproduction method that allow a user to easily determine narrowing by a combination of a plurality of events.

The recorded image reproduction device of the present invention is a recorded image reproduction device that records an image input for each channel and reproduces a recorded image of a selected channel, and displays the recorded image for each channel on a screen of a display unit. Recorded image time axis display means for displaying a time axis, event information display means for displaying event information generated at a corresponding time on the channel on the time axis of the recorded image for each channel, and an operation input unit A selection unit that selects a position on the time axis of the recorded image based on an instruction input and a reproduction unit that reproduces the recorded image corresponding to the selected position are provided.
As a result, even a user who is unfamiliar with the operation can intuitively understand the event status, that is, on which channel a plurality of events have occurred at which time.

Further, the present invention is the above-described recorded image reproduction device, wherein the event information display means displays a plurality of overlapping event information when displaying a plurality of event information superimposed on a time axis of a recorded image of the same channel. The display form of is different.
This makes it possible to intuitively understand the overlapping of a plurality of events on the screen even when a plurality of events occur in the same channel.

Also, the present invention is the recorded image reproduction apparatus described above, further comprising display control means for controlling whether or not the event information is displayed by the event information display means.
This makes it possible to display event information on the time axis of the recorded image as desired by the user.

Further, the present invention is the above recorded image reproduction device, wherein the display control means includes a list display means for displaying a list of event information on the screen of the display section, and a list of the displayed event information. Event information selection means for selecting event information displayed by the event information display means is provided.
This makes it possible to display arbitrary event information displayed in the event information list.

Further, the present invention is the recorded image playback device described above, wherein the screen includes a region for receiving an instruction regarding whether or not to display the event information in addition to a region for displaying the time axis of the recorded image. Assume that an area for displaying a list, an area for receiving selection of event information from the list of event information, and an area for receiving an instruction to reproduce the recorded image are provided.
Thereby, it becomes possible to improve a user's operativity.

Further, the present invention is the recorded image playback device described above, wherein the event information display means links event information generated between a plurality of channels, and displays the link information on the time axis of the recorded image. The selection means selects the cooperation information displayed on the time axis of the recorded image.
As a result, even if multiple events occur in multiple channels, you can intuitively understand the search results based on the combination of multiple events on the screen without entering a complicated search expression. It becomes possible for the user to easily determine narrowing down by a combination of events. Therefore, when the user confirms the recorded image, the labor required for the search can be significantly reduced.

Further, the present invention is the above-described recorded image playback device, wherein the event information display means links a plurality of event information generated in the same channel, and uses the link information of the recorded image of the same channel. It is displayed on the time axis, and the selection means selects the cooperation information displayed on the time axis of the recorded image.
As a result, the user can intuitively understand at which time each individual event has occurred regarding a large event in which a plurality of events that have occurred in one channel are linked.

Further, the present invention is the above-described recorded image reproduction apparatus, wherein the cooperation instruction means for instructing the cooperative reproduction of the recorded image corresponding to the cooperation information, and the individual instruction for instructing the individual reproduction of the recorded image corresponding to the cooperation information Instructing means, and when the cooperative reproduction means is instructed to perform cooperative reproduction, the reproduction means reproduces the recorded image corresponding to the cooperative information in cooperation, and the individual instruction means is instructed to perform individual reproduction. In this case, it is assumed that the recorded images corresponding to the cooperation information are individually reproduced.
Thereby, when reproducing a recorded image, it becomes possible to arbitrarily select a reproduction method.

The recorded image reproduction method of the present invention is a recorded image reproduction method in a recorded image reproduction apparatus that records an image input for each channel and reproduces a recorded image of a selected channel, wherein the channel is displayed on a screen of a display unit. A recorded image time axis display step for displaying the time axis of each recorded image, and an event information display step for displaying event information generated at a corresponding time in the channel on the time axis of the recorded image for each channel; The method includes a selection step of selecting a position on the time axis of the recorded image based on an instruction input from the operation input unit, and a reproduction step of reproducing the recorded image corresponding to the selected position.
As a result, even a user who is unfamiliar with the operation can intuitively understand the event status, that is, on which channel a plurality of events have occurred at which time.

  The present invention also provides a program for causing a computer to function as each means in the recorded image reproduction apparatus described above.

  According to the present invention, it is possible to provide a recorded image reproduction apparatus and a recorded image reproduction method that can easily understand at which time a plurality of events have occurred in which channel. In addition, it is possible to provide a recorded image reproduction device and a recorded image reproduction method that allow the user to easily determine whether or not to narrow down by combining a plurality of events.

  The recorded image playback apparatus and the recorded image playback method according to the present embodiment are applied to a monitoring camera system that records images taken by a plurality of cameras for each channel.

(First embodiment)
FIG. 1 is a block diagram showing the configuration of the surveillance camera system according to the first embodiment of the present invention. This surveillance camera system includes a plurality of video cameras 101 (101a, 101b...), A plurality of sensors 102 (102a, 102b...), A recorded image reproduction device 100, and a display 103.

  The plurality of video cameras 101 are installed at different monitoring points and output captured monitoring images. Each of the plurality of sensors 102 acquires information such as temperature and door opening / closing.

  The recorded image reproduction apparatus 100 includes an image input / output unit 110, a sensor input unit 111, an image compression unit 112, an image recording unit 113, a secondary storage unit 114, an image expansion unit 115, a CPU 116, and an operation input unit 117.

  The image input / output unit 110 captures (captures) an image output from the video camera 101 and outputs the image expanded by the image expansion unit 115. The sensor input unit 111 inputs various sensor information output from the sensor 102. The image compression unit 112 compresses the image captured (captured) by the image input / output unit 110.

  The image recording unit 113 stores compressed image information. Various sensor information input by the sensor input unit 111 is stored in the secondary storage unit 114. The image decompression unit 115 decompresses image information stored in the image recording unit 113.

  The CPU 116 performs overall control of the apparatus including control related to the exchange of information between blocks, analysis of information obtained by the sensor input unit 111, and control of a user interface. The operation input unit 117 is connected to an external pointing device, a keyboard, and the like, and inputs information according to an operation instruction from the user. The system bus 118 connects the components from the image input / output unit 110 to the operation input unit 117 to each other. The display 103 displays an image output from the image input / output unit 110 and various windows described later.

  Here, the “event” used in the image search will be described in detail. There are two types of events: events that are determined based on images (video signals) obtained from the image input / output unit 110 and events that are determined based on various sensor information obtained from the sensor input unit 111. is there. When determining whether an event has occurred and performing a search based on the event, the CPU 116 performs the same search without changing the handling according to the type of the event. Therefore, the conditions of various events can be narrowed down by combining a plurality of events at the time of search.

  Examples of events determined based on the video signal obtained from the image input / output unit 110 include the following. The CPU 116 calculates the difference between the current frame and the previous frame for the luminance signal in the video signal, and determines that the event “change in brightness” has occurred when the difference exceeds a predetermined threshold. Further, the CPU 116 calculates the motion information of the object in the video signal, and when the motion is detected, determines that the “motion occurrence” event has occurred. In addition to such an event, the CPU 116 can use information obtained by performing arbitrary image processing as an event generation condition. The generation conditions and algorithm can be set by the user. Also, the event name of the occurrence condition set by the user can be arbitrarily set by the user.

  On the other hand, examples of events determined from various sensor information obtained by the sensor input unit 111 include the following. When the sensor 102 is a temperature sensor, temperature information is obtained from the sensor input unit 111. The CPU 116 analyzes the temperature information, and when an abnormally high temperature is detected, the CPU 116 determines that a “heat source generation” event has occurred. When the sensor 102 is a room lighting switch, an input signal indicating ON / OFF information of the lighting switch is obtained from the sensor input unit 111. The CPU 116 recognizes the lighting switch ON / OFF information, and determines that the event “lighting switch ON” has occurred when a switch ON signal is detected. In addition to such an event, the CPU 116 can determine any information input from the sensor input unit 111 as an event. In addition, the user can arbitrarily set the generation condition. Also, the event name of the occurrence condition set by the user can be arbitrarily set by the user.

  The event is stored in the secondary storage unit 114 together with the time of occurrence, and is used as tag information of a database when searching for an image. The occurrence status of the event searched based on this tag information is displayed graphically (graphically) in a recorded image state window (see FIG. 2) described later.

  FIG. 2 is a diagram showing a control window 200 displayed by starting the recording event display software. The control window 200 is provided with a date display window 201, a recorded image state window 202, a display switching window 203, an event display window 204, and a playback control window 205.

  In the date display window 201, the date of the currently displayed recording information is displayed. The user can change the date information by inputting operation instruction information via the operation input unit 117 by clicking on the date display window 201 with a pointing device. When the date is changed by the user, the information displayed in the other windows is updated to information corresponding to the changed date. For example, the recorded image status window 202 displays time information of the recorded image corresponding to the date displayed in the date display window 201.

  FIG. 3 is a view showing the recorded image state window 202. In the figure, the horizontal axis represents time, and the vertical axis represents camera channel information. 0:00 to 24:00 is displayed as the time. When a recorded image exists at the corresponding time and channel, a rectangular area 301 expressed in an arbitrary color is displayed. As a result, the user can intuitively recognize in which channel at which time the recorded image exists. In this example, the time zone from 0:00 to 24:00 is displayed as the time, but other time zones may be displayed. Further, although a window having nine input channels is shown, the window may be configured with an arbitrary number of channels. Further details of the recorded image information window 202 will be described later.

  The display switching window 203 allows the user to select which display he wants to perform. FIG. 4 is a diagram showing the display switching window 203. In the display switching window 203, a “registered event display” for displaying a registered event is shown as a content display window 401 (see FIG. 4A). When switching the content display window, when the user clicks the display switching button 402 with the pointing device, a list 403 of currently selectable contents is displayed (see FIG. 5B). Then, the user selects whether to perform “registered event display” processing or “user setting event registration” processing.

  In the event display window 204, an event that the user wants to display at the time of search is selected. FIG. 5 is a diagram showing the event display window 204. The event display window 204 is provided with a content display window 501 and a display selection window 502. In the content display window 501, the user can select event content to be displayed. In the display selection window 502, “display” or “non-display” can be selected. When “Display” is selected, the selected event is displayed in the recorded image state window 202 in the content display window 501. The color used for this display is displayed on the background of the display selection window 502. On the other hand, when “Hide” is selected, the event selected in the content display window 501 is not displayed in the recorded image state window 202.

  FIG. 6 is a diagram showing a specific example of the event display window 204. In the content display window 501, as described above, the user can select the event content to be displayed. In the display selection window 502, “display” or “non-display” can be selected. When “display” is selected, the event selected in the content display window 501 is displayed in the recorded image state window 202. When a display event is selected, if a button in the content display window (event selection area) 501 is clicked with a pointing device, a list 803 of registered events currently registered is displayed.

  This registration event has a hierarchical structure. Here, there are two child events, “movement occurrence” and “door opening / closing”, for the “movement related” parent event. In addition to the “camera related” parent event, there are two child events of “camera manual operation” and “video signal LOSS”. When the user selects the parent event, the user can obtain the same result as when all the child events are selected, and can check the occurrence state of the motion information under a wide range of conditions. In addition, when only a child event is selected, the event occurrence condition under a narrower condition can be confirmed.

  In this list of registered events 803, the hierarchical structure is two layers, and there are two child events for one parent event, but it is needless to say that the hierarchical structure is not limited to this. For example, by providing a hierarchical structure deeper than two hierarchies and further increasing the number of child events, it is possible to realize a search based on detailed events.

  FIG. 7 is a view showing a recorded image state window 202 on which a registered event is displayed. In the recorded image state window 202, the rectangular area 301 represents the time during which the recorded image exists as described above. A rectangular area 902 corresponds to one registered event and represents the occurrence time of the selected registered event. A rectangular area 903 represents a registration event occurrence time different from the registration event represented by the rectangular area 902. The overlapping area of the rectangular areas 902 and 903 means that two different registration events occur simultaneously. Here, when two or more different registration events occur at the same time, visual recognition is facilitated by changing the display form of the rectangular area representing each event. For example, the display position of the rectangular area is shifted, the color is changed, or the area shape is changed.

  FIG. 8 is a diagram showing colors displayed in the recorded image state window 202 when an event is selected. As a rule, events are displayed in color. An arbitrary color 1001 is assigned to the parent event displayed at the top of the hierarchical structure. Further, when displaying child events below the hierarchical structure, a plurality of texture patterns 1002 are displayed in a superimposed manner based on the color assigned to the display of the parent event.

  By using such a display form, even a user unfamiliar with the operation can intuitively understand on the recorded image state window 202 the situation of which channel and at which time the event has occurred. . In addition, even when a plurality of registered events occur in a plurality of channels, a search result based on a combination condition of a plurality of registered events can be intuitively understood on the recorded image state window 202 without inputting a complicated search expression. be able to. Thereby, when the user confirms the monitoring image, the labor required for the search can be reduced.

  Also, the playback control window 205 is provided with a playback button 205a, a stop button 205b, a reverse playback button 205c, and a recording state display section 205d. Using this playback control window 205, playback of recorded images, reverse playback, stop, and switching from the playback screen to the recorded image status display are performed.

  The operation of the recorded image reproduction apparatus in the surveillance camera system having the above-described configuration will be described. FIG. 9 is a flowchart showing an operation processing procedure of the recording event display software executed by the CPU 116. A processing program relating to each processing procedure shown in the following flowcharts is stored in a storage medium (ROM in the CPU 116, the secondary storage unit 114, or the image recording unit 113), and each process is executed by the CPU 116.

  First, the control window 200 is displayed on the screen of the display 103, and the display selection by the user is acquired from the display switching window 203 in the control window 200 (step S1). When the display switching button 402 is clicked by the user at the time of selection, a list 403 of selectable contents is displayed (see FIG. 4). Here, “Registered event display” and “Register user event” are displayed as a list 403 of selectable contents.

  Then, the result of selection is determined (step S2). If “registered event display” is selected, the event display window 204 is redrawn (step S3), and a registered event display process is performed (step S4). In this registered event display process, an event item is selected. Details of the registered event display process will be described later. Then, a display / non-display selection process for selecting whether or not to draw the selected event item in the recorded image state window 202 is performed (step S5). Details of the display / non-display selection processing will be described later.

  On the other hand, when “user setting event registration” is selected in step S2, user setting event registration processing is performed (step S6). The user can newly register an event used for “registered event display” or the like with an arbitrary name. As an event generation condition, information obtained by analyzing the video signal obtained from the image input / output unit 110 by the CPU 116 and information obtained by analyzing the various sensor signals obtained from the sensor input unit 111 by the CPU 116 are used. Also, event registration is performed using the area of the event display window 204.

  Thereafter, event image reproduction processing is performed (step S7). In this event image reproduction process, the user can check the occurrence status of the displayed event and perform the reproduction process of the recorded image. Details of the event image reproduction processing will be described later.

  As a result, the user can intuitively understand on the recorded image state window 202 the situation of which event has occurred in which channel and at what time. In addition, the user can easily select and play back a recorded image based on a combination condition of a plurality of events.

  FIG. 10 is a flowchart showing the registered event display processing procedure in step S4 of FIG. It is determined whether or not the button of the content display window (event selection area) 501 has been clicked with the pointing device (step S11). If not clicked, the process is terminated and the process returns to the main process.

  On the other hand, if the pointing device is clicked, a list 803 of registered events currently registered is displayed (step S12). And it is discriminate | determined whether the registration event was selected from the list 803 of registration events (step S13). If the registered event is not selected, the process proceeds to step S18. On the other hand, if a registered event is selected, it is determined whether or not the selected registered event exists in the recorded image (step S14). If the selected registration event does not exist in the recorded image, the process proceeds to step S18.

  On the other hand, if the registered event selected in step S14 exists in the recorded image, whether or not another registered event already selected exists and is displayed at the time when the selected registered event exists. Is determined (step S15). If there is no other registered event already selected at the time when the selected registered event exists, the display status of the selected event is set to “display”, and the recorded image state portion on the recorded image state window 202 The registration event occurrence state is displayed over the recorded image information (see the rectangular area 902 in FIG. 7, step S16). Thereafter, the process proceeds to step S18.

  On the other hand, if there is a registered event that has already been displayed at the time when the selected registered event exists, the display status of the selected event is set to “display”, and in the recorded image state portion on the recorded image state window 202 The display position is shifted so as not to overlap with the already displayed registration event (see the rectangular area 903 in FIG. 7, step S17). Thereafter, the process proceeds to step S18.

  Then, it is determined whether or not all registered events have been selected (step S18). If not all have been selected, the process returns to step S11. On the other hand, when all the registered events have been selected, this process ends and the process returns to the main process.

  FIG. 11 is a flowchart showing the registration event display / non-display selection processing procedure in step S5 of FIG. First, it is determined whether or not at least one registered event has been selected (step S21). If no registered event is selected, this process is terminated and the process returns to the main process.

  On the other hand, if at least one registered event is selected, it is determined whether or not the display selection window 502 is “display” (step S22). If it is “display”, it is determined whether or not the display selection window 501 is changed from “display” to “non-display” (step S23). When not changing to “non-display”, the process is terminated as it is, and the process returns to the main process. On the other hand, when the display selection window 501 is changed from “display” to “non-display”, the rectangular area corresponding to the selected recording event information is deleted from the recorded image state window 202 (step S24). Thereafter, the present process is terminated and the process returns to the main process.

  On the other hand, if the display selection window 502 is “non-display” in step S22, it is determined whether or not the display selection window 502 is changed from “non-display” to “display” (step S25). If the display is not changed to “display”, the process is terminated as it is, and the process returns to the main process. On the other hand, when the display selection window 502 is changed from “non-display” to “display”, a rectangular area corresponding to the selected recording event information is displayed in the recorded image state window 202 (step S26). Thereafter, the present process is terminated and the process returns to the main process.

  FIG. 12 is a flowchart showing the event image reproduction processing procedure in step S7. First, it is determined whether or not a point where a recorded image exists on the recording state display window 202 has been clicked by the pointing device (step S31). If not clicked, the process is terminated and the process returns to the main process.

  On the other hand, when clicked, the selected region is determined according to the position of the clicked location (step S32). That is, when only the information portion of the recorded image that is not an event is clicked, the recorded image information area is selected. When an area where a registered event occurs is clicked, the area of the registered event is selected. When an area where two or more registered events overlap is clicked, only an area that satisfies all the conditions is selected. When the playback button 205a is clicked with the area selected, the recorded image is played back from the beginning of the selected selection area (step S33). Thereafter, the present process is terminated and the process returns to the main process.

  FIG. 13 is a flowchart showing the date change processing procedure. This processing program is stored in a storage medium (ROM in CPU 116, secondary storage unit 114, or image recording unit 113). The date is changed by instructing the date displayed in the date display window 201 in the control window 200 with a pointing device.

  In response to the date change, the recorded image state displayed in the recorded image state window 202 is updated (step S41). It is determined whether display of a registered event is selected in the display selection window 502 (step S42). If the display of the registered event is not selected, this process is terminated as it is. On the other hand, when the display of the registered event is selected in step S42, the registered event is drawn in the recorded image state portion in the recorded image state window 202 (step S43). Then, this process is complete | finished.

  As described above, according to the recorded image reproduction apparatus of the first embodiment, the event occurrence status is displayed on the graphical user interface (GUI) around the time together with the recording time information for each channel. Thereby, the user can intuitively understand the event situation, that is, at which time of which channel the event has occurred on the window. Further, even when a plurality of events occur in a plurality of channels, it is possible to intuitively understand search results based on a combination of a plurality of events on a window without inputting a complicated search expression. In addition, the user can easily determine the narrowing down by a combination of a plurality of events from the overlap of the plurality of events displayed on the GUI. Thereby, it is possible to easily search and reproduce an image satisfying a desired condition. Therefore, the labor required for the search when confirming the user's image can be remarkably reduced.

(Second Embodiment)
Since the configuration of the surveillance camera system in the second embodiment is the same as that in the first embodiment, the description thereof is omitted by giving the same reference numerals, and different processing is shown here. FIG. 14 is a diagram showing a display switching window 203 in the second embodiment.

  The display switching window 203 indicates that “multiple channel event linkage” is displayed as the content display window 1401 (see FIG. 5A). Here, “multiple channel event linkage” refers to analyzing the occurrence status of a plurality of single events between different channels and handling each single event as a single new event. As long as the event is registered in advance by this cooperation process, the user can easily search for the occurrence status of a plurality of single events occurring between a plurality of channels as one event occurrence.

  For example, when a “door open / close” event occurs in channel 1, an “illumination switch ON” event occurs in channel 3, and a “movement occurrence” event occurs in channel 4, the multi-channel event name “intruder detection (route) 1) ”event has occurred (see FIG. 17). In this example, the number of event linkages of “multi-channel event linkage” is 3, but any number of event linkages can be similarly processed as long as there are a plurality of event linkages.

  When a display switching button 1402 of the display switching window 203 is clicked with a pointing device, a list 1403 of contents that can be currently selected is displayed (see FIG. 14B). By this selection, the user can select one of “multiple channel event linkage display” processing, “registered event display” processing, and “user setting event registration” processing.

  15 and 16 are diagrams showing the event display window 204. In the event display window 204, a “multi-channel event linkage” content display window 1501 and an occurrence time display window 1503 are displayed.

  The content display window 1501 is provided with an event display switching button 1502. The user can click the event display switching button 1502 to select the “multi-channel event linkage” event content to be displayed.

  Specifically, when the user clicks an event display switching button 1502 with a pointing device, a list 1601 of event contents of “multiple channel event linkage” that can be currently selected is displayed in the content display window 1501 (FIG. 16 ( A)). By clicking the desired event content from among these, the user can select the event type of “multi-channel event linkage”.

  In the occurrence time display window 1503, the event occurrence time in the selected “multi-channel event linkage” is displayed. As the occurrence time displayed here, the first time at which one of a plurality of single events has occurred and the time at which the single event ended last are displayed. The generation time display window 1503 is provided with a time display switching button 1504. When the user clicks the time display switching button 1504 with the pointing device, a list 1602 of the occurrence times and end times of all events in the generated “multi-channel event linkage” is displayed (see FIG. 16B). By clicking the desired occurrence time and end time from among these, the user can select the event occurrence time of “multi-channel event linkage”, and perform various processing on the event corresponding to the selected event occurrence time. It can be carried out.

  FIG. 17 is a diagram showing the event display window 204 when the event name “intruder detection (path 1)” is selected as the event content of “multiple channel event linkage”. The event display window 204 includes a content display window 1501 and an occurrence time display window 1503 of “multiple channel event linkage”, an event linkage playback button 1705, an event occurrence channel display column 1706, a single channel event name display column 1707, and an event alone. A play button 1708 is displayed.

  When the user clicks the event cooperation playback button 1705 with the pointing device, all the generated single events are played back in order of time. In the event occurrence channel display field 1706, the channel in which the event displayed in the single channel event name display field 1707 has occurred is displayed.

  Here, a “door open / close” event has occurred in channel 1. Accordingly, “CH1” is displayed in the channel column 1706a, and “door open / close” is displayed in the event name 1707a. In addition, an “illumination switch ON” event has occurred in channel 3. Accordingly, “CH3” is displayed in the channel column 1706b, and “lighting switch ON” is displayed in the event name 1707b. In addition, a “movement occurrence” event has occurred in channel 4. Therefore, “CH4” is displayed in the channel column 1706c, and “movement occurrence” is displayed in the event name 1707c.

  In this example, since the number of event linkages of “multi-channel event linkage” is 3, the number of events displayed is 3, but any number of events can be displayed in the same manner. is there.

  When the user clicks an event single playback button 1708 with a pointing device, the corresponding event displayed in the generated channel column 1706 and the single channel event name display column 1707 is played back alone.

  In addition, using the time information of the selected “multiple channel event linkage” event, a “multiple channel event linkage display” process is performed on the recorded image state window 202. FIG. 18 is a diagram showing the recorded image state window 202 in which the “multiple channel event linkage display” process has been performed. A “door open / close” event 1801 is represented in channel 1. Channel 3 represents an “illumination switch ON” event 1802. Channel 4 represents a “movement occurrence” event 1803. With this display, the user can grasp at a glance the relationship between the occurrence time of each individual event and the occurrence channel in the “multi-channel event linkage” event.

  FIG. 19 is a flowchart showing an operation processing procedure of the multi-channel event linkage display display software executed by the CPU 116. This processing program is stored in a storage medium (ROM in CPU 116, secondary storage unit 114, or image recording unit 113).

  About the same step process as the processing program shown in FIG. 9 of the first embodiment, the same step number is assigned, and the detailed description thereof is omitted. Here, the processes of different steps S2A and S8 are detailed. Show.

  First, the control window 200 is displayed on the screen of the display 103, and the display selection by the user is acquired from the display switching window 203 in the control window 200 (step S1). In this selection, when the display switching button 1402 is clicked by the user, a list 1403 of selectable contents is displayed (see FIG. 14). Here, “multiple channel event linkage display”, “registered event display”, and “user setting event registration” are displayed as a list 1403 of selectable contents.

  Then, the selection result is determined (step S2A). If “registered event display” is selected, the event display window 204 is redrawn (step S3), and a registered event display process is performed (step S4). In this registered event display process, an event item is selected. Further, a display / non-display selection process for selecting whether or not to draw the selected event item in the recorded image state window 202 is performed (step S5).

  On the other hand, when “user setting event registration” is selected in step S2A, user setting event registration processing is performed (step S6). The user can newly register an event used for “registered event display” or the like with an arbitrary name. As conditions for the event occurrence, information obtained by analyzing the video signal obtained from the image input / output unit 110 by the CPU 116 and information obtained by analyzing the various sensor signals obtained from the sensor input unit 111 by the CPU 116 can be used. Also, event registration is performed using the area of the event display window 204.

  On the other hand, when “multiple channel event linkage processing” is selected in step S2A, “multiple channel event linkage display” processing is performed (step S8). Thereafter, event image reproduction processing is performed (step S7). In this event image playback process, the user confirms the event occurrence status displayed in the “registered event display” process in step S4 or the “multi-channel event linked display” process in step S8, and performs the playback process of the recorded image. It can be carried out.

  FIG. 20 is a flowchart showing the “multi-channel event linkage display” processing procedure in step S8. A single event occurring between a plurality of channels is analyzed to determine whether or not a “multiple channel event linkage” event has occurred (step S61). Here, the presence / absence of occurrence of the “multi-channel event linkage” event is determined, for example, by whether or not an event that has occurred in a plurality of channels exists within a predetermined time width. If the “multi-channel event linkage” event has not occurred, the process is terminated as it is, and the process returns to the main process.

  On the other hand, if a “multiple channel event linkage” event has occurred, display according to a user instruction is selected from the “multiple channel event linkage” event search field displayed in the event display window 204 (step S62). In this selection, a “multi-channel event linkage” event can be selected from the currently selectable “multi-channel event linkage” event list 1601.

  From the occurrence time column displayed in the event display window 204, the occurrence time of the “multi-channel event linkage” event according to the user's instruction is selected (step S63). Upon this selection, a list 1602 of all event occurrence times in the “multi-channel event linkage” is displayed.

  Event information of the selected occurrence time is displayed on the event display window 204 (see FIG. 17, step S64). Further, event information of the selected occurrence time is displayed on the recorded image state window 202 (see FIG. 18, step S65).

  Thereafter, it is determined whether or not the cooperative playback button 1705 has been clicked (step S66). When the cooperative playback button 1705 is clicked, all the displayed single events are played back in order of time (step S67). After the reproduction is completed, the process proceeds to step S70.

  On the other hand, if the cooperative playback button 1705 is not clicked in step S66, it is determined whether or not the single playback button 1708 is clicked (step S68). When the single reproduction button 1708 is clicked, the selected single event is reproduced (step S69). After the reproduction is completed, the process proceeds to step S70. On the other hand, if the single playback button 1708 is not clicked, the process proceeds to step S70.

  It is determined whether or not the reproduction according to the user instruction is continued (step S70). When the reproduction is continued, the process returns to step S62 and the reproduction process is repeated. On the other hand, when the reproduction is not continued, this process is terminated and the process returns to the main process.

  According to the recorded image playback apparatus of the second embodiment, the user intuitively understands at which time each single event has occurred between a plurality of channels regarding the event “multi-channel event linkage”. Can do. In addition, the recorded image of each event can be easily reproduced. As a result, it is possible to reduce the labor required for the search at the time of monitoring image confirmation.

(Third embodiment)
Since the configuration of the surveillance camera system in the third embodiment is the same as that of the first embodiment, the description thereof is omitted by giving the same reference numerals. FIG. 21 is a diagram showing a display switching window 203 in the third embodiment.

  The display switching window 203 indicates that “single channel event linkage” is displayed as the content display window 2101 (see FIG. 5A). Here, “single channel event linkage” means that the occurrence status of a plurality of events in the same channel is analyzed, and individual events of the same channel are linked and handled as one new event.

  As long as the events are registered in advance, the user can easily search for the occurrence status of a plurality of single events that have occurred in a certain channel as one event occurrence.

  Here, it is assumed that a single channel event name “intruder detection (single channel)” occurs when “sound detection”, “light switch ON”, and “movement occurrence” events occur continuously in a certain channel ( (See FIG. 24). In this example, the number of event linkages of “single channel event linkage” is three, but any number can be similarly displayed as long as it is two or more.

  When the user clicks the display switching button 2102 with the pointing device, a list 2103 of contents that can be currently selected is displayed (see FIG. 21B). In this selection, the user can select one of “single channel event linkage display” processing, “registered event display” processing, and “user setting event registration” processing.

  FIG. 22 is a diagram showing the event display window 204. The content display window 2201 of “single channel event linkage” displays the event content of “single channel event linkage”, the occurrence time and the occurrence channel of the “single channel event linkage” event.

  FIG. 23 is a diagram showing the event contents of “single channel event linkage”, the occurrence time and the occurrence channel of the “single channel event linkage” event. When the user clicks the event display switching button 2202 with a pointing device, a list 2301 of event contents of “single channel event linkage” that can be currently selected is displayed (see FIG. 4A). In this selection, the user can select an event type of “single channel event linkage”.

  The occurrence time and occurrence channel display window 2203 displays the occurrence time and occurrence channel of the “single channel event linkage” event selected in the “single channel event linkage” content display window 2201 (see FIG. 5B). ).

  Here, as the “occurrence time”, a time period from the time at which the first single event has occurred to the time at which the last single event has ended among a plurality of single events is displayed. Specifically, an event has occurred in three channels. When the user clicks the time display switching button 2204 with a pointing device, a list 2302 of occurrence times and end times and occurrence channels is displayed for all the events of the “single channel event linkage” that have occurred. In this selection, the user can select an event occurrence time and channel of “single channel event linkage”, and can perform each process on the selected event.

  FIG. 24 is a diagram showing the event display window 204 when the single channel event name “intruder detection (single channel)” is selected. The event display window 204 includes an event linkage playback button 2205, an event generation channel display field 2406, a single channel event name display field 2407, and an event single playback in addition to the content display window 2201 and the generation time and generation channel display window 2203 described above. A button 2408 is displayed.

  When the user clicks the event cooperation playback button 2205 with the pointing device, all the generated single events are played back in order of time. The event occurrence channel display field 2406 shows in which channel the “single channel event linkage” event has occurred. Here, the “sound detection”, “lighting switch ON”, and “movement occurrence” events are continuously generated in the three channels. Therefore, “CH3” is displayed in the display channel 2406a in the event occurrence channel display field 2406, and “Sound detection” is displayed in the display event name 2407a in the single channel event name display field 2407. In addition, “CH3” is displayed on the display channel 2406b, and “lighting switch ON” is displayed on the display event name 2407b. In addition, “CH3” is displayed in the display channel name 2406c, and “movement occurrence” is displayed in the display event name 2407c. In this example, since the number of event linkages of “single channel event linkage” is 3, the number of events displayed is 3, but any number of events can be displayed in the same manner.

  When the user clicks the event single playback button 2408 with the pointing device, the event displayed in the generated channel column 2406 and the single channel event name display column 2407 is played back alone.

  Further, using the time information of the selected “single channel event linkage” event, a “single channel event linkage display” process is performed on the recorded image state window 202. FIG. 25 is a diagram showing a display result of the “single channel event linkage display” process in the recorded image state window 202. In the recorded image state of the three channels, a “sound detection” event 2501, an “illumination switch ON” event 2502, and a “movement occurrence” event 2503 are displayed. By this display, the user can grasp at a glance the occurrence time of each individual event in the “single channel event linkage” event and its relationship.

  FIG. 26 is a flowchart showing an operation processing procedure of the multi-channel event cooperation display display software executed by the CPU 116. This processing program is stored in a storage medium (ROM in CPU 116, secondary storage unit 114, or image recording unit 113).

  About the same step process as the processing program of the said 1st, 2nd embodiment, the same step number is attached | subjected, the detailed description is abbreviate | omitted, and here, the process of different step S2B and S8A is shown in detail. .

  First, the control window 200 is displayed on the screen of the display 103, and the display selection by the user is acquired from the display switching window 203 in the control window 200 (step S1). When the user clicks the display switching button 2102 at the time of selection, a list 2103 of selectable contents is displayed (see FIG. 21). Here, as a list 2103 of selectable contents, “single channel event linked display”, “registered event display”, and “user set event registration” are displayed.

  The result of selection is discriminated (step S2B). If “registered event display” is selected, the event display window 204 is redrawn (step S3), and a registered event display process is performed (step S4). In this registered event display process, an event item is selected. Further, a display / non-display selection process for selecting whether or not to draw the selected event item in the recorded image state window 202 is performed (step S5).

  On the other hand, when “user setting event registration” is selected in step S2B, user setting event registration processing is performed (step S6). The user can newly register an event used for “registered event display” or the like with an arbitrary name. As conditions for event occurrence, information obtained by analyzing the video signal obtained from the image input / output unit 110 by the CPU 116 and information obtained by analyzing various sensor signals obtained from the sensor input unit 111 by the CPU 116 can be used. Also, event registration is performed using the area of the event display window 204.

  On the other hand, when “single channel event linkage processing” is selected in step S2B, “single channel event linkage display” processing is performed (step S8A).

  Thereafter, event image reproduction processing is performed (step S7). In this event image playback process, the user confirms the occurrence status of the event displayed in the “registered event display” process in step S4 or the “single channel event linked display” process in step S8A, and performs the playback process of the recorded image. It can be carried out.

  FIG. 27 is a flowchart showing the “single channel event linkage display” processing procedure in step S8A. The same step processes as those in FIG. 20 of the second embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.

  First, a single event occurring between the same channels is analyzed to determine whether or not a “single channel event linkage” event has occurred (step S61A). If the “single channel event linkage” event has not occurred, the process ends as it is, and the process returns to the main process.

  On the other hand, if a “single channel event linkage” event has occurred, display according to a user instruction is selected from the “single channel event linkage” event search field displayed in the event display window 204 (step S62A). In this selection, a “single channel event linkage” event can be selected from the list of event contents “currently selected single channel event linkage” 2301.

  From the occurrence time column displayed in the event display window 204, the occurrence time of the “single channel event linkage” event according to the user's instruction is selected (step S63). Upon this selection, a list 2302 of all event occurrence times and channel information in “single channel event linkage” is displayed.

  Event information of the selected occurrence time is displayed on the event display window 204 (see FIG. 24, step S64). Further, event information of the selected occurrence time is displayed on the recorded image state window 202 (see FIG. 25, step S65).

  Thereafter, it is determined whether or not the cooperative reproduction button 2205 has been clicked (step S66). When the cooperative playback button 2205 is clicked, all the displayed single events are played back in order of time (step S67). After the reproduction is completed, the process proceeds to step S70.

  On the other hand, if the cooperative playback button 2205 is not clicked in step S66, it is determined whether or not the single playback button 2408 is clicked (step S68). When the single reproduction button 2408 is clicked, the selected single event is reproduced (step S69). After the reproduction is completed, the process proceeds to step S70. On the other hand, if the single playback button 2408 is not clicked, the process proceeds to step S70.

  It is determined whether or not the reproduction according to the user instruction is continued (step S70). When continuing the reproduction, the process returns to step S62A and the reproduction process is repeated. On the other hand, when the reproduction is not continued, this process is terminated and the process returns to the main process.

  According to the recorded image reproduction apparatus of the third embodiment, the user can intuitively understand at which time each individual event has occurred regarding the event of “single channel event cooperation”. Therefore, the recorded image of each event can be easily reproduced. As a result, it is possible to reduce the labor required for the search when the monitoring image is confirmed by the user.

  Here, the recorded image time axis display means, the event information display means, the display control means, and the list display means described in the claims are realized by the functions of the CPU 116 and the image input / output unit 110 and expressed on the display screen of the display 103. It is what is done. The recorded image time axis display means corresponds to the recorded image state window 202, and the event information display means corresponds to rectangular areas 902 and 903 displayed in the recorded image state window 202. The display control means corresponds to the processes of steps S12 and S13. Of these, the list display means corresponds to the list of registered events 803 and step S12, and the event information selection means corresponds to the process of step S13.

  The selection unit, the reproduction unit, the cooperation instruction unit, and the individual instruction unit are realized by the functions of the CPU 116. The selection means corresponds to the processing in steps S31 and S32, and the reproduction means corresponds to the processing in step S33. The cooperation instruction unit corresponds to the process of step S66, and the individual instruction unit corresponds to the process of step S68.

  The present invention is not limited to the configuration of the embodiment described above, and various modifications can be made within the scope of the claims.

  According to the above-described embodiment, even a user who is unfamiliar with the operation can intuitively understand the situation of which event has occurred in which channel and at what time on the recorded image state window. In addition, even when multiple registration events occur in multiple channels, you can intuitively understand the search results based on the combination conditions of multiple registration events on the recorded image status window without entering a complicated search expression. be able to. Thereby, the labor required for the search at the time of the monitoring image confirmation by the user can be reduced. Therefore, it is suitable for a security camera monitoring camera system and the like.

  The present invention has an effect that it is possible to easily understand at which time a plurality of events have occurred in which channel, and an effect that the user can easily determine narrowing down by a combination of a plurality of events. It is useful for a recorded image playback apparatus and a recorded image playback method that record an input image for each channel and play back a recorded image of a selected channel.

1 is a block diagram showing a configuration of a surveillance camera system according to a first embodiment of the present invention. The figure which shows the window for control displayed by starting the recording event display software in 1st Embodiment The figure which shows the recorded image status window in 1st Embodiment. The figure which shows the display switching window in 1st Embodiment. The figure which shows the event display window in 1st Embodiment. The figure which shows the specific example of the event display window in 1st Embodiment. The figure which shows the recorded image state window where the registration event in 1st Embodiment was displayed The figure which shows the color displayed on the recorded image status window at the time of the event selection in 1st Embodiment The flowchart which shows the operation | movement process sequence of the video recording event display software performed by CPU in 1st Embodiment. The flowchart which shows the registration event display processing procedure in step S4 which concerns on 1st Embodiment. The flowchart which shows the display / non-display selection processing procedure of the registration event in step S5 which concerns on 1st Embodiment. The flowchart which shows the event image reproduction | regeneration processing procedure in step S7 which concerns on 1st Embodiment. The flowchart which shows the date change process sequence in 1st Embodiment. The figure which shows the display switching window in 2nd Embodiment. The figure which shows the event display window in 2nd Embodiment. The figure which shows the event display window in 2nd Embodiment. The figure which shows the event display window when event name "Intruder detection (path 1)" is selected as event content of "multiple channel event cooperation" in 2nd Embodiment. The figure which shows the recording status display window in which "multiple channel event cooperation display" processing was performed in 2nd Embodiment The flowchart which shows the operation | movement process sequence of the multichannel event cooperation display display software performed by CPU in 2nd Embodiment. The flowchart which shows the "multi-channel event cooperation display" processing procedure in step S8 which concerns on 2nd Embodiment. The figure which shows the display switching window in 3rd Embodiment. The figure which shows the event display window in 3rd Embodiment. The figure which shows the event content of "single channel event cooperation", the generation | occurrence | production time of a "single channel event cooperation" event, and a generation channel in 3rd Embodiment The figure which shows the event display window at the time of selecting single channel event name "intruder detection (single channel)" in 3rd Embodiment The figure which shows the display result of the "single channel event cooperation display" process in the recording status display window which concerns on 3rd Embodiment The flowchart which shows the operation | movement process sequence of the multi-channel event cooperation display display software performed by CPU in 3rd Embodiment. The flowchart which shows the "single channel event cooperation display" process sequence in step S8A which concerns on 3rd Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Recorded image reproduction apparatus 101 Video camera 102 Sensor 103 Display 110 Image input / output part 111 Sensor input part 112 Image compression part 113 Image recording part 114 Secondary storage part 115 Image expansion part 116 CPU
117 Operation Input Unit 202 Recorded Image Status Window 203 Display Switching Window 204 Event Display Window

Claims (10)

A recorded image playback device that records an image input for each channel and plays back a recorded image of a selected channel,
Recorded image time axis display means for displaying the time axis of the recorded image for each channel on the screen of the display unit;
Event information display means for displaying event information generated at a corresponding time on the channel on the time axis of the recorded image for each channel;
Selection means for selecting a position on the time axis of the recorded image based on an instruction input from the operation input unit;
A recorded image reproduction apparatus comprising: reproduction means for reproducing a recorded image corresponding to the selected position.   2. The recorded image reproduction device according to claim 1, wherein the event information display means changes a display form of the plurality of overlapping event information when displaying the plurality of event information superimposed on the time axis of the recorded image of the same channel.   The recorded image reproduction apparatus according to claim 1, further comprising display control means for controlling whether or not the event information is displayed by the event information display means. The display control means includes
List display means for displaying a list of event information on the screen of the display unit;
4. The recorded image reproduction device according to claim 3, further comprising event information selection means for selecting event information displayed by the event information display means from the displayed list of event information.   In the screen, in addition to an area for displaying the time axis of the recorded image, an area for receiving an instruction on whether to display the event information, an area for displaying the list of event information, and an event from the list of event information 5. The recorded image reproduction apparatus according to claim 4, further comprising an area for receiving selection of information and an area for receiving an instruction to reproduce the recorded image. The event information display means links event information generated between a plurality of channels, displays the link information on the time axis of the recorded image,
The recorded image reproduction apparatus according to claim 1, wherein the selection unit selects cooperation information displayed on a time axis of the recorded image. The event information display means links a plurality of event information generated in the same channel, displays the link information on the time axis of the recorded image of the same channel,
The recorded image reproduction apparatus according to claim 1, wherein the selection unit selects cooperation information displayed on a time axis of the recorded image. Cooperation instruction means for instructing cooperative reproduction of a recorded image corresponding to the cooperation information;
Individual instruction means for instructing individual reproduction of a recorded image corresponding to the linkage information,
The playback unit plays back the recorded image corresponding to the linkage information in cooperation when the linkage instruction is instructed by the linkage instruction unit, and when the individual instruction is instructed by the individual instruction unit, 8. The recorded image reproduction device according to claim 6, wherein corresponding recorded images are individually reproduced. A recorded image playback method in a recorded image playback apparatus for recording an input image for each channel and playing back a recorded image of a selected channel,
A recorded image time axis display step for displaying a time axis of the recorded image for each channel on the screen of the display unit;
On the time axis of the recorded image for each channel, an event information display step for displaying event information that occurred at the corresponding time in the channel;
A selection step of selecting a position on the time axis of the recorded image based on an instruction input from the operation input unit;
A recorded image reproduction method comprising: a reproduction step of reproducing a recorded image corresponding to the selected position.   The program for functioning a computer as each means in the recorded image reproduction apparatus in any one of Claim 1 to 8.

Images