JP4361504B2 - VIDEO INFORMATION RECORDING / REPRODUCING METHOD, VIDEO INFORMATION PROCESSING METHOD, VIDEO INFORMATION RECORDING / REPRODUCING DEVICE, AND VIDEO INFORMATION PROCESSING DEVICE - Google Patents

Description

  The present invention relates to a video information recording / reproducing method and apparatus, and more particularly, to a processing method and apparatus for searching recorded video from a terminal connected via a network and applied to a surveillance camera application or the like. .

  In a conventional video signal recording device, a method of encoding a video signal input from a camera or the like when recording a video and recording the encoded video signal on a video tape, a hard disk, etc. is generally required. For such applications, for example, a method of recording with a reduced data size using an image compression technique such as JPEG (Joint Photographic Experts Group) is widely used.

  In addition, a technique for transmitting data compressed by this image compression technique to a remote place using a network technique such as a LAN or the Internet has been put into practical use and has become widespread.

  Furthermore, in monitoring applications, for important video locations such as when an event is detected by a sensor, the video recording position is associated with event information such as an alarm so that the video at that time can be identified later. It is often performed that the desired video is retrieved later.

  In such a situation, there is a problem of how efficiently a desired video can be searched from many recorded event-related images.

As an improvement measure, at the stage of recording the video on the storage medium, by reducing the image compression rate only when an event has occurred using means such as abnormality detection, a larger amount of code is allocated than usual. Some records are recorded with high image quality so that details can be confirmed at the time of search (for example, see Patent Document 1).
Alternatively, a plurality of encoding processing means for compressing an image, or a means for converting an image format separately from the encoding means, can be recorded in detail with an encoding form that can be easily seen on a network. There are those that perform two types of encodings (see, for example, Patent Document 2).

JP 2001-333380 A (2nd page, FIG. 1) JP 2004-254248 A (page 19, FIG. 1)

  However, in the conventional technique, when high-quality images are recorded in response to the occurrence of an event as in the above-mentioned document 1, visibility is improved by viewing high-quality images at the time of search, but search is performed via a network. When viewing, the data transfer takes time when the network bandwidth is not sufficient with respect to the amount of data, and there is a problem that it takes time for searching and viewing.

  Further, when the configuration is such that a plurality of encodings can be performed as in the above-mentioned document 2, the encoding control is realized in a case of one type of encoding means, whether realized by hardware or software. Compared with this, there is a problem that the configuration is complicated and the cost is increased.

The present invention has been made in order to solve the above-described problems, and improves searchability when searching for an event-related image recorded in a video recording / playback apparatus using a remote information processing apparatus via a network. The purpose is to let you.

The present invention
In a video information processing method for retrieving event occurrence images via a network,
A part of the frame image data related to the event occurrence received is decoded, the event occurrence time is arranged in time series in one axis direction, and the images before and after each event image are arranged in time axis in the direction orthogonal to the previous axis In addition, the present invention provides a video information processing method in which a plurality of two-dimensional images are displayed side by side .

As described above, according to the present invention, it is possible to improve searchability when searching for a recorded image related to an event via a network.

Embodiment 1 FIG.
FIG. 1 is a diagram for explaining a video information recording / reproducing apparatus according to Embodiment 1 of the present invention. More specifically, FIG. 1 is a block diagram for realizing the apparatus.

1, a video information recording / reproducing apparatus 1 includes an image input unit 2, an image encoding unit 3 that encodes and compresses an input image, a data storage unit 4, and image data and event data for writing to the storage unit. Data recording unit 5, data reading unit 6 for reading out recorded images and management data, image data part extraction control unit 7 for extracting a part of frame image data, image read out to a network such as a LAN or the Internet A data transmission unit 8 for transmitting data, a command reception unit 9 for obtaining a command such as a data transmission request from the network, an event signal input unit 10 from an external event generator, and an event process for processing the received event signal 11, image quality control during recording, or input via command receiver 9 Comprising a processing control unit 12 for operating in accordance with the command.
The data transmission unit 8 and the command reception unit 9 are connected to the video information processing apparatus 14 via a network 13 such as a LAN or the Internet.

  The video information processing device 14 is for viewing the image data recorded in the video information recording / reproducing means 1 via the network 13. For example, as shown in FIG. A data receiving unit 15 that receives data, a decoding unit 16 that decodes received image data, a display unit 17 that displays image data and the like, a control unit 18, an image data transmission request, an image search request, and the like The command transmission unit 19 for transmitting the message and the designation means 80 are included. The designation unit 80 is a unit that is operated by the user to specify a search range, a display method, and the like, and may be configured by a graphical user interface (GUI) as will be described later. It may be composed of parts. The control unit 18 receives a designation input from the designation unit 80 and controls the command transmission unit 19 to transmit a command, receives data in the data reception unit 15, decodes in the decoding unit 16, and displays on the display unit 17. Control etc.

  In FIG. 1, command input means directly connected to the video information recording / reproducing apparatus 1 for controlling the start and stop of recording, means for displaying the status of the device, and a frame for temporarily storing data during image processing Portions that do not directly affect the effects of the present invention, such as a memory, a directly connected display device, or a data decoding processing means for displaying recorded video, are omitted.

  In the video information recording / reproducing apparatus 1 according to the first embodiment, a video input from a camera or the like connected to the image input unit 2 is controlled by the processing control unit 12 to a predetermined image quality and recording interval, and the image encoding unit. 3, and the encoded data is recorded by the data recording unit 5 in the data storage unit 4 which is a data recording medium. Further, an external sensor or the like is connected to the event signal input unit 10, and when the sensor event is detected, the event signal processing unit 11 issues an event processing request to the processing control unit 12, and when the event occurs Record the images and events associated with each other.

  In addition, the video information recording / reproducing apparatus 1 sends a control request to the control processing unit 12 when receiving a transmission request for data recorded in the data storage unit 4 from the video information processing device 14 via the network 13 and the command receiving unit 9. The image data reading unit 6 reads the necessary frame image data from the data storage unit 4 and transmits the image data from the data transmission unit 8 to the video information processing apparatus via the network 13.

  The image encoding unit 3 according to the first embodiment performs embedded encoding having a hierarchy when encoding an input image. Coded data in a certain layer is selected from all data for one frame image. If extracted, the image is encoded so that an image having a quality corresponding to the extracted amount can be obtained. FIG. 3 shows an example of JPEG 2000 encoded data, which is one of the embedded encodings. FIG. 3 shows one frame of image data. In FIG. 3, 20 is a header storing information necessary for decoding the image data, and 21 to 26 are layers in which packet data is hierarchically divided. . FIG. 3 shows an example in which data is configured in six layers, in which 21 is a layer 1, 2 is a layer 2, 23 is a layer 3, 24 is a layer 4, 25 is a layer 5, and 26 is a layer 6. Layer 1 is composed of packets from packet 0 to packet 17, layer 2 is composed of packets from packet 18 to packet 35, layer 3 is composed of packets from packet 36 to packet 53, and layer 4 is a packet. 54 is composed of packets from packet 72 to packet 71, layer 5 is composed of packets from packet 72 to packet 89, and layer 6 is composed of packets from packet 90 to packet 107.

  Hierarchical data divided by layers as shown in FIG. 3 is composed of data with a coarser image quality as the layer number is smaller, and is arranged so that the image quality improves as the layer number increases. That is, when decoding is performed using only the data from packet 0 to packet 17 of layer 1, the image becomes the coarsest, and the image quality is improved by decoding using data from packet 0 to packet 35. When decoding is performed using all data from 0 to packet 107, the highest quality of the recorded image is obtained.

  When the command receiving unit 9 receives a recording image transmission request from the video information processing apparatus 14, the video information recording / reproducing apparatus 1 of the first embodiment searches for an event image to determine whether the request is a normal image transmission request. The processing control unit 12 determines whether the request is a request, and the image data partial extraction control unit 7 is operated only when it is determined that the request is an event image search request. During the operation of the image data partial extraction control unit 7, not all layers of each event image data are read, but only a part of the layers is read. That is, when reading all data, read the data of the header 20, the layer 1 data 21, the layer 2 data 22, the layer 3 data 23, the layer 4 data 24, the layer 5 data 25, and the layer 6 data 26 shown in FIG. However, in the first embodiment, only the data of the number of layers smaller than the total number of layers is read, and for example, only the header 20, the layer 1 data 21, the layer 2 data 22, and the layer 3 data 23 shown in FIG. Are sequentially transmitted from the data transmission unit 8 to the video information processing apparatus 14 in the order of event occurrence time.

  With this configuration, when searching for an event image via a network, for example, by transmitting only packets for three layers from encoded data recorded hierarchically in six layers, the amount of transmission data can be reduced. Since it can be about half of the normal time, it is possible to transmit a plurality of event image data at high speed, and as a result, the video information processing apparatus 14 can display a plurality of event images at high speed. It becomes possible. At this time, since it is not encoded again in another format as in the conventional example, it can be realized with a simple configuration.

  In addition, in this configuration, data is not recorded in the storage unit 4 for network transmission separately from the normal image quality, and thus there is an effect of suppressing an increase in recording data size in the storage unit 4.

  The method of determining the amount of transmission data at the time of event image search may be fixed, for example, a layer that is half the number of recording layers, or may be arbitrarily selected by the user, Alternatively, the number of layers may be variable according to the recording image quality. When the number of transmission layers at the time of event image search is variable, the amount of data per frame at the time of image recording can often be changed by the user according to the purpose and situation. A method of setting a transmission data size and selecting the number of layers closest to the data size can be considered. At this time, in order to exert the effect of the present embodiment, the target image data size must be smaller than the image data size at the time of recording.

  In addition, when the video information processing apparatus 14 decodes part of the hierarchical data received from the video information recording / reproducing apparatus 1, the video information recording is performed so that the data is less than the number of recorded hierarchical levels. The playback apparatus 1 can realize decoding by a method such as sending data indicating the number of transmission layers prior to frame image data.

Embodiment 2. FIG.
FIG. 4 is a diagram for explaining the operation of the video information recording / reproducing apparatus according to the second embodiment for carrying out the present invention, more specifically, a management data diagram for realizing the apparatus.

  In FIG. 4, 30 is an event management table, 31 is an event number, 32 is an event occurrence date, 33 is an event occurrence time, 34 is image designation information (image number) when the event occurs, and 35 is the image data. This is a recorded address in the data storage unit 4. The management table shown in FIG. 4 is recorded as management data in the data storage unit 4, the event occurrence order and the event occurrence date and time are managed in time series, and the image data recorded at that time is uniquely stored. Events and image data are associated with each other in the form of designated image numbers.

  When the event image data recorded by the video information recording / reproducing apparatus of the present embodiment is received from the video information processing apparatus via the network, the video information recording / reproducing apparatus The management data shown in FIG. 4 is read, an event image is searched, and a part of the data is sequentially transmitted. At this time, the video information recording apparatus according to the present embodiment also sends a frame image positioned before the event image and a frame image positioned after the event image in time series as the event-related images. The number of frame images before an event to be transmitted simultaneously and the number of post-event images to be transmitted simultaneously are set in advance.

  Data transmitted according to the present embodiment will be described with reference to FIGS. When the event image search request is received, the number of images before and after the event that is continuous with the event image is set to one image before the event image in time and three images after the event image. In the case of the case, first, when a data transmission request for event image search is received from the video information processing apparatus via the network, the control processing unit reads the management data 30 and searches for the earliest event in time. To do. In FIG. 4, the event number is 00001, and the event image number at this time is 102. At this time, the image before the time point of the event image is 101, and the three images after the event image are identified as 103, 104, and 105. Therefore, as shown in FIG. 5, the video information recording apparatus according to the present embodiment first transmits the 101st image, and then sequentially transmits the image data as 102, 103, 104, and 105. . Subsequently, the next event of time number 00001 is searched to identify the target event image. In the example of FIG. 4, the image No. 3055 is the second event image, and when the previous and subsequent images are searched from the management table 30 for the second event image, the image numbers No. 3054, No. 3056, No. 3057 , 3058 corresponds to the above data, and the data from 3054 to 3058 are transmitted in time series as shown in FIG. Thereafter, the same processing is repeated in the order of event occurrence. At this time, the video information recording apparatus of the present embodiment does not transmit all the data of all layers for any image, but transmits only the data of limited layers.

  With this configuration, a large number of event images and event-related image data can be transmitted at a high speed, and images before and after the event can be confirmed continuously with the event image by the video information processing apparatus received with these data. Therefore, the visibility can be improved when searching for a desired event.

  Note that the management table 30 is not limited to the form of the present embodiment. For example, the date and time information does not need to be directly a date or time value, and the date and time is calculated using an arithmetic operation or the like. It may be determined uniquely. For example, the date and time may be indicated by serial continuous values at the same time. For the purpose of another effect, other than the items in this management table, for example, the camera number and the output signal of the event sensor. There is no problem even if attribute data such as state is included.

  If event image data and event image data before and after the event image data do not exist, dummy data in which the entire area is white after decoding may be transmitted, or a unique marker indicating that there is no data is transmitted. The image information processing apparatus that has received the data may be processed by a method such as masking the target image.

Embodiment 3 FIG.
FIG. 6 is a diagram for explaining the operation of the video information recording / reproducing apparatus according to the third embodiment for practicing the present invention, and more specifically, a data configuration explanatory diagram for realizing the apparatus. FIG. 7 is a diagram for explaining a video information recording / reproducing apparatus according to Embodiment 3 for carrying out the present invention, and more specifically, a block diagram for realizing the apparatus.

  In FIG. 6, 50 is a data stream of one frame image, 51 is a main header including information for data decoding, 52 is stream data, and 53 is a marker indicating the end of data. In this main header, a segment for indicating the encoding format is defined, and in this portion, the number of layers in which the main image data is encoded is described. In FIG. 7, reference numeral 60 denotes a header rewriting unit. In addition, the parts denoted by the same reference numerals as those in FIG. 1 are the same as or correspond to those in FIG.

  The video information recording / reproducing apparatus according to the third embodiment is hierarchically recorded in the data storage unit 4 when an event image search request is received from the video information processing apparatus 14 via the network 13 in FIG. Only a part of the frame image data is transmitted from the data transmission unit 8. In this embodiment, when data of only a part of the hierarchy is transmitted instead of the entire hierarchy data in this embodiment, the header rewrite unit 60 rewrites the parameter of the number of hierarchies described in the header for each frame image data. To be sent. For example, in the data recorded in 6 layers at the time of recording, a value of 6 is written as the number of layers in the header, but when only 3 layers are transmitted at the time of data transmission, this value is rewritten to 3 and the data is Send. Further, a marker 53 indicating the end position of data is also added so as to be positioned at the end of the data constituted by a part of the hierarchy. Note that the rewriting of the header is performed only on the transmission data, and the header of the data itself recorded in the data storage unit 4 is not rewritten.

  With this configuration, the video information processing apparatus 14 that has received the image data from the video information recording / reproducing apparatus 1 according to the third embodiment via the network has encoded data that is configured with only partial hierarchical data. Even so, it is possible to perform the decoding process without changing the processing configuration from the data composed of all the normal data.

Embodiment 4 FIG.
FIG. 8 is a diagram for explaining a video information processing apparatus according to Embodiment 4 for carrying out the present invention, and more specifically, a diagram showing a display state of an image obtained by decoding received data. .

  In FIG. 8, 70 is a display screen of the display unit 17 of the video information processing apparatus 14, 71 is an arrow indicating an event occurrence order or time, 72 is an arrow indicating the frame arrangement direction before and after the event, and 73 is a direction indicated by the arrow 71. A scroll bar for scrolling the display image, and is operated by a mouse or the like (not shown). Also, 201 is an event image when an event occurs, 200 is an event-related image one frame before the event image 201, 202 is an event-related image one frame after 201, 203 is an image two frames after the event image 201, Reference numeral 204 denotes an event-related image three frames after the event image 201. Similarly, 211 is the next event image of 201, 210 to 214 are event-related images before and after the event image 211, 220 to 224 are the next event of the event image 221, and the event-related images before and after that, 230 to Reference numeral 234 denotes an event related image before and after the event next to the event image 231.

  In the present embodiment, in the process of searching for desired data from the recorded data at the time of event occurrence via the network, the data at the time of event occurrence and data before and after the event occurrence are received and decoded, and the arrows in FIG. Event images are displayed in chronological order in the vertical direction indicated by 71, and frame images before and after the occurrence of the event are displayed in chronological order in the horizontal direction indicated by an arrow 72 that is orthogonal to the axis. When a large number of events occur and cannot be displayed in the display device, the display range can be changed in the event occurrence time-series direction using the scroll bar 73.

  When data is received from the network, the data is displayed in a state inferior to the original image quality of the recorded image because a part of the data layer that is a feature of the present invention is received.

  Here, as an example, a case will be described in which an image of a room having a door for entering and leaving is recorded by a camera, and an event trigger is set when the door is opened. An alarm is generated when the door is opened, and image data at that time is recorded in association with the event. When searching for an image recorded in this way, on the display screen for searching in this embodiment, the image 201 is an image at the time when the door is opened for the first time, and 200 is before the event occurs. Images 202 to 204 are images after the occurrence of the event. The next row 211 is an event image when the door is opened for the second time, and 210 and 212 to 214 are images before and after the event image 211. Similarly, each event image is displayed in chronological order in the order of event occurrence in the direction of the arrow 71 on the screen, and in addition, the images before and after that are displayed side by side in the direction of the arrow 72. In the configuration of this embodiment, since the image quality of each frame image is coarse, it is difficult to obtain information on the details of the person from the display image, but the gender and physical characteristics of the person shown in the image are sufficient. It is possible to discriminate, and because the frame images before and after the event image are displayed side by side along the time axis, the behavior of the person can also be discriminated. For example, `` Suspicious tall man who entered the room with the door open '' When a recorded video is searched for such an event, it is possible to search at a glance which event image is a desired image at a glance, thereby realizing a significant improvement in searchability.

  Note that when image data composed of only a part of layers is decoded, the image quality naturally deteriorates compared to the case of decoding images using all layers. If a 30 Kbyte code is assigned and this image is hierarchically structured with six levels of image quality, it is possible to discriminate the gender and physical characteristics of a person even with a data amount of about 5 Kbytes corresponding to one layer. It was.

Embodiment 5 FIG.
FIG. 9 is a diagram for explaining a video information processing apparatus according to Embodiment 5 for carrying out the present invention, and more specifically, a diagram showing a display unit for an image obtained by decoding received data. .

  In FIG. 9, the same reference numerals as those in FIG. 8 denote the same or corresponding parts. In FIG. 9, 81 is an input box for designating the start date and time of the search range, 82 is an input box for designating the end date and time of the search range, and 83 is the number of frames of the image before the event to be displayed side by side with the event image. An input box 84 is an input box for the number of frames of the post-event image to be displayed side by side with the event image, and 85 is displayed by skipping the image before and after the event to be displayed side by side with the event image with respect to the frame interval at the time of recording. A frame skip input box 86 designates an event search execution button for starting an event search.

  When searching for an event image via the network in the video processing apparatus according to the present embodiment, it is possible to specify a search time range in the search start date / time input box 81 and the search end date / time input box 82. Normally, when monitoring video or the like is recorded by a video information recording device, it is generally recorded continuously over a plurality of days, so a plurality of event image data are stored in the storage unit of the video information recording / reproducing device. Is generally recorded, and therefore there may be a case where a very large number of event images exist depending on event conditions. In the present embodiment, when a search range can be specified in the search start date / time input box 81 and the search end date / time input box 82, a plurality of event images and images before and after the event image are displayed two-dimensionally. Since it is possible to prevent reading an enormous number of image data via the network, it is not necessary to spend a long time for display, and as a result, a comfortable operation at the time of search is realized.

  Further, when searching for an event image via the network in the video processing apparatus according to the present embodiment, the number of images before and after the event to be displayed side by side with the event image is set as the pre-event frame number input box 83 and the post-event frame number input box 84. It is possible to specify with. For example, if the search target of the target search video is hardly moving, even if the number of frames before and after is reduced, the number of data transmission images can be reduced without reducing the amount of recognition information, so that High-speed display can be realized, and when the object moves greatly, the operational features of the object can be seen by increasing the number of display frames before and after. As described above, according to the configuration of the present embodiment, it is possible to realize a display form suitable for the search according to the characteristics of the search target video, and improve the visibility during the search.

  In addition, when searching for an event image via the network in the video processing apparatus according to the present embodiment, the related image before and after the event displayed side by side with the event image in the frame skip input box is not limited to a continuous frame from the event image. , It can be specified by skipping at the specified frame. In a video information recording apparatus that records for a long time, in order to perform a long-time recording on a storage medium of a finite capacity, a method of adjusting the interval between recorded videos is generally used, for example, 1 second according to the recording application. A method of adjusting the frame interval is widely used, such as recording only frame images at intervals, or recording images at intervals of 0.1 seconds when finer recording is required. In particular, when an event due to an alarm occurs, the video of that portion is considered to be important and tends to be recorded at shorter time intervals. In this case, if the image of the event and the images before and after the event are displayed at the same frame interval as when they were recorded, there arises a problem that the image before and after the event and the event image have substantially the same contents. In other words, if event images are recorded at intervals of 0.1 seconds, only the information in the range of 0.3 seconds can be obtained from the image of the three frames after the event from the occurrence of the event. Because of this, there will be less cognitive information. In this embodiment, since the frame display interval can be specified from the frame skip input box, the display time range can be adjusted. For example, 10 frames can be skipped for images recorded at intervals of 0.1 seconds. The event + 1 is the image 1 second after the event image, the event + 2 is the image 2 seconds after the event occurrence, the event + 3 is the image 3 seconds after the event occurrence, and the number of displayed images is the same. A wide range of images can be displayed over time, and the amount of information during search is improved.

  In this embodiment, as shown in FIG. 9, the search range designation, display frame number designation, and frame skip designation are input using a dialog on the screen, and a graphical user interface having a dialog box is searched. The means for designating the range, the display frame, and the number of frame skips (designating means indicated by reference numeral 80 in FIG. 2) is configured. However, the method for designating these values is not limited to this embodiment. For example, the main body of the video processing apparatus may be provided with another form such as a graphical user interface button or key input unit for setting these parameters, which is used as a designation means.

  In addition, it is not necessary for the user to specify all of the search range specification, display frame number specification, and frame skip specification described in the present embodiment, and the video information processing apparatus automatically performs a part based on information set in advance. It may be set with.

Embodiment 6 FIG.
FIG. 10 is a diagram for explaining a video information processing apparatus according to Embodiment 6 for carrying out the present invention, and more specifically, a diagram showing a display unit for an image obtained by decoding received data. .

  10, the same reference numerals as those in FIG. 8 denote the same or corresponding parts. In FIG. 10, reference numeral 91 denotes an input box for the number of pixels in the width direction of the image display area.

  FIG. 10 shows an example in which the number of frames after the event is set to 5. In this embodiment, the display area width direction size is acquired from the area width size input box 91, and the display area width direction size and Searching for event images because each frame image is reduced and displayed so that one event-related image fits in one horizontal row from the number of frames before and after the event that are displayed side by side at the same time as one event image Improve visibility at the time.

  The method of determining the size of each frame image may be calculated from the acquired area width size, the number of images displayed side by side at the same time, and the interval size between the images. Alternatively, a method of changing in a stepwise manner so that the minimum size can be accommodated in the display area may be used.

  Note that FIG. 10 shows a method of inputting the width dimension of the display area from the input box 91 on the screen, but the processing unit for displaying the image in the width direction of the display area places the image on the display device. A method of automatically obtaining from a processing unit that performs drawing may be used.

  That is, when a plurality of event-related images are displayed two-dimensionally as described above, the image resolution of the display unit 17 is acquired, and the specified number of frame images to be displayed side by side with respect to one event image and the acquired images The frame image size to be automatically displayed may be changed based on the resolution.

Embodiment 7 FIG.
FIG. 11 is a diagram for explaining a video information processing apparatus according to Embodiment 7 for carrying out the present invention, and more specifically, a diagram showing a display unit for an image obtained by decoding received data. . FIG. 12 is a diagram showing the image display unit after state transition from FIG. 11 in the present embodiment. FIG. 13 is another example of FIG. 11, and 120 to 123 are event selection buttons.

  11 and 12, the same reference numerals as those in FIG. 8 denote the same or corresponding parts. 11, 101 is a frame image selection frame, FIG. 112 is a frame image instruction pointer, and 103 is a moving image playback button. In FIG. 12, 110 is a moving image playback area, and 111 is a moving image stop button.

  In the video information processing apparatus according to the seventh embodiment, when the event image is searched, the event image 201 is displayed in the display screen 70 of the display unit 17 in the vertical direction in the order in which the events occurred, as shown in FIG. 211, 221, 231 are arranged side by side, and the frame images before and after the event image are arranged in time series in the horizontal direction, and are displayed with coarser image quality than the recording state. When a desired event image is found in this display state, or when it is desired to confirm more detailed information than the currently displayed image quality, a frame image instruction pointer is used using a mouse connected to the video processing device. 102 is moved onto a desired image, and after the frame image selection frame 101 is displayed, the playback button 103 is pressed to change to the two-dimensional display screen that has been displayed so far, as shown in FIG. As described above, images from frames designated in the moving image reproduction area 110 are sequentially displayed and displayed as moving images.

  As shown in FIG. 11, when two-dimensional display of a plurality of images was performed, only a partial layer of recorded data was received and displayed with a coarse image quality compared to the image quality at the time of recording. As shown in the above, when displaying as a moving image for detailed confirmation, data of all layers of the recorded data is obtained. With this configuration, it is possible to view with the highest recorded image quality, so that there is an effect of realizing confirmation in detail. Moreover, since the recording is not performed in two types of formats, the capacity of the storage device is efficiently used.

  In this embodiment, a desired image is selected using a mouse connected to the video information processing apparatus. However, the image selection means is not limited to a mouse, and other pointing devices may be used. It is also possible to use up / down / left / right instruction keys of a keyboard connected to the video processing apparatus, or to select an image by hardware means such as a button provided directly on the video processing apparatus. Also good. In addition to the method of selecting one image as described in FIG. 11, selection of desired events is provided with selection buttons 120 to 123 for selecting each event as shown in FIG. It may be a method of selecting in the group.

  Although the embodiments have been described above, in any of the embodiments, the video recording / playback apparatus may be configured with dedicated hardware, or realized by software processing means on a general-purpose personal computer. Also good. Similarly, the video processing apparatus may be configured with hardware, or may be realized by processing means using software on a general-purpose personal computer.

  In any of the embodiments, an alarm signal that triggers an event image is not limited to an externally input alarm signal, but a video information recording / reproducing apparatus that uses a motion detection process that uses a video difference signal or the like during image recording. It may be an event that occurs inside the computer, or may be manually input by a person, for example, a supervisor using a foot switch or the like. Further, the present invention is not limited to means directly connected to the video information recording / reproducing apparatus, but may be a form for receiving an event signal via a network. Further, the number of events is not limited to one, and a plurality of event generation means may exist, and a combination of a plurality of event conditions may be used as a trigger.

  In addition, although this embodiment has been described in the form of processing in units of frames, the principles and effects of the present invention are also applied to those recorded as interlaced field image data. In this case, it is only necessary to display a frame image by using a field synthesis process or an interpolation process widely used as a known technique at the stage of displaying a plurality of images two-dimensionally.

1 is a block diagram for explaining a video information recording / reproducing apparatus according to Embodiment 1. FIG. It is a block diagram which shows the outline | summary of a structure of the video information processing apparatus of FIG. FIG. 3 is a configuration diagram of a hierarchical structure data format for explaining the video information recording / reproducing apparatus of the first embodiment. FIG. 10 is a configuration diagram of management data for explaining a video information recording / reproducing apparatus of a second embodiment. FIG. 10 is an explanatory diagram of a data transmission order for explaining the video information recording / reproducing apparatus of the second embodiment. FIG. 10 is a configuration diagram of a data structure for explaining a video information recording / reproducing apparatus according to a third embodiment. FIG. 10 is a block diagram for explaining a video information recording / reproducing apparatus according to a third embodiment. FIG. 10 is a configuration diagram of a display unit for explaining a video information processing apparatus according to a fourth embodiment. FIG. 10 is a configuration diagram of a display unit for explaining a video information processing apparatus according to a fifth embodiment. FIG. 10 is a configuration diagram of a display unit for explaining a video information processing apparatus according to a sixth embodiment. FIG. 10 is a configuration diagram of a display unit for explaining a video information processing apparatus according to a seventh embodiment. FIG. 10 is a configuration diagram of a display unit for explaining a video information processing apparatus according to a seventh embodiment. FIG. 10 is a configuration diagram of a display unit for explaining a video information processing apparatus according to a seventh embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Image | video information recording / reproducing apparatus, 2 Image input part, 3 Image encoding part, 4 Data storage part, 5 Data recording part, 6 Data reading part, 7 Image data partial extraction control part, 8 Data transmission part, 9 Command receiving part , 10 event signal input unit, 11 event processing unit, 12 control processing unit, 13 network, 14 video information processing device, 15 data receiving unit, 16 decoding unit, 17 display unit, 18 control unit, 19 command transmission unit, 20 Header, 21 layer 1, 22 layer 2, 23 layer 3, 24 layer 4, 25 layer 5, 26 layer 6, 30 event management table, 31 event number, 32 event occurrence date, 33 event occurrence time, 34 image number, 35 Recording address, 50 1 image data 51 main header, 52 stream data, 53 data end marker, 60 header rewrite unit, 70 display screen, 71 event direction arrow, 72 event related image direction arrow, 73 scroll bar, 80 designation means, 81 search start date input Box, 82 search end date and time input box, 83 frame number before event input box, 84 frame number after event input box, 85 frame interval input box, 86 event search execution button, 91 display area width input box, 101 frame image selection frame, 102 frame image instruction pointer, 103 video playback button, 110 video playback area, 111 video playback stop button, 120 event selection button, 121 event selection button, 122 Event selection button, 123 Event selection button, 200 Image before event, 201 Event image, 202 Image after event, 203 Image after event, 204 Image after event, 210 Image before event, 211 Event image, 212 Event image, 213 After event Images, 214 post-event images, 220 pre-event images, 221 event images, 222 post-event images, 223 post-event images, 224 post-event images, 230 pre-event images, 231 event images, 232 post-event images, 233 post-event images, 234 Post-event image.

Claims (13)

In a video information processing method for retrieving event occurrence images via a network,
A part of the frame image data related to the event occurrence received is decoded, the event occurrence time is arranged in time series in one axis direction, and the images before and after each event image are arranged in time axis in the direction orthogonal to the previous axis. A video information processing method for displaying a plurality of images two-dimensionally. When requesting transmission of a part of the frame image data related to the event occurrence, the search start date / time, the search end date / time, the number of frames to be displayed before the event, the number of frames to be displayed after the event, or the frame skip interval The video information processing method according to claim 1 , wherein one or more of the two are designated. When displaying a plurality of event-related images two-dimensionally, the image resolution of the display means is acquired, and automatically from the specified number of frame images to be displayed side by side with respect to one event image and the acquired image resolution The video information processing method according to claim 1 , wherein a frame image size to be displayed is changed. In a video information processing method for playing back video recorded in a video information recording apparatus storing event image data via a network,
Obtain only a part of each recorded frame image data and display two-dimensional multiple images,
A video information processing method characterized in that, by specifying a desired image from among the displayed images, all the data recorded in each frame is acquired and continuously reproduced. .   A video information recording / playback processing method for recording and playing back image data used in the video information processing method according to claim 1,
  Record that an event has occurred when at least one event signal is input and the recording address of the recorded image data at that time,
  Recorded frame image data when a data transmission request for retrieving an image recorded when the event occurs is received from the video information processing apparatus that implements the video information processing method via the network. Are sequentially read out and transmitted to the video information processing apparatus via the network.
  And a video information recording / reproducing processing method.   6. The video information recording / reproducing processing method according to claim 5, wherein in the encoding of the image, frame image data is hierarchically encoded.   6. The video information according to claim 5, wherein when only a part of the hierarchically encoded frame image data is transmitted, a part of header information indicating an attribute of the frame image data is changed. Recording / playback processing method. Means for receiving frame image data via a network;
Means for decoding the received encoded data;
Means for displaying the decrypted image;
Only the partial hierarchical data of each frame of the frame image data related to the event occurrence is acquired by the data receiving means and decoded by the decoding means, and the decoded event-related image is displayed on the display screen of the display means In the above, event occurrence times are arranged in time series in one axis direction, and images before and after the frame image at the time of each event occurrence are arranged in a direction orthogonal to the axis of the event occurrence time so as to be two-dimensionally plural. A video information processing apparatus comprising: control means for displaying. 9. The video information processing apparatus according to claim 8 , further comprising means for designating a search start date and time, a search end date and time, and the number of frame images before and after the event when requesting transmission of event-related image data. 9. The video information processing apparatus according to claim 8 , further comprising means for designating a desired one frame from the two-dimensionally displayed images.   A video information recording / playback processing device for recording and playing back image data used in the video information processing device according to any one of claims 8 to 10,
  A recording unit that records that an event has occurred when at least one or more event signals are input and a recording address of the recording image data at that time;
  A part of the frame image data recorded in the recording means when a data transmission request for retrieving an image recorded when the event occurs is received from the video information processing apparatus via the network. Are sequentially read out and sent to the video information processing apparatus via the network.
  And a video information recording / reproducing processing apparatus.   12. The video information recording / playback processing apparatus according to claim 11, wherein in the encoding of the image, frame image data is hierarchically encoded.   12. The video information according to claim 11, wherein when only a part of the frame image data encoded hierarchically is transmitted, a part of header information indicating an attribute of the frame image data is changed. Recording / playback processing device.

Images