JP2010219796A - Video data display device and video data display method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To allow a user to comfortably browse a video content at high speed while allowing the user to grasp contents of a moving image by minimizing the use of a storage device even if the video content is a mixture of a still image and a moving image. <P>SOLUTION: A video data display device includes a first reading means for reading first video data from a storage device, a delay time calculating means that calculates a time taken for displaying at least a part of the first video data on the basis of the first video data read by the first reading means, a video data generating means that generates second video data on the basis of a time calculated by the delay time calculating means and the first video data, and a video data recording means that records the second video data generated by the video data generating means in the storage device. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a video data display device and a video data display method.

In recent years, with the spread of digital still cameras capable of shooting still images and moving images and digital recorders that record video content of television broadcasts, the number of digital moving image content managed by individuals has increased dramatically. Therefore, many methods for searching / browsing desired video content from owned video content have been proposed.
Generally, when searching / browsing desired video content from owned video content, one or more (for example, 4) video frames are extracted from the video to generate a single frame thumbnail, and the same as a still image thumbnail Browse thumbnails side by side. Further, Patent Document 1 proposes that a thumbnail of a frame immediately after a scene change or a thumbnail of a frame at a certain time interval is created and displayed in a frame-by-frame manner so that the outline of video content is grasped. Yes.

However, in addition to not being able to view the video content as a video, there is no information obtained from the sound, and finally confirmation of the content is performed using application software that plays the video . This method does not allow seamless and interactive browsing operations.
However, in order to view and display the content of video content as a video during browsing, it is necessary to read and decode the video data itself, and play it back. It is necessary to wait. This waiting time dramatically increases as the moving image content has higher image quality and higher resolution. Such a situation becomes conspicuous even in an embedded device that does not have a high-performance decoding processing means. In the case of browsing only a still image, it is possible to improve responsiveness by prefetching image data and caching it. However, when moving images are mixed, it is difficult to cache moving images because the amount of data is larger than that of still images.
In order to solve this, in Patent Document 2, a moving image thumbnail is prepared for each chapter of the moving image content, and the prepared moving image thumbnail is reproduced for a specified time. By preparing the moving image thumbnail in this way, it becomes possible to quickly reproduce and display.

JP-A-10-284948 JP 2007-116385 A

  However, if the specified time is too short, there is a possibility that the part to be viewed will not be reproduced. In addition, when a moving image thumbnail corresponding to the entire moving image is prepared for a long time, it is necessary to store the video data twice, resulting in waste.

  The present invention has been made in view of such a problem, and even in the case of video content in which still images and moving images are mixed, the use of a storage device is minimized, including the grasping of moving image contents, and The purpose is to enable comfortable viewing of video content.

  Therefore, the present invention provides at least the first video data based on the first reading means for reading the first video data from the storage device and the first video data read by the first reading means. The second video data is generated based on the delay time calculation means for calculating the time required to display a part of the image, the time obtained by the delay time calculation means, and the first video data Video data generating means for performing recording, and video data recording means for recording the second video data generated by the video data generating means on a storage device.

  According to the present invention, even in the case of video content in which still images and moving images are mixed, the use of the storage device is minimized, and the video content can be browsed comfortably at high speed including grasping the content of the moving images. be able to.

It is a figure which shows an example of the system configuration | structure of a video data display system. It is a figure which shows an example of the hardware constitutions of a video data display apparatus. It is a figure which shows an example of a function structure etc. of a video data display apparatus. 4 is a flowchart illustrating an example of processing for generating a moving image thumbnail from original moving image data in the video data display device according to the first embodiment. It is a figure which shows an example of the calculation method of delay time and the number of frames in a video data display apparatus. It is a figure which shows an example of the moving image thumbnail produced | generated in a video data display apparatus. It is a figure which shows an example of the display screen produced | generated with a video data display apparatus and displayed on a display apparatus. It is a flowchart which shows an example of the process of the video data display in a video data display apparatus. It is the figure which showed typically the order of the frame image displayed when the video content corresponding to the case of the moving image data of FIG. 6 is selected. 12 is a flowchart illustrating an example of processing for generating a moving image thumbnail from original moving image data in the video data display device according to the second embodiment.

<First Embodiment>
DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, a first embodiment of the invention will be described with reference to the drawings.
FIG. 1 is a diagram illustrating an example of a system configuration of a video data display system.
Reference numeral 1 denotes a video data display device. Reference numeral 2 denotes a display device that displays a user interface for browsing video data. Reference numeral 3 denotes an operation input device that performs browsing operation of video data.

FIG. 2 is a diagram illustrating an example of a hardware configuration of the video data display apparatus.
In FIG. 2, a CPU (Central Processing Unit) 21 executes control programs stored in a ROM (Read Only Memory) 22 and an HDD (Hard Disk Drive) 23 to control each device.
The ROM 22 holds various control programs and data.
A RAM 24 (Random Access Memory) has a work area for the CPU 21, a data save area during error processing, a control program load area, and the like.
The HDD 23 stores various control programs and various data. The network interface (Net-IF) 25 can communicate with the display device 2, the operation input device 3, and the like via wired or wireless.

The CPU bus 27 includes an address bus, a data bus, and a control bus.
The control program may be stored in advance in the ROM 22 and the HDD 23, or may be stored in the ROM 22 and the HDD 23 from another information device or the like via the network 206.
The CPU 21 of the video data display device 1 executes processing based on a program stored in the ROM 22 or the HDD 23 of the video data display device 1. Thereby, a part of the function of the video data display apparatus 1 as shown in FIG. 3 described later, or a process related to a flowchart described later is realized.

FIG. 3 is a diagram illustrating an example of a functional configuration of the video data display device.
Reference numeral 101 denotes a video data storage medium that stores video data. For convenience, the video data storage medium 101 will be described as a configuration provided in, for example, the RAM 24 or the HDD 23 in the video data display device. However, the video data storage medium 101 may be an external device. Reference numeral 102 denotes a first video data reading unit for reading the first video data, and means for reading the original moving image data. Reference numeral 103 denotes a delay time calculation unit that calculates the time from when the original moving image data is selected until it can be displayed.

  A video data generation unit 104 generates second video data, that is, video thumbnails, from the original video data. Reference numeral 105 denotes a video data recording unit that records the generated moving image thumbnail in the video data storage medium 101. Reference numeral 111 denotes a second video data reading unit that reads the second video data, and is a unit that reads a moving image thumbnail generated by the video data generation unit 104. Reference numeral 113 denotes a first decoding processing unit that decodes original moving image data. Reference numeral 112 denotes a second decoding processing unit that decodes moving image thumbnails.

  A display image generation unit 114 generates a display image using the original moving image data decoded by the first decoding processing unit 113 and the moving image thumbnail decoded by the second decoding processing unit 113. . The display image generated by the display image generation unit 114 is output from the display output unit 115 and displayed on the display device 2. 116 determines whether to generate a display image using the original moving image data decoded by the first decoding processing unit 113 or the moving image thumbnail decoded by the second decoding processing unit 113 It is a display switching unit that gives instructions. An operation receiving unit 121 receives a user operation for selecting video content. Here, the first and second video data reading units, the first and second decoding processing units, the display image generating unit, the display output unit, the display switching unit, and the operation receiving unit are described as configurations in the apparatus for convenience. However, it may exist in an external device such as the display device 2. In this case, since it is necessary to generate a moving image thumbnail, the first video data reading unit is also required in the apparatus.

FIG. 4 is a flowchart illustrating an example of processing for generating a moving image thumbnail from original moving image data in the video data display device according to the first embodiment.
The first video data reading unit 102 reads the original moving image data from the video data storage medium 101 (S101) (first reading). The first video data reading unit 102 reads the bit rate of the original moving image data from the header information of the read moving image data (S102), and passes it to the delay time calculation unit 103. The delay time calculation unit 103 calculates a delay time from the bit rate (S103). Further, the first video data reading unit 102 reads the frame rate from the header information of the read moving image data and passes it to the video data generation unit 104. The video data generation unit 104 calculates the number of frames for the delay time using the frame rate and the delay time obtained by the calculation by the delay time calculation unit 103 (S104). Note that a more specific example of the calculation of the delay time and the number of frames will be described later and will not be described here. Thereafter, the video data generation unit 104 generates moving image thumbnails for the calculated number of frames from the original moving image data (S105). The video data recording unit 105 records the generated moving image thumbnail in the video data storage medium 101, and ends the process shown in FIG.

FIG. 5 is a diagram illustrating an example of a calculation method of the delay time and the number of frames in the video data display device.
In the example of FIG. 5, the bit rate of the original moving image data, which is a parameter depending on the original moving image data, is R1 (bps), and the frame rate of the original moving image data is F1 (FPS). Further, in the example of FIG. 5, the buffering length of the decoder is T1 (sec) as a parameter depending on the apparatus based on the compression method of the original moving image data. For example, when the compression method is MPEG, a decoder that decodes moving image data generally performs buffering for each GOP (Group Of Pictures), and buffers frames until the next GOP can be prepared for decoding. . Furthermore, a certain amount of buffering is generally performed to absorb fluctuations in the transfer rate. Next, in the example of FIG. 5, as a parameter depending on the performance of the apparatus, the bit rate for reading moving image data from the recording medium is R2 (bps), and the longest seek time of the recording medium is T1 (sec). For example, when the recording medium is a hard disk drive, generally, the head portion for reading data moves in the radial direction of the disk, and the disk rotates to read the data. At this time, the time until the head and the disk move from the head position before the movement to the head of the data is called a seek time, and there are variations depending on the head position before the movement and the position where the data is written. Therefore, in this embodiment, the longest seek time is adopted. From these values, the delay time T3 is T1 + T2 ÷ (R2 ÷ R1). Here, the arithmetic expression for obtaining the delay time T3 is an example, and the video data display device takes into consideration the decoding processing characteristics of the dedecoder according to the resolution of the moving image, data transfer, initialization time of the decoder, and processing of the entire system. You may also take into account the fluctuation of performance. Using the delay time T3 and the frame rate of the original moving image data, the number of frames of the moving image thumbnail to be generated is determined as F1 × T3 by the video data display device.

FIG. 6 is a diagram illustrating an example of a moving image thumbnail generated in the video data display device.
Reference numeral 400 is a schematic representation of the original moving image data. Reference numerals 401 to 418 schematically illustrate moving image frames related to original moving image data. Reference numeral 400-1 is a schematic diagram of moving image thumbnail data relating to original moving image data. Reference numerals 401-1 to 412-1 schematically illustrate moving image frames of moving image thumbnail data corresponding to moving image frames related to original moving image data. The video data generation unit 104 generates video thumbnail data having a data length that can be displayed within the delay time T3 from the original video data based on the delay time T3. For example, when generating a moving image thumbnail compressed in the Motion JPEG format from original moving image data compressed in the MPEG format, the video data generation unit 104 decodes the original moving image data for each GOP, Sort in order. Next, the video data generation unit 104 compresses each decoded moving image frame into the JPEG format, and generates moving image thumbnail data (within the time) for a delay time T3 together with time information given for each frame. . At this time, it is desirable that the video data generation unit 104 sets the frame image generated for each frame to a thumbnail image with a reduced resolution in consideration of a time from reading to display described later. Furthermore, it is desirable that the compression method can perform decoding processing at a high speed such as Motion JPEG used in the description of the present embodiment.

FIG. 7 is a diagram illustrating an example of a display screen generated by the video data display device and displayed on the display device.
Reference numerals 210 to 290 denote video data icons for displaying images for browsing individual video data. Reference numeral 201 denotes a page display delimiter, which shows a page in which nine video data icons are grouped for convenience. Reference numerals 202 and 203 denote indicators that indicate an operation for changing the displayed page. Reference numeral 204 denotes a focus display of the selected video data icon.
Here, the video data icon is an object having a smaller size or a smaller data amount than the video data representing the content of the video data.

FIG. 8 is a flowchart illustrating an example of video data display processing in the video data display device.
The operation receiving unit 121 waits until a new operation input is received (S701). When the operation input is received and the operation input is not an operation input for selecting video content (“No” in S702), but in the case of an end instruction (“Yes” in S711), the operation receiving unit 121 performs the processing illustrated in FIG. Exit. If it is not an end process (“No” in S711), the video data display device 1 performs a process (not shown) defined in advance, and returns to a standby state for operation input. When the received operation input is a new video content selection instruction (“Yes” in S702), the display output unit 115 moves the focus display 204 to the selected video content. Then, the second video data reading unit 111 reads a moving image thumbnail (second reading). The second decoding processing unit 112 performs a moving image thumbnail decoding process. Then, the display image generation unit 114 and the display output unit 115 start displaying video content within the focus display (S703).

When the reading of the moving image thumbnail is completed, the first video data reading unit 102 starts reading the original moving image data while performing decoding processing and display of the moving image thumbnail (S704). Next, the first decoding processing unit 113 sequentially reads out the read original moving image data up to the GOP including the frame next to the final frame of the moving image thumbnail, and sequentially performs the decoding processing in units of GOPs. Further, the first decoding processing unit 113 buffers the frame image of the original moving image data decoded after the last frame of the moving image thumbnail (S705). The first decoding processing unit 113 sequentially decodes and buffers frames based on the original moving image data frame corresponding to the position of the final frame of the moving image thumbnail data (for example, from the frame). You may do it.
When the original moving image data becomes displayable and display image generation using the final frame of the moving image thumbnail ends (“Yes” in S706), the first decoding processing unit 113 reads the original moving image from the buffer. Read the frame image of the data. Then, the display switching unit 116 switches processing so as to generate a display image (S707). For example, after at least part of the original moving image data is decoded by the first decoding processing unit 113, the display switching unit 116 switches the moving image thumbnail data so that the original moving image data and display are continuous.

FIG. 9 is a diagram schematically showing the order of frame images displayed when video content corresponding to the moving image data of FIG. 6 is selected.
The video data display device 1 performs display processing in accordance with the processing of the flowchart shown in FIG. 8, so that a video thumbnail is displayed immediately after selection as shown in FIG. Is displayed on the display device 2 as a frame image.

<Second Embodiment>
Hereinafter, a second embodiment of the present invention will be described with reference to the drawings. In addition, description is abbreviate | omitted about the location according to 1st Embodiment mentioned above.
FIG. 10 is a flowchart illustrating an example of processing for generating a moving image thumbnail from original moving image data in the video data display device according to the second embodiment.
The difference from the first embodiment is read when the video data display device 1 actually generates a video thumbnail without using parameters such as the bit rate of the original video data when calculating the delay time. From this point, the time until the decoded frame image can be displayed is measured.

  First, the first video data reading unit 102 reads the original moving image data from the video data storage medium 101 (S901). The first decoding processing unit 113 decodes the read original moving image data and performs buffering of the frame image (S902). The delay time calculation unit 103 measures the time taken so far when the original moving image data can be displayed (S903). Further, the first video data reading unit 102 reads the frame rate from the header information of the read moving image data and passes it to the video data generation unit 104. The video data generation unit 104 calculates the number of frames corresponding to the delay time based on the frame rate and the delay time obtained in S902 (S904). Thereafter, the video data generation unit 104 generates moving image thumbnail data corresponding to the calculated time from the frame image buffered in S102 (S105). Finally, the moving image thumbnail generated by the video data recording unit 105 is recorded in the video data storage medium 101, and the process ends.

<Other embodiments>
The above-described object is achieved by the following way. That is, a storage medium (or recording medium) in which a program code of software that realizes the functions of the above-described embodiments is recorded is supplied to the system or apparatus. Then, the central processing means (CPU or MPU) of the system or apparatus reads and executes the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the storage medium recording the program code constitutes the above-described embodiment.

  In addition, by executing the program code read by the central processing means of the system or apparatus, an operating system (OS) or the like operating on the system or apparatus performs actual processing based on the instruction of the program code. Do some or all. The case where the function of the above-described embodiment is realized by the processing is also included.

  Furthermore, it is assumed that the program code read from the storage medium is written to a memory provided in a function expansion card inserted into the system or apparatus or a function expansion unit connected thereto. After that, based on the instruction of the program code, the CPU of the function expansion card or function expansion unit performs part or all of the actual processing, and the function of the above-described embodiment is realized by the processing. It is.

  When the above-described embodiment is applied to the storage medium, the storage medium (computer-readable storage medium) stores program codes corresponding to the flowcharts described above.

  As described above, according to each of the above-described embodiments, even in the case of video content in which still images and moving images are mixed, the use of a storage device such as a ROM, RAM, or HDD is minimized, and high-speed including grasping of moving image contents is included. In addition, video content can be viewed comfortably.

  The preferred embodiments of the present invention have been described in detail above, but the present invention is not limited to such specific embodiments, and various modifications can be made within the scope of the gist of the present invention described in the claims.・ Change is possible.

1 Video data display device: 2 Display device: 3 Operation input device

Claims (13)

First reading means for reading first video data from the storage device;
A delay time calculating means for calculating a time required to display at least a part of the first video data based on the first video data read by the first reading means;
Video data generating means for generating second video data based on the time obtained by the delay time calculating means and the first video data;
Video data recording means for recording the second video data generated by the video data generating means in a storage device;
A video data display device comprising:   The video data generating means has the data length that can be displayed at least within the time based on the time obtained by the delay time calculating means and the first video data. 2. The video data display device according to claim 1, wherein the video data is generated from the first video data.   The video data generation means uses, as the second video data, video data consisting of frames from a position of a certain frame of the first video data to a frame position corresponding to at least the time obtained by the delay time calculation means. The video data display device according to claim 1, wherein the video data display device is generated. Second video data reading means for reading the second video data from the storage device;
First decoding means for decoding the first video data read by the first reading means;
Second decoding means for decoding the second video data read by the second reading means;
Display means for displaying on the display device the second video data decoded by the second decoding means;
The second video data decoded by the second decoding means displayed on the display device is decoded by the first decoding means related to the second video data. Switching means for switching to video data of
The video data display device according to claim 1, further comprising: The first decoding means sequentially decodes the frames based on the frame corresponding to the position of the last frame of the second video data of the first video data,
The switching means is configured to continuously display from the second video data to the first video data after at least a part of the first video data is decoded by the first decoding means. 5. The video data display device according to claim 4, wherein the video data display device is switched to. First reading means for reading first video data from the storage device;
A delay time calculating means for calculating a time required to display at least a part of the first video data based on the first video data read by the first reading means;
Video data generating means for generating second video data based on the time obtained by the delay time calculating means and the first video data;
Video data recording means for recording the second video data generated by the video data generating means in a storage device;
Second video data reading means for reading the second video data from the storage device;
First decoding means for decoding the first video data read by the first reading means;
Second decoding means for decoding the second video data read by the second reading means;
Display means for displaying on the display device the second video data decoded by the second decoding means;
The second video data decoded by the second decoding means displayed on the display device is decoded by the first decoding means related to the second video data. Switching means for switching to video data of
A video data display system comprising: A first read step in which the video data display device reads the first video data from the storage device;
A delay time calculating step in which the video data display device calculates a time required to display at least a part of the first video data based on the first video data read in the first reading step. When,
A video data generation step in which the video data display device generates second video data based on the time obtained in the delay time calculation step and the first video data;
A video data recording step in which the video data display device records the second video data generated in the video data generation step in a storage device;
A video data display method comprising:   In the video data generation step, based on the time obtained in the delay time calculation step and the first video data, the second data having a data length that can be displayed at least within the time. 8. The video data display method according to claim 7, wherein the video data is generated from the first video data.   In the video data generation step, video data consisting of frames from a position of a certain frame of the first video data to a frame position corresponding to at least the time obtained in the delay time calculation step is used as the second video data. 9. The video data display method according to claim 7, wherein the video data display method is generated. A second video data reading step in which the video data display device reads the second video data from the storage device;
A first decoding step in which the video data display device decodes the first video data read in the first reading step;
A second decoding step in which the video data display device decodes the second video data read in the second reading step;
A display step in which the video data display device displays the second video data decoded in the second decoding step on the display device;
In the first decoding step, the video data display device converts the second video data decoded in the second decoding step displayed on the display device to the second video data. A switching step for switching to the decoded first video data;
The video data display method according to claim 7, further comprising: In the first decoding step, the first video data is sequentially decoded from the frame corresponding to the position of the last frame of the second video data,
In the switching step, after at least a part of the first video data is decoded in the first decoding step, the display continues from the second video data to the first video data. The video data display method according to claim 10, wherein the video data display method is switched to. Computer
First reading means for reading first video data from the storage device;
A delay time calculating means for calculating a time required to display at least a part of the first video data based on the first video data read by the first reading means;
Video data generating means for generating second video data based on the time obtained by the delay time calculating means and the first video data;
Video data recording means for recording the second video data generated by the video data generating means in a storage device;
A program characterized by making it function.   A computer-readable storage medium storing the program according to claim 12.

Images