JP4375286B2 - Video display method and video display device - Google Patents

Description

  The present invention provides a video display that generates and displays a thumbnail image (compressed still image) representing the content from a plurality of content that is a set of a video signal and an audio signal recorded on a recording medium such as a DVD. The present invention relates to a method and a video display apparatus for implementing the method.

  In recent years, hard disk recorders (hereinafter abbreviated as HDR) that record video and audio on a hard disk are widely used. In HDR, video is compressed by a method such as MPEG-2 video (Moving Picture Experts Group Phase 2 Video), and audio is compressed by a method such as MPEG-1 audio (Moving Picture Experts Group Phase 1 Audio) to hard disk drive , Abbreviated as HDD) and DVD. Video and audio are recorded as one file from the start to the end of recording, and one file is created each time start / end is repeated.

  Thus, in a video display device that reproduces a plurality of video / audio files such as an HDR in which a plurality of files are recorded and an optical disc on which a plurality of files such as a DVD are written, each file is searched for a desired image to be viewed. In many cases, representative reduced images, that is, thumbnail images are displayed in a list on the screen of a display device. FIG. 11 shows an example of this, and thumbnail images 1001, 1002, and 1003 are displayed side by side on one display screen 1000. FIG.

In displaying such thumbnail images, a plurality of thumbnail image data corresponding to a plurality of normal-size image data are stored so as to be searchable, and a plurality of selectively arranged reduced image data are output to a display device Is disclosed (for example, see Patent Document 1 below). Also disclosed is an apparatus provided with position specifying means for allowing a user to specify the position of video information that is the basis of a thumbnail image (see, for example, Patent Document 2 below).
Japanese Patent Publication No. 3-32951 (page 2, right column, lines 18-26) JP 2003-32581 A (paragraph 0010)

  However, the thumbnail images displayed as a list by the above-described conventional apparatus are only images at a certain moment of the images recorded on the recording medium, and do not represent the characteristics of the images recorded on the recording medium. There was a problem that it was difficult to grasp the contents of.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to implement a video display method capable of easily grasping the contents of an image simply by looking at a list-displayed screen and the method. Another object is to provide a video display device.

In order to achieve the above object, the present invention stores a plurality of thumbnail images respectively generated from a plurality of contents made up of video signals and audio signals in a memory means as a list screen, and the stored thumbnail images In a video display method for displaying a list screen of
Detecting first and second physical feature data from an audio signal of the content;
Selecting one image size data corresponding to the detected first physical feature data from a plurality of image size data given in advance in association with the first physical feature data;
Selecting one color data corresponding to the detected second physical feature data from a plurality of color data given in advance in association with the second physical feature data;
Extracting predetermined representative image data according to the timing at which the first and second physical feature data are detected from the video signal of the content;
Reducing the extracted representative image data in correspondence with the selected one image size data;
Generating thumbnail images with image frames by combining the reduced representative image data with image frame shape data colored with the selected one color data;
Storing the generated thumbnail images with image frames in the memory means for configuring as a list screen,
A list screen of thumbnail images with image frames stored in the memory means is displayed on the display means.

Further, the present invention stores a plurality of thumbnail images respectively generated from a plurality of contents composed of video signals and audio signals as a list screen in a memory means, and uses the stored thumbnail image list screen as a display means. In the video display method to display,
Detecting first and second physical feature data from an audio signal of the content;
Selecting one image frame shape data corresponding to the detected first physical feature data from a plurality of image frame shape data given in advance in association with the first physical feature data When,
Selecting one color data corresponding to the detected second physical feature data from a plurality of color data given in advance in association with the second physical feature data;
Extracting predetermined representative image data according to the timing at which the first and second physical feature data are detected from the video signal of the content;
Reducing the extracted representative image data in correspondence with the selected one image frame shape data;
The selected one image data is colored with the selected one color data, and the thumbnail image with the image frame is generated by combining the reduced representative image data with the colored image frame shape data. And steps to
Storing the generated thumbnail images with image frames in the memory means for configuring as a list screen,
A list screen of thumbnail images with image frames stored in the memory means is displayed on the display means.

Further, the present invention stores a plurality of thumbnail images respectively generated from a plurality of contents composed of video signals and audio signals as a list screen in a memory means, and uses the stored thumbnail image list screen as a display means. In the video display device to display,
Feature detection means for detecting first and second physical feature data from the audio signal of the content;
Representative image extraction means for extracting predetermined representative image data corresponding to the timing at which the first and second physical feature data are detected from the video signal of the content;
A first storage means in which a plurality of image size data associated with the first physical feature data is stored in advance;
A second storage means in which a plurality of color data associated with the second physical feature data is stored in advance;
According to the detected first physical feature data, one image size data is acquired from the first storage means, and the extracted representative image data is reduced in correspondence with the image size data, One color data is acquired from the second storage means according to the detected second physical feature data, and predetermined image frame shape data is colored with this color data, and this colored image frame shape Image processing means for generating thumbnail images with image frames by combining data with the reduced representative image data;
Image synthesizing means for storing in the memory means for configuring the generated thumbnail images with image frames as a list screen;
A list screen of thumbnail images with image frames stored in the memory means is configured to be displayed on the display means.

Further, the present invention stores a plurality of thumbnail images respectively generated from a plurality of contents composed of video signals and audio signals as a list screen in a memory means, and uses the stored thumbnail image list screen as a display means. In the video display device to display,
Feature detection means for detecting first and second physical feature data from the audio signal of the content;
Representative image extraction means for extracting predetermined representative image data corresponding to the timing at which the first and second physical feature data are detected from the video signal of the content;
A first storage means in which a plurality of image frame shape data associated with the first physical feature data is stored in advance;
A second storage means in which a plurality of color data associated with the second physical feature data is stored in advance;
One image frame shape data is acquired from the first storage means according to the detected first physical feature data, and the extracted representative image data is reduced in correspondence with the image frame shape data. At the same time, one color data is acquired from the second storage means according to the detected second physical feature data, and the acquired image frame shape data is colored with this color data, and this color is added. Image processing means for combining the image frame shape data with the reduced representative image data to generate a thumbnail image with an image frame;
Image synthesizing means for storing in the memory means for configuring the generated thumbnail images with image frames as a list screen;
A list screen of thumbnail images with image frames stored in the memory means is configured to be displayed on the display means.

  According to the present invention, the representative image representing the content is reduced to an image having an image size or a frame shape associated with the first physical feature of the audio signal, and the representative image is the second image of the audio signal. Thumbnail images with a color associated with physical features or with a colored frame shape are generated, so you can easily grasp the contents of an image simply by looking at the screen displayed in a list on the display means It becomes possible.

Hereinafter, the present invention will be described in detail based on preferred embodiments shown in the drawings.
<First Embodiment>
FIG. 1 is a functional block diagram of a video display apparatus for implementing a video display method according to the present invention. In FIG. 1, on a recording medium 11, a plurality of contents having a set of a video signal and an audio signal are recorded. When generating thumbnail images representing each of these contents and displaying them on the display means 19, the feature detection means 12 acquires the audio signal of the content recorded on the recording medium 11, and the first audio signal for each content is acquired. The physical feature X and the second physical feature Y are calculated. Here, the physical characteristic of the audio signal is a predetermined parameter value obtained from the audio signal waveform. In the present embodiment, the average output level and the average frequency per unit time will be described as an example. The representative image extraction unit 13 acquires a video signal paired with the audio signal for which the first and second physical characteristics are calculated, and extracts a representative image representing the content including the video signal. . The representative image is preferably an I frame when the video signal is in the MPEG format. When the representative image is extracted, a position specifying unit 14 operated by the user is provided to determine which position in the content to extract the video image. The position designating unit 14 displays representative image candidates, and extracts a representative image so that the user selects a desired image. The first storage means 15 stores a plurality of image sizes prepared in advance or a plurality of frame shapes prepared in advance as a table in association with the physical feature X of the audio signal, and the second storage means In FIG. 16, a plurality of colors prepared in advance are stored as a table in association with the physical feature Y of the audio signal. The image processing means 17 refers to the first storage means 15 and reduces the representative image extracted by the representative image extraction means 13 to an image having an image size or a frame shape associated with the physical feature X of the audio signal. In addition, referring to the second storage means 16, the representative image is framed with a color associated with the physical feature Y or the frame shape is colored, and a thumbnail image is generated for each content. The image synthesizing unit 18 synthesizes a plurality of thumbnail images generated by the image processing unit 17 and stores them in a memory so as to be displayed on the list screen, and causes the display unit 19 to display the stored thumbnail images.

  FIG. 2 is a block diagram showing a specific configuration example of the first embodiment for realizing the function of the video display apparatus shown in FIG. In FIG. 2, an HDD 101, a memory 102, an image processing unit 103, and a CPU 104 are connected to each other via a bus line 105 so that signals can be exchanged. Among these, the HDD 101 as a recording medium records a plurality of contents including a set of video signals and audio signals. In the memory 102, the average output level of the audio signal and the size of the image are associated and stored as a table, and the average frequency and color of the audio signal are associated and stored as a table. Under the control of the CPU 104, the image processing unit 103 executes the processing of extracting the representative image, generating the thumbnail image, and synthesizing the list image. In FIG. 2, illustration of the position specifying means 14 and the display means 19 shown in FIG. 1 is omitted.

  The operation of the first embodiment of the video display apparatus configured as described above will be described according to the flowchart of FIG. 7 showing an example of a specific processing procedure of the CPU 104 with reference to FIGS. Here, FIG. 3 is an envelope of the audio signal recorded in the HDD 101, FIG. 4 is a chart showing the correspondence between the average output level of the audio signal and the size of the image, and FIG. 5 is the correspondence between the average frequency of the audio signal and the color. FIG. 6 shows an example of a screen displaying a list of thumbnail images.

  First, in the HDD 101, three VOB (Video Object) files including compressed video signals and audio signals are recorded as VTS_01_1.VOB, VTS_01_2.VOB, and VTS_01_3.VOB. In step S601, the CPU 104 extracts and decodes the audio signal of the VOB file recorded in the HDD 101. An example of the decoded audio signal is shown in FIG. Subsequently, in step S602, an average output level and an average frequency are detected from the decoded audio signal using a known technique. As an example, it is assumed that the average output level of the audio signal extracted from the VTS_01_1.VOB file is −2 dB and the average frequency is 750 Hz. Therefore, the image size is determined to be “240 × 180” with reference to the table (FIG. 4) showing the relationship between the average output level and the image size stored in the memory 102 in step S603, and then in step S604, the memory is determined. The frame color is determined as “green” with reference to the table (FIG. 5) showing the relationship between the average frequency and the color stored in 102. If the average level of the audio signal extracted from the VTS_01_1.VOB file is in a range other than “−3 to 0 (dB)” in FIG. 4 and the average frequency is in a range other than “500 to 1000 (Hz) in FIG. For example, the image size is determined to be another value, and the frame color is also determined to be another color.

  In step S605, a representative image is extracted from the VOB file. Since the image size determined in step S603 is “240 × 180”, the representative image is reduced to that size in step S606. Subsequently, since the frame color determined in step S604 is “green”, a green frame is added to the reduced image in step S607. In step S608, a plurality of thumbnail images are combined and stored in the memory 102 for display on the list screen. Next, in step S609, it is determined whether or not the processing for all the VOB files recorded in the HDD 101 has been completed. If it is determined that the processing has not ended, the processing in steps S601 to S609 is repeated for the other VOB files. If it is determined that all the VOB files recorded in the HDD 101 have been processed, the process proceeds to step S610, where a list screen synthesized on the memory 102 is output. FIG. 6 shows a display example of the list screen. The reduced image 501 displayed side by side on the display screen 500 shows the file VTS_01_1.VOB, the reduced image 502 shows the file VTS_01_2.VOB, and the reduced image 503 shows the file VTS_01_3. Indicates VOB.

  As a result, the file VTS_01_1.VOB having a large sound is displayed as a relatively small reduced image 501 and the file VTS_01_2.VOB having a small sound is displayed as a relatively small reduced image 502. A file with a low sound is displayed with a blue frame, and a file with a high sound is displayed with a red frame. As a result, if the reduced image is large, it can be predicted that the scene is intense or exciting. Moreover, it can be predicted that the scene is calmer as the color of the frame approaches blue.

  As described above, according to the first embodiment of the present invention, it is possible to easily grasp the contents of each image only by looking at the screen displayed as a list on the display means.

<Second Embodiment>
In the first embodiment described above, the image size is varied with respect to the difference in the average output level of the audio signal, and the frame color is varied with respect to the difference in the average frequency of the audio signal, but the size is reduced. As described above, the frame size is made different for the difference in the average output level of the audio signal while the image size is kept constant, and the color of the frame is made different for the difference in the average frequency of the audio signal. It is possible to make predictions similar to As described above, the second embodiment is configured to display thumbnail images having different frame thicknesses and colors depending on the physical characteristics of the audio signal. Here, the first embodiment stores a table in which the average output level of the audio signal and the image size are associated with each other as shown in FIG. In the embodiment, as shown in FIG. 8, a table in which the average output level of the audio signal is associated with the frame thickness is stored in the memory 102. Other than this, the hardware configuration is the same as that of the first embodiment, and the processing procedure of the CPU 104 corresponding thereto is different.

  The operation of the second embodiment configured as described above will be described with reference to FIGS. 8 and 9 according to the flowchart of FIG. Here, FIG. 8 is a chart showing the correspondence between the average output level of the audio signal and the thickness of the frame, and FIG. 9 is an example of a screen displaying a list of thumbnail images.

  First, the CPU 104 extracts and decodes the audio signal of the VOB file recorded in the HDD 101 in step S901. Subsequently, in step S902, an average output level and an average frequency are detected from the decoded audio signal using a known technique. As an example, assume that the average level of the audio signal extracted from the VTS_01_1.VOB file is −2 dB and the average frequency is 750 Hz. Therefore, the frame thickness is determined to be “20” with reference to the table (FIG. 8) showing the relationship between the average output level and the frame thickness stored in the memory 102 in step S903, and then in step S904. The frame color is determined as “green” with reference to a table (FIG. 5) showing the relationship between the average frequency and the color stored in the memory 102. If the average level of the audio signal extracted from the VTS_01_1.VOB file is in a range other than “−3 to 0 (dB)” in FIG. 8 and the average frequency is in a range other than “500 to 1000 (Hz) in FIG. For example, the thickness of the frame is determined to another value, and the color of the frame is also determined to be another color.

  Next, a representative image is extracted from the VOB file in step S905. In step S906, the representative image is reduced to a preset size. Subsequently, since the frame color determined in step S904 is “green”, a green frame is attached to the reduced image in step S907. In step S908, a plurality of thumbnail images are combined and stored on the memory 102 so as to be displayed on the list screen. Next, in step S909, it is determined whether or not the processing for all the VOB files recorded in the HDD 101 has been completed. If it is determined that the processing has not ended, the processing in steps S901 to S909 is repeatedly executed for the other VOB files. If it is determined that all the VOB files recorded on the HDD 101 have been processed, the process proceeds to step S910, where a list screen synthesized on the memory 102 is output. FIG. 9 shows a display example of the list screen. The reduced image 801 displayed side by side on the display screen 800 indicates the file VTS_01_1.VOB, the reduced image 802 indicates the file VTS_01_2.VOB, and the reduced image 803 indicates the file VTS_01_3. Indicates VOB.

  As a result, the file VTS_01_1.VOB having a large sound is displayed as a reduced image 801 having a relatively thick frame, and the file VTS_01_2.VOB having a small sound is displayed as a reduced image 802 having a relatively thin frame. The A file with a low sound is displayed with a blue frame, and a file with a high sound is displayed with a red frame. As a result, if the frame of the reduced image is thick, it can be predicted that the scene is intense or swells. Moreover, it can be predicted that the scene is calmer as the color of the frame approaches blue.

  As described above, according to the second embodiment of the present invention, it is possible to easily grasp the contents of each image only by looking at the screen displayed as a list on the display means.

  In each of the above-described embodiments, the average output level is calculated as the first physical feature of the audio signal and the average frequency is calculated as the second physical feature. However, the average frequency is calculated as the first physical feature. In addition, the average output level may be calculated as the second physical feature, or the timbre related to the way the harmonics are included, the range of the pitch of the sound, etc. It is good. In the first embodiment, the size of the thumbnail image and the color of the frame are changed to express the nature of the content. In the second embodiment, the thickness of the frame of the thumbnail image and the color thereof are changed to change the content. However, instead of changing the thickness of the frame, the frame shape (pattern) may be changed by making the frame itself double or triple, or by adding a pattern to the frame itself.

It is a functional block diagram of the video display apparatus which implements the video display method according to the present invention. It is a block diagram which shows the specific structural example of 1st Embodiment which implement | achieves the function of the video display apparatus shown in FIG. In order to explain the operation of the first embodiment, an envelope of an audio signal recorded in the hard disk drive. In order to explain the configuration of the first embodiment, it is a chart showing the correspondence between the average output level of the audio signal and the size of the image. In order to explain the configuration of the first embodiment, it is a chart showing the correspondence between the average frequency and color of the audio signal. In order to explain the operation of the first embodiment, it is an example of a screen displaying a list of thumbnail images. FIG. 4 is a flowchart illustrating an example of a specific processing procedure of a CPU in order to explain the operation of the first embodiment. In order to explain the configuration of the second embodiment, it is a chart showing the correspondence between the average output level of the audio signal and the thickness of the frame. In order to explain the operation of the second embodiment, it is an example of a screen displaying a list of thumbnail images. It is a flowchart which shows an example of the specific process sequence of CPU, in order to demonstrate operation | movement of 2nd Embodiment. In order to explain the prior art, it is a screen example in which thumbnail images are displayed as a list on the screen of a display device.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 Recording medium 12 Feature detection means 13 Representative image extraction means 14 Position designation means 15 1st memory means 16 2nd memory means 17 Image processing means 18 Image composition means 19 Display means 101 Hard disk drive (HDD)
102 Memory 103 Image processing unit 104 CPU

Claims (4)

In a video display method for storing a plurality of thumbnail images respectively generated from a plurality of contents including video signals and audio signals as a list screen in a memory means, and displaying the list screen of the stored thumbnail images on a display means ,
Detecting first and second physical feature data from an audio signal of the content;
Selecting one image size data corresponding to the detected first physical feature data from a plurality of image size data given in advance in association with the first physical feature data;
Selecting one color data corresponding to the detected second physical feature data from a plurality of color data given in advance in association with the second physical feature data;
Extracting predetermined representative image data according to the timing at which the first and second physical feature data are detected from the video signal of the content;
Reducing the extracted representative image data in correspondence with the selected one image size data;
Generating thumbnail images with image frames by combining the reduced representative image data with image frame shape data colored with the selected one color data;
Storing the generated thumbnail images with image frames in the memory means for configuring as a list screen,
A video display method characterized in that a list screen of thumbnail images with image frames stored in said memory means is displayed on said display means. In a video display method for storing a plurality of thumbnail images respectively generated from a plurality of contents including video signals and audio signals as a list screen in a memory means, and displaying the list screen of the stored thumbnail images on a display means ,
Detecting first and second physical feature data from an audio signal of the content;
Selecting one image frame shape data corresponding to the detected first physical feature data from a plurality of image frame shape data given in advance in association with the first physical feature data When,
Selecting one color data corresponding to the detected second physical feature data from a plurality of color data given in advance in association with the second physical feature data;
Extracting predetermined representative image data according to the timing at which the first and second physical feature data are detected from the video signal of the content;
Reducing the extracted representative image data in correspondence with the selected one image frame shape data;
The selected one image data is colored with the selected one color data, and the thumbnail image with the image frame is generated by combining the reduced representative image data with the colored image frame shape data. And steps to
Storing the generated thumbnail images with image frames in the memory means for configuring as a list screen,
A video display method characterized in that a list screen of thumbnail images with image frames stored in said memory means is displayed on said display means. In a video display device for storing a plurality of thumbnail images respectively generated from a plurality of contents including video signals and audio signals as a list screen in a memory means and displaying the list screen of the stored thumbnail images on a display means ,
Feature detection means for detecting first and second physical feature data from the audio signal of the content;
Representative image extraction means for extracting predetermined representative image data corresponding to the timing at which the first and second physical feature data are detected from the video signal of the content;
A first storage means in which a plurality of image size data associated with the first physical feature data is stored in advance;
A second storage means in which a plurality of color data associated with the second physical feature data is stored in advance;
According to the detected first physical feature data, one image size data is acquired from the first storage means, and the extracted representative image data is reduced in correspondence with the image size data, One color data is acquired from the second storage means according to the detected second physical feature data, and predetermined image frame shape data is colored with this color data, and this colored image frame shape Image processing means for generating thumbnail images with image frames by combining data with the reduced representative image data;
Image synthesizing means for storing in the memory means for configuring the generated thumbnail images with image frames as a list screen;
A video display device configured to display a list screen of thumbnail images with image frames stored in the memory means on the display means. In a video display device for storing a plurality of thumbnail images respectively generated from a plurality of contents including video signals and audio signals as a list screen in a memory means and displaying the list screen of the stored thumbnail images on a display means ,
Feature detection means for detecting first and second physical feature data from the audio signal of the content;
Representative image extraction means for extracting predetermined representative image data corresponding to the timing at which the first and second physical feature data are detected from the video signal of the content;
A first storage means in which a plurality of image frame shape data associated with the first physical feature data is stored in advance;
A second storage means in which a plurality of color data associated with the second physical feature data is stored in advance;
One image frame shape data is acquired from the first storage means according to the detected first physical feature data, and the extracted representative image data is reduced in correspondence with the image frame shape data. At the same time, one color data is acquired from the second storage means according to the detected second physical feature data, and the acquired image frame shape data is colored with this color data, and this color is added. Image processing means for combining the image frame shape data with the reduced representative image data to generate a thumbnail image with an image frame;
Image synthesizing means for storing in the memory means for configuring the generated thumbnail images with image frames as a list screen;
A video display device configured to display a list screen of thumbnail images with image frames stored in the memory means on the display means.

Images