JP2004072727A - Image processing method, image processing apparatus, image recording and reproducing apparatus, and television receiver - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve a problem that a user occasionally interrupts the reproduction of recorded moving images in the middle when searching a desired scene. <P>SOLUTION: The moving image under reproduction is displayed on a main picture and a plurality of thumbnail images are displayed to be indexes when searching the desired scene. Besides, the thumbnail image to be displayed is updated in a predetermined timing in accordance with the progress of the moving image. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an image recording / reproducing technique, and more particularly to a technique for assisting a user to search for a desired scene when viewing a moving image.
[0002]
[Prior art]
In recent years, recording of moving images using a recording medium such as a DVD (Digital Versatile Disc) or a hard disk magnetic recording medium (hereinafter, also simply referred to as a “hard disk”) that allows easy random access to recorded data has begun to spread. I have. In particular, as the capacity and cost of hard disks have been increased, hard disk recorders, which are image recording / reproducing devices using hard disks, have been commercialized, and there have been cases where hard disk recorders are incorporated in television receivers (for example, And Patent Document 1).
[0003]
At present, when a hard disk having a recording capacity of about 80 GB which is relatively easily available is used, recording can be performed for about 30 hours with a picture quality comparable to that of a general VTR. It is possible.
[0004]
[Patent Document 1]
JP 2001-177804 A (full text)
[0005]
[Problems to be solved by the invention]
In an image recording / reproducing apparatus using a recording medium that allows easy random access to recording data as described above, there is a method of using a thumbnail image as a technique for searching for a desired scene of a recorded moving image. In this method, a still image is selected in advance from a moving image, reduced to a predetermined size, and displayed as an index. However, even if this is used, it may take time to find a desired scene. In addition, it is necessary to temporarily stop reproduction of a moving image and call up an index display screen to search for a desired scene.
[0006]
The inventor has come to the following recognition under such a situation. That is, if it is possible to easily search for a desired scene, user convenience is improved. In addition, in the case of a scene immediately adjacent to the currently displayed scene, by continuing to display the moving image, a desired scene is immediately displayed, and it is possible to search for the scene without having to interrupt the moving image. If so, the search becomes easy and the number of user operations can be reduced. Further, when the scene to be searched is temporally close to the currently displayed scene, it may not be necessary to interrupt the reproduction of the moving image.
[0007]
The present invention has been made based on such recognition, and an object of the present invention is to provide a technique for assisting a user in searching for a desired scene when viewing a moving image.
[0008]
[Means for Solving the Problems]
One embodiment of the present invention relates to an image processing method. The method includes, when a moving image is displayed, controlling a plurality of reduced images to be displayed so that the progress and time relationship of the moving image can be recognized, and displaying the reduced image in accordance with the progress of the moving image. Controlling to update.
[0009]
Here, the reduced image refers to an image obtained by reducing the size of a unit image constituting a moving image, but the reduction method and the reduction form are not limited. For example, the vertical and horizontal lengths of the image may be reduced at the same ratio, or only a part of the image may be used.
[0010]
In addition, one or a plurality of reduced images may be displayed. Further, the image may be an image indicating a scene subsequent to the currently displayed scene, may be a previous scene, or may be a combination thereof. Further, control may be performed such that the image is displayed on the same screen as the moving image, or control may be performed so that only the reduced image is displayed.
[0011]
When a plurality of reduced images are controlled to be displayed, the interval between the images is arbitrary. That is, for example, the intervals may be equal in time, or the intervals may be increased as the distance from the currently displayed scene increases.
[0012]
The viewer of the moving image can search for a desired scene without interrupting the display of the current moving image based on the reduced image. If the scene being searched is immediately adjacent to the currently displayed scene, the display need not be interrupted. According to the present invention, such an operation can be avoided.
[0013]
Another embodiment of the present invention relates to an image processing device. The display control unit controls, when a moving image is displayed, a plurality of reduced images to be displayed on the same screen as a screen on which the moving image is displayed so that the progress and the time relation of the moving image can be recognized. And a reduced image updating unit that controls the reduced image displayed on the same screen as the moving image to be updated in accordance with the progress of the moving image.
[0014]
Another embodiment of the present invention relates to an image recording / reproducing apparatus. In this apparatus, an image extracting unit that acquires a moving image signal and extracts a unit image constituting the moving image, and an original image of an index image used when searching for a desired scene of the moving image is extracted by the image extracting unit. An image selection unit for selecting from the selected unit images, a first data recording unit for holding a moving image signal, an index image generation unit for generating an index image by reducing the size of the selected original image, and an index image A second data recording unit that records and holds the original image in association with the original image, an index image specifying unit that selects a predetermined index image from the second data recording unit according to the progress of the moving image, And an index updating unit that controls the index image to be updated accordingly.
[0015]
The first and second data recording units include an optical disk recording medium such as a DVD and a hard disk. The index image used for the search is also called a thumbnail image.
[0016]
As the timing for generating the index image, (1) a predetermined time interval, (2) a scene change of a moving image based on an instruction from a user, (4) switching from a commercial to a main program, (5) (6) Index image acquisition point indicated by the creator of the moving image; (7) If the moving image is composed of a plurality of chapters, the first image of the chapter or the index image of the chapter (8) There is a change point of the sound volume, specifically, a point where the sound volume largely changes. In the case of the timings (1) to (3) described above, an index image may be generated excluding commercial scenes. The switching of the display format includes, for example, a time when the number of effective pixels is changed from 720 × 480 and 480i which is an interless method to a format where the number of effective pixels is 1280 × 720 and 720p which is a progressive method.
[0017]
Here, the index image may be generated while reproducing the recorded moving image, or may be generated together with the recording when newly recording the moving image.
[0018]
The timing of updating the index image includes a case where the scene of the displayed moving image approaches one of the index images and a case where the scene matches. Further, the phrase “the time relationship can be recognized” means, for example, arranging index images in order from the index image that is later in time so that the context of the displayed moving image scene can be understood. For example, a moving image is displayed in the left 2/3 region of the display device, and two index images are respectively arranged before and after the index image in the right 1/3 region, and the moving image is displayed in chronological order such that the upper direction is the moving direction of the moving image. Deploy.
[0019]
Still another embodiment of the present invention also relates to an image recording / reproducing apparatus. The apparatus includes a first decoding unit that acquires encoded data and decodes a unit image constituting a moving image, and a first decoding unit that decodes an original image of an index image used when searching for a desired scene of the moving image. An image selecting unit that selects from unit images decoded by the unit, a first data recording unit that holds encoded data, and an index image generating unit that generates an index image by reducing the size of the selected original image And an encoding unit for intra-coding the index image (also referred to as “intra-frame coding”) and compressing the data amount of the index image, and second data for storing the encoded index image in association with the original image A recording unit, a second decoding unit that selects and decodes a predetermined index image according to the progress of the moving image, and an index that is decoded according to the progress of the moving image. It has a index update section that controls so as to update the scan image.
[0020]
In addition, the apparatus includes an index area generation unit that generates an index display area configured using a plurality of decoded index images so that a time relationship with the moving image can be recognized. A display control unit that controls the display to be arranged and displayed on a screen. Further, the first and second decoding units may be shared and realized by a single configuration. In addition, the index display area may be controlled to be displayed on a moving image as an OSD (On Screen Display). In that case, it is desirable to consider the visibility of the moving image of the viewer.
[0021]
When recording a moving image on an image recording / reproducing device or when reproducing a moving image recorded on an image recording / reproducing device, an index image is previously created at an arbitrary interval, a scene change, or a timing desired by a viewer. After being generated and encoded, it is recorded in the second data recording unit. Subsequently, when reproducing a moving image, an index image is selected and decoded according to the progress of the moving image. When the first and second decoding units are shared, the index image is decoded using the idle time of the moving image decoding process.
[0022]
The index image is recorded in association with the recording address of the recording medium on which the original image is recorded, and the image to be displayed is selected from the recording address associated with the index image selected by the user, and the moving image is displayed. It may have a scene determination unit that moves the scene to the image. Examples of the moving image coding method include Motion JPEG (Joint Photographic Coding Experts Group), MPEG (Moving Picture Experts Group) 2, and MPEG4, but are not limited thereto. As a compression method of the index image, there are MPEG, JPEG, GIF (Graphics Interchange Format) and the like.
[0023]
Still another embodiment of the present invention also relates to an image recording / reproducing apparatus. This apparatus obtains encoded data, which is a moving image signal encoded according to MPEG, and decodes a unit image constituting the moving image, and searches for a desired scene of the moving image. An image selection unit for selecting an original image of an index image to be used when performing decoding from a unit image decoded by the first MPEG decoder, a first data recording unit for holding encoded data, An index image generating unit for generating an index image by reducing the size, an MPEG encoder for intra-coding the index image, and a second data recording unit for holding the coded index image in association with the original image And a second MPEG decoder for decoding a predetermined index image, and a decoded image so that the time relationship between the progress of the moving image and the second MPEG decoder can be recognized. Has a index area generator which generates a composed index area using index images, a display control unit that controls to display the index area, the.
[0024]
Yet another embodiment of the present invention relates to a television receiver. This television receiver receives a digital television broadcast signal wave multiplexed with a transport stream including a moving image signal encoded in accordance with MPEG and subjected to predetermined modulation, and converts the signal wave. A tuner unit for demodulating a transport stream, a TS separating unit for separating a moving image signal from the transport stream as encoded data, and a first MPEG for acquiring the encoded data and decoding a unit image constituting the moving image A decoder, a first data recording unit that holds the encoded moving image signal as encoded data, and an original image of an index image used for searching for a desired scene of the moving image by a first MPEG decoder. An image selection unit that selects from the decoded unit images and an index image that is generated by reducing the size of the selected unit images. An index image generation unit, an MPEG encoder for intra-coding the index image, a second data recording unit for holding the encoded index image in association with the original image, and a second data decoding unit for decoding a predetermined index image An MPEG decoder, an index area generating unit for generating an index area configured using the decoded index image so that a time relationship between the moving image and the progress of the moving image can be recognized, and a display for controlling to display the index area. A control unit; and a scene determination unit that, when one of the index images constituting the index area is selected by the user, resumes the progress of the moving image from an image corresponding to the index image.
[0025]
Yet another embodiment of the present invention relates to a television receiver. This television receiver receives a digital television broadcast signal wave multiplexed with a transport stream including a moving image signal encoded in accordance with MPEG and subjected to predetermined modulation, and converts the signal wave. A tuner unit for demodulating a transport stream, a TS separating unit for separating a moving image signal from the transport stream as encoded data, and a first MPEG for acquiring the encoded data and decoding a unit image constituting the moving image A decoder, a first data recording unit that holds a transport stream, and an original image of an index image used when searching for a desired scene of a moving image are selected from unit images decoded by the first MPEG decoder. An image selecting unit for generating an index image by reducing the size of the selected unit image; A generating unit, an MPEG encoder that intra-codes the index image, a second data recording unit that holds the encoded index image in association with the original image, and a second MPEG that decodes the predetermined index image A decoder, an index area generating unit that generates an index area configured using the decoded index image so that a time relationship between the moving image and the progress can be recognized, and a display control unit that controls display of the index area. And a scene determination unit that, when one of the index images constituting the index area is selected by the user, restarts the progress of the moving image from the image corresponding to the index image.
[0026]
The present applicant has commercialized the reverse reproduction technology proposed in Japanese Patent Application Laid-Open No. 2001-238167 as a one-chip LSI (Large-Scale Integration) circuit. This LSI includes an MPEG2 decoder and an MPEG encoder capable of decoding a two-channel MPEG2 stream. By using this LSI, the present invention can be realized at low cost.
[0027]
It is to be noted that any combination of the above-described components and any conversion of the expression of the present invention between a method, an apparatus, a system, a recording medium, and the like are also effective as embodiments of the present invention.
[0028]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, a description will be given based on preferred embodiments 1 to 5 of the present invention. In these embodiments, when a digital television broadcast recorded on a hard disk is played back, index images reduced for search (hereinafter also referred to as “thumbnail images”) are displayed in chronological order, so that the user can Assists in specifying a desired scene.
[0029]
Generally, when a user wants to move to another scene of the same program while watching a program recorded on a recording medium such as a hard disk, conventionally, the user has to perform frame-by-frame playback and wait until a desired scene is played, or Therefore, it is necessary to interrupt the reproduction and call a screen on which the thumbnail image is displayed, and call a desired scene.
[0030]
Thus, in the embodiment, a moving image that is currently being reproduced is displayed, and a plurality of thumbnail images are displayed on the same screen. Further, the displayed thumbnail images are switched at a predetermined timing according to the progress of the moving image. Hereinafter, the moving image being reproduced is referred to as a main image. The area where the main image is displayed is called a main screen, and the area where a plurality of thumbnail images are displayed is called a thumbnail frame. In normal reproduction, only the main screen is displayed, and the main image and the thumbnail frame are displayed on the same screen according to a user's instruction.
[0031]
If there is a scene to be jumped among the displayed thumbnail images, the user selects the image using an interface means such as a remote controller (hereinafter, simply abbreviated to “RC”). Subsequently, decoding of the image to be displayed on the main screen from the scene corresponding to the selected thumbnail image is resumed and displayed. If the desired scene does not exist, another thumbnail image is decoded and a new thumbnail frame is generated and displayed according to a user's instruction.
[0032]
FIG. 1 shows a state in which first to third thumbnail images TN1 to TN3 are arranged and displayed on the same screen in a main image MI and a thumbnail frame TF so that their time-series relationship can be recognized on the display device 12. I have.
[0033]
The first thumbnail image TN1 corresponds to a scene temporally earlier than the main image MI, while the second thumbnail image TN2 and the third thumbnail image TN3 correspond to a scene temporally subsequent to the main image MI. ing.
[0034]
FIG. 2 shows a time-series relationship between the main image MI and the first to sixth thumbnail images TN1 to TN6. For example, in FIG. 1, the main image MI is located between the first thumbnail image TN1 and the second thumbnail image TN2. For this reason, the first to third thumbnail images TN1 to TN3 are arranged in the thumbnail frame TF. These thumbnail images are updated in conjunction with the progress of the main image MI. For example, when the main image MI reaches the second thumbnail image TN2 or when the main image MI reaches a predetermined interval, the first to third thumbnail images TN1 to TN3 are updated as shown in FIG. The second to fourth thumbnail images TN2 to TN4 are displayed.
[0035]
Further, in response to the user's instruction, while the main image MI exists between the first thumbnail image TN1 and the second thumbnail image TN2 as shown in FIG. 4, the fourth to sixth thumbnail images TN4 to TN6 are stored in the thumbnail frame TF. May be arranged.
[0036]
Hereinafter, Embodiments 1 to 5 are specific examples for implementing the above-described scene search. Here, a television receiving apparatus including a digital television broadcast receiving apparatus and an image recording apparatus using a hard disk is assumed.
[0037]
(Embodiment 1)
FIG. 5 is a block diagram showing a configuration of the television receiver 10 according to Embodiment 1. The television receiver 10 includes a display device 12, a tuner unit 14, an image recording / reproducing unit 16, and a remote control light receiving unit 60. The remote control light receiving unit 60 receives an instruction to the device by an operation of the RC 62 by the user. The received instruction is transmitted as a control signal to each component of the television receiver 10 by a control core circuit 50 described later.
[0038]
The tuner unit 14 further includes an RF unit 22 that converts an RF (Radio Frequency) signal received by the antenna 18 into a baseband signal, a demodulation unit 24 that demodulates the obtained baseband signal, and an error correction unit 26. The signal output from the tuner unit 14 is called a transport stream (hereinafter simply abbreviated as “TS”), and the TS is used for a moving image signal, an audio signal, and a data broadcast according to the digital television broadcasting standard. All data is multiplexed.
[0039]
The image recording / reproducing unit 16 includes a TS separating unit 28, a hard disk 30, a first MPEG decoder 32, a second MPEG decoder 34, an MPEG encoder 36, an image selecting unit 38, a data amount reducing unit 40, and a thumbnail area generating unit 42. The image recording / reproducing unit 16 is not limited to the configuration included in the television receiver 10 and may be manufactured and sold alone.
[0040]
The TS separation unit 28 separates the multiplexed signal into signals corresponding to various information included in the TS, such as a moving image signal and an audio signal. Since the feature of the present embodiment is a moving image signal, only a moving image signal will be described below, and a description of a signal other than a moving image signal such as an audio signal will be omitted. The moving image signal and the audio signal separated by the TS separation unit 28 are encoded image data and encoded audio data, respectively, encoded in the MPEG2 format. The encoded image data separated by the TS separation unit 28 is transmitted to the hard disk 30 and the first switch circuit SW1.
[0041]
The hard disk 30 includes an encoded image data area 44 for holding encoded image data, and a thumbnail image data area 46 for holding a reduced image used as a thumbnail image after being further intra-coded. The first MPEG decoder 32 and the second MPEG decoder 34 decode image data encoded in the MPEG2 format.
[0042]
The image selecting unit 38 selects an image to be used as a thumbnail image from the decoded moving image. The selection is performed when a predetermined time interval or a scene change exists.
[0043]
When the selection timing is a predetermined time interval, the time interval is set according to the situation before recording or the situation before the start of thumbnail image selection. For example, one of the following conditions (1) to (4) is selected.
(1) Set according to one recording time. For example, if the recording time is 30 minutes, the time interval is 5 minutes, and if the recording time is 120 minutes, the time interval is 15 minutes. As a result, it is possible to select an image to be used for a thumbnail image as a search point without any excess or shortage according to the recording time.
(2) Set according to the type of program to be recorded. For example, if the program to be recorded is a sports program, the time interval is 15 minutes, and if the program is a drama, the time interval is 5 minutes. Depending on the type of program, the development of the content may be slow. In such a case, even if the time interval of the thumbnail images is shortened, a point that is not so effective as a search point is selected as the thumbnail image, and the processing and Storage capacity can be wasted. Therefore, by setting the time interval according to the type of the program, it is possible to select an image to be used as a thumbnail image at an optimal time interval for the type of the program to be recorded.
(3) Set according to the remaining storage capacity of the hard disk 30. For example, if the storage capacity of the hard disk 30 has room, the time interval is set to 1 minute, and the storage interval is set to 2 minutes, 5 minutes, and 10 minutes. This can prevent the recording capacity of the hard disk 30 from becoming insufficient during recording.
(4) Set when the viewer makes a recording reservation. This makes it possible to determine a time interval for acquiring a thumbnail image according to the viewer's will.
[0044]
The image selection unit 38 may use the thumbnail image acquisition point indicated by the program transmission side, that is, the content creation side, as the timing of selecting an image to be used as a thumbnail image from the moving image decoded by the first MPEG decoder 32. The thumbnail image acquisition point is, for example, the start point of each corner of the program or the timing at which a title back is inserted. By collecting the search points selected by the program transmitting side intentionally, more appropriate scene search can be realized.
[0045]
If the program is composed of a plurality of chapters, the image selecting unit 38 uses the first image of each chapter as a thumbnail image, or, if an index image is prepared for each chapter, uses the index image as a thumbnail image. May be used. This allows the viewer to search for a desired scene while looking at the adjacent chapter images. Also, a two-step operation of searching for a scene to be viewed after searching on the chapter screen can be realized at the same time.
[0046]
The timing at which the image selecting unit 38 generates a thumbnail image is configured such that the viewer selects from the above-described conditions and sets it in the television receiver 10. The image selection unit 38 selects a thumbnail image based on the conditions set by the user.
[0047]
The data amount reduction unit 40 reduces the data amount by generating a thumbnail image by converting the size of the image selected by the image selection unit 38 into a sufficient image size as a thumbnail image. At this time, not only the size but also the number of colors used may be reduced from, for example, 16 bits to 8 bits.
[0048]
The MPEG encoder 36 compresses the thumbnail image selected by the image selection unit 38 and reduced in data amount by the data amount reduction unit 40 by intra-image encoding. The compressed thumbnail image is recorded as encoded data in the thumbnail image data area 46 together with the recording address recorded in the encoded image data area 44 before the original image is decoded. Here, the image is coded and compressed according to a compression method that focuses on the spatial frequency, specifically, an MPEG-2 standard I picture. The thumbnail area generation unit 42 generates a thumbnail frame composed of a plurality of thumbnail images decoded by the second MPEG decoder 34.
[0049]
The image recording / reproducing unit 16 further includes a first switch circuit SW1, a second switch circuit SW2, a control core circuit 50, and a display control unit 52. The display controller 52 displays the thumbnail frames generated by the thumbnail area generator 42 together with the main screen. At this time, the main screen is converted to an appropriate size in order to secure an area for displaying a thumbnail frame on the display screen.
[0050]
The control core circuit 50 controls the operation of each component of the image recording / reproducing unit 16 including the first MPEG decoder 32, the second MPEG decoder 34, the MPEG encoder 36, the thumbnail area generating unit 42 and the display control unit 52. Generally, the control core circuit 50 includes a central processing unit (CPU). The various control instruction programs are described in advance in the hard disk 30 or a ROM (Read Only Memory) (not shown).
[0051]
The first switch circuit SW1 switches the input of the first MPEG decoder 32 under the control of the control core circuit 50, and determines whether to display the image data currently being broadcast or the image data recorded on the hard disk 30. The circuit switches. When the connection on the first node N1 side is established, the encoded data received at the tuner unit 14 at that time and separated from the TS stream is sent to the first MPEG decoder 32. On the other hand, when the connection is established on the second node N2 side, the encoded data is read from the hard disk 30 and sent to the first MPEG decoder 32.
[0052]
Similarly, the second switch circuit SW2 selectively sends the moving image decoded by the first MPEG decoder 32 and the thumbnail frame generated by the thumbnail area generation unit 42 to the display control unit 52 under the control of the control core circuit 50. When the connection of the third node N3 is established, the moving image decoded by the first MPEG decoder 32 is sent to the display control unit 52. On the other hand, when the connection of the fourth node N4 is established, the thumbnail frame is displayed. It is sent to the control unit 52. When the thumbnail frame is not displayed, the connection on the third node N3 side is always established. When the display of the thumbnail frame is requested by the user, the connection of the fourth node N4 is established every time the thumbnail frame is updated.
[0053]
Further, although not shown in the figure, the apparatus has a memory functioning as a work area in processing each component.
[0054]
A procedure for searching for a scene using a thumbnail image based on the above configuration will be described with reference to the flowchart shown in FIG. The arrangement on the display device when the thumbnail images are displayed is the arrangement shown in FIG.
[0055]
When the user selects the display of the thumbnail frame, the second MPEG decoder 34 reads and decodes three thumbnail images corresponding to the main image from the thumbnail image data area 46 (S10). Subsequently, the thumbnail area generating unit 42 generates a thumbnail frame TF based on the decoded thumbnail image (S12). The generated thumbnail frame TF is displayed on the display device 12 together with the main image by the display control unit 52 (S14).
[0056]
When any of the displayed thumbnail images is selected by the user (Y in S16), the main screen jumps to the scene associated with the selected thumbnail image (S18), and the display of the thumbnail images ends. . On the other hand, when the thumbnail image is not selected by the user (N in S16), if it is not the update timing of the thumbnail image (N in S20), the process returns to the step S14 and the display of the thumbnail frame is continued. If it is the update timing (Y in S20), the process returns to step S10, a new thumbnail image is read, and the same processing is performed thereafter.
[0057]
As described above, according to the first embodiment, the user can search for a desired scene without interrupting the display of the currently displayed moving image.
[0058]
(Embodiment 2)
In the first embodiment, generation of a thumbnail image is performed at a predetermined time interval or when a scene change exists. In the second embodiment, thumbnail images are generated based on an instruction from a user. The display of thumbnail images and the search for scenes are the same as in the first embodiment.
[0059]
FIG. 7 is a block diagram showing a configuration of the television receiver 10 according to Embodiment 2. Since this configuration is similar to the configuration of the image recording / reproducing unit 16 shown in FIG. 5, only the features that are characteristic of the second embodiment will be described, and the other description will be omitted.
[0060]
In the second embodiment, a third switch circuit SW3 is provided on the signal path between the first MPEG decoder 32 and the image selection unit 38. The user instructs the timing of generating a thumbnail image using the RC 62 while checking the main image.
[0061]
When the instruction is received, the third switch circuit SW3 is turned on, and the image selecting unit 38 selects the original image of the thumbnail image. Subsequent processing is the same as in the first embodiment.
[0062]
According to the second embodiment, the effects of the first embodiment can be obtained, and a scene desired by the user can be recorded as a thumbnail image.
[0063]
(Embodiment 3)
In the first and second embodiments, the second MPEG decoder 34 is used when decoding a thumbnail image. In the third embodiment, the first MPEG decoder 32 and the second MPEG decoder 34 are made common to form one MPEG decoder.
[0064]
FIG. 8 is a block diagram showing a configuration of the television receiver 10 according to Embodiment 3. The configuration characteristic of this embodiment is that the second MPEG decoder 34 in the image recording / reproducing unit 16 shown in FIG. 7 is omitted, and the function of the second MPEG decoder 34 is performed by the first MPEG decoder 32 as described above. Therefore, when a moving image and a thumbnail image are decoded, that is, when a thumbnail frame is generated, the encoded data is decoded in a time-division manner.
[0065]
Further, the first switch circuit SW1 further has a fifth node N5. When decoding the coded image data recorded in the coded image data area 44 of the hard disk 30 and displaying a moving image, the first switch circuit SW1 and the second node N2 side of the first switch circuit SW1 are controlled according to the control of the control core circuit 50. The connection on the third node N3 side of the two-switch circuit SW2 is established. When the thumbnail image is decoded, the connection on the fifth node N5 side of the first switch circuit SW1 and the connection on the fourth node N4 side of the second switch circuit SW2 are simultaneously established.
[0066]
According to the third embodiment, the same effects as those of the first and second embodiments can be obtained. In addition, when an MPEG2 decoder capable of decoding a two-channel MPEG2 stream is already provided, the additional cost can be minimized. The present invention can be realized.
[0067]
(Embodiment 4)
In the first to third embodiments, the data recorded on the hard disk 30 is the encoded data once separated from the TS by the TS separation unit 28. In the fourth embodiment, the TS is recorded on the hard disk 30 as it is. The area of the hard disk 30 where the TS is recorded is called a TS data area 66, which corresponds to the coded image data area 44 of the first to third embodiments.
[0068]
FIG. 9 is a block diagram showing a configuration of the television receiver 10 according to Embodiment 4. Since this configuration is similar to the television receiver 10 described in the second embodiment, the features that are particularly characteristic of the fourth embodiment will be described.
[0069]
The hard disk 30 includes a TS data area 66 in which a TS is recorded, instead of the encoded image data area 44 in which encoded data separated from the TS is recorded. Further, the first switch circuit SW1 is provided before the TS separation unit 28, that is, on the tuner unit 14 side. The first switch circuit SW1 selects either the TS currently being received by the tuner unit 14 or the TS recorded in the TS data area 66 and sends it to the TS separation unit 28.
[0070]
In the fourth embodiment, the TS is recorded in the TS data area 66 of the hard disk 30 by changing the configuration of the second embodiment. Naturally, the configuration of the first and third embodiments may be similarly changed to record the TS in the TS data area 66 of the hard disk 30.
[0071]
(Embodiment 5)
In the first embodiment, the generation timing of the thumbnail image is obtained by, for example, referring to the image decoded by the first MPEG decoder 32 and detecting a scene change. In the present embodiment, the point at which the audio data changes significantly is the generation timing of the thumbnail image.
[0072]
FIG. 13 is a block diagram showing a configuration of a television receiver 10 according to Embodiment 5. This configuration is similar to the television receiver 10 described in the first embodiment, and thus, features that are particularly characteristic of the present embodiment will be described.
[0073]
The television receiver 10 includes an audio decoder 54 that decodes the encoded audio data separated by the TS separation unit 28, and an audio output unit 56 that outputs the decoded audio data to the outside. When the audio data is encoded according to the MPEG2 standard and the processing capability of the first MPEG decoder 32 is high, the first MPEG decoder 32 may perform the function of the audio decoder 54. Note that the audio decoder 54 and the audio output unit 56 are originally provided in the television receiver 10 shown in the first to fourth embodiments, but are omitted for ease of explanation.
[0074]
The audio data decoded by the audio decoder 54 is transmitted to the image selection unit 38 and the audio output unit 56. The image selecting unit 38 refers to the audio data, determines a point at which the audio data greatly changes as timing for selecting a thumbnail image, and, based on the timing, determines a thumbnail image from the moving image decoded by the first MPEG decoder 32. Select an image to use as Note that the configuration of the present embodiment may be changed in the same manner as in the fourth embodiment, and the TS may be recorded in the TS data area 66 of the hard disk 30.
[0075]
The above-described configuration can be realized in terms of hardware by a CPU, a memory, or another LSI of an arbitrary computer, and can be realized in software by a program having an image processing function loaded in the memory. Here, the functional blocks realized by their cooperation are drawn. Therefore, it is understood by those skilled in the art that these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof.
[0076]
The present invention has been described based on some embodiments. These embodiments are exemplifications, and it is understood by those skilled in the art that various modifications can be made to the combination of each component and each processing process, and such modifications are also within the scope of the present invention. By the way. Such modified examples will be described.
[0077]
In the embodiment, the time intervals of the thumbnail images are equal, but as shown in FIG. 10, the time intervals may be increased as the time interval from the main image MI increases.
[0078]
FIG. 10 shows a time-series relationship between the main image MI and the six first to sixth thumbnail images TN1 to TN6. The main image MI is located between the third thumbnail image TN3 and the fourth thumbnail image TN4. The first to third thumbnail images TN1 to TN3 correspond to scenes before the main image MI, and the fourth to sixth thumbnail images TN4 to TN6 correspond to scenes after the main image MI.
[0079]
FIG. 11 shows an arrangement of the main image MI and the first to sixth thumbnail images TN1 to TN6 on the display device 12. The first thumbnail frame TF1 includes first to third thumbnail images TN1 to TN3, and the second thumbnail frame TF2 includes fourth to sixth thumbnail images TN4 to TN6. With the main image MI at the center, the first thumbnail frame TF1 is arranged on the left and the second thumbnail frame TF2 is arranged on the right, so that the order of the main image MI and the six thumbnail images can be easily recognized.
[0080]
FIG. 12 shows a functional block configuration of an image recording / reproducing apparatus 70 in which the present invention is focused on from another viewpoint. The image recording / reproducing device 70 includes an input interface block 72, a data block 74, a moving image block 76, an index image generation block 78, a frame generation block 80, and a display control block 84.
[0081]
The main correspondence between the image recording / reproducing unit 16 described in the first to fifth embodiments and the respective components of the image recording / reproducing device 70 shown in FIG. 12 will be described below. The first MPEG decoder 32 corresponds to the moving image block 76, and the hard disk 30 corresponds to the data block 74. The image selection unit 38, the data amount reduction unit 40, and the MPEG encoder 36 correspond to the index image generation block 78. The frame generation block 80 corresponds to the second MPEG decoder 34 and the thumbnail area generation unit 42, and the display control block 84 corresponds to the display control unit 52 and the second switch circuit SW2. Although not shown, each component block executes its function in cooperation with a predetermined control circuit such as a CPU corresponding to the control core circuit 50. Similarly, the functions of the respective constituent blocks are executed by co-operation.
[0082]
The input interface block 72 receives encoded data from the transmission medium 90. The encoded data is sent to the moving image block 76 or recorded in the data block 74. The index image generation block 78 selects an image to be used as a thumbnail image from the moving image decoded in the moving image block 76, generates a thumbnail image, encodes the thumbnail image, and records it in the data block 74.
[0083]
The frame generation block 80 decodes a plurality of predetermined thumbnail images, and generates a thumbnail frame so that the time relationship between the thumbnail images and the moving image can be recognized. The generated thumbnail frame is displayed on the display device 12 together with the moving image by the display control block 84. The frame generation block 80 updates the thumbnail frame at a predetermined update timing. Here, the transmission medium 90 includes a storage medium such as a DVD, and a broadcast medium such as a terrestrial broadcast, a satellite broadcast, and a CATV.
[0084]
【The invention's effect】
According to the present invention, a desired scene can be searched when a user views a moving image. From another viewpoint, it is possible to search for a scene without interrupting the display of a moving image. From still another viewpoint, when the index image is further compressed, a new large recording capacity is not required, so that a scene search technique can be realized while suppressing an increase in cost.
[Brief description of the drawings]
FIG. 1 is a diagram showing an arrangement of a thumbnail frame and a main image on a display device.
FIG. 2 is a diagram illustrating a time-series relationship between a thumbnail image and a main image when time intervals between thumbnail images are equal.
FIG. 3 is a diagram illustrating an arrangement of a thumbnail frame and a main image on a display device.
FIG. 4 is a diagram illustrating an arrangement of a thumbnail frame and a main image on a display device.
FIG. 5 is a block diagram illustrating a configuration of a television receiver according to Embodiment 1.
FIG. 6 is a flowchart showing a procedure for displaying a thumbnail frame and jumping to a desired scene.
FIG. 7 is a block diagram showing a configuration of a television receiver according to a second embodiment.
FIG. 8 is a block diagram showing a configuration of a television receiver according to a third embodiment.
FIG. 9 is a block diagram showing a configuration of a television receiver according to Embodiment 4.
FIG. 10 is a diagram illustrating a time-series relationship between a thumbnail image and a main image when the time interval between the thumbnail images increases as the distance from the main image increases.
FIG. 11 is a diagram showing an arrangement of a thumbnail frame and a main image on a display device according to a modification.
FIG. 12 is a diagram showing a configuration of an image recording / reproducing apparatus by functional blocks.
FIG. 13 is a block diagram showing a configuration of a television receiver according to a fifth embodiment.
[Explanation of symbols]
Reference Signs List 10 television receiver, 12 display device, 14 tuner unit, 16 image recording / reproducing unit, 18 antenna, 22 RF unit, 24 demodulation unit, 26 error correction unit, 28 TS separation unit, 30 hard disk, 32 first MPEG decoder, 34 2nd MPEG decoder, 36 MPEG encoder, 38 image selection section, 40 data amount reduction section, 42 thumbnail area generation section, 44 coded image data area, 46 thumbnail image data area, 50 control core circuit, 52 display control section, 54 audio Decoder, 56 audio output unit, 60 remote control light receiving unit, 62 RC, 66 TS data area, 70 image recording / reproducing device, 72 input interface block, 74 data block, 76 moving image block, 78 index image generation block, 80 frame generation B Click, 84 display control block, 90 transmission media.

Claims (19)

When a moving image is displayed, controlling a plurality of reduced images to be displayed so that the progress and time relationship of the moving image can be recognized.
Controlling the displayed reduced image to be updated according to the progress of the moving image;
An image processing method comprising: When a moving image is displayed, a display control unit that displays a plurality of reduced images on the same screen as the screen on which the moving image is displayed so that the progress and the time relationship of the moving image can be recognized.
A reduced image updating unit that updates a reduced image displayed on the same screen as the moving image according to the progress of the moving image,
An image processing apparatus comprising: An image extracting unit that obtains a moving image signal and extracts a unit image constituting the moving image,
An image selection unit that selects an original image of an index image used when searching for a desired scene of the moving image from the unit images extracted by the image extraction unit,
A first data recording unit that holds the moving image signal,
An index image generation unit that generates an index image by reducing the size of the selected original image,
A second data recording unit that records and holds the index image in association with the original image,
An index image specifying unit that selects a predetermined index image from the second data recording unit according to the progress of the moving image,
An index update unit that controls to update the index image in accordance with the progress of the moving image,
An image recording / reproducing apparatus comprising: A first decoding unit that acquires encoded data and decodes a unit image constituting a moving image,
An image selection unit that selects an original image of an index image used when searching for a desired scene of the moving image from the unit images decoded by the first decoding unit,
A first data recording unit that holds the encoded data,
An index image generation unit that generates an index image by reducing the size of the selected original image,
An encoding unit that intra-codes the index image and compresses the data amount of the index image,
A second data recording unit that holds the encoded index image in association with the original image,
A second decoding unit that selects and decodes a predetermined index image in accordance with the progress of the moving image,
An index update unit that controls to update the decoded index image in accordance with the progress of the moving image,
An image recording / reproducing apparatus comprising: An index area generating unit that generates an index display area configured using the index image so that a time relationship with the moving image can be recognized,
A display control unit that controls to arrange and display the moving image and the index display area on the same screen,
The image recording / reproducing apparatus according to claim 3, further comprising: 6. The image recording / reproducing apparatus according to claim 4, wherein the first and second decoding units are shared and realized by a single configuration. A first MPEG decoder that acquires encoded data, which is a moving image signal encoded according to MPEG, and decodes a unit image forming the moving image;
An image selection unit that selects an original image of an index image used when searching for a desired scene of the moving image from unit images decoded by the first MPEG decoder;
A first data recording unit that holds the encoded data,
An index image generating unit that generates an index image by reducing the size of the selected unit image,
An MPEG encoder for intra-coding the index image;
A second data recording unit that holds the encoded index image in association with the original image,
A second MPEG decoder for decoding a predetermined index image;
An index area generating unit that generates an index area configured using the decoded index image so that a time relationship with the progress of the moving image can be recognized.
A display control unit that controls display of the index area;
An image recording / reproducing apparatus comprising: 8. The image recording / reproducing apparatus according to claim 7, wherein the first and second MPEG decoders are shared and realized by a single configuration. A tuner that receives a digital television broadcast signal wave multiplexed with a transport stream including a moving image signal encoded in accordance with MPEG and that has been subjected to predetermined modulation, and demodulates the signal wave into a transport stream. Department and
A TS separation unit that separates the video signal from the transport stream as encoded data,
A first MPEG decoder that acquires the encoded data and decodes a unit image constituting a moving image;
A first data recording unit that holds the encoded moving image signal as encoded data,
An image selection unit that selects an original image of an index image used when searching for a desired scene of the moving image from unit images decoded by the first MPEG decoder;
An index image generating unit that generates an index image by reducing the size of the selected unit image,
An MPEG encoder for intra-coding the index image;
A second data recording unit that holds the encoded index image in association with the original image,
A second MPEG decoder for decoding a predetermined index image;
An index area generating unit that generates an index area configured using the decoded index image so that a time relationship with the progress of the moving image can be recognized.
A display control unit that controls display of the index area;
When any of the index images constituting the index area is selected by the user, a scene determination unit that resumes the progress of the moving image from the image corresponding to the index image,
A television receiver comprising: A tuner that receives a digital television broadcast signal wave multiplexed with a transport stream including a moving image signal encoded in accordance with MPEG and that has been subjected to predetermined modulation, and demodulates the signal wave into a transport stream. Department and
A TS separation unit that separates the video signal from the transport stream as encoded data,
A first MPEG decoder that acquires the encoded data and decodes a unit image constituting a moving image;
A first data recording unit that holds the transport stream,
An image selection unit that selects an original image of an index image used when searching for a desired scene of the moving image from unit images decoded by the first MPEG decoder;
An index image generating unit that generates an index image by reducing the size of the selected unit image,
An MPEG encoder for intra-coding the index image;
A second data recording unit that holds the encoded index image in association with the original image,
A second MPEG decoder for decoding a predetermined index image;
An index area generating unit that generates an index area configured using the decoded index image so that a time relationship with the progress of the moving image can be recognized.
A display control unit that controls display of the index area;
When any of the index images constituting the index area is selected by the user, a scene determination unit that resumes the progress of the moving image from the image corresponding to the index image,
A television receiver comprising: 11. The television receiver according to claim 9, wherein the first and second MPEG decoders are shared and realized by a single configuration. 9. The image recording / reproducing apparatus according to claim 3, wherein the image selecting unit selects an original image of the index image at a predetermined time interval. 9. The image recording / reproducing apparatus according to claim 3, wherein the image selecting unit selects an original image of the index image based on an instruction from a user. 9. The image recording / reproducing apparatus according to claim 3, wherein the image selecting unit selects an original image of the index image at a timing when a scene of the moving image changes greatly. 9. The image recording / reproducing apparatus according to claim 3, wherein the image selecting unit selects an original image of the index image at a timing provided to the moving image by a creator of the moving image. apparatus. When the moving image is composed of a plurality of chapters, the image selecting unit selects a leading image of the chapter as an original image of the index image. An image recording / reproducing apparatus according to claim 1. If the moving image is composed of a plurality of chapters and a search image is provided in the chapter, the image selection unit selects the search image as an original image of the index image. Item 9. The image recording / reproducing device according to any one of Items 3 to 8. Further comprising a third decoder for decoding the audio data included in the encoded data,
9. The image selecting unit according to claim 3, wherein the image selecting unit refers to the audio data decoded by the third decoder, and selects an original image of the index image at a timing when a volume largely changes. 10. The image recording / reproducing apparatus according to the above. 13. The image recording / reproducing apparatus according to claim 12, wherein the image selecting unit sets the predetermined time interval according to a situation before extracting the original image of the index image.

Images