WO2007055445A1 - A pre-viewing method of multiple movies or movie-clips in multimedia apparatus - Google Patents

A pre-viewing method of multiple movies or movie-clips in multimedia apparatus Download PDF

Info

Publication number
WO2007055445A1
WO2007055445A1 PCT/KR2006/000611 KR2006000611W WO2007055445A1 WO 2007055445 A1 WO2007055445 A1 WO 2007055445A1 KR 2006000611 W KR2006000611 W KR 2006000611W WO 2007055445 A1 WO2007055445 A1 WO 2007055445A1
Authority
WO
WIPO (PCT)
Prior art keywords
moving images
frame
multimedia device
video
images
Prior art date
Application number
PCT/KR2006/000611
Other languages
French (fr)
Inventor
Jong Hun Lee
Young Chul Lim
Woo Young Jung
Original Assignee
Daegu Gyeongbuk Institute Of Science And Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Daegu Gyeongbuk Institute Of Science And Technology filed Critical Daegu Gyeongbuk Institute Of Science And Technology
Publication of WO2007055445A1 publication Critical patent/WO2007055445A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/4147—PVR [Personal Video Recorder]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H04N21/42607—Internal components of the client ; Characteristics thereof for processing the incoming bitstream
    • H04N21/4263—Internal components of the client ; Characteristics thereof for processing the incoming bitstream involving specific tuning arrangements, e.g. two tuners
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/482—End-user interface for program selection

Definitions

  • the present invention relates to technology for previewing moving images, and, more particularly, to a method for previewing a plurality of moving images through various multimedia devices, simultaneously and in real-time.
  • 10-2004-0001190 has disadvantages in that, since a plurality of video decoders must be used in a multimedia device, or the number of video decoders is determined by the number of moving images to be previewed, and an I-frame is previously extracted to generate thumbnail images and to play the previously generated thumbnail images, configuration of the multimedia device is complicated and also additional resources for extracting and storing the extracted I-frame must be required.
  • FIG. 1 and FIG. 2 are illustrated to describe the prior art method for previewing moving images.
  • FIG. 1 is a schematic block diagram describing a prior art method for previewing a plurality of moving images, using a plurality of video decoders.
  • FIG. 2 is a flow chart describing a prior art method for previewing moving images while an image file is played, in which the image file is generated as thumbnail images are generated and stored.
  • a multimedia device adopting the prior art method for previewing a plurality of moving images includes video decoders (Vl, V2, V3, V4,...Vm) which process the plurality of moving images (Ma, Mb, Mb,.Mm,..., respectively.
  • the prior art multimedia device is operated such that decoded signals are processed by a video processor (VPC) and then outputted on a video screen (P).
  • VPC video processor
  • the prior art multimedia device When the prior art multimedia device is configured to include a plurality of video decoders (Vl, V2, V3, V4,..Vm), it has good preview reproduction performance.
  • the prior art multimedia device has disadvantages in that its hardware is very complicated, and its cost is raised since the number of elements for the device is increased.
  • FIG. 2 is a view describing a method of playing moving images on a preview screen, according to another embodiment of the prior art.
  • a method for the multimedia device is performed such that: broadcasting signals are received (102); the received broadcasting signals are demodulated and then decoded (101); the decoded signals are encoded (102); only I- frames are extracted from the encoded signals (103); thumbnail images to be previewed are generated from the I-frames (105); and the generated thumbnail images are stored in a storage device, which is called an image storage loop.
  • the multimedia device of the prior art receives a search command for previewing thumbnail images on the basis of user s manipulation (110); displays an individual or representative thumbnail image thereon on the basis of broadcasting programs stored therein through the image storage loop (111); and, based on determination of the user, which is made as to whether there is a program representing an image to be searched, when a program representing the selected thumbnail image is selected by the user (113), displays the thumbnail image of the program according to selection information (114).
  • the prior art method since the prior art method includes such an image storage loop, such that a preview file is generated, and then the previously generated file is played, it cannot allow users to preview a plurality of moving images simultaneously and in real time. Namely, the prior art method is limited in a real time play and concurrency. Disclosure of Invention Technical Problem
  • the above and other objects can be accomplished by the provision of a method for previewing moving images in a multimedia device which includes one or more than one video decoder (VD) for decoding a plurality of moving images (Ml, M2, M3,.MN,..to be previewed, in which the video decoder (VD) outputs a video picture (P) generated as a video processor (VPC) processes decoded signals, the method comprising the steps of: allocating extraction interval (d) of an I-frame from respective groups of pictures (GOP) of respective moving images (Ma, Mb, Mb, .Mm, ..to extract preview images from the respective moving images (Ma, Mb, Mb, .Mm, ..; and extracting the I- frames in the GOP of the moving images (Ma, Mb, Bb, . Mm,.. with the extraction interval (d) of the I-frames (I), decoding the extracted I-frames, and
  • the extraction interval (d) of the I-frames (I) is determined by a processor adopted to the multimedia device and the number of counted moving images to be played, in which the processor of the multimedia device further includes a program logic to determine the extraction interval of the I-frames (I).
  • the method for previewing a plurality of moving images can effectively search for a plurality of moving images through various multimedia devices, in real time, using a processor with low performance or only a single video decoder, the multimedia device employing the method can be cost-effective and the method can provide users with convenience for using the device.
  • FIG. 1 is a schematic block diagram describing a prior art method for previewing a plurality of moving images, using a plurality of video decoders;
  • FIG. 2 is a flow chart describing a prior art method for previewing moving images while an image file is played, in which the image file is generated as thumbnail images are generated and stored;
  • FIG. 3 is a schematic block diagram illustrating a multimedia device according to the present invention, adapting a method for previewing a plurality of moving images
  • FIG. 4 shows captured images which are successively extracted images displayed on a user s watch screen adapting a method for previewing a plurality of moving images in a multimedia device according to the present invention
  • FIG. 5 is a view describing a video decoding method for previewing a plurality of moving images, in real time, through a method for previewing a plurality of moving images through a multimedia device according to the present invention
  • FIG. 6 is a flow chart describing a method for previewing a plurality of moving images, in real time, through a multimedia device according to the present invention.
  • FIG. 7 is a schematic block diagram of a multimedia device adapting a method for previewing a plurality of moving images, in real time, through a multimedia device according to the present invention. Best Mode for Carrying Out the Invention
  • FIG. 3 is a schematic block diagram illustrating a multimedia device according to the present invention, adapting a method for previewing a plurality of moving images.
  • FIG. 4 is captured images which are successively extracted images displayed on a user's watch screen adapting a method for previewing a plurality of moving images in a multimedia device according to the present invention.
  • FIG. 5 is a view describing a video decoding method for previewing a plurality of moving images, in real time, through a method for previewing a plurality of moving images through a multimedia device according to the present invention.
  • FIG. 6 is a flow chart describing a method for previewing a plurality of moving images, in real time, through a multimedia device according to the present invention.
  • FIG. 7 is a schematic block diagram of a multimedia device adapting a method for previewing a plurality of moving images, in real time, through a multimedia device according to the present invention.
  • the method of the present invention serves to resolve problems in the prior art method for previewing a plurality of moving images through the multimedia device, and will be described in detail below, with reference to FIG. 3.
  • a multimedia device is configured to process a plurality of moving images (Ma, Mb, Mb, . Mm,., using a single video decoder (VD).
  • FIG. 4 shows views illustrating captured images which are sequentially outputted through screens for preview images with an extraction interval (d).
  • FIG. 5 is a view describing a video decoding method for previewing a plurality of moving images, in real time, through a method for previewing a plurality of moving images through a multimedia device according to the present invention.
  • the moving images (Ma, Mb, Mb, . Mm,. includes groups of pictures (referred to as GOP), in which the GOP has each of the moving images (Ma, Mb, Mb, . Mm,...
  • the GOP is formed by combination of I-frame (I), P-frame (P), and B-frame (B).
  • the 1-frame (I) is a frame that the I-frame itself can perform video decoding.
  • the P-frame (P) needs a reference frame as well as itself in order to perform video decoding.
  • the B-frame (B) requires an I-frame as a reference frame and a P-frame (P), in order to perform video decoding.
  • the basic idea of the method for previewing a plurality of moving images according to the present invention is that only an I-frame (I) is extracted from the GOP and then decoded in order to preview the moving images (Ma, Mb, Mb, . Mm,.., but instead all frames, such as, I-frame, P-frame, and B-frame, are decoded, thereby enhancing performance of the processor.
  • Mb, Mb, . Mm,. is performed as follows:
  • An I-frame (I) of an initial GOP in each of the moving images is sequentially extracted and decoded.
  • the extraction interval (d) of the I-frame (I) of the GOP is adjusted on the basis of performance of the processor used in the multimedia device, or the number of video decoders and the number of moving images to be previewed.
  • the extraction interval (d) is between present I-frame and a pervious extracted I- frame in the respective moving images.
  • the multimedia device using a processor with low performance can perform a preview function in that a plurality of moving images can be simultaneously and effectively previewed, as the processor of the multimedia device has a logic circuit which is capable of adjusting the extraction interval of the I-frame (I) to be extracted after the previously extracted frame according to performance of the employed processor.
  • FIG. 5 describes a sequence of extracting and decoding the I-frame (I) in the plurality of moving images.
  • FIG. 6 is a flow chart describing a method for efficiently previewing a plurality of moving images in real time, according to one embodiment of the present invention.
  • the multimedia device receives a signal for previewing moving images according to user's manipulation in step 200.
  • the processor in the multimedia device counts the number of the moving images
  • the processor determines as to whether the number (i) of the moving image is the number (m) of total moving images in step 203. When the determination is negative, the processor in the multimedia device determines the extraction interval of the I-frame (I) using a logic circuit which performs determination on the basis of the counted number (m) of moving images (Ma, Mb, Mb, . Mm,., and performance of the processor, in step 204. Successively, only the 1-frame (I) of the moving image (i) is extracted in step 205.
  • the I-frame (I) of the extracted moving image (i) is decoded to form an image in step 206.
  • the decoded image as the extracted image (Al) of FIG. 4 is outputted on a screen in step 207.
  • step 208 is returned to step 203 to perform determination as to whether the number (i) of the moving image is the number (m) of total moving images. Therefore, as the steps 203 to 208 are repeatedly performed, images (Al, Bl, Cl, ... are sequentially outputted on the output display as shown in FIG. 4.
  • the processor performs determination as to whether the number (i) of the moving image is the number (m) of total moving images in step 212, if the determination is negative, i.e., i ⁇ m , an I-frame (I) spaced from the extraction distance (d) of the I-frame (I), which is previously calculated, is extracted in step 213. After that, the extracted I-frame (I) is decoded as an image in step 214 and then outputted as an image (A2) on a display in step 215.
  • step 216 The number (i) of the moving image is increased to i+1 in step 216.
  • the present invention is described through a multimedia device with a single video decoder (VD), it can be modified to include more than two video decoders (VD) one of which processes moving images (Ma, Mb, Mb, . Mm,., with large capacity and another of which processes moving images (Ma, Mb, Mb, . Mm,., with small capacity, such that the image preview function can be smoothly implemented.
  • VD video decoders
  • FIG. 7 is a schematic block diagram of a multimedia device adapting a method for previewing a plurality of moving images in real time in a multimedia device according to the present invention.
  • the multimedia device whose configuration is performed in simulation, includes a real time TV watching function through a DMB, a video on demand (VoD) service watching function through a WLAN or a WiBro, and a watching function for a variety of multimedia contents which are previously stored in a hard disk.
  • VoD contents, and multimedia contents through the multimedia device (MM), a central processing unit (CPU) or a video decoder decodes I-frames (I) of the DMB TV channel in sequence according to time and output the decoded frames on a display. Also, the CPU or the video decoder decodes VoD contents in sequence and outputs the decoded contents on a display. In addition, the CPU or the video decoder decodes I- frames (I) from multimedia contents stored in storage media in sequence and then displays the decoded frames on a display.
  • the extraction interval of the 1-frame is adjusted according to performance of the CPU and the number of the moving image to be previewed, in which the 1-frame is a frame next to the previous extracted I-frame from the multimedia contents, respectively. Therefore, the plurality of moving images can be previewed in real time such that desired multimedia contents can be easily searched.
  • DMB TV listening and watching is performed such that a channel is selected through DMB tuner, MPEG-TS signals are extracted through base-band, and H.264 decoding is performed in hardware or software through the CPU.
  • Video signals of such decoded DMB TV signals are outputted in digital DVI or
  • the outputted video signals are converted to analog video output signals through a video output processor and then displayed as video images on a display.
  • Audio signals outputted from the CPU in an I2S format are outputted in a stereo-
  • IPTV listening and watching or VoD contents watching are performed through a
  • WLAN or a WiB ro such that: multimedia contents which are encapsulated in an IP frame are received through a WLAN or WiBro PHY or MAC; multimedia contents in MPEG 2 or MPEG 4 or H.264 format are extracted through network stack in the CPU; video decoding is performed based on video format of the multimedia contents; and video and audio signals are outputted through a video output processor and an audio processor.
  • the multimedia contents stored in storage media are listened to and watched such that: the CPU accesses the HDD through the IDE interface; video decoding is performed according to video format of multimedia contents; video and audio signals are outputted through a video output processor and an audio processor; and the multimedia contents are outputted on a display.
  • storage media such as a hard disk (HDD)
  • HDD hard disk

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Human Computer Interaction (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

A method for previewing a plurality of moving images in various multimedia playing devices, simultaneously and in real-time, is disclosed. The method is performed in a multimedia device which includes one or more than one video decoder (VD) for decoding a plurality of moving images (M1, M2, M3, MN) to be previewed, in which the video decoder (VD) outputs a video picture (P) generated as a video processor (VPC) processes decoded signals. More specifically, the method comprises the steps of: allocating extraction interval (d) of I-frame from respective groups of pictures (GOP) of respective moving images (Ma, Mb, Mb, Mm) to extract preview images from the respective moving images (Ma, Mb, Mb, Mm) and extracting the I-frame in the GOP of the moving images (Ma, Mb, Bb, Mm) with the extraction interval (d) of the I-frame (I), decoding the extracted I-frame, and outputting the decoded I-frame on an output display. Therefore, the method previews a plurality of moving images in various multimedia devices using only a low performance processor or a single video decoder in real time, such that the multimedia device employing the method can be cost-effective and provide users with convenience of use.

Description

Description
A PRE VIEWING METHOD OF MULTIPLE MOVIES OR MOVIE-CLIPS IN MULTIMEDIA APPARATUS
Technical Field
[1] The present invention relates to technology for previewing moving images, and, more particularly, to a method for previewing a plurality of moving images through various multimedia devices, simultaneously and in real-time. Background Art
[2] With development and spread of various multimedia devices playing moving images, reproduction performance becomes very important factor to design the multimedia devices.
[3] Especially, since the moving images require a memory with large capacity, which is dynamically driven, if a processor with relatively low specification or a memory with small capacity is used to process such moving images, the processor and the memory will be overloaded with respect to response speed, activity, or real time playing. Therefore, a novel method for processing image data is required, minimizing resources required for processing the image data.
[4] Such technology is disclosed in Korean Patent Application No. 10-2004-0001190, entitled digital broadcasting receiver and method for searching for thumbnail therethrough
[5] However, the prior art technology disclosed in Korean Patent application No.
10-2004-0001190 has disadvantages in that, since a plurality of video decoders must be used in a multimedia device, or the number of video decoders is determined by the number of moving images to be previewed, and an I-frame is previously extracted to generate thumbnail images and to play the previously generated thumbnail images, configuration of the multimedia device is complicated and also additional resources for extracting and storing the extracted I-frame must be required.
[6] FIG. 1 and FIG. 2 are illustrated to describe the prior art method for previewing moving images.
[7] FIG. 1 is a schematic block diagram describing a prior art method for previewing a plurality of moving images, using a plurality of video decoders. FIG. 2 is a flow chart describing a prior art method for previewing moving images while an image file is played, in which the image file is generated as thumbnail images are generated and stored.
[8] More specifically, as shown in FIG. 1, a multimedia device adopting the prior art method for previewing a plurality of moving images (Ma, Mb, Mb, Mm,... includes video decoders (Vl, V2, V3, V4,...Vm) which process the plurality of moving images (Ma, Mb, Mb,.Mm,..., respectively. The prior art multimedia device is operated such that decoded signals are processed by a video processor (VPC) and then outputted on a video screen (P).
[9] When the prior art multimedia device is configured to include a plurality of video decoders (Vl, V2, V3, V4,..Vm), it has good preview reproduction performance. However, the prior art multimedia device has disadvantages in that its hardware is very complicated, and its cost is raised since the number of elements for the device is increased.
[10] FIG. 2 is a view describing a method of playing moving images on a preview screen, according to another embodiment of the prior art.
[11] For example, when a multimedia device is implemented with a broadcasting receiver, a method for the multimedia device is performed such that: broadcasting signals are received (102); the received broadcasting signals are demodulated and then decoded (101); the decoded signals are encoded (102); only I- frames are extracted from the encoded signals (103); thumbnail images to be previewed are generated from the I-frames (105); and the generated thumbnail images are stored in a storage device, which is called an image storage loop.
[12] When preview operation is performed, the multimedia device of the prior art: receives a search command for previewing thumbnail images on the basis of user s manipulation (110); displays an individual or representative thumbnail image thereon on the basis of broadcasting programs stored therein through the image storage loop (111); and, based on determination of the user, which is made as to whether there is a program representing an image to be searched, when a program representing the selected thumbnail image is selected by the user (113), displays the thumbnail image of the program according to selection information (114).
[13] As such, since the prior art method includes such an image storage loop, such that a preview file is generated, and then the previously generated file is played, it cannot allow users to preview a plurality of moving images simultaneously and in real time. Namely, the prior art method is limited in a real time play and concurrency. Disclosure of Invention Technical Problem
[14] Therefore, it is an aspect of the invention to provide a method for previewing a plurality of moving images in various multimedia playing devices, in real-time, without generation of thumbnail images, as extraction interval of I-frames to be extracted is adjusted according to the number of moving images to be previewed.
[15] It is another aspect of the invention to provide a method for previewing a plurality of moving images in various multimedia devices, which is capable of previewing a plurality of moving images in multimedia devices with a processor with low performance or only a single video decoder, in real time, so that thereby minimizing system specification and reducing price of the multimedia device.
[16] Additional aspects and/or advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention. Technical Solution
[17] In accordance with an aspect of the present invention, the above and other objects can be accomplished by the provision of a method for previewing moving images in a multimedia device which includes one or more than one video decoder (VD) for decoding a plurality of moving images (Ml, M2, M3,.MN,..to be previewed, in which the video decoder (VD) outputs a video picture (P) generated as a video processor (VPC) processes decoded signals, the method comprising the steps of: allocating extraction interval (d) of an I-frame from respective groups of pictures (GOP) of respective moving images (Ma, Mb, Mb, .Mm, ..to extract preview images from the respective moving images (Ma, Mb, Mb, .Mm, ..; and extracting the I- frames in the GOP of the moving images (Ma, Mb, Bb, . Mm,.. with the extraction interval (d) of the I-frames (I), decoding the extracted I-frames, and outputting the decoded I-frames on an output display.
[18] Preferably, the extraction interval (d) of the I-frames (I) is determined by a processor adopted to the multimedia device and the number of counted moving images to be played, in which the processor of the multimedia device further includes a program logic to determine the extraction interval of the I-frames (I).
Advantageous Effects
[19] As appreciated through the above aspects, since the method for previewing a plurality of moving images can effectively search for a plurality of moving images through various multimedia devices, in real time, using a processor with low performance or only a single video decoder, the multimedia device employing the method can be cost-effective and the method can provide users with convenience for using the device. Brief Description of the Drawings
[20] These and/or other aspects and advantages of the invention will become apparent and more readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
[21] FIG. 1 is a schematic block diagram describing a prior art method for previewing a plurality of moving images, using a plurality of video decoders; [22] FIG. 2 is a flow chart describing a prior art method for previewing moving images while an image file is played, in which the image file is generated as thumbnail images are generated and stored;
[23] FIG. 3 is a schematic block diagram illustrating a multimedia device according to the present invention, adapting a method for previewing a plurality of moving images;
[24] FIG. 4 shows captured images which are successively extracted images displayed on a user s watch screen adapting a method for previewing a plurality of moving images in a multimedia device according to the present invention;
[25] FIG. 5 is a view describing a video decoding method for previewing a plurality of moving images, in real time, through a method for previewing a plurality of moving images through a multimedia device according to the present invention;
[26] FIG. 6 is a flow chart describing a method for previewing a plurality of moving images, in real time, through a multimedia device according to the present invention; and
[27] FIG. 7 is a schematic block diagram of a multimedia device adapting a method for previewing a plurality of moving images, in real time, through a multimedia device according to the present invention. Best Mode for Carrying Out the Invention
[28] Reference will now be made in detail to the embodiments of the present invention, examples of which are illustrated in the accompanying drawings.
[29] FIG. 3 is a schematic block diagram illustrating a multimedia device according to the present invention, adapting a method for previewing a plurality of moving images. FIG. 4 is captured images which are successively extracted images displayed on a user's watch screen adapting a method for previewing a plurality of moving images in a multimedia device according to the present invention. FIG. 5 is a view describing a video decoding method for previewing a plurality of moving images, in real time, through a method for previewing a plurality of moving images through a multimedia device according to the present invention. FIG. 6 is a flow chart describing a method for previewing a plurality of moving images, in real time, through a multimedia device according to the present invention. FIG. 7 is a schematic block diagram of a multimedia device adapting a method for previewing a plurality of moving images, in real time, through a multimedia device according to the present invention.
[30] The method of the present invention serves to resolve problems in the prior art method for previewing a plurality of moving images through the multimedia device, and will be described in detail below, with reference to FIG. 3.
[31] As shown in FIG. 3, a multimedia device according to the present invention is configured to process a plurality of moving images (Ma, Mb, Mb, . Mm,., using a single video decoder (VD). FIG. 4 shows views illustrating captured images which are sequentially outputted through screens for preview images with an extraction interval (d).
[32] FIG. 5 is a view describing a video decoding method for previewing a plurality of moving images, in real time, through a method for previewing a plurality of moving images through a multimedia device according to the present invention.
[33] The moving images (Ma, Mb, Mb, . Mm,., includes groups of pictures (referred to as GOP), in which the GOP has each of the moving images (Ma, Mb, Mb, . Mm,... The GOP is formed by combination of I-frame (I), P-frame (P), and B-frame (B).
[34] Here, the 1-frame (I) is a frame that the I-frame itself can perform video decoding.
The P-frame (P) needs a reference frame as well as itself in order to perform video decoding. The B-frame (B) requires an I-frame as a reference frame and a P-frame (P), in order to perform video decoding. Mode for the Invention
[35] The basic idea of the method for previewing a plurality of moving images according to the present invention is that only an I-frame (I) is extracted from the GOP and then decoded in order to preview the moving images (Ma, Mb, Mb, . Mm,.., but instead all frames, such as, I-frame, P-frame, and B-frame, are decoded, thereby enhancing performance of the processor.
[36] As shown in FIG. 5, the method for previewing a plurality of moving images (Ma,
Mb, Mb, . Mm,., is performed as follows:
[37] An I-frame (I) of an initial GOP in each of the moving images is sequentially extracted and decoded. The extraction interval (d) of the I-frame (I) of the GOP is adjusted on the basis of performance of the processor used in the multimedia device, or the number of video decoders and the number of moving images to be previewed. Here, the extraction interval (d) is between present I-frame and a pervious extracted I- frame in the respective moving images.
[38] In other words, the multimedia device using a processor with low performance can perform a preview function in that a plurality of moving images can be simultaneously and effectively previewed, as the processor of the multimedia device has a logic circuit which is capable of adjusting the extraction interval of the I-frame (I) to be extracted after the previously extracted frame according to performance of the employed processor.
[39] When the function of previewing a plurality of moving images according to the present invention is performed, FIG. 5 describes a sequence of extracting and decoding the I-frame (I) in the plurality of moving images. FIG. 6 is a flow chart describing a method for efficiently previewing a plurality of moving images in real time, according to one embodiment of the present invention.
[40] The method is performed as follows:
[41] The multimedia device receives a signal for previewing moving images according to user's manipulation in step 200.
[42] The processor in the multimedia device counts the number of the moving images
(Ma, Mb, Mb, . Mm,., in the present device (or a storage device) in step 201, in which the counted number is denoted by symbol m.
[43] After that, the counted number m of the moving image (i) is initialized as i=l in step 202.
[44] Afterwards, the processor determines as to whether the number (i) of the moving image is the number (m) of total moving images in step 203. When the determination is negative, the processor in the multimedia device determines the extraction interval of the I-frame (I) using a logic circuit which performs determination on the basis of the counted number (m) of moving images (Ma, Mb, Mb, . Mm,., and performance of the processor, in step 204. Successively, only the 1-frame (I) of the moving image (i) is extracted in step 205.
[45] The I-frame (I) of the extracted moving image (i) is decoded to form an image in step 206. The decoded image as the extracted image (Al) of FIG. 4 is outputted on a screen in step 207.
[46] Afterwards, the number of the moving image is increased as i=i+l in step 208, and then step 208 is returned to step 203 to perform determination as to whether the number (i) of the moving image is the number (m) of total moving images. Therefore, as the steps 203 to 208 are repeatedly performed, images (Al, Bl, Cl, ... are sequentially outputted on the output display as shown in FIG. 4.
[47] On the other hand, when the determination of step 203 is positive, that is, the number (i) of the moving image is the number (m) of total moving images, the number (i) of the moving image is initialized (i=l) in step 212.
[48] Afterwards, the processor performs determination as to whether the number (i) of the moving image is the number (m) of total moving images in step 212, if the determination is negative, i.e., i<m , an I-frame (I) spaced from the extraction distance (d) of the I-frame (I), which is previously calculated, is extracted in step 213. After that, the extracted I-frame (I) is decoded as an image in step 214 and then outputted as an image (A2) on a display in step 215.
[49] The number (i) of the moving image is increased to i+1 in step 216. The procedure after step 216 is returned to step 212 wherein the processor determines as to whether the number (i) of the moving image is the number (m) of total moving images, in order to repeat the loop until i=m, such that all images (Bl, Cl, .. can be outputted on the output display. When i=m, the procedure is returned to step 211 wherein the number (i) of moving image is initialized (i=l).
[50] As such, when image observation time, which means time while a user observes images outputted on an output screen, exceeds extraction interval (d) of an I-frame (I) + output time of images (Al, Bl, Cl, .., the loop is repeated from the exceeding time point, such that successively changed moving images can be played on the output screen.
[51] Although the present invention is described through a multimedia device with a single video decoder (VD), it can be modified to include more than two video decoders (VD) one of which processes moving images (Ma, Mb, Mb, . Mm,., with large capacity and another of which processes moving images (Ma, Mb, Mb, . Mm,., with small capacity, such that the image preview function can be smoothly implemented.
[52] FIG. 7 is a schematic block diagram of a multimedia device adapting a method for previewing a plurality of moving images in real time in a multimedia device according to the present invention.
[53] As shown in FIG. 7, the multimedia device (MM), whose configuration is performed in simulation, includes a real time TV watching function through a DMB, a video on demand (VoD) service watching function through a WLAN or a WiBro, and a watching function for a variety of multimedia contents which are previously stored in a hard disk.
[54] For example, in order to simultaneously preview images of DMB channel, several
VoD contents, and multimedia contents through the multimedia device (MM), a central processing unit (CPU) or a video decoder decodes I-frames (I) of the DMB TV channel in sequence according to time and output the decoded frames on a display. Also, the CPU or the video decoder decodes VoD contents in sequence and outputs the decoded contents on a display. In addition, the CPU or the video decoder decodes I- frames (I) from multimedia contents stored in storage media in sequence and then displays the decoded frames on a display.
[55] Afterwards, the extraction interval of the 1-frame is adjusted according to performance of the CPU and the number of the moving image to be previewed, in which the 1-frame is a frame next to the previous extracted I-frame from the multimedia contents, respectively. Therefore, the plurality of moving images can be previewed in real time such that desired multimedia contents can be easily searched.
[56] DMB TV listening and watching is performed such that a channel is selected through DMB tuner, MPEG-TS signals are extracted through base-band, and H.264 decoding is performed in hardware or software through the CPU.
[57] When performing such decoding, all frames need not to be decoded. Namely, only an I-frame (I) needs to be decoded. In other words, the I-frame (I) is decoded as the extraction interval of the I-frame is adjusted according to performance of the CPU and the number of moving images to be previewed.
[58] Video signals of such decoded DMB TV signals are outputted in digital DVI or
YCrCb or RGB format. The outputted video signals are converted to analog video output signals through a video output processor and then displayed as video images on a display.
[59] Audio signals outputted from the CPU in an I2S format are outputted in a stereo-
L/R or digital SPDIF format through an audio output processor.
[60] IPTV listening and watching or VoD contents watching are performed through a
WLAN or a WiB ro such that: multimedia contents which are encapsulated in an IP frame are received through a WLAN or WiBro PHY or MAC; multimedia contents in MPEG 2 or MPEG 4 or H.264 format are extracted through network stack in the CPU; video decoding is performed based on video format of the multimedia contents; and video and audio signals are outputted through a video output processor and an audio processor.
[61] The multimedia contents stored in storage media, such as a hard disk (HDD), are listened to and watched such that: the CPU accesses the HDD through the IDE interface; video decoding is performed according to video format of multimedia contents; video and audio signals are outputted through a video output processor and an audio processor; and the multimedia contents are outputted on a display. Industrial Applicability
[62] Although a few embodiments of the present invention have been shown and described, it would be appreciated by those skilled in the art that changes may be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the claims and their equivalents.

Claims

Claims
[1] A method for previewing moving images in a multimedia device which includes one or more than one video decoder (VD) for decoding a plurality of moving images (Ml, M2, M3, . MN,.. to be previewed, in which the video decoder (VD) outputs a video picture (P) generated as a video processor (VPC) processes decoded signals, the method comprising the steps of: allocating extraction interval (d) of I- frame from respective groups of pictures (GOP) of respective moving images (Ma, Mb, Mb, .Mm, .. to extract preview images from the respective moving images (Ma, Mb, Mb, .Mm, ..; and extracting the I-frame in the GOP of the moving images (Ma, Mb, Bb, . Mm, .. with the extraction interval (d) of the 1-frame (I), decoding the extracted I-frame, and outputting the decoded I-frame on an output display.
[2] The method as set forth in claim 1, wherein the extraction interval (d) of the I- frame (I) is determined by a processor employed by the multimedia device and the number of the counted moving images to be played, in which the processor of the multimedia device further includes a program logic to determine the extraction interval of the I-frame (I).
[3] The method as set forth in claim 1, wherein the method is applied to a multimedia device using software codec.
[4] The method as set forth in claim 1, wherein the method is applied to a multimedia device using a hardware video decoder.
[5] The method as set forth in claim 1 or 4, wherein the method is applied to a multimedia device with video decoders, the number of which is less than that of the previewed moving images.
PCT/KR2006/000611 2005-11-11 2006-02-22 A pre-viewing method of multiple movies or movie-clips in multimedia apparatus WO2007055445A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2005-0108235 2005-11-11
KR20050108235 2005-11-11

Publications (1)

Publication Number Publication Date
WO2007055445A1 true WO2007055445A1 (en) 2007-05-18

Family

ID=38023420

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2006/000611 WO2007055445A1 (en) 2005-11-11 2006-02-22 A pre-viewing method of multiple movies or movie-clips in multimedia apparatus

Country Status (1)

Country Link
WO (1) WO2007055445A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103428570A (en) * 2012-05-24 2013-12-04 三星电子株式会社 Method and apparatus for multi-playing videos
CN105635837A (en) * 2015-12-30 2016-06-01 努比亚技术有限公司 Video playing method and device
US10237551B2 (en) 2010-09-30 2019-03-19 Mitsubishi Electric Corporation Moving image encoding device, moving image decoding device, moving image coding method, and moving image decoding method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5877817A (en) * 1996-05-28 1999-03-02 Samsung Electro-Mechanics Co., Ltd. Digital satellite broadcast receiver having simultaneous multi-channel search function, and control method therefor
EP1182584A2 (en) * 2000-08-19 2002-02-27 Lg Electronics Inc. Method and apparatus for video skimming
US6754274B2 (en) * 1995-12-11 2004-06-22 Samsung Electronics Co., Ltd. Video data recording method and apparatus for high-speed reproduction
US20050123205A1 (en) * 2003-12-06 2005-06-09 Samsung Electronics Co., Ltd. Apparatus and method for providing thumbnail image data on a mobile terminal

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6754274B2 (en) * 1995-12-11 2004-06-22 Samsung Electronics Co., Ltd. Video data recording method and apparatus for high-speed reproduction
US5877817A (en) * 1996-05-28 1999-03-02 Samsung Electro-Mechanics Co., Ltd. Digital satellite broadcast receiver having simultaneous multi-channel search function, and control method therefor
EP1182584A2 (en) * 2000-08-19 2002-02-27 Lg Electronics Inc. Method and apparatus for video skimming
US20050123205A1 (en) * 2003-12-06 2005-06-09 Samsung Electronics Co., Ltd. Apparatus and method for providing thumbnail image data on a mobile terminal

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10237551B2 (en) 2010-09-30 2019-03-19 Mitsubishi Electric Corporation Moving image encoding device, moving image decoding device, moving image coding method, and moving image decoding method
US10237550B2 (en) 2010-09-30 2019-03-19 Mitsubishi Electric Corporation Moving image encoding device, moving image decoding device, moving image coding method, and moving image decoding method
US10244264B2 (en) 2010-09-30 2019-03-26 Mitsubishi Electric Corporation Moving image encoding device, moving image decoding device, moving image coding method, and moving image decoding method
US10244233B2 (en) 2010-09-30 2019-03-26 Mitsubishi Electric Corporation Moving image encoding device, moving image decoding device, moving image coding method, and moving image decoding method
US10291939B2 (en) 2010-09-30 2019-05-14 Mitsubishi Electric Corporation Moving image encoding device, moving image decoding device, moving image coding method, and moving image decoding method
CN103428570A (en) * 2012-05-24 2013-12-04 三星电子株式会社 Method and apparatus for multi-playing videos
RU2619089C2 (en) * 2012-05-24 2017-05-11 Самсунг Электроникс Ко., Лтд. Method and device for multiple videos reproduction
CN103428570B (en) * 2012-05-24 2018-06-05 三星电子株式会社 For the method and apparatus of multiple broadcasting video
CN105635837A (en) * 2015-12-30 2016-06-01 努比亚技术有限公司 Video playing method and device
CN105635837B (en) * 2015-12-30 2019-04-19 努比亚技术有限公司 A kind of video broadcasting method and device

Similar Documents

Publication Publication Date Title
US8457478B2 (en) Method and apparatus for receiving, storing, and presenting multimedia programming without indexing prior to storage
US8378923B2 (en) Locating and displaying method upon a specific video region of a computer screen
US20010038746A1 (en) Layered coding of image data using separate data storage tracks on a storage medium
US20080247729A1 (en) Method and apparatus for normal reverse playback
US7990473B2 (en) Image processing apparatus, image processing method, and image processing program
CN101960844A (en) Application enhancement tracks
JP2002118802A (en) Video recording and reproducing device
CN1284366C (en) Device for recording and/or reproducing digital data and control method thereof
US20070286584A1 (en) Information processing system, recording/playback apparatus, playback terminal, information processing method, and program
WO2007055445A1 (en) A pre-viewing method of multiple movies or movie-clips in multimedia apparatus
KR101731829B1 (en) Device and method for processing digital contents in digital video receiver
JP2005347871A (en) Television receiver
CN1672409A (en) Trick play behavior controlled by a user
JP5304539B2 (en) Media quality conversion apparatus, media quality conversion method, and media quality conversion program
TWI819630B (en) Media playback device and related media playback method
JP4413661B2 (en) Recording / playback device, image playback system, and terminal device
JP2002033712A (en) Packet processor and packet output method therefor
CN117221638A (en) Media playing device and related media playing method
JP2008153955A (en) Video recording and reproducing device, and its method for special reproduction
CN100450170C (en) Method and device for acquisition of digital video continuous pictures
KR20050077123A (en) Apparatus and method for generating thumbnail image in pvr system
KR100703002B1 (en) Signal process apparatus capable of selective encoding and method thereof
KR20080004673A (en) Method for searching a picture in recording and reproducing a picture
CN115866349A (en) Multimedia file playing method and device and electronic equipment
KR20120057673A (en) Display processing apparatus and control method of the same

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 06716061

Country of ref document: EP

Kind code of ref document: A1