KR101275555B1 - Method and apparatus for reproducing multi media, and multi-media file format thereof - Google Patents

Abstract

Disclosed are a method and apparatus for playing multimedia, and a multimedia file format therefor. The method comprises the steps of accepting a request from a client and finding at least one destination media data in the destination file using media information including at least one of animation information and sliding information. Therefore, it is possible to generate a scene desired by the client using various media data and media information. In particular, animations are added to music (for example, accompaniment of original music processing) and images (for example, still images). Since the result can be provided to the client along with the text, for example, a song can be accompanied by the animation of the accompaniment along with the lyrics, and the effect of the video can be provided with a small amount of data. More effects are given to devices with limited resources.

Media data, animation, lyrics data, accompaniment data, scenes

Description

METHOD AND APPARATUS FOR REPRODUCING MULTIMEDIA, AND MULTI-MEDIA FILE FORMAT

1 is a diagram schematically showing a multimedia file format according to the present invention.

2 is a diagram illustrating an embodiment of a multimedia file format according to the present invention.

3 is a diagram showing a format of an embodiment according to the present invention for the track area shown in FIG.

4 is a view for explaining another embodiment of a multimedia file format according to the present invention.

5 is a diagram showing the format of an embodiment according to the present invention for the track area shown in FIG.

6 is a view for explaining another embodiment of a multimedia file format according to the present invention.

7 is a flowchart for explaining an embodiment of a multimedia playback method according to the present invention.

8 is a block diagram of an embodiment of a multimedia playback apparatus according to the present invention.

FIG. 9 is a flowchart for describing an exemplary embodiment of the present invention in operation 172 illustrated in FIG. 7.

FIG. 10 is a flowchart for describing an exemplary embodiment of the present invention with respect to step 194 illustrated in FIG. 9.

FIG. 11 is a flowchart for explaining another embodiment of the present invention with respect to step 194 illustrated in FIG. 9.

FIG. 12 is a flowchart for describing an exemplary embodiment of the present invention in the step 176 illustrated in FIG. 7.

FIG. 13 is a block diagram of a preferred embodiment of the present invention of the media search unit shown in FIG. 8.

FIG. 14 is a flowchart for describing an exemplary embodiment of the present invention in operation 222 illustrated in FIG. 12.

FIG. 15 is a flowchart for explaining another exemplary embodiment of the present invention at step 222 illustrated in FIG. 12.

FIG. 16 is a flowchart for describing another exemplary embodiment of the present invention at step 222 illustrated in FIG. 12.

DESCRIPTION OF THE REFERENCE NUMERALS

10, 10A, 10B, 10C: file identification area 12, 12A, 12B, 12C: information area

14, 14A, 14B, 14C: Data area 180: Interface part

182: media search unit 184: storage unit

186: scene generator

The present invention relates to various types of media such as audio or video, and more particularly, to a multimedia playback method and apparatus for processing and playing various types of media data, and a multimedia file format therefor.

Recently, with the development of the Internet and portable devices, the MP3 (MPEG Audio layer-3) music market is growing significantly. In addition, display devices are being employed in personal computers (PCs) or portable devices. Along with this, the client wants to express various personalities or satisfy the demand for entertainment. For example, clients are creating new cultural phenomena, such as creating videos by themselves and watching them or providing them as gifts to others. In addition, new services such as karaoke using music are emerging. At this time, existing services use newly created sound sources in the form of MIDI (Musical Instrument Digital Interface) files. Therefore, because the newly created sound source is different from the original music, these existing services lower the client's satisfaction and are not actually utilized in the market. In addition, the karaoke service provided has a problem because it can not provide a variety of visual elements, such as video or lyrics to the client due to the influence of the network capacity.

SUMMARY OF THE INVENTION The present invention has been made in an effort to provide a multimedia playback method and apparatus capable of easily and quickly finding various types of media data and creating various scenes using the same.

Another object of the present invention is to provide a multi-media file format that enables easy and fast retrieval of various types of media data and enables media data to be used for various scenes.

In accordance with an aspect of the present invention, there is provided a multimedia playback method including accepting a request from a client and using media information including at least one of animation information and sliding information. It is preferred to consist of finding steps.

In addition, the multimedia reproducing apparatus according to the present invention for achieving the above object, the media to search for at least one media data requested by the client through the interface information that is operated by the client to generate a request signal and the media information of the object file The media information may include at least one of animation information and sliding information.

In order to achieve the above object, it is preferable that the data identification region having file identification information, a data region having media data, and an information region having media information including at least one of animation information and sliding information of the media data. .

Hereinafter, with reference to the accompanying drawings, each of the multimedia file format and embodiments thereof according to the present invention will be described.

FIG. 1 is a diagram schematically showing a multimedia file format according to the present invention, and is composed of a file identification area 10, an information area 12, and a data area 14. As shown in FIG. The file identification area 10 has file identification information. Here, the file identification information means information for distinguishing a plurality of files from each other, and may be expressed in a format and / or a version of the file.

The data area 14 is an area in which various media data is recorded. The various media data means at least one of video data, audio data, and text data. Here, the video data may mean at least one of video image data and still image data. The video data may be compressed in the form of a Joint Picture Expert Group (JPEG), Moving Picture Expert Group (MPEG) -1, 2, or Advanced Video Coding (AVC). For example, the video data may be various types of video clips or pictures obtained through a device such as a camcorder or a portable terminal. The video image data is data to express a moving image like a video clip, and the still image data is data to express a still image like a photo. The audio data may mean at least one of music data, accompaniment data, and voice data. The music data is data representing music, and may be compressed by, for example, MP3 or Advanced Audio Coding (AAC). In this case, the music data may mean a result of combining accompaniment data and voice data. Accompaniment data may refer to data consisting of only musical instrument sounds excluding the voice of a singer in music. According to the present invention, if the music has accompaniment with the singer's voice, the accompaniment data can be obtained by excluding the voice data from the music data. Here, the voice data may mean only the voice of a client singing a song along with the accompaniment. To reduce the amount when stored, the voice data may take the form of MP3, for example. The text data may refer to data representing text such as lyrics or characters. Media data included in the media area 14 illustrated in FIG. 1 may have a stream form. In this case, the media data may be stored in the media area 14 in units of bytes.

The information area 12 has media information for each media data. Media information refers to information describing media data. If the media data is music data, the media information for the music data may have information about the singer and / or composer of the music. As such, attributes of the media data may be defined using the media information. For example, the media information may be information related to a stream format, a location and / or a representation method of media data included in the data area 14. According to the present invention, the information area 12 has at least one of animation information and sliding information as media information. The animation information refers to information describing the animation of the video data, and the sliding information refers to information describing the sliding of the video data. For example, the animation information may be information about how to give a certain animation effect to which video data among various video data. The sliding information may be information on how to give a sliding effect to which video data among various video data.

According to an embodiment of the present invention, the animation information or sliding information may have at least one of video information and time information. Here, the video information means information about the video data. For example, the video information may include at least one of the size of the video to be animated or sliding, the type of video to be animated or sliding, and the properties of the animation or sliding. The time information means information on the reproduction time of the media data. For example, the time information may include at least one of duration information, order information, and synchronization information. Here, the period information means information on a period during which the media data is played. For example, the period information may be information about a period in which each video data being slid is shown to the client. The order information means information on the order in which each media data is to be reproduced. For example, the order information may have information about the order in which each video data is to be slid. The synchronization information is information used when synchronizing other media data to media data to which at least one of animation and sliding is applied. For example, the synchronization information may be information used when synchronizing text data to at least one of audio data and video data. To represent this synchronization information, the 3GPP 26.245 standard or MPEG-4 streaming text format can be used. For example, it is possible to represent text data synchronized with media data such as audio and / or video data using MPEG-4 BIFS (Binary Format for Scene). Media information may be described by MPEG-7.

According to the present invention, at least one of the animation information and / or the sliding information may be represented in text form or in binary form. If animation information and / or sliding information is expressed in text form, the description of animation and / or sliding effect can be easily edited and produced. In addition, meanings involving animation and / or sliding effects can be intuitively understood by the client. In addition, when animation information and / or sliding information is represented in binary form, the animation information and / or sliding information may be encoded. Therefore, not only the amount of media data can be reduced by encoding but also the speed of decoding can be improved. For this purpose, the animation information and / or sliding information may be represented by light-weigh application scene representation (LASeR) scripts or hierarchical vector graphics (SVG).

FIG. 2 is a view for explaining an embodiment of a multimedia file format according to the present invention, and is composed of a file identification area 10A, an information area 12A, and a data area 14A. The file identification area 10A, information area 12A, and data area 14A shown in FIG. 2 are embodied in the file identification area 10, information area 12, and data area 14 shown in FIG. Each corresponds to an example. The data area 14A shown in FIG. 2 is an area in which various media data is recorded and includes at least one of audio data 40, video data 42, and text data 44. The audio data 40 may include at least one of music and / or accompaniment data 50 and voice data 52. In addition, the video data 42 may include at least one of the video image data 54 and the still image data 56. Here, data 56 may be present to represent the M still images JPEG. M is a positive integer of 1 or more.

The information area 12A shown in FIG. 2 provides track areas 20 to 32 for each type of media data. Each track area has media information for corresponding media data. For example, the track area 20 has media information for the music data 50, and the track area 22 has media information for the accompaniment data 50. The track area 24 has media information for the audio data 52, and the track area 26 has media information for the video image data 54. At least one track area 28,... And / or 30 has media information for still image data 56. The plurality of track areas 28 to 30 may have animation information and / or sliding information that may produce different effects, respectively. The track area 32 has media information for the text data 44.

FIG. 3 is a diagram showing the format of an embodiment according to the present invention for the track area shown in FIG. 2, which is comprised of a media area 70 and a meta area 72. As shown in FIG. According to the present invention, each track area included in the information area 12A shown in FIG. 2 may provide at least one of the media area 70 and the meta area 72. For example, a track area may provide both the media area 70 and the meta area 72 shown in FIG. 3. The media area 70 has sliding information as media information. The meta area 72 has at least one of metadata, sliding information, and animation information about the media data as media information. Here, the meta data (or meta content) for the media data is a description such as an attribute of the media data itself or an attribute of which the media data is to be used. For example, meta data is a technique such as a compression format of media data or a corresponding one when classifying media data into a conventional concept. It is possible to search or select multimedia data by meta data. More specifically, for example, the media information included as meta data in the meta area 72 may have at least one of an identification number, a name, a shape, a position, and a size of the corresponding media data. Here, the identification number of the data of the media means unique information given to each media data so that media data included in the data area 14A can be distinguished from each other. Therefore, access to each media data can be facilitated using the identification number. According to the present invention, the meta region 72 may have meta data separately divided. For example, the meta area 72 may have the identification number, position, and size of the media data as one bundle, and may have the name and form of the media data as another bundle. The meta region 72 of each of the track regions 28 to 30 for the video data 42, for example still image data 56 shown in FIG. 2, has at least one of animation information and sliding information as media information. Can be.

According to the present invention, when sliding video data while applying animation effects, animation information and sliding information included in the meta area 72 may be used, and sliding information and meta area included in the media area 70 may be used. Animation information included in 72 may be used. When sliding video data without providing an animation effect, sliding information included in the media area 70 or the meta area 72 may be used.

4 is a view for explaining another embodiment of the multimedia file format according to the present invention, and is composed of a file identification area 10B, an information area 12B, and a data area 14B. The file identification area 10B, information area 12B, and data area 14B shown in FIG. 4 are different implementations of the file identification area 10, information area 12, and data area 14 shown in FIG. Each corresponds to an example. The data area 14B shown in FIG. 4 is an area in which various media data is recorded, and has the same configuration as the data area 14A shown in FIG. That is, data area 14B includes at least one of audio data 110, video data 112, and text data 114. The audio data 110 may include at least one of music and / or accompaniment data 120 and voice data 122. In addition, the video data 112 may include at least one of the video image data 124 and the still image data 126.

According to the present invention, the information area 12B shown in FIG. 4 provides the track areas 90 to 100 for each type of media data. In this case, one track area may be provided for one media data in the information area 12A or 12B shown in FIG. 2 or 4, and a plurality of track areas may be provided for one media data. . Each track area shown in FIG. 4 has at least one of first attribute information and sliding information as a first portion of media information. Here, the first attribute information is information indicating some of attributes of corresponding media data. For example, an attribute of media data may be an attribute of media data itself. At this time, the information representing the rest of the attributes of the corresponding media data is included in the main meta area 80. The track area 90 has first attribute information for the music data 120 as a first part, and the track area 92 has first attribute information for the accompaniment data 120 as a first part. The track area 94 has first attribute information for the audio data 122 as the first portion, and the track area 96 has first attribute information for the video image data 124 as the first portion. The track area 98 has the first attribute information for the still picture data 126 as the first portion, and the track area 100 has the first attribute information for the text data 114 as the first portion. Unlike FIG. 2, only one track area 98 may be provided for the still image data 126. In this case, animation information and / or sliding information for different animations and / or sliding effects may be described in detail in the main meta area 80.

According to the present invention, the information area 12B shown in FIG. 4 may further include a main meta area 80. Here, the main meta area 80 has at least one of animation information, sliding information, and second attribute information as the second portion of the media information. Here, the second attribute information means information on an attribute that distinguishes media data. The main meta region 80 may provide at least one of the first and second description regions 82 and 84. The first description area 82 has the second attribute information as the second part. Here, similarly to the media information included as meta data in the meta area 72 shown in FIG. 3, the second attribute information may have at least one of an identification number, a name, a shape, a position, and a size of the corresponding media data. . For example, it is assumed that music data 120 in the form of MP3, M still image data (JPEG) 126, and text data 114 are included in the data area 14B. In this case, as illustrated in FIG. 4, the first description area 82 may have an identification number item_ID, a name item_name and / or a content_type. According to the present invention, the first description region 82 may have the second attribute information divided. For example, the first description area 82 may have identification numbers, positions, and sizes of media data as one bundle, and may have names and forms of various media data as different bundles. The second description area 84 has at least one of animation information and sliding information as second information of the media information. For this purpose, the second description area 84 may be implemented in one file form. When sliding while applying animation effects to the video data 112, animation information and sliding information included in the second description region 84 are used. Sliding information included in the track area 96 or 98 and animation information included in the second description area 84 may be used. If only the sliding effect is provided without providing the animation effect to the video data 112, the sliding information included in the track area 96 or 98 or the sliding information included in the second description area 84 may be used. have.

FIG. 5 is a diagram showing the format of the embodiment according to the present invention for the track area shown in FIG. According to the present invention, each track area included in the information area 12B shown in FIG. 4 may provide at least one of the media area 140 and the auxiliary meta area 142. For example, a track area may provide both the media area 140 and the auxiliary meta area 142. The media area 140 has sliding information as the first portion of the media information. The auxiliary meta area 142 has meta data including the first attribute information as the first portion of the media information.

FIG. 6 is a diagram for explaining another embodiment of the multimedia file format according to the present invention, and is composed of a file identification area 10C, an information area 12C, and a data area 14C. The file identification area 10C, the information area 12C, and the data area 14C shown in FIG. 6 are different from the file identification area 10, the information area 12, and the data area 14 shown in FIG. It corresponds to an Example, respectively. The data area 14C illustrated in FIG. 6 includes first to Nth sub data areas 164 to 170. Here, N is a positive integer of 2 or more. Since the n-th sub data area has media data and has the same structure as that of the data area 14A or 14B shown in FIG. 2 or 4, detailed description thereof will be omitted. Where 1 ≦ n ≦ N.

According to the present invention, the information area 12C shown in FIG. 6 is composed of first to Nth sub information areas 156 to 162 and a main meta area 152. The n-th sub information area 156,..., Or 162 is provided at least by the type of media data included in the n-th sub data area 164,. A track area provided as the first part of the information is provided. The track areas provided in the n-th sub information area 156, ..., or 162 are the same as the track areas 90 to 100 shown in FIG. 4, and an embodiment of each track area is shown in FIG. Since it is the same as the detailed description thereof will be omitted. The main meta area 152 has at least one of animation information, sliding information, second and third attribute information as the second portion of the media information. Here, the third attribute information refers to information about an attribute that distinguishes the first to Nth sub information regions 156 to 162. Fourth attribute information on an attribute that distinguishes the first to Nth sub data regions may be included in the main meta region 152. However, even if the fourth attribute information is not provided, the first to Nth sub data regions may be distinguished using the third attribute information. The main meta region 152 may provide at least one of the first and second description regions 150 and 154. Here, the first description area 150 has at least one of the second attribute information and the third attribute information as the second part. Except that the first description region 150 further has at least one of the third and fourth attribute information, the first and second description regions 150 and 154 shown in FIG. 6 are shown in FIG. 4. Since the first and second technical regions 82 and 84 have the same configuration, detailed description thereof will be omitted.

It is assumed that one file having the format shown in FIG. 1 has a plurality of contents, for example, a plurality of movies, and one sub data area has one movie. In this case, a file having the format shown in FIG. 6 may be used instead of a file having the format shown in FIG. Meanwhile, unlike the file having the format shown in FIG. 2, the file having the format shown in FIG. 4 or 6 has a second description area 84 or 154 including at least one of animation information and sliding information. It may be compatible with a general SVG decoder (not shown). In other words, when the SVG decoder is used to reproduce the media data contained in the data area 14B or 14C of the file shown in Fig. 4 or 6, by the information described in the second description area 84 or 154. Animation effects and / or sliding effects of the corresponding media data may be implemented.

Hereinafter, the configuration and operation of an embodiment of a multimedia playback method according to the present invention using the aforementioned multimedia file format and an embodiment of an apparatus for performing the method will be described with reference to the accompanying drawings.

FIG. 7 is a flowchart illustrating an embodiment of a multimedia playback method according to the present invention, in which a file is stored (step 172) and a corresponding media data is found in a file according to a request received from a client. Generating step (steps 174 to 178). 8 is a block diagram of an embodiment of a multimedia playback apparatus according to the present invention, which is comprised of an interface unit 180, a media search unit 182, a storage unit 184, and a scene generation unit 186. According to the present invention, the storage unit 184 stores the file (step 172). The format of the file stored in the storage unit 184 in step 172 is as shown in FIGS. 1 to 6, for example. For example, the storage unit 184 may store files having various types of formats. Here, the storage unit 184 stores the file identification area 10, 10A, 10B or 10C, the information area 12, 12A, 12B or 12C and the data area 14, 14A, 14B or 14C of each file. Can be.

FIG. 9 is a flowchart for describing an exemplary embodiment of the present invention in operation 172 illustrated in FIG. 7, which comprises steps of storing a file identification area, a data area, and an information area (steps 190 to 194). . First, the storage unit 184 stores a file identification area 10, 10A, 10B, or 10C having file identification information (step 190). After operation 190, the storage unit 184 stores the data regions 14, 14A, 14B, and 14C having various media data (operation 192). After operation 192, the storage unit 184 stores the information area 12, 12A, 12B, or 12C having media information about the media data (operation 194). In the storage unit 184, the order of storing the file identification area, data area and information area is not limited to FIG. For example, the storage unit 184 may simultaneously store the file identification area, the data area, and the information area, or may store the file identification area, the data area, and the information area in a different order than that shown in FIG. 9. Regardless of the order in which the regions are stored, the format of the file stored in the storage unit 184 may be as shown in FIGS. 1, 2, 4, or 6.

According to an embodiment of the present invention, the format of the file stored in the storage unit 184 is implemented as shown in FIG. At this time, the storage unit 184 stores the track areas 20 to 32 when storing the information area 12A. Here, when storing the track areas 20 to 32, the storage unit 184 stores at least one of the media area 70 and the meta area 72 shown in FIG. 3. When storing the media area 70, the storage unit 184 stores the sliding information as media information. When storing the meta area 72, the storage unit 184 stores at least one of metadata, sliding information, and animation information about media data as media information.

FIG. 10 is a flowchart for explaining an exemplary embodiment of the present invention with respect to step 194 illustrated in FIG. 9. The track areas 90 to 100 and the first and second technology areas 82 and 84 are illustrated in FIG. It consists of the steps of storing (steps 196 to 200). According to another embodiment of the present invention, the format of the file stored in the storage unit 184 is implemented as shown in FIG. In this case, when storing the information area 12B, the storage unit 184 stores the track areas 90 to 100 (step 196). When storing each of the track areas 90 to 100, the storage unit 184 may store at least one of the media area 140 and the auxiliary meta area 142 illustrated in FIG. 5. When storing the media area 140, the storage unit 184 stores the sliding information as the first part. In addition, when storing the auxiliary meta area 142, the storage unit 184 stores meta data including the first attribute information as the first part. After operation 196, the storage unit 184 stores the main meta region 80 having at least one of animation information, sliding information, and second attribute information as the second portion of the media information (steps 198 and 200). ). When storing the main meta area 80, the storage unit 184 stores the first description area 82 having the second attribute information as the second part of the media information (step 198). After operation 198, the storage unit 184 stores the second description region 84 having at least one of animation information and sliding information as second information of the media information (operation 200).

FIG. 11 is a flowchart for explaining another exemplary embodiment of the first embodiment shown in FIG. 9 according to an embodiment of the present invention. The first to Nth sub information areas 156 to 162 are stored (210). Step) and storing the first and second description areas 150 and 154 (steps 212 and 214). According to another embodiment of the present invention, the format of the file stored in the storage unit 184 is implemented as shown in FIG. In this case, when storing the data area, the storage unit 184 stores the first to Nth sub data areas 164 to 170 (step 192). After the operation 192, when storing the information area, the storage unit 184 stores the first to Nth sub information areas 156 to 162 (step 210). After operation 210, the storage unit 184 stores the main meta region 152 (steps 212 and 214). According to the present invention, when storing the main meta area 152, the storage unit 184 stores the first description area 150 having at least one of the second property information and the third property information as the second part ( Step 212). After operation 212, the storage unit 184 stores the second description region 154 having at least one of animation information and sliding information as a second part (operation 214).

According to the present invention, the order in which the storage unit 184 stores the first and second description regions [82 and 84 or 150 and 154 of the main meta region 80 or 152 is shown in FIG. 10 or 11. It is not limited to. For example, the storage unit 184 may simultaneously store the first and second description areas [82 and 84 or 150 and 154], and store the second description area 84 or 154 in the first description area ( 82 or 150).

On the other hand, after step 172, the interface unit 180 accepts the request of the client (step 174). That is, the interface unit 180 is operated by the client to generate a request signal, and outputs the generated request signal to the media search unit 182. After operation 174, at least one media data is found among media data included in a destination file according to a request of the client (operation 176). Here, the object file refers to a file including media data and media information necessary for generating a scene desired by the client. In order to perform step 176, the media search unit 182 searches for an object file among files stored in the storage unit 184 through a request signal received from the interface unit 180. At this time, the media search unit 182 analyzes the media information included in the found object file depending on the request signal. In response to the result of analyzing the media information, the media search unit 182 searches for the target media data among the media data. The target media data means media data desired by the client.

FIG. 12 is a flowchart for describing an exemplary embodiment of the present invention in the step 176 illustrated in FIG. 7. The step (step 220) of searching for an object file and searching for corresponding media data in the found object file ( In step 222). FIG. 13 is a block diagram of a preferred embodiment of the media search unit 182 shown in FIG. 8 according to the present invention, and includes a file search unit 230 and a data search unit 232. After operation 174, a target file including media data and media information desired by the client is found among the files (operation 220). In order to perform step 220, the file search unit 230 may include a request signal input from the interface unit 180 through the input terminal IN1 and a file identification area 10 input from the storage unit 184 through the input terminal IN2. 10A, 10B, or 10C) file identification information. That is, the file search unit 230 recognizes the file identification information contained in the request signal, and finds and receives an object file having the recognized file identification information in the storage unit 184.

After operation 220, the media information included in the information area 12, 12A, 12B, or 12C is analyzed in the found object file, and the media data corresponding to the client's request is analyzed in the data area 14, 14A, 14B, or 14C. (Step 222). In order to perform step 222, the data search unit 232 reads the media information read from the information area 12, 12A, 12B, or 12C through a request signal received from the interface unit 180 through the input terminal IN1. Analyze At this time, in response to the result of analyzing the media information, the data search unit 232 finds at least one media data desired by the client in the data area 14, 14A, 14B, or 14C. At this time, the data search unit 232 outputs the found media data to the scene generation unit 186 through the output terminal OUT2.

FIG. 14 is a flowchart for describing an exemplary embodiment of the present invention in operation 222 illustrated in FIG. 12, in which a corresponding track area is searched (step 240) and media data is searched (step 242). Is done. If the format of the object file is as shown in Fig. 2, a corresponding track area is found among the track areas 20 to 32 included in the information area 12A (step 240). The track area found in step 240 has media information, which describes media data that satisfies the client's request. To this end, the track area may be found using the track identification information. After operation 240, the client may satisfy the client's request by using at least one of sliding information included in the media area 70 of the found track area and metadata, sliding information, and animation information included in the meta area 72. The media data is found in the data area 14A (step 242).

FIG. 15 is a flowchart for explaining another exemplary embodiment of the present invention in operation 222 illustrated in FIG. 12, in which a corresponding track area is searched (step 260) and media data is searched (step 262). Is made of. If the format of the object file is implemented as shown in Fig. 4, the track area having the first portion that meets the client's request is found among the track areas 90 to 100 included in the information area 12B. 260 steps). For this purpose, the track identification information can be used to find a track area having a first portion that meets the client's needs. After operation 260, at least one of the first portion and the second portion stored in the main meta region 80 is used, the media data corresponding to the client's request is searched for in the data region 14B (operation 262).

FIG. 16 is a flowchart for explaining another exemplary embodiment of the present invention in operation 222 illustrated in FIG. 12, in which a corresponding sub data region is found (operation 280), and a corresponding track region is formed (operation 280). Step 282) and finding the media data (step 284). If the format of the object file is implemented as shown in FIG. 6, a corresponding sub data area is found among the first to Nth sub data areas (step 280). The sub data area found in operation 280 includes media data that will satisfy a client's request. To this end, each sub data area may have sub data area identification information that uniquely represents itself as fourth attribute information. That is, the sub data area including the media data to satisfy the client's request can be found using the sub data area identification information. After step 280, a track area having a first portion for media data that will satisfy the client's request is found (step 282). The track area found in step 282 is included in a sub information area corresponding to the sub data area found in step 280. If the n-th sub data area includes media data that satisfies the client's request, the track area having the first portion is searched for in the n-th sub information area (step 282). After operation 282, at least one of the found first portion and the second portion stored in the main meta region 152 is used to find media data in the data region 14C that satisfies the client's request (operation 284).

Meanwhile, after operation 176, the scene generator 186 generates a scene that satisfies a client's request by using the at least one media data and the media information found by the media search unit 182, and displays the generated scene. The output is performed through the output terminal OUT1 (step 178). It is assumed that the scene generator 186 generates a scene to which an animation effect is applied to the video image. To this end, the scene generator 186 searches for video data, for example, still image data, using the second attribute information included in the first description area 82 or 150. In this case, the scene generator 186 may animate still image data by using animation information that is a second portion of the media information included in the second description area 84 or 154. At this time, when sliding the animated video data, the scene generator 186 uses sliding information.

Meanwhile, the scene generator 186 may regard the media data to be synthesized as an object and use the media information to express a plurality of objects as one completed scene based on the object. To this end, the media information used to generate the scene in the scene generation unit 186 is HTML (Hyper Text Markup Language) used to describe a homepage on a scene description language, for example, BIFS, WWW (World Wide Web). And the like. The scene generator 186 may receive media information, which is a scene description language, from the media search unit 182.

For example, it is assumed that the media data found in the media search unit 182 is at least one still image data, and the media information expressed as the scene description language is animation information. In this case, the scene generator 186 may generate a scene that provides an animation effect to the still image data. In addition, the scene generator 186 may process the video data by applying animation effects and / or sliding effects, and generate a scene by variously synthesizing the processed video data and other media data. For example, various scenes may be generated by combining at least two of music data, processed still image data, text data, and video data. In detail, the media search unit 182 searches for audio data, still image data, animation information, and sliding information, and the scene generator 186 uses the found data and information to slide the still image in a state where music flows. You can create animated scenes. In particular, when the multimedia playback apparatus is a portable device having a limited resource or the like, according to the multimedia playback method and apparatus according to the present invention, only a few pieces of information, such as a few pieces of still image data, animation information and sliding information, Can provide an effect. Here, the limited resource means a case where the storage capacity of the multimedia reproducing apparatus is low or the resolution is low. The scene generation unit 186 generates a scene in which the audio data and the accompaniment data are synthesized, and the generated scene is the music data 50 or 120 in the audio data 40 or 110 of the data area 14, 14A, 14B or 14C. If stored as), the client may hear the song that it previously sang based on the accompaniment.

The multimedia playback method shown in Fig. 7 accepts the client's request after storing the file and finds the corresponding media data. However, the present invention is not limited thereto. For example, the multimedia reproduction method illustrated in FIG. 7 may not provide step 172. In this case, a file necessary to perform step 176 may be provided from the outside. In addition, in the multimedia playing method illustrated in FIG. 7, step 172 of storing a file may be performed at the same time as step 174, or may be performed before step 176 after step 174 is performed.

The above-described multimedia playback apparatus according to the present invention may be connected to a network to input a file, receive a broadcast signal in a file format, or receive a file from a storage medium. In addition, when the format of the audio data to be decoded is different, it can be changed to the audio format of the multimedia format according to the present invention. In order to synchronize, the audio signal may be output using the sample number or time information corresponding to the duration.

A computer-readable recording medium includes all kinds of storage devices in which data that can be read by a computer system is stored. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disks, optical data storage devices, and the like, which are also implemented in the form of carrier waves (for example, transmission over the Internet). It also includes. The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. Functional programs, codes, and code segments for implementing the user tracking method can be easily inferred by programmers of the art to which the present invention pertains.

Above, preferred embodiments of the present invention described above are disclosed for the purpose of illustration. Accordingly, those skilled in the art will be able to make various other embodiments within the spirit and scope of the present invention as disclosed in the claims by way of improvement, modification, replacement, or addition of the disclosed embodiments.

As described above, the multimedia playback method and apparatus according to the present invention and the multimedia file format therefor may generate a scene desired by a client using various media data and media information, and in particular, music (for example, For example, you can provide the client with the text and the result of adding animation to the original music accompaniment) and video (for example, still images). It can also provide a variety of enjoyment to the client by providing the effect of the video with only a small amount of data to give more effect in a device having limited resources, such as a portable terminal.

Claims (40)

Accepting the client's request; And Finding at least one destination media data in the destination file using media information including at least one of animation information and sliding information; Generating a scene satisfying the request by using the found media data and the media information; And Storing the object file; The storing of the object file includes: Storing a file identification area having file identification information; Storing a data area having the media data; And Storing an information area having the media information, The storing of the information area may include: Storing at least one track area provided for each type of the media data and having at least one of the first attribute information and the sliding information of the media data as a first portion of the media information; And Storing a main meta area having at least one of second attribute information, the animation information, and the sliding information for distinguishing the media data as a second portion of the media information, The storing of the main meta area may include: Storing a first description region having the second attribute information as the second portion, And the second attribute information includes at least one of an identification number, a name, a form, a position, and a size of the media data. delete delete delete The method of claim 1, wherein storing the information area comprises: And storing at least one track area having the media information, the track area having the media information. The method of claim 5, wherein storing the track area Storing at least one of a media area and a meta area, And the media area includes the sliding information, and the meta area includes at least one of metadata about the media data, the sliding information, and the animation information. delete delete The method of claim 1, wherein the storing of the main meta area comprises: And storing a second description area having at least one of the animation information and the sliding information. The method of claim 9, wherein generating the scene comprises: And searching for the media data using the animation information and the second attribute information, and animate the found media data. The method of claim 1, wherein storing the data area Storing the first through Nth, wherein N is a positive integer greater than or equal to 2; And the nth (1 ≦ n ≦ N) sub data area has the media data. The method of claim 11, wherein storing the information area is Storing the first to Nth sub information areas; And Storing the main meta area; At least one n-th sub information area is provided for each type of the media data included in the n-th sub data area, and includes a track area having the sliding information. The main meta area has at least one of the animation information and the sliding information. The method according to claim 1 or 12, wherein The storing of the track area may include storing at least one of a media area and an auxiliary meta area as the track area, wherein the media area has the sliding information and the auxiliary meta area has metadata. Multimedia playback method. delete delete 13. The method of any one of claims 1, 5 and 12, wherein finding the media data (a) analyzing the file identification information to find the object file; And and (b) analyzing the media information included in the information area of the found destination file to find the destination media data in the data area. The method of claim 16, wherein step (b) Finding the track area with the media information describing the target media data; And And retrieving the target media data from the data area using the media information included in the found track area. delete delete delete delete delete delete delete In the method of playing a multimedia data file comprising a file identification area, a data area, and an information area, Finding a track area within the information area; And Searching for media data using media information included in the track area; The file identification area has file identification information The data area includes audio data and still picture data, and the information area includes a first track area having media information on the audio data, and a second track area having media information on the still image data. Including; The second track area includes a media area and a meta area, The media area of the second track area includes media information of the still picture data, The meta area of the second track area includes meta data for the still picture data. 26. The method of claim 25, And the audio data includes at least one of music data, accompaniment data, and voice data. delete 26. The method of claim 25, wherein the meta area further comprises at least one of sliding information and animation information. 26. The method of claim 25, The information area is And a main meta area having at least one of animation information and sliding information. The method of claim 29, And wherein the main meta area includes a first description area having at least one of an identification number, a name, a shape, a position, and a size of the media data. The method of claim 30, The main meta area further comprises a second description area having at least one of animation information and sliding information. delete delete delete delete delete delete delete delete 26. The method of claim 25, And the information area further has, as the media information, synchronization information for synchronizing the media data with each other.

Images