KR100678884B1 - Apparatus and method for displaying multimedia data combined with text data, and recording medium having the method recorded thereon - Google Patents

Abstract

The present invention relates to a multimedia data display apparatus and a display method combined with text data, and a recording medium recording the method. The display apparatus for multimedia data described according to the MPV (MusicPhotoVideo) format includes an asset selected by a user. Determine whether the asset is composed of single audio data and at least one text data, extract information for displaying the audio data and the text data, and then extract the audio data using the information. And at least one or more pieces of the text data are extracted from the information according to a predetermined exhibition method and sequentially displayed while the audio data is reproduced.

MPV (MusicPhotoVideo), text data

Description

Apparatus and method for displaying multimedia data combined with text data, and recording medium having the method recorded thereon}

FIG. 1 is an exemplary diagram showing the types of assets described in the MPV (MusicPhotoVideo) specification.

2 is an exemplary diagram briefly describing a <TextContent> element according to an embodiment of the present invention.

3 is an exemplary diagram briefly describing a <TextBody> element according to an embodiment of the present invention.

4A is an exemplary diagram briefly describing a <TextLocation> element according to an embodiment of the present invention.

FIG. 4B is an exemplary diagram illustrating a position coordinate relationship between lower elements constituting a <TextLocation> element according to an embodiment of the present invention.

5 is an exemplary diagram briefly describing an <AudioWithText> element according to an embodiment of the present invention.

6 is an exemplary diagram illustrating a type definition of a type of a <AudioWithText> element according to an embodiment of the present invention.

7 is an exemplary diagram briefly describing a <PhotoWithText> element according to an embodiment of the present invention.

8 is an exemplary diagram illustrating a type definition of a type of a <PhotoWithText> element according to an embodiment of the present invention.

9 is an exemplary diagram briefly describing a <VideoWithText> element according to an embodiment of the present invention.

10 is an exemplary diagram illustrating a type definition of a type of a <VideoWithText> element according to an embodiment of the present invention.

11 is an exemplary diagram briefly describing an <AudioWithTextRef> element according to an embodiment of the present invention.

12 is an exemplary diagram briefly describing a <PhotoWithTextRef> element according to an embodiment of the present invention.

13 is an exemplary diagram briefly describing a <VideoWithTextRef> element according to an embodiment of the present invention.

14A and 14B are flow diagrams of an embodiment of a method of displaying a 'VideoWithText' asset according to an embodiment of the present invention.

15A-15C are flow diagrams of one embodiment showing a method of displaying a 'PhotoWithText' asset in accordance with an embodiment of the present invention.

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multimedia data display apparatus and a display method combined with text data, and a recording medium on which the method is recorded. It is managed in the form of MPV (MPV: 'MultiPhotoVideo' or 'MusicPhotoVideo', hereinafter referred to as 'MPV') and is provided to the user.

MPV is an industry standard specification for multimedia titles published in 2002 by the Optical Storage Technology Association (hereinafter referred to as "OSTA"), which allows users to view various types of music, photo and video data. It is a standard for providing conveniently or for manipulating and processing the multimedia data. Definitions and other standards for MPVs are available and available through the OSTA official website (www.osta.org).

Recently, media data such as digital pictures, videos, digital audio, and texts have been processed and played using a personal computer. In addition, the use of a device for generating the media content, for example, a digital camera, a digital camcorder, a digital audio player (a device for reproducing digital audio data such as MP3, WMA, etc.) As a result, various types of media data are generated in large quantities.

However, a personal computer has been mainly used to manage such a large amount of multimedia data, which causes a difficulty in requiring a file-based user experience. In addition, when multimedia data is generated in a specific product, attribute data, data play order, and playback method may be generated for each multimedia data, and when connected to a personal computer, the attribute data is lost and only original data is moved. . That is, inter-operability of data and attributes of data between home appliances, personal computers, and digital content generating devices is very weak.

An example in which the inter-operability is weak will be described. Properties determined using the digital camera to capture pictures, and using the slideshow function to view captured pictures on the digital camera. Properties determined using the slideshow order, time interval between photos, and the panorama function. Data such as the relationship between the photographed pictures and the attributes determined while using the continuous shutter function are stored together with the actual image data as the original data. At this time, when the digital camera transmits the image to the television using the AV cable, the user can view the multimedia data expressing each property. However, when connecting to a personal computer via a Universal Serial Bus (USB) cable, only the original data is transferred to the computer and all of its properties are lost.

As shown in the above example, the inter-operability of the personal computer with the attribute data stored in the digital camera, that is, the meta data, is very weak. Or, it may be regarded that there is no inter-operability of the personal computer with respect to the function of the digital camera.

The MPV standard is in progress to reinforce the weakness of inter-operability of data between digital devices.

The MPV specification processes a collection of multimedia data, such as digital photos, videos, audio, stored on storage media (or devices) such as optical disks, memory cards, computer hard disks, or exchanged by Internet protocols, Manifests, metadata, and practices for playback are defined.

MPV is currently being standardized by the Optical Storage Technology Association (OSTA) and the International Imaging Industry Association (I3A). The MPV is an open specification and processes a collection of digital photos, videos, digital audio, and text. Its main purpose is to make it easy to replace, replace and reproduce.

MPV is largely divided into two categories: MPV Core-Spec. 0.90WD and Profile.

The core is made up of three basic elements: Collection, Metadata, and Identification.

The collection has a manifest as a root member, and includes a metadata, an album, a marked asset, an asset list, and the like. At this time, an asset refers to multimedia data described according to the MPV format. There are two kinds. First, there is a simple media asset (digital photo, video, digital audio, document, etc.) is an example. In addition, there is a composite media asset, which includes digital photography + digital audio (StillWithAudio), continuous shooting digital photography (StillMultishotSequence), and panoramic photography digital photography (StillPanoramaSequence). 1 shows an example of the above contents.

The metadata follows the XML format, and there are five types of identifiers for identification.

LastURL: The path and file name of the asset.

2. InstanceID: unique ID for each asset (eg Exif 2.2)

3. DocumentID: same for both original and changed data

4. ContentID: generated whenever the asset is used for a specific purpose

5. id: local variable in metadata

On the other hand, there are seven profiles in total: Basic profile, Presentation profile, Capture / Edit profile, Archive profile, Internet profile. ), A printing profile, a container profile, and the like.

In other words, MPV supports functions such as managing various file associations using XML (Extensible Markup Language) metadata so that various multimedia data recorded on a storage medium can be reproduced according to a user's intention, and in particular, JPEG, MP3, It supports WMA, WMV, MPEG-1, MPEG-2, MPEG-4, supports digital camera formats AVI and QuickTime MJPEG video, MPV compliant discs are ISO9660 level 1, Joliet compatible, multi It is also compatible with session CDs, DVDs, memory cards, hard disks and the Internet, allowing users to manage and process a wide variety of multimedia data.

However, in the standard for the MPV format, various types of multimedia data that are not defined in the standard, that is, a new type of asset are needed, and the addition of a function for providing the multimedia data is required.

The present invention proposes a new multimedia data form in addition to the various types of multimedia data currently proposed by the MPV format, and proposes a method of providing the multimedia data to a user. To do so.

In order to achieve the above object, the multimedia data display apparatus combined with the text data described in accordance with the MPV (MusicPhotoVideo) format according to the embodiment of the present invention has a user-selected asset is a single audio data and at least one text data Determine whether the asset is composed of an asset, extract information for displaying the audio data and the text data, and extract and play the audio data using the information, while the audio data is reproduced. According to a predetermined display method, at least one or more pieces of the text data may be extracted from the information and displayed sequentially.

In this case, preferably, the asset includes position information indicating a position at which the text data is displayed and time information indicating a time at which the text data is displayed. In addition, the display method preferably includes displaying according to exhibition time information for designating a time at which each text data is displayed while the audio data is being reproduced.

In addition, in order to achieve the above object, the multimedia data display apparatus combined with the text data described according to the MPV (MusicPhotoVideo) format according to the embodiment of the present invention has a user-selected asset (single asset) is a single video data and at least one text Determine whether the asset is composed of data, extract information for displaying the video data and the text data, extract and play the video data using the information, and play the video data. While extracting at least one or more of the text data from the information according to a predetermined exhibition method to display sequentially.

In this case, preferably, the asset includes position information indicating a position at which the text data is displayed and time information indicating a time at which the text data is displayed. Preferably, the exhibition method includes displaying the exhibition data according to exhibition time information for designating a time at which the respective text data is displayed while the video data is reproduced.

 In addition, in order to achieve the above object, the multimedia data display apparatus combined with the text data described in accordance with the MPV (MusicPhotoVideo) format according to the embodiment of the present invention is a user selected asset (asset) is a single image data and at least one text Determine whether the asset is composed of data, extract information for displaying the image data and the text data, extract and display the image data using the information, and display the image data. While extracting at least one or more of the text data from the information according to a predetermined exhibition method to display sequentially.

In this case, preferably, the asset includes position information indicating a position at which the text data is displayed and time information indicating a time at which the text data is displayed. In addition, preferably, the exhibition method includes displaying in accordance with exhibition time information for designating a time at which each text data is displayed while the image data is displayed.

In order to achieve the above object, the multimedia data display method combined with the text data described in accordance with the MPV (MusicPhotoVideo) format according to the embodiment of the present invention, the user-selected asset (asset) is a single audio data and at least one text data A first step of checking whether the asset is composed of an asset, a second step of extracting information for displaying the audio data and the text data, and extracting and reproducing the audio data using the information And a fourth step of extracting at least one or more of the text data from the information and sequentially displaying the same according to a predetermined exhibition method while the audio data is reproduced. Preferably, the exhibition method includes displaying the exhibition data according to exhibition time information for designating a time at which the respective text data is displayed while the audio data is being reproduced. And start time information starting to be displayed and exhibition time interval information indicating a time interval at which the text data is reproduced. In addition, preferably, the asset includes position information indicating a position where the text data is displayed and time information indicating a time when the text data is displayed.

In order to achieve the above object, the multimedia data display method combined with the text data described according to the MPV (MusicPhotoVideo) format according to the embodiment of the present invention is a user-selected asset (single asset) is a single video data and at least one text data A first step of determining whether the asset is composed of an asset, a second step of extracting information for displaying the video data and the text data, and extracting and playing the video data using the information And a fourth step of extracting at least one or more of the text data from the information and sequentially displaying the video data according to a predetermined exhibition method while the video data is reproduced. Preferably, the exhibition method includes displaying the exhibition data according to exhibition time information for designating a time at which the respective text data is displayed while the video data is being reproduced. And start time information starting to be displayed and exhibition time interval information indicating a time interval at which the text data is displayed. In addition, preferably, the asset includes position information indicating a position where the text data is displayed and time information indicating a time when the text data is displayed.

In order to achieve the above object, in the multimedia data display method combined with the text data described according to the MPV (MusicPhotoVideo) format according to the embodiment of the present invention, the asset selected by the user is a single image data and at least one text data A first step of checking whether the asset is composed of an asset, a second step of extracting information for displaying the image data and the text data, and extracting and displaying the image data using the information And a fourth step of extracting and displaying at least one or more of the text data from the information sequentially according to a predetermined exhibition method while the image data is displayed. Preferably, the exhibition method includes displaying the exhibition data according to exhibition time information for designating a time at which each text data is displayed while the image data is displayed. And start time information starting to be displayed and exhibition time interval information indicating a time interval at which the text data is displayed.

In addition, preferably, the asset includes position information indicating a position where the text data is displayed and time information indicating a time when the text data is displayed.

In order to achieve the above object, a recording medium in which a program for displaying multimedia data combined with text data described according to the MPV (MusicPhotoVideo) format according to the embodiment of the present invention is recorded. Determine whether the asset is composed of audio data and at least one text data, extract information for displaying the audio data and the text data, and extract and play the audio data using the information. And while the audio data is being reproduced, a program for extracting at least one or more of the text data from the information and sequentially displaying the information is recorded according to a predetermined exhibition method.

In order to achieve the above object, a recording medium in which a program for displaying multimedia data combined with text data described according to the MPV (MusicPhotoVideo) format according to the embodiment of the present invention is recorded. Determine whether the asset is composed of video data and at least one text data, extract information for displaying the video data and the text data, and extract and play the video data using the information. And while the video data is being reproduced, a program for extracting at least one or more of the text data from the information and sequentially displaying the same according to a predetermined exhibition method is recorded.

In order to achieve the above object, a recording medium in which a program for displaying multimedia data combined with text data described according to the MPV (MusicPhotoVideo) format according to the embodiment of the present invention is recorded. Determine whether the image data is an asset composed of at least one text data, extract information for displaying the image data and the text data, and extract and display the image data using the information. While the image data is displayed, a program for extracting at least one or more of the text data from the information according to a predetermined exhibition method is sequentially recorded.

Hereinafter, a multimedia data display apparatus and method in which text data described according to an MPV format according to an embodiment of the present invention will be described with reference to the accompanying drawings.

Meanwhile, in the present invention, XML (eXtensible Markup Language) is used to provide multimedia data conforming to the MPV format, which will be described according to the XML schema.

In the present invention, various multimedia data are provided by presenting the 'AudioWithText' asset, the 'PhotoWithText' asset, and the 'VideoWithText' asset which are not proposed by OSTA. Looking at the definition and use example of the three new assets (asset) as follows. Hereinafter, 'smpv' and 'mpv' represent namespaces in XML, where 'smpv' represents namespaces for elements newly proposed by the present invention, and 'mpv' represents Represents the namespace for elements proposed by OSTA.

1.AudioWithText asset

An AudioWithText asset is an asset in which at least one piece of data is combined with a single audio asset and may be referred to as an <AudioWithText> element when described in XML. The audio asset and text data are also treated as elements in a file described in XML. Before looking at the structure of the <AudioWithText> element, it is necessary to look at the structure of the text data associated with the audio asset, and in the present invention, the structure of the text data is shown. Define an <TextContent> element as an element.

2 schematically illustrates a structure of a <TextContent> element. Referring to the diagram of the <TextContent> element shown in FIG. 2, the <TextContent> element is composed of a plurality of elements each having a namespace of 'mpv' and 'smpv'. It can be seen that.

Here, the description of the element using 'mpv' as a namespace is omitted since it is described in OSTA's homepage 'www.osta.org' which proposes the MPV specification. Therefore, hereinafter, elements having 'smpv' as a namespace will be described in order.

(1) <TextBody> element

The <TextBody> element represents well-formatted text data according to the Hyper Text Markup Language (HTML) rules. The <TextBody> element can represent HTML text properties such as properties of Cascading Style Sheets (CSS) that define fonts and colors of text. The <TextBody> element is mainly used to display text data with a small amount of data, and is described directly in an MPV file. Meanwhile, the <TextRef> element is defined in the MPV core specification. The <TextRef> element is a text data directly described in an MPV file like the <TextBody> element. Rather, it refers to a separate file that contains text data. In this case, the separate file may be an MPV format or a file of another format. If the <TextRef> element is not described as an attribute of the <TextContent> element, the <TextBody> element must be described. 3 briefly describes the <TextBody> element.

(2) <TextLocation> element

The <TextLocation> element defines the location of a subtitle or caption on the screen. If there is no <TextLocation> element, a default instruction can be used. The HTML format and the Synchronized Multimedia Integration Language (SMIL) format also have a method of defining text characteristics, but if a <TextLocation> element is used, the characteristics of the <TextLocation> element take precedence.

The <TextLocation> element may have a lower element indicating the location coordinates at which the text is displayed. There are <TextLeft> elements, <TextTop> elements, <TextWidth> elements, and <TextHeight> elements. In FIG. 4A, the <TextLocation> element is briefly described, and in FIG. 4B, a positional coordinate relationship between elements is illustrated.

(3) <TextStartTime> element

The <TextStartTime> element represents a start time at which text data is displayed, and is defined in a <TextBody> element or a <TextRef> element. In this case, in the case of the <TextBody> element, the value of the <TextStartTime> element must be defined. In the case of the <TextRef> element, it is optional, but may be used to further control the starting point for displaying the text data.

(4) <TextDuration> element

The <TextDuration> element indicates the time at which the text data is displayed. In the case of the caption defined in the <TextBody> element, the <TextDuration> element is used together with the <TextStart> element. <TextDuration> element

(5) <AudioWithText> element

5 schematically illustrates a structure of an <AudioWithText> element. Referring to the diagram of the <AudioWithText> element illustrated in FIG. 5, the <AudioWithText> element is composed of a plurality of elements each having a namespace of 'mpv' and 'smpv'. It can be seen that.

Here, the description of the element using 'mpv' as a namespace is omitted since it is described in OSTA's homepage 'www.osta.org' which proposes the MPV specification. The <TextContent> element, whose name is 'smpv', describes the text information to be displayed. In addition, 'AudioRefGroup' may be defined to specify audio data, which includes an <AudioRef> element that is an MPV core specification and an <AudioPartRef> element according to an embodiment of the present invention. In this case, the <AudioPartRef> element refers to an <AudioPart> element, where the <AudioPart> element represents a part of corresponding audio data. FIG. 6 shows a type definition for the type of the <AudioWithText> element.

2. 'PhotoWithText' asset

7 schematically illustrates the structure of a <PhotoWithText> element. An 'PhotoWithText' asset is an asset in which a single image data and at least one text data are combined and may be referred to as a 'PhotoWithText' element when described in XML. Location information of text data is defined in the <TextLocation> element to display text data in the image data. In addition, at least two text data may be displayed in one image data. 8 illustrates a type definition for a type of the <PhotoWithText> element.

3. 'VideoWithText' asset

9 schematically illustrates the structure of a <VideoWithText> element. An 'VideoWithText' asset is an asset in which a single video data and at least one text data are combined and may be referred to as a 'VideoWithText' element when described in XML. The 'VideoWithText' asset may be usefully used to display a subtitle of a movie or to display additional information on a screen when a movie is displayed. FIG. 10 illustrates a type definition for a type of the <VideoWithText> element.

4. Elements for Reference

The <AudioWithTextRef> element, the <PhotoWithTextRef> element, and the <VideoWithTextRef> element all have a similar structure. Used to reference the 'AudioWithText' asset, the 'PhotoWithText' asset, and the 'VideoWithText' asset, respectively. 11 to 13 show the structure of elements for each reference.

14A and 14B are flowcharts illustrating an embodiment of a method of displaying a 'VideoWithText' asset according to an embodiment of the present invention.

When the user selects the 'VideoWithText' asset using software capable of playing the MPV file (S1400), the software refers to the text file to extract the text data constituting the 'VideoWithText' asset. It is checked whether or not (reference) (S1405).

If the text file is referenced, that is, if the <TextRef> element is present, the format of the text file referenced by the <TextRef> element is checked (S1435). At this time, if the format of the text file is a correct text file, the 'VideoWithText' asset is started to be displayed (S1440). Otherwise, an error message is generated and delivered to the user and the return value is returned or the corresponding program is displayed. This ends (not shown).

If the text data is described directly in the MPV file instead of referring to the text file in step S1405, that is, if it includes a <TextBody> element, the <TextBody> element is It is checked whether it is described according to the type (S1410). At this time, if the <TextBody> element is described according to the format, the time at which the text data starts to be displayed and the time at which the display ends are defined (S1415 and S1420), and a separate new text file is created ( S1425). If the <TextBody> element is not described according to the format, an error message is generated and delivered to the user, the return value is returned, or the corresponding program is terminated (S1430).

On the other hand, creating a separate new text file in step S1425 is to improve the reusability of the software component. That is, since the text data is described directly in the <TextBody> element, the corresponding text data is recorded in a separate file so that the file can be used as a function as an input parameter.

The 'VideoWithText' asset is displayed by inputting a file including text data (S1440).

In this case, a function of generating a thread or a child processor to display a video frame (S1445) and a function of checking a display time while displaying text data are separately performed (S1450 to S1470). Done.

First, when video data constituting the 'VideoWithText' asset starts to be played back, a timer starts to operate (S1450). At this time, the timer has information on when the text data constituting the 'VideoWithText' asset starts to be displayed and when the exhibition ends. Information about the end time point may be obtained by adding a <TextStart> element value and a <TextDuration> element value. When the text data is displayed as much as the <TextDuration> element value (S1455) and terminates, a time event occurs (S1460), and it is then checked whether there is text data to be displayed. (S1465). If there is text data to be displayed, time information of the text data to be displayed is extracted and transmitted to the timer (S1470), and the step S1450 is repeatedly performed. If there is no data to be displayed in step S1465, the text data is no longer displayed, only a video frame is displayed.

When all the video data constituting the 'VideoWithText' asset is played, a return value is generated and another asset selected by the user is played.

Meanwhile, the 'AudioWithText' asset may be displayed by using the same method as the process illustrated in FIGS. 14A and 14B.

15A-15C are flow diagrams of one embodiment showing a method of displaying a 'PhotoWithText' asset in accordance with an embodiment of the present invention.

When the user selects the 'PhotoWithText' asset using the software capable of playing the MPV file (S1500), the software extracts information of the image data constituting the 'PhotoWithText' asset (S1505). . Then, the software checks whether a text file is referenced to extract text data constituting the 'PhotoWithText' asset (S1510).

If the text file is referenced, that is, if the <TextRef> element is present, the format of the text file referenced by the <TextRef> element is checked (S1540). At this time, if the format of the text file is a correct text file, the 'PhotoWithText' asset is started to be displayed (S1550). Otherwise, an error message is generated and delivered to the user and the return value is returned or the corresponding program is displayed. This ends (not shown).

If the text data is described directly in the MPV file instead of referring to the text file in step S1510, that is, if the text data element includes a <TextBody> element, the <TextBody> element is included. It is checked whether it is described in accordance with the form (S1515). At this time, if the <TextBody> element is described according to the format, when at least two <TextContent> elements exist, the text data to be displayed is arranged in a temporal order (S1520). Then, after extracting the value of the <TextLocation> element to obtain the location information of the text data to be displayed (S1525), the playback time of the 'PhotoWithText' asset is determined (S1530), and a separate new text file is created. (S1535). In this case, as a method for determining the reproduction time, the reproduction time of at least one or more pieces of text data may be the sum of all the reproduction times or the reproduction time value of the image data from the image information extracted in step S1505.

If the <TextBody> element is not described according to the format in step S1515, an error message is generated and delivered to the user, the return value is returned, or the corresponding program is terminated (S1545).

On the other hand, creating a separate new text file in step S1535 is to improve the reusability of the software component. That is, since the text data is described directly in the <TextBody> element, the corresponding text data is recorded in a separate file so that the file can be used as a function as an input parameter.

A file containing text data is inputted to start displaying the 'PhotoWithText' asset (S1550).

In this case, a function (S1555 to S1570) for displaying a image data by creating a thread or a child processor (S1555 to S1570) and a function (S1575 to S1590) for checking a display time while displaying text data are shown. It will be done separately.

First, when image data constituting the 'PhotoWithText' asset starts to be displayed, a timer starts to operate (S1555). At this time, when the playback time of the 'PhotoWithText' asset determined in step S1530 ends, a time event occurs (S1560). The displayed image data is then deleted, returning the memory used to display the 'PhotoWithText' asset (S1565), generating a return value, and selecting another asset of the user's choice. It is played (S1570).

On the other hand, when image data constituting the 'VideoWithText' asset starts to be displayed, a timer starts to operate by another thread or child processor (S1575). At this time, the timer has information about when the text data constituting the 'PhotoWithText' asset starts to be displayed and when the exhibition ends. Information about the end time point may be obtained by adding a <TextStart> element value and a <TextDuration> element value. When the text data is displayed as much as the <TextDuration> element value (S1580) and terminates, a time event occurs (S1582), and a life time of the 'PhotoWithText' asset Check whether it has reached (S1584). If the life time of the 'PhotoWithText' asset is reached, the thread or the processor is terminated (S1590). If the life time of the 'PhotoWithText' asset has not yet reached in step S1584, it is checked whether there is text data to be displayed next (S1586). If the text data to be displayed exists, the time information of the text data to be displayed is extracted and transmitted to the timer (S1588), and the operation S1575 is repeated. If there is no data to be displayed in step S1586, the text data is no longer displayed and the corresponding thread or child processor is terminated (S1590).

Meanwhile, the multimedia data provided by the MPV format may be described and represented in the form of an XML document. The XML document may be converted into a plurality of application documents according to stylesheets applied to the XML document. In the present invention, by applying stylesheets to convert XML documents into HTML documents, the user can manage audio and video data through a browser. In addition, WML (Wireless Markup Language), cHTML ( By applying stylesheets that convert to Compact HTML documents, users can access multimedia data combined with text data described by MPV format through mobile terminals such as personal digital assistants (PDAs), cellular phones, and smart phones. Accessible.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited to drawing.

According to an embodiment of the present invention, by providing a user with a new type of multimedia data asset in which audio, photo and video data are respectively combined with text data, the user is described in MPV format. There is an effect to be able to create and use a variety of multimedia data.

Claims (27)

delete delete delete delete delete delete delete delete delete In the display method of the multimedia data described by the MPV (MusicPhotoVideo) format, A first step of checking whether the asset selected by the user is an asset including audio data and at least one text data; Extracting information for displaying the audio data and the text data; A third step of extracting and reproducing the audio data using the information; And a fourth step of extracting and sequentially displaying at least one or more of the text data from the information according to a predetermined display method while the audio data is being reproduced. The method of claim 10, And the asset includes position information indicating a position at which the text data is displayed and time information indicating a time at which the text data is displayed. The method of claim 10, And the display method is displayed according to exhibition time information for designating a time at which each text data is displayed while the audio data is reproduced. The method of claim 12, The exhibition time information is a multimedia data display method is a combination of text data including the start time information that the text data starts to display and the display time interval information indicating the time interval at which the text data is reproduced. In the display method of the multimedia data described by the MPV (MusicPhotoVideo) format, A first step of checking whether the asset selected by the user is an asset including video data and at least one text data; Extracting information for displaying the video data and the text data; A third step of extracting and playing back the video data using the information; And a fourth step of extracting and sequentially displaying at least one text data from the information according to a predetermined display method while the video data is reproduced. The method of claim 14, And the asset includes position information indicating a position at which the text data is displayed and time information indicating a time at which the text data is displayed. The method of claim 14, And the display method is displayed according to exhibition time information for designating a time for displaying each text data while the video data is being reproduced. The method of claim 16, The display time information is a multimedia data display method is a combination of text data including the start time information that the text data starts to display and the display time interval information indicating the time interval in which the text data is displayed. In the display method of the multimedia data described by the MPV (MusicPhotoVideo) format, A first step of checking whether the asset selected by the user is an asset including image data and at least one text data; Extracting information for displaying the image data and the text data; A third step of extracting and displaying the image data using the information; And a fourth step of extracting and sequentially displaying at least one or more of the text data from the information according to a predetermined display method while the image data is displayed. The method of claim 18, And the asset includes position information indicating a position at which the text data is displayed and time information indicating a time at which the text data is displayed. The method of claim 18, The display method is a multimedia data display method combined with the text data comprising the display according to the exhibition time information for specifying the time the respective text data is displayed while the image data is displayed. The method of claim 20, The display time information is a multimedia data display method is a combination of text data including the start time information that the text data starts to display and the display time interval information indicating the time interval in which the text data is displayed. In a recording medium on which a program for displaying multimedia data described in the MPV (MusicPhotoVideo) format is recorded, The program determines whether the asset selected by the user is an asset consisting of audio data and at least one text data, extracts information for displaying the audio data and the text data, and then stores the information. And extract and reproduce the audio data by using a plurality of the at least one text data from the information according to a predetermined display method while the audio data is reproduced. The method of claim 22, The asset includes an exhibition of multimedia data described in the MPV (MusicPhotoVideo) format, wherein the asset includes location information indicating a position at which the text data is displayed and time information indicating a time at which the text data is displayed. Record medium on which the program is recorded. In a recording medium on which a program for displaying multimedia data described in the MPV (MusicPhotoVideo) format is recorded, The program determines whether the asset selected by the user is an asset composed of video data and at least one text data, extracts information for displaying the video data and the text data, and then stores the information. And extract and play the video data by using a plurality of the at least one text data from the information according to a predetermined display method while the video data is reproduced. The method of claim 24, The asset includes an exhibition of multimedia data described in the MPV (MusicPhotoVideo) format, wherein the asset includes location information indicating a position at which the text data is displayed and time information indicating a time at which the text data is displayed. Record medium on which the program is recorded. In a recording medium on which a program for displaying multimedia data described in the MPV (MusicPhotoVideo) format is recorded, The program determines whether the asset selected by the user is an asset composed of image data and at least one text data, extracts information for displaying the image data and the text data, and then stores the information. And extracting and displaying the image data by using a plurality of the at least one text data from the information according to a predetermined display method while the image data is displayed. The method of claim 26, The asset includes an exhibition of multimedia data described in the MPV (MusicPhotoVideo) format, wherein the asset includes location information indicating a position at which the text data is displayed and time information indicating a time at which the text data is displayed. Record medium on which the program is recorded.

Images