KR20050045688A - Apparatus and method for displaying audio and video data, and recording medium having the method recorded thereon - Google Patents

Abstract

The present invention relates to an audio and video data display device and a display method, and a recording medium recording the method. The present invention relates to a display device for multimedia data described according to the MPV (MusicPhotoVideo) format. Determine whether the asset is composed of audio data and at least one video, extract reference information for displaying the audio data and the video data, and extract the audio data using the reference information. And display at least one video data from the reference information and display the video data sequentially according to a predetermined display method while the audio data is displayed.

Description

Apparatus and method for displaying audio and video data, and recording medium having the method recorded thereon}

The present invention relates to an apparatus for displaying audio and video data, a method for displaying the same, and a recording medium recording the method. More specifically, the audio and video data among multimedia data may be referred to as MPV ('MultiPhotoVideo' or 'MusicPhotoVideo'). It is managed as a form of 'MPV' and provided to the user.

MPV is an industry standard specification for multimedia titles published in 2002 by the Optical Storage Technology Association (hereinafter referred to as "OSTA"), which allows users to view various types of music, photo and video data. It is a standard for providing conveniently or for manipulating and processing the multimedia data. Definitions and other standards for MPVs are available and available through the OSTA official website (www.osta.org).

Recently, media data such as digital pictures, videos, digital audio, and texts have been processed and played using a personal computer. In addition, the use of a device for generating the media content, for example, a digital camera, a digital camcorder, a digital audio player (a device for reproducing digital audio data such as MP3, WMA, etc.) As a result, various types of media data are generated in large quantities.

However, a personal computer has been mainly used to manage such a large amount of multimedia data, which causes a difficulty in requiring a file-based user experience. In addition, when multimedia data is generated in a specific product, attribute data, data play order, and playback method may be generated for each multimedia data, and when connected to a personal computer, the attribute data is lost and only original data is moved. . That is, inter-operability of data and attributes of data between home appliances, personal computers, and digital content generating devices is very weak.

An example in which the inter-operability is weak will be described. Properties determined using the digital camera to capture pictures, and using the slideshow function to view captured pictures on the digital camera. Properties determined using the slideshow order, time interval between photos, and the panorama function. Data such as the relationship between the photographed pictures and the attributes determined while using the continuous shutter function are stored together with the actual image data as the original data. At this time, when the digital camera transmits the image to the television using the AV cable, the user can view the multimedia data expressing each property. However, when connecting to a personal computer via a Universal Serial Bus (USB) cable, only the original data is transferred to the computer and all of its properties are lost.

As shown in the above example, the inter-operability of the personal computer to the attribute data stored in the digital camera, that is, the metadata, is very weak. Or, it may be regarded that there is no inter-operability of the personal computer with respect to the function of the digital camera.

The MPV standard is in progress to reinforce the weakness of inter-operability of data between digital devices.

The MPV specification processes a collection of multimedia data, such as digital photos, videos, audio, stored on storage media (or devices) such as optical disks, memory cards, computer hard disks, or exchanged by Internet protocols, Manifests, metadata, and practices for playback are defined.

MPV is currently being standardized by the Optical Storage Technology Association (OSTA) and the International Imaging Industry Association (I3A). The MPV is an open specification and processes a collection of digital photos, videos, digital audio, and text. Its main purpose is to make it easy to replace, replace and reproduce.

MPV is largely divided into two categories: MPV Core-Spec. 0.90WD and Profile.

The core is made up of three basic elements: Collection, Metadata, and Identification.

The collection has a manifest as a root member, and includes a metadata, an album, a marked asset, an asset list, and the like. At this time, an asset refers to multimedia data described according to the MPV format. There are two kinds. First, there is a simple media asset (digital photo, video, digital audio, document, etc.) is an example. In addition, there is a composite media asset, which includes digital photography + digital audio (StillWithAudio), continuous shooting digital photography (StillMultishotSequence), and panoramic photography digital photography (StillPanoramaSequence). 1 shows an example of the above contents.

The metadata follows the XML format, and there are five types of identifiers for identification.

LastURL: The path and file name of the asset.

2. InstanceID: unique ID for each asset (eg Exif 2.2)

3. DocumentID: same for both original and changed data

4. ContentID: generated whenever the asset is used for a specific purpose

5. id: local variable in metadata

On the other hand, there are seven profiles in total: Basic profile, Presentation profile, Capture / Edit profile, Archive profile, Internet profile. ), A printing profile, a container profile, and the like.

In other words, MPV supports functions such as managing various file associations using XML (Extensible Markup Language) metadata so that various multimedia data recorded on a storage medium can be reproduced according to a user's intention, and in particular, JPEG, MP3, It supports WMA, WMV, MPEG-1, MPEG-2, MPEG-4, supports digital camera formats AVI and QuickTime MJPEG video, MPV compliant discs are ISO9660 level 1, Joliet compatible, multi It is also compatible with session CDs, DVDs, memory cards, hard disks and the Internet, allowing users to manage and process a wide variety of multimedia data.

However, in the standard for the MPV format, various types of multimedia data that are not defined in the standard, that is, a new type of asset are needed, and the addition of a function for providing the multimedia data is required.

The present invention proposes a new multimedia data form in addition to the various types of multimedia data currently proposed by the MPV format, and proposes a method of providing multimedia data described according to the MPV format to the user in various ways. This is to make the use of multimedia data more diverse.

In order to achieve the above object, the audio and video data display apparatus described according to the MPV (MusicPhotoVideo) format according to the embodiment of the present invention is an asset in which the asset selected by the user is composed of a single audio data and at least one video. (asset), extract reference information for displaying the audio data and the video data, extract and display the audio data by using the reference information, and display the predetermined audio data while the audio data is displayed. According to an exhibition method, at least one or more pieces of video data may be extracted from the reference information and displayed sequentially. In this case, preferably, the exhibition method adjusts exhibition time information for designating a time at which the respective video data is played while the audio data is displayed, and adjusts the volume of the audio data and the volume generated during the playback of the video data. It includes what is displayed according to the volume control information.

In order to achieve the above object, the audio and video data display apparatus described according to the MPV (MusicPhotoVideo) format according to the embodiment of the present invention is an asset in which the asset selected by the user consists of a single video data and at least one audio. (asset), extract reference information for displaying the video data and the audio data, and extract and display the video data using the reference information. According to an exhibition method, at least one or more pieces of the audio data may be extracted from the reference information to be sequentially displayed. In this case, preferably, the display method is a volume control for adjusting exhibition time information for designating a time for each audio data to be played while the video data is displayed and a volume generated during reproduction of the audio data. Includes display based on information.

In order to achieve the above object, the audio and video data display method described in accordance with the MPV (MusicPhotoVideo) format according to an embodiment of the present invention, the asset selected by the user is composed of a single audio data and at least one video a first step of determining whether or not an asset is present; a second step of extracting reference information for displaying the audio data and video data; and a third step of extracting and displaying the audio data using the reference information. And extracting at least one or more pieces of the video data from the reference information and sequentially displaying the audio data according to a predetermined display method while the audio data is displayed.

In this case, preferably, the exhibition method adjusts exhibition time information for designating a time at which the respective video data is played while the audio data is displayed, and adjusts the volume of the audio data and the volume generated during the playback of the video data. It includes what is displayed according to the volume control information. At this time, the exhibition time information includes start time information at which the video data starts to be reproduced and reproduction time information indicating a time at which the video data is reproduced.

Also, preferably, the fourth step may further include: synchronizing first time information for designating a time at which the audio data is played with second time information for designating a time at which the at least one video data is played; Extracting first volume control information for adjusting the volume of the audio data generated during the reproduction of the audio data and second volume control information for adjusting the volume of the audio volume generated during the reproduction of the at least one video data; Step 4-2 and Step 4-3 of providing the audio data and the video data through a display medium using the time information and the volume control information.

In order to achieve the above object, the audio and video data display method described in accordance with the MPV (MusicPhotoVideo) format according to an embodiment of the present invention, the asset selected by the user consists of a single video data and at least one audio a first step of determining whether or not an asset is present; a second step of extracting reference information for displaying the video data and audio data; and a third step of extracting and displaying the video data using the reference information. And a fourth step of extracting and sequentially displaying at least one audio data from the reference information according to a predetermined exhibition method while the video data is displayed.

At this time, preferably, the exhibition method adjusts exhibition time information for designating a time at which the respective audio data is played while the video data is displayed, and adjusts the volume of the volume generated when the video data and the audio data are reproduced. It includes what is displayed according to the volume control information. At this time, the exhibition time information includes start time information at which the audio data starts to be reproduced and reproduction time information indicating a time at which the audio data is reproduced.

Also, preferably, the fourth step may further include: a fourth step of synchronizing first time information for specifying a time at which the video data is played with second time information for specifying a time at which the at least one audio data is played Extracting first volume control information for adjusting the volume of the volume generated during playback of the video data and second volume control information for adjusting the volume of volume generated during the playback of the at least one audio data; And step 4-2, and step 4-3 of providing the video data and the audio data through a display medium by using the time information and the volume control information.

In order to achieve the above object, a recording medium having a program recorded thereon for displaying audio and video data described in accordance with the MPV (MusicPhotoVideo) format according to the embodiment of the present invention has an asset selected by a user and a single audio data. Determine whether the asset is composed of at least one video, extract reference information for displaying the audio data and the video data, and extract and display the audio data using the reference information. While the audio data is displayed, at least one or more pieces of the video data may be extracted from the reference information according to a predetermined exhibition method and displayed sequentially.

In addition, in order to achieve the above object, a recording medium having a program recorded thereon for displaying audio and video data described in accordance with the MPV (MusicPhotoVideo) format according to the embodiment of the present invention has a single video in which the asset selected by the user is a single video. Determine whether the asset is composed of data and at least one audio, extract reference information for displaying the video data and the audio data, and extract and display the video data using the reference information. While the video data is displayed, at least one or more pieces of the audio data may be extracted from the reference information and displayed sequentially according to a predetermined exhibition method.

Hereinafter, an audio and video data display apparatus and method described according to an MPV format according to an embodiment of the present invention will be described with reference to the accompanying drawings.

Meanwhile, in the present invention, XML (eXtensible Markup Language) is used to provide multimedia data conforming to the MPV format, which will be described according to the XML schema.

In the present invention, the 'AudioWithVideo' asset and the 'VideoWithAudio' asset which are not proposed by OSTA are provided to provide more multimedia data. Looking at the definition of the two new assets (asset) and examples of use as follows. Hereinafter, 'smpv' and 'mpv' represent namespaces in XML, where 'smpv' represents namespaces for elements newly proposed by the present invention, and 'mpv' represents Represents the namespace for elements proposed by OSTA.

1.AudioWithVideo asset

An AudioWithVideo asset is an asset in which at least one video asset is combined with a single audio asset and may be referred to as an <AudioWithVideo> element when described in XML. have. For example, the user may listen to at least one video content while listening to one piece of music. In this case, the time interval at which the plurality of video contents are played may be adjusted, and the volume of the Asian content and the volume of the music may be mutually adjusted.

The audio asset and the video asset are also treated as elements in a file described in XML. In this case, the audio asset may be represented by <smpv: AudioPart> and <mpv: Audio>, and the video asset may be represented by <smpv: VideoPart> and <mpv: Video>. have.

The <AudioPart> element represents a part of an audio asset. <SMPV: start>, <SMPV: stop>, and <SMPV: dur> may be defined as child elements of the <AudioPart> element, and at least one of the three child elements. The above must be specified.

The <SMPV: start> element may be defined as <xs: element name = "SMPV: start" type = "xs: long" minOccurs = "0" />, which is referred to as an audio asset. Start time, in seconds, for a portion of the total time of. If no value is given, the start time is calculated as [SMPV: start] = [SMPV: stop]-[SMPV: dur] based on the values of <SMPV: stop>, <SMPV: dur>. If no value of <SMPV: stop> or <SMPV: dur> is specified, the value of <SMPV: start> is zero.

The <SMPV: stop> element may be defined as <xs: element name = "SMPV: stop" type = "xs: long" minOccurs = "0" />, which is referred to as an audio asset. The ending point for a portion of the total time in 'seconds'. If no value is given, the end time is calculated as [SMPV: stop] = [SMPV: start] + [SMPV: dur] based on the values of <SMPV: start> and <SMPV: dur>. If no value of <SMPV: dur> is specified and <SMPV: start> is specified, then the value of <SMPV: stop> is the end time of the referenced asset. On the other hand, if the value of <SMPV: start> is not specified and the value of <SMPV: dur> is specified, the value of <SMPV: stop> becomes the value of <SMPV: dur>.

<MPV: dur> element may be defined as <xs: element name = "SMPV: dur" type = "xs: long" minOccurs = "0" />, which is referred to as an audio asset Represents the time actually played out of the total time. If the value of <SMPV: dur> is not given, it can be calculated in the same manner as [SMPV: dur] = [SMPV: stop]-[SMPV: start].

The <VideoPart> element represents a part of a video asset. The method of defining a <VideoPart> element may apply the same method of the <AudioPart> element.

2 schematically illustrates the structure of an 'AudioWithVideo' asset.

Referring to the diagram of the <AudioWithVideo> element shown in FIG. 2, the <AudioWithVideo> element is composed of a plurality of elements each having a namespace of 'mpv' and 'smpv'. It can be seen that.

In this case, 'mpv' is a namespace, and description of the element is described on the OSTA homepage 'www.osta.org' which is proposed for the MPV specification. Therefore, hereinafter, elements having 'smpv' as a namespace will be described in order.

(1) <AudioPartRef>

The <AudioPartRef> element refers to an <AudioPart> element.

(2) <VideoPartRef>

The <VideoPartRef> element refers to the <VideoPart> element.

(3) <VideoWithAudioRef>

The <VideoWithAudioRef> element refers to a <VideoWithAudio> element, and FIG. 3 briefly describes the <VideoWithAudioRef> element.

(4) <AudioWithVideoRef>

The <AudioWithVideoRef> element refers to an <AudioWithVideo> element. In FIG. 4, the <AudioWithVideoRef> element is briefly described.

(5) <VideoDurSeq>

The value of the <VideoDurSeq> element represents the time at which each video data is played. At this time, the unit is second and represents a relative time value. The playback time can also be expressed in decimal units. If the value of the <VideoDurSeq> element is not set, it is assumed that the playback time is not set. Therefore, the total playback time of the corresponding video data is regarded as the value of the <VideoDurSeq> element.

Meanwhile, the total reproduction time of the corresponding video data may be determined according to a reference type of the video data referenced in the video asset.

That is, the total reproduction time of the corresponding video data is the total reproduction time of the referenced video data when the reference type is 'VidoeRef'. If the reference type is 'VideoPartRef', the total reproduction time of the corresponding video data may be obtained using the attribute value of the referenced <VideoPart> element. In addition, when the reference type is 'AudioWithVideoRef', the reference type for audio data should be checked in the referenced <AudioWithVideo> element. That is, when the reference type for audio data is 'AudioRef', the total reproduction time of the video data is the total reproduction of the audio data, and the reference type for audio data is 'AudioPartRef'. In this case, the total playback time of the corresponding video data can be obtained using the attribute value of the referenced <AudioPart> element. If the reference type is 'VideoWithAudioRef', only the video asset is extracted from the referenced <VideoWithAudio> element, and the video data referred to as 'VideoRef' in the extracted video asset (asset). The total playback time of the video is taken as the total playback time of the video data.

The description of the value of the <VideoDurSeq> element is as follows.

[Equation 1]

VideoDurSeq = <clock-value> (";" <clock-value>);

[Equation 2]

clock-value = (<seconds> | <unknown-dur>)

[Equation 3]

unknown-dur = the empty string

[Equation 4]

seconds = <decimal number> (. <decimal number>).

Equation 1 indicates that the <VideoDurSeq> element value can be represented by a 'clock-value', and when the video data is 2 or more, ";" is used to distinguish the playback time of each video data. do.

[Equation 2] means that the value of 'clock-value' in [Equation 1] is represented by 'seconds' or 'unknown-dur'.

[Equation 3] means that 'unknown-dur' does not set the 'clock-value' value in [Equation 2].

In Equation 4, 'seconds' in Equation 2 is expressed as a decimal number, and means that the playback time of the corresponding video data is represented using a decimal point.

For example, when the value of 'seconds' is '7.2', this indicates that a playback time of the corresponding video data is 7.2 seconds. As another example, when the value of 'seconds' is '2; 10.9', there are two corresponding video data. The playback time of the first video data is 2 seconds and the playback time of the second video data is 10.9 seconds. As another example, when the 'seconds' value is '; 5.6', there are two corresponding video data. Since the playing time of the first video data is not set, the first video data is played during the total playing time of the corresponding content. The playback time of the second video data is 5.6 seconds. 5 briefly describes the <VideoDurSeq> element.

(6) <StartSeq>

The value of the <StartSeq> element indicates a start point of playback when each video data is played. At this time, the unit is second, and represents a relative time value with respect to the time point at which each video data starts to be reproduced. The time point at which playback starts is also expressed in decimal units. For example, if the value of the <StartSeq> element is not set, the value is regarded as 0 seconds. In other words, playback starts from the point in time at which the video data starts to be played. If the value of the <StartSeq> element is greater than the total playback time of the video data, the result is that the video data is played after the playback of the video data ends. In this case, the value of the <StartSeq> element is set. See 0 seconds.

If both the <VideoDurSeq> element and the <StartSeq> element are defined within the <AudioWithVideo> element, the <VideoDurSeq> element value and the <StartSeq> element ( element) should be equal to or smaller than the total playback time of the video data to be played. If not, the <VideoDurSeq> element value is obtained by subtracting the <StartSeq> element value from the total playing time of the corresponding video data. 6 briefly describes the <StartSeq> element.

(7) <VideoVolumeSeq>

The <VideoVolumeSeq> element value represents the volume level of the corresponding video data as a percentage. Therefore, when the <VideoVolumeSeq> element value is 0, the volume of the corresponding video data is also 0. If the <VideoVolumeSeq> element value is not set, the video is reproduced at the original volume of the video data.

If a plurality of video data is played, the <VideoVolumeSeq> element value is set as many as the number of video data to be played. However, if only a single value is set, the volume of all the video data to be played is set to the single Play back with a single value. FIG. 7 briefly describes the <VideoVolumeSeq> element.

(8) <AudioVolume>

The <AudioVolume> element value represents a volume level of corresponding audio data as a percentage. If the value of the <AudioVolume> element is not set, the value of the <AudioVolume> element is regarded as 100. 8 briefly describes the <AudioVolume> element.

9 is an exemplary diagram summarizing a diagram of a type of an <AudioWithVideo> element.

As an example, a method of providing an AudioWithVideo asset by using the above-described element is described.

Example 1

<SMPV: AudioWithVideo>

<AudioRef> A0007 </ AudioRef>

<VideoRef> V1205 </ VideoRef>

<VideoRef> V1206 </ VideoRef>

<SMPV: StartSeq>; 3 </ SMPV: StartSeq>

</ SMPV: AudioWithVideo>

In Example 1), an AudioWithVideo asset is played using one audio asset referred to as a 'A0007' value and two video assets referred to as a 'V1205' and a 'V1206' value, respectively. The method is shown. In the case of Example 1), when the <StartSeq> element value is viewed, since the value is not set for the video asset referred to as the 'V1205' value, the value is regarded as 0 second. That is, the video asset referred to by the value 'V1206' is played when the video asset referred to by the value 'V1206' is played from the time when the audio asset referred to by the value 'A0007' starts to play. Will be played back. On the other hand, since the value is set to 3 for the video asset referred to by the value of 'V1206', the video asset referred to by the value of 'V1206' starts from the beginning of the video asset referred to by the value of 'V1206'. Playback starts from 3 seconds later.

Example 2

<SMPV: AudioWithVideo>

<AudioRef> A0001 </ AudioRef>

<VideoRef> V1001 </ VideoRef>

<VideoRef> V1002 </ VideoRef>

<VideoRef> V1003 </ VideoRef>

<SMPV: VideoDurSeq> 2 ;; 10 </ SMPV: VideoDurSeq>

<SMPV: StartSeq>; 3; 0 </ SMPV: StartSeq>

<SMPV: VideoVolumeSeq> 50 </ SMPV: VideoVolumeSeq>

<SMPV: AudioVolume> 50 </ SMPV: AudioVolume>

</ SMPV: AudioWithVideo>

In Example 2), an AudioWithVideo asset (asset) is used by using one audio asset referred to as the 'A0001' value and three video assets referred to as the 'V1001', 'V1002', and 'V1003' values, respectively. ) Shows how to play. In the case of Example 2), the video asset referred to by the value 'V1001' is played for 2 seconds. The video asset referred to as the 'V1002' value is 3 from the start of the video asset referred to as the 'V1002' value after the playback of the video asset referred to as the 'V1001' value is finished. Playback starts from the second. The video asset referred to as the 'V1003' value is played for 10 seconds after the playback of the video asset referred to as the 'V1002' value is finished.

Meanwhile, the volumes of the three video assets are all reproduced by 50% of the original volume, and the volumes of the audio assets are also reproduced by only 50% of the original volume.

Example 3

<SMPV: AudioWithVideo>

<AudioRef> A0001 </ AudioRef>

<VideoPartRef> VP1001 </ VideoPartRef>

<AudioWithVideoRef> AV1002 </ AudioWithVideoRef>

</ SMPV: AudioWithVideo>

In Example 3), one audio asset (asset) referred to as 'A0001', a VideoPart asset (asset) referred to as 'VP1001', and an AudioWithVideo asset using an AudioWithVideo asset (asset) referred to as 'AV1002' (asset) to play back.

2. 'VideoWithAudio' asset

An 'VideoWithAudio' asset is an asset in which at least one audio asset is combined with a single video asset. The 'VideoWithAudio' element is described as an 'VideoWithAudio' element when described in XML. It can be called. The audio asset and video asset are also treated as elements in a document described in XML. In this case, the audio asset may be represented by 'smpv: AudioPart' and 'mpv: Audio', and the video asset may be represented by 'smpv: VideoPart' and 'mpv: Video'. have.

10 schematically illustrates the structure of a 'VideoWithAudio' element. Referring to the diagram of the <VideoWithAudio> element shown in FIG. 10, the <VideoWithAudio> element is composed of a plurality of elements each having a namespace of 'mpv' and 'smpv'. It can be seen that.

Here, the description of the element using 'mpv' as a namespace is omitted since it is described in OSTA's homepage 'www.osta.org' which proposes the MPV specification. Therefore, hereinafter, elements having 'smpv' as a namespace will be described in order. In the meantime, the description of the AudioWithVideo asset will be omitted.

(1) <AudioDurSeq>

The value of the <AudioDurSeq> element represents the time at which each audio data is played. At this time, the unit is second and represents a relative time value. The playback time can also be expressed in decimal units. If the value of the <AudioDurSeq> element is not set, the playback time is not set, so the total reproduction time of the corresponding audio data is regarded as the value of the <AudioDurSeq> element. The description of the value of the <AudioDurSeq> element is as follows.

[Equation 5]

AudioDurSeq = <clock-value> (";" <clock-value>);

[Equation 6]

clock-value = (<seconds> | <unknown-dur>)

[Equation 7]

unknown-dur = the empty string

[Equation 8]

seconds = <decimal number> (. <decimal number>).

In Equation 5, the <AudioDurSeq> element value may be represented by a 'clock-value', and when audio data is 2 or more, it means that the playback time of each audio content is distinguished using ";". do.

[Equation 6] means that the 'clock-value' value in [Equation 5] is represented by 'seconds' or 'unknown-dur'.

In Equation 7, 'unknown-dur' in Equation 6 means that the 'clock-value' value is not set.

In Equation 6, 'seconds' value in [Equation 6] is expressed as a decimal number, and means that the reproduction time of the corresponding audio data is represented using a decimal point.

For example, when the 'clock-value' value is '12 .2 ', it indicates that the reproduction time of the corresponding audio data is 12.2 seconds. As another example, when the 'clock-value' value is '20; 8.9 ', there are two corresponding audio data. The playback time of the first audio data is 20 seconds and the playback time of the second audio data is 8.9 seconds. . As another example, when the 'clock-value' value is '; 56.5', there are two corresponding audio data. Since the playback time of the first audio data is not set, the first audio data is played during the total playback time of the corresponding audio data. The playback time of the second audio data is 56.5 seconds. FIG. 11 briefly describes the <AudioDurSeq> element.

(2) <AudioVolumeSeq>

The <AudioVolumeSeq> element value represents the volume level of the corresponding audio data as a percentage. If the <AudioVolumeSeq> element value is not set, the audio volume is reproduced at the original volume of the corresponding audio data.

If a plurality of audio data is played, the <AudioVolumeSeq> element value is set as many as the number of audio data to be played. However, if only a single value is set, the volume of all the audio data to be played is set to the single Play back with a single value. 12 briefly describes the <AudioVolumeSeq> element.

(3) <VideoVolume>

The <VideoVolume> element value represents the volume level of the corresponding video data as a percentage. If the value of the <VideoVolume> element is not set, the value of the <VideoVolume> element is regarded as 100. That is, the original volume of the video data is reproduced. 13 briefly describes the <VideoVolume> element.

14 is an exemplary diagram summarizing a diagram of a type of the <VideoWithAudio> element.

Meanwhile, in the present invention, a reference group for reference of an asset may be defined.

That is, an 'AudioRefGroup' for referring to an audio asset and a 'VideoRefGroup' for referencing a video asset may be defined.

At this time, the AudioRefGroup includes an <mpv: AudioRef> element and an <SMPV: AudioPartRef> element.

In addition, the VideoRefGroup includes a <mpv: VideoRef> element, a <SMPV: VideoPartRef> element, a <SMPV: VideoWithAudioRef> element, and a <SMPV: AudioWithVideoRef> element. . 15 and 16, the 'AudioRefGroup' group and the 'VideoRefGroup' group are described.

17 is a flowchart illustrating a process of playing an 'AudioWithVideo' asset according to an embodiment of the present invention.

The user executes software that can execute the file described according to the MPV format, and selects an 'AduioWithVideo' asset in a specific album (S1700). Then, a thread or child processor is created to collect information about the audio asset and information about the video asset, respectively.

That is, reference information about the audio asset constituting the 'AudioWithVideo' asset selected by the user is extracted (S1705). In operation S1710, information about the audio asset is extracted from an asset list using the reference information. At this time, reproduction time information and volume information of the audio asset are obtained (S1715, S1720).

Meanwhile, another thread or child processor first extracts an asset list (S1725) associated with the audio asset (S1725), and extracts information about all video assets from the asset list. Extract (S1730). Then, the scenario for reproducing the video asset, that is, the order and the reproduction time of each video data, is determined using the information (S1735). Although a scenario of all video assets combined with the audio asset is determined in step S1735, the total playback time of all video assets may be longer than the playback time of the audio asset. Therefore, in this case, the total reproduction time of the video assets is determined according to the reproduction time of the audio asset. At this time, the reproduction time information of the audio asset obtained in step S1715 is used (S1740). Thus, some video assets played after the playback time of the audio asset may not be played. When the step S1740 is finished, the volume of the volume generated from each video data is adjusted (S1745).

When both the audio and video assets constituting the 'AudioWithVideo' asset are obtained to display the 'AudioWithVideo' asset, the content representing the 'AudioWithVideo' asset is played using the information (S1750). .

Meanwhile, the multimedia data provided by the MPV format may be described and represented in the form of an XML document. The XML document may be converted into a plurality of application documents according to stylesheets applied to the XML document. In the present invention, by applying stylesheets to convert XML documents into HTML documents, the user can manage audio and video data through a browser. In addition, WML (Wireless Markup Language), cHTML ( By applying stylesheets that convert to Compact HTML documents, users can access audio and video data described by MPV format through mobile terminals such as PDAs (Personal Digital Assistants), cellular phones, and smart phones. Do.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited to drawing.

According to the present invention, by providing a user with a new type of multimedia data asset combining audio data and video data, the user can create and use a variety of multimedia data described in the MPV format.

FIG. 1 is an exemplary diagram showing the types of assets described in the MPV (MusicPhotoVideo) specification.

2 is an exemplary diagram schematically showing the structure of an 'AudioWithVideo' asset according to an embodiment of the present invention.

3 is an exemplary diagram briefly describing a <VideoWithAudioRef> element according to an embodiment of the present invention.

4 is an exemplary diagram briefly describing an <AudioWithVideoRef> element according to an embodiment of the present invention.

5 is an exemplary diagram briefly describing a <VideoDurSeq> element according to an embodiment of the present invention.

6 is an exemplary diagram briefly describing a <StartSeq> element according to an embodiment of the present invention.

7 is an exemplary diagram briefly describing a <VideoVolumeSeq> element according to an embodiment of the present invention.

8 is an exemplary diagram briefly describing an <AudioVolume> element according to an embodiment of the present invention.

9 is an exemplary diagram summarizing a diagram of a type of a <AudioWithVideo> element according to an embodiment of the present invention.

10 is an exemplary diagram schematically showing the structure of a 'VideoWithAudio' asset according to an embodiment of the present invention.

11 is an exemplary diagram briefly describing an <AudioDurSeq> element according to an embodiment of the present invention.

12 is an exemplary diagram briefly describing an <AudioVolumeSeq> element according to an embodiment of the present invention.

FIG. 13 is an exemplary diagram briefly describing a <VideoVolume> element according to an embodiment of the present invention. FIG.

14 is an exemplary diagram summarizing a diagram of a type of a <VideoWithAudio> element according to an embodiment of the present invention.

15 is an exemplary view briefly describing an AudioRefGroup group according to an embodiment of the present invention.

16 is an exemplary view briefly describing a VideoRefGroup group according to an embodiment of the present invention.

17 is a flowchart illustrating a process of playing an 'AudioWithVideo' asset according to an embodiment of the present invention.

Claims (14)

In the display device for multimedia data described in the MPV (MusicPhotoVideo) format, Determine whether the asset selected by the user is an asset consisting of a single audio data and at least one video, extract reference information for displaying the audio data and the video data, and then refer to the reference information. And extract and display the audio data by using a plurality of the at least one video data from the reference information according to a predetermined display method while the audio data is displayed. The method of claim 1, The display method includes display time information for designating a time at which the respective video data is played while the audio data is displayed, and volume control information for adjusting the volume of the audio data and the volume generated when the video data is played. Audio and video data display device including the display according. In the display device for multimedia data described in the MPV (MusicPhotoVideo) format, Determine whether the asset selected by the user is an asset composed of a single video data and at least one audio, extract reference information for displaying the video data and the audio data, and then refer to the reference information. And extract and display the video data by using a plurality of the at least one audio data from the reference information according to a predetermined display method while the video data is displayed. The method of claim 3, The display method may be displayed according to exhibition time information for designating a time at which the respective audio data is played while the video data is displayed and volume control information for adjusting a volume of the audio data. Audio and video data display device comprising. In the display method of the multimedia data described by the MPV (MusicPhotoVideo) format, A first step of checking whether the asset selected by the user is an asset including single audio data and at least one video data; Extracting reference information for displaying the audio data and the video data; A third step of extracting and displaying the audio data using the reference information; And extracting at least one or more pieces of the video data from the reference information and sequentially displaying the audio data according to a predetermined display method while the audio data is displayed. The method of claim 5, The display method includes display time information for designating a time at which the respective video data is played while the audio data is displayed, and volume control information for adjusting the volume of the audio data and the volume generated when the video data is played. Audio and video data display method comprising the display according. The method of claim 6, And the exhibition time information includes start time information at which the video data starts to be reproduced and reproduction time information indicating a time at which the video data is reproduced. The method of claim 5, The fourth step may include: synchronizing first time information for designating a time at which the audio data is played with second time information for designating a time at which the at least one video data is played; Extracting first volume control information for adjusting the volume of the audio data generated during the reproduction of the audio data and second volume control information for adjusting the volume of the audio volume generated during the reproduction of the at least one video data; Wow; And a step 4-3 of providing the audio data and the video data through a display medium by using the time information and the volume control information. In the display method of the multimedia data described by the MPV (MusicPhotoVideo) format, A first step of checking whether the asset selected by the user is an asset including single video data and at least one audio; Extracting reference information for displaying the video data and the audio data; A third step of extracting and displaying the video data using the reference information; And extracting and sequentially displaying at least one audio data from the reference information according to a predetermined display method while the video data is displayed. The method of claim 9, The display method includes display time information for designating a time at which the respective audio data is played while the video data is displayed, and volume control information for adjusting the volume of the video data and the volume generated when the audio data is reproduced. Audio and video data display method comprising the display according. The method of claim 10, And the exhibition time information includes start time information at which the audio data starts to be reproduced and reproduction time information indicating a time at which the audio data is reproduced. The method of claim 9, The fourth step may include: synchronizing first time information for designating a time at which the video data is played with second time information for designating a time at which the at least one audio data is played; Extracting first volume control information for adjusting the volume of the volume generated when the video data is reproduced and second volume control information for adjusting the volume of volume generated when the at least one audio data is reproduced; Wow; And a fourth step of providing the video data and the audio data through a display medium using the time information and the volume control information. In a recording medium on which a program for displaying multimedia data described in the MPV (MusicPhotoVideo) format is recorded, The program determines whether the asset selected by the user is an asset composed of single audio data and at least one video, and extracts reference information for displaying the audio data and the video data. Extracting and displaying the audio data by using the reference information, and extracting and displaying at least one or more of the video data from the reference information sequentially according to a predetermined exhibition method while the audio data is displayed. Record carrier. In the recording medium, a program for displaying multimedia data described in the MPV (MusicPhotoVideo) format, The program determines whether the asset selected by the user is an asset composed of single video data and at least one audio, extracts reference information for displaying the video data and the audio data, and Extracting and displaying the video data using the reference information, and extracting and displaying at least one of the audio data from the reference information sequentially according to a predetermined exhibition method while the video data is displayed. Record carrier.