KR20090052780A - Method for providing object-based audio service, method for creating/ editing/reproducing multi-object audio contents files, and file structure thereof - Google Patents

Abstract

The present invention relates to a method for providing an object-based audio service, a method for creating / editing / playing a multi-object audio content file for the same, and a file structure thereof. The present invention relates to an image / video / text related to an audio preset as an additional service to an object-based audio service. By additionally providing additional data in the form of visual data such as a user, the user can author / edit various audio contents according to his or her taste.

To this end, the present invention provides a method for providing an object-based audio service, the method comprising: generating a plurality of audio objects constituting audio content; Generating an audio preset defining an object property for each audio object; And multiplexing and transmitting the audio object, the audio preset, and additional data related to the audio preset.

Object-based audio, audio object, multi-object audio content file, supplementary data, supplementary data index information

Description

Object-based audio service providing method, multi-object audio content file creation method and the structure and the file structure for the same, and the structure of the file AND FILE STRUCTURE THEREOF}

The present invention relates to an object-based audio service, and more particularly, to an object-based audio service as an additional service, by additionally providing additional data in the form of visual data such as an image / video / text related to an audio preset. The present invention relates to an object-based audio service providing method which enables to author / edit various audio contents according to taste, a method of creating / editing / playing a multi-object audio content file for the same, and a file structure thereof.

The present invention is derived from a study conducted as part of the public R & D technology-based venture development project of the Ministry of Information and Communication and the Ministry of Information and Telecommunication Research and Development.

An audio signal provided through a broadcast service such as a TV broadcast, a radio broadcast, or a DMB is synthesized with audio signals obtained from various sound sources and stored / transmitted as one audio signal.

In such an environment, it is possible for the viewer to adjust the strength of the entire audio signal and the like, but it is impossible to control the characteristics of the audio signal for each sound source such as adjusting the strength of the audio signal for each sound source included in the audio signal.

However, when authoring audio content, if the audio signal for each sound source is stored without being synthesized, the content reproduction terminal can watch the corresponding content while controlling the intensity of the audio signal for each sound source. In this way, the storage / transmission stage independently stores / transmits multiple audio signals so that the viewer can control and listen to each audio signal in a receiver (content playback terminal). It is called.

In the object-based audio service, properties such as location, sound intensity, and sound field environment of each object are defined and provided as a preset so that a user can utilize them in the playback of audio content. In other words, if a plurality of preset audio information is authored and included in a file, the receiver can more efficiently reproduce the object-based audio service.

In the case of general multimedia services, a service is usually provided by one audio object and one video object. However, the MPEG-4 system standard defines a multimedia service including several objects.

In the conventional object-based audio service, an audio service is provided through a multimedia content including a plurality of objects similarly to those defined in the MPEG-4 system.

In particular, the conventional object-based audio service can be divided into an editor's preset provision process and a user's control process. The editor provides audio scene information in the form of presets that defines the attributes of each object. Accordingly, the terminal provides a relatively simple control function such as a user selects and listens to various presets according to tastes, or configures a new audio scene by combining the position of each object, the loudness, and the like.

For example, in the case of a music content composed of a singer's song, piano, drum, guitar, keyboard, etc., multiplexing and storing each audio object separately, and storing and providing various audio scenes configured by the editor in combination as a preset form do. The user can then select one of the editor's presets according to his or her preferences, or newly configure and listen to his / her own audio content.

In today's individualized society, which pursues its own unique values rather than universal values, the era of simply playing and receiving media data produced according to the existing format is over, and users can write their own multimedia contents. The tendency to edit and share it widely with others is prominent. In addition, users want a multimedia service that combines all types of media.

However, object-based audio services up to now have been limited to providing only audio data itself, such as providing audio objects and related audio presets, which is opposed to a user's tendency to request various multimedia services. Has a problem.

Therefore, in providing object-based audio services, not only audio objects and audio presets but also visual additional data such as images, videos, and data related to audio presets are provided. This will allow the receiving users to edit / reconstruct the audio content to their liking using the additional data.

In the prior art as described above, in providing an object-based audio service, there is a problem that the provided audio service data is limited to the audio object and the corresponding audio preset, and thus does not meet the needs of users who want various audio services. It is an object of the present invention to solve this problem.

The objects of the present invention are not limited to the above-mentioned objects, and other objects and advantages of the present invention which are not mentioned above can be understood by the following description, and will be more clearly understood by the embodiments of the present invention. Also, it will be readily appreciated that the objects and advantages of the present invention may be realized by the means and combinations thereof indicated in the claims.

In order to solve the above object, the present invention is characterized in that the object-based audio service further provides additional data in the form of visual data such as an image / video / text related to an audio preset as an additional service.

More particularly, the present invention provides a method of providing an object-based audio service, comprising: generating a plurality of audio objects constituting audio content; Generating an audio preset defining an object property for each audio object; And multiplexing and transmitting the audio object, the audio preset, and additional data related to the audio preset.

The present invention also provides a method for generating a multi-object audio content file for an object-based audio service, comprising: generating a plurality of audio objects constituting audio content; Generating an audio preset defining an object property for each audio object; And generating a multi-object audio content file using the audio object, the audio preset, and additional data related to the audio preset.

The present invention also provides a method of editing a multi-object audio content file, comprising: providing object information and audio preset information for the multi-object audio content file to a user; And receiving at least one of an audio object, audio preset, additional data, and additional data index information from the user, and adding the received object to the multi-object audio content file.

The present invention also provides a method of playing a multi-object audio content file, comprising: providing audio preset information and additional data index information for the multi-object audio content file to be played back to a user; Receiving an audio preset and related additional data from the user; And playing the audio content using the corresponding audio object and the selected additional data according to the selected audio preset.

The present invention also provides an object field for recording a plurality of audio objects constituting audio content; An additional data field in which additional data related to an audio preset is recorded; And a header field in which an audio preset defining an object property of the audio content and index information of the additional data are recorded. The multi-object audio content file structure for an object-based audio service can be read by a computer. Provide a record carrier.

As described above, the present invention can provide a more effective object-based audio service by additionally providing visual data such as an image or a video / text related to object-based audio content as an additional service, and furthermore, to activate the object-based audio service. It works.

In addition, the present invention provides a structure that allows a user to add audio objects such as performances or songs recorded by the user to a multi-object audio content file afterwards, thereby allowing the user to create a unique and unique object. This has the effect of authoring the underlying audio content.

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, whereby those skilled in the art may easily implement the technical idea of the present invention. There will be. In addition, in describing the present invention, when it is determined that the detailed description of the known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a configuration diagram of a multi-object audio content file for a conventional object-based audio service, and FIG. 2 is a configuration diagram of a multi-object audio content file including additional data and a user audio object according to the present invention.

The existing multi-object audio content file 10 has a header 11 that stores an audio preset authored by the editor and a plurality of framed audio objects authored by the editor, as shown in FIG. It consists of 12).

In contrast, the multi-object audio content file according to the present invention, as shown in Figure 2, the header field 21, 4, the audio object field 22 authored by the editor (author), the additional data field ( 23), and a data structure including an audio object field 24 for storing audio objects added after the user by the user.

The multi-object audio content file 20 according to the present invention includes 'additional data' 23 in the form of visual data such as images, images, texts, and the like related to audio presets. It has a structure to add. Accordingly, the user may select and play back additional data (additional data created by the editor) for each preset in the audio reproduction step, or add additional data such as an image or a video created by the user. Here, the additional data 23 may include various types of additional data. In particular, the additional data 23 may include visual data such as an image, an image, a text, and the like.

In addition, the multi-object audio content file 20 according to the present invention may include an audio object 24 that the user directly records / produces.

In summary, the multi-object audio content file 20 according to the present invention has a structure in which an editor can include additional data such as images / videos / characters related to presets in a file, and a user plays, sings, and images / videos. It is characterized by having a structure that can include additional data such as / character.

Meanwhile, the header 21 of the multi-object audio content file 20 according to the present invention is different from the existing header structure in which only a preset edited by the editor using only the audio object is stored. Audio presets defining attributes (eg, object position, loudness, etc.) and index information (see FIG. 4) for additional data are included. Here, the index information for the additional data is information that allows the user to select the additional data 23 related to the audio preset.

The present invention, through the multi-object audio content file and its structure as described above, can be provided by adding the image, image, text, etc. to the object-based audio service, so that the user to his or her performance or song as an audio object In addition, you can organize your own audio content and share it with others. In other words, users will be able to produce various Music User Created Contents (UCC).

For example, if an editor creates an existing object audio signal and an artist's image or video / characters in various forms according to presets, and then multiplexes them to the user, the user can listen to music according to the preset selected by the user and simultaneously You can watch videos / images and texts.

In the case of the original song preset, the video or image of the singer may be provided as the additional data 23, and in the case of the karaoke preset, the video or image such as the scenery, but not the singer, may be provided as the additional data 23. In addition, the editor may provide a description of the concept of the preset (description of the content) or additional data (video / image) matching with the preset as index information.

The user may combine the object audio signal to create his own audio content, and add his / her own image / image, description of the content, message, and the like. Users can also create their own unique object-based audio content by adding their own performances or songs to the audio content.

3 is a configuration diagram of a file header for a conventional object-based audio service, Figure 4 is a configuration diagram of a file header for an object-based audio service according to the present invention.

In the header 11 of the conventional multi-object audio content file, only the preset edited by the editor using only the audio object is stored.

Alternatively, the header 21 of the multi-object audio content file 20 according to the present invention may store not only an audio preset 41 authored by an editor, but also a preset 42 written by a user. The header 21 stores audio preset information (not shown in FIG. 4) such as the total number of presets and the preset name.

That is, the header 21 according to the present invention, as shown in Figure 4, the editor configures the preset by using the object audio, and the index information (additional) for the additional data associated with the preset (editor authoring preset) Data index information), and a structure in which a user can add a new preset (user authoring preset) configured by using an audio object added by the user.

In addition, the file header 21 according to the present invention includes audio presets 41 and 42 and index information (additional data index information) 411 to 422 for additional data. The user may select additional data 23 that matches a specific audio preset through the additional data index information 411 through 422. Here, the additional data index information includes information about additional data (images, images, texts, etc.) related to each audio preset.

FIG. 5 is a flowchart illustrating a method of generating a multi-object audio content file for an object-based audio service according to the present invention, and illustrates a method performed in an object-based audio service providing device, particularly an encoding device.

The audio service providing apparatus generates a plurality of audio objects constituting audio content (500), and then generates an audio preset in which object attributes are defined for each audio object (502). In operation 504, the audio service providing apparatus generates additional data related to the audio preset and index information of the additional data. Here, the additional data may be generated and used directly by the audio service providing apparatus or may be received from an external source.

Thereafter, the apparatus for providing an audio service generates one multi-object audio content file by using the audio object, the audio preset, the additional data, and the additional data index information (506). The detailed structure of the multi-object audio content file is as described with reference to FIGS. 2 and 4.

6 is a flowchart illustrating an object-based audio service providing method through a network according to an embodiment of the present invention, and shows a method performed by the apparatus for providing an object-based audio service.

The audio service providing apparatus according to the present invention generates a plurality of audio objects constituting audio content (600), and then generates an audio preset defining object properties for each audio object (602). In operation 604, the apparatus for providing an audio service generates additional data related to the audio preset and index information of the additional data. Here, the additional data may be generated and used directly by the audio service providing apparatus or may be received from an external source.

Then, the audio service providing apparatus multiplexes the audio object, the audio preset, the additional data, and the additional data index information and transmits the same through the communication or broadcast network (606). Then, the receiving terminal of the user plays the audio content.

7 is a flowchart illustrating a method of editing a multi-object audio content file according to an exemplary embodiment of the present invention, and illustrates a process of editing a multi-object audio content file in a content reproduction terminal of a user.

The user's content reproduction terminal outputs object information and audio preset information for the multi-object audio content file (700).

The content reproduction terminal of the user, according to the user's request, at least among the audio object 24, the additional data 23, the audio preset 42, or the additional data index information 411 to 422 created by the user himself from the user. Any one or more inputs are received and added to the multi-object audio content file (702). By doing this, the user constructs his own unique and unique multi-object audio content file.

Although not shown in the drawing, the content reproduction terminal of the user changes the audio object, the audio preset, the additional data, or the additional data index information according to the change request of the user.

8 is a flowchart illustrating a method of playing a multi-object audio content file according to an exemplary embodiment of the present invention.

The content reproduction terminal of the user outputs audio preset information and additional data index information for the audio content (multi-object audio content file) to be reproduced (800). Then, the user selects additional data related to the specific audio preset through the output information.

When the user selects the audio preset and the additional data selected by the user (802), the user plays the audio content using the corresponding audio object and the selected additional data according to the audio preset selected by the user (804).

Additional data such as an image, an image, and the like, and additional data index information may be stored in the multi-object audio content file, or in some embodiments, may be stored in a separate file separate from the multi-object audio content file.

On the other hand, the method of the present invention as described above can be written in a computer program. And the code and code segments constituting the program can be easily inferred by a computer programmer in the art. In addition, the written program is stored in a computer-readable recording medium (information storage medium), and read and executed by a computer to implement the method of the present invention. The recording medium may include any type of computer readable recording medium.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the technical spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited by the drawings.

1 is a block diagram of a multi-object audio content file for a conventional object-based audio service,

2 is a configuration diagram of an embodiment of a multi-object audio content file including additional data and a user audio object according to the present invention;

3 is a block diagram of a file header for a conventional object-based audio service,

4 is a configuration diagram of an embodiment of a file header for an object-based audio service according to the present invention;

5 is a flowchart illustrating a method of generating a multi-object audio content file for an object-based audio service according to the present invention;

6 is a flowchart illustrating an embodiment of a method for providing an object-based audio service through a network according to the present invention;

7 is a flowchart illustrating a method of editing a multi-object audio content file according to the present invention;

8 is a flowchart illustrating a method of playing a multi-object audio content file according to the present invention.

Claims (15)

In the object-based audio service providing method, Generating a plurality of audio objects composing audio content; Generating an audio preset defining an object property for each audio object; And Multiplexing and transmitting the audio object, the audio preset, and additional data related to the audio preset; Object-based audio service providing method comprising a. The method of claim 1, Generating additional data related to the audio preset Object-based audio service providing method further comprising. The method of claim 1, The additional data, The object-based audio service providing method, characterized in that the visual data associated with the audio preset. The method of claim 1, The transmitting step, And providing index information on the additional data and transmitting the index information. In the multi-object audio content file generation method for object-based audio service, Generating a plurality of audio objects composing audio content; Generating an audio preset defining an object property for each audio object; And Generating a multi-object audio content file using the audio object, the audio preset, and additional data related to the audio preset. Multi-object audio content file generation method comprising a. The method of claim 5, wherein Generating additional data related to the audio preset The multi-object audio content file generation method further comprising. The method of claim 5, wherein The additional data, And the visual data associated with the audio preset. The method of claim 5, wherein The multi-object audio content file, And index information of the audio preset and the additional data as header information. In the multi-object audio content file editing method, Providing object information and audio preset information for the multi-object audio content file to a user; And Receiving at least one of an audio object, audio preset, additional data, and additional data index information from the user and adding it to the multi-object audio content file Method of editing a multi-object audio content file comprising a. The method of claim 9, Modifying or deleting at least one of an object, an audio preset, additional data, and additional data index information for the multi-object audio content file according to the user's request Editing method of a multi-object audio content file further comprising. In the multi-object audio content file playback method, Providing audio preset information and additional data index information for the multi-object audio content file to be played back to the user; Receiving an audio preset and related additional data from the user; And Playing audio content using a corresponding audio object and the selected additional data according to the selected audio preset; Method of playing a multi-object audio content file comprising a. The method of claim 11, The additional data index information and additional data, And playing the multi-object audio content file or a separate file. An object field in which a plurality of audio objects constituting audio content are recorded; An additional data field in which additional data related to an audio preset is recorded; And A header field in which an audio preset defining object properties of the audio content and index information of the additional data are recorded. A computer-readable recording medium recording a multi-object audio content file structure for an object-based audio service, comprising: a. The method of claim 13, The additional data, And a visual data associated with the audio preset, wherein the computer-readable recording medium records a multi-object audio content file structure for an object-based audio service. The method of claim 13, The multi-object audio content file, And the index information of the audio preset and the additional data as header information. A computer-readable recording medium having recorded thereon a multi-object audio content file structure for an object-based audio service.

Images