KR100802179B1 - Object-based 3-dimensional audio service system using preset audio scenes and its method - Google Patents

Abstract

The present invention solves the inconvenience of the operation of controlling the audio signal for each sound source of the user (viewer) in providing the object-based three-dimensional audio service to the user (viewer), allowing the user (viewer) easily and conveniently. An object-based three-dimensional audio service system using a preset audio scene for listening to an object-based three-dimensional audio service, and a method thereof, comprising: an audio input means for receiving an audio signal in an apparatus for providing a three-dimensional audio service ; Extracting an object audio signal from the input audio signal, placing the extracted object audio signal in a three-dimensional space, and for each of the object audio signals based on audio scene information of each preset object audio signal Audio scene generation means for editing object properties to generate a plurality of three-dimensional audio scene information having different object properties; And encoding means for encoding (multiplexing) the object audio signals and the plurality of 3D audio scene information to output object-based 3D audio content.

Audio, broadcast, object, based, scene, preset, service, information, playback, offer

Description

Object-based 3-dimensional audio service system using preset audio scenes and its method

1 is a configuration example of a conventional audio service system,

2 is a configuration diagram of an object-based three-dimensional audio service system using a preset audio scene according to the present invention;

3 is a flowchart illustrating an object-based 3D audio service providing method using a preset audio scene according to the present invention;

4 is a flowchart illustrating a method of reproducing an object-based 3D audio service using a preset audio scene according to the present invention.

* Explanation of symbols on the main parts of the drawing

30: object based 3D audio service providing apparatus

31: input unit 32: preset audio scene generator

33: encoder 34: transmitter

40: object-based 3D audio service playback device

41: receiver 42: decoder

43: audio scene information configuration section 44: audio signal synthesis section

45: audio signal playback unit

The present invention relates to an object-based three-dimensional audio service system and a method using a preset audio scene, and more particularly, to use a three-dimensional audio-related technology to provide a more realistic broadcast to the user (viewer), The present invention relates to an object-based three-dimensional audio service system using a preset audio scene and a method for providing an interactive (bidirectional) service in which an audio scene can be directly configured.

delete

1 is an exemplary configuration diagram of a conventional audio service system.

As shown in FIG. 1, the conventional audio service providing apparatus 10 includes an acquirer 11 for obtaining an audio signal (sound) and an audio signal obtained for transmission to the audio service reproduction apparatus 20. An editing / compositing unit 12 for editing and synthesizing (sound), and a storage / transmitting unit 13 for storing the synthesized audio signal (sound) and transmitting it to the audio service reproducing apparatus 20 do.

In addition, the audio service reproducing apparatus 20 may include a receiving unit 21 for receiving an audio signal transmitted from the audio service providing apparatus 10, a control unit 22 for controlling the received audio signal, and an audio signal. And a reproducing section 23 for reproducing.

Based on the conventional audio service system having such a configuration, a general audio signal provided through a broadcasting service such as TV broadcasting, radio broadcasting, DMB, etc., is obtained by converting several audio signals obtained from various sound sources into one audio signal. It is synthesized. For example, an audio signal provided through a soccer game is synthesized and transmitted into a single audio signal such as a sound in a stadium, a shout of an audience, a voice of a commentator, and the like. In this case, the user (viewer) can adjust the strength of the entire audio signal, but it is impossible to adjust the strength of each object such as the voice of the commentator included in the audio signal, the sound in the stadium, the shout of the audience. The reason is that in a general broadcast service, multiple audio signals are pre-synthesized into one audio signal before being transmitted.

However, when the transmitting device (audio service providing device 10) transmits the audio signals for each sound source independently without synthesizing, the receiving device (audio service reproducing device 20) receives the strength of the audio signal for each sound source. You can watch while controlling the back. As described above, an audio service that transmits several audio signals independently so that a user (viewer) can listen to each audio signal at the receiving device while controlling it properly is called an object-based audio service.

For example, if an audio signal provided through a soccer game is provided as a three-dimensional audio service for each object, a user (a viewer) controls each object such as a sound in a stadium, a shout of an audience, a voice of a commentator, and the like. You can listen to the sound you want. In other words, the sound in the stadium is louder, the audience shouts louder, the narrator's voice is louder, so that the audio signal is heard so that the sound of the spectator and the narrator's voice are not heard at all. You can control and listen.

Therefore, it is applied to all broadcasting services and multimedia services that provide audio such as digital broadcasting, radio broadcasting, DMB, Internet broadcasting, digital movie, DVD, video contents, etc., and is object-based to control and listen to audio signals for each sound source. There is an urgent need for a method of receiving 3D audio services.

Although, as an example of the preceding standard, 'object-based three-dimensional audio system and its control method' (Korean Patent Publication No. 10-2004-0037437 (published on May 07, 2004)) has proposed a solution for this, but this is the user (viewer) There is a problem that it is cumbersome because the audio signal for each sound source must be adjusted in order to set an audio signal suitable for oneself.

The present invention has been proposed to solve the above problems, and in order to provide an object-based three-dimensional audio service to the user (viewer), to solve the inconvenience of the operation to control the audio signal for each sound source of the user (viewer) It is an object of the present invention to provide an object-based three-dimensional audio service system using a preset audio scene and a method for allowing a user (a viewer) to listen to an object-based three-dimensional audio service easily and conveniently.

Other objects and advantages of the present invention can be understood by the following description, and will be more clearly understood by the embodiments of the present invention. Also, it will be readily appreciated that the objects and advantages of the present invention may be realized by the means and combinations thereof indicated in the claims.

According to an aspect of the present invention, there is provided a three-dimensional audio service providing apparatus comprising: audio input means for receiving an audio signal; Extracting an object audio signal from the input audio signal, placing the extracted object audio signal in a three-dimensional space, and for each of the object audio signals based on audio scene information of each preset object audio signal Audio scene generation means for editing object properties to generate a plurality of three-dimensional audio scene information having different object properties; And encoding means for encoding (multiplexing) the object audio signals and the plurality of 3D audio scene information to output object-based 3D audio content.

The present invention provides a three-dimensional audio service reproduction apparatus comprising: decoding means for decoding (demultiplexing) object-based three-dimensional audio content to output object audio signals and a plurality of three-dimensional audio scene information; The 3D audio scene information is selected by the user (viewer) by providing the plurality of 3D audio scene information having different object attributes decoded (demultiplexed) by the decoding means to the user (viewer). Audio scene configuration means for constituting new three-dimensional audio scene information under the control of the user (viewer); Controlling the object property of each of the decoded object audio signals according to the 3D audio scene information selected or newly configured by the user (viewer) and delivered from the audio scene composition means to synthesize the object audio signals. Audio signal synthesizing means; And reproducing means for reproducing the audio signal synthesized by the audio signal synthesizing means.

Meanwhile, the present invention provides a method of providing a 3D audio service, the method comprising: receiving an audio signal; Extracting an object audio signal from the input audio signal, placing the extracted object audio signal in a three-dimensional space, and for each of the object audio signals based on audio scene information of each preset object audio signal Generating audio scene information by editing object properties to generate a plurality of three-dimensional audio scene information having different object properties; And encoding (multiplexing) the object audio signals and the plurality of 3D audio scene information and outputting object-based 3D audio content.

In addition, the present invention provides a method of reproducing a three-dimensional audio service, comprising: decoding (demultiplexing) object-based three-dimensional audio content and outputting object audio signals and a plurality of three-dimensional audio scene information; Providing the plurality of 3D audio scene information having different decoded (demultiplexed) object attributes to a user (viewer) so that any 3D audio scene information can be selected by the user (viewer). Audio scene information construction step of constructing new three-dimensional audio scene information under the control of the user (viewer); An audio signal synthesis step of synthesizing the object audio signals by controlling object properties of each of the decoded object audio signals according to the 3D audio scene information selected or newly configured and delivered by the user (viewer); And reproducing the synthesized audio signal.

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, whereby those skilled in the art may easily implement the technical idea of the present invention. There will be. In addition, in describing the present invention, when it is determined that the detailed description of the known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

delete

2 is a diagram illustrating an embodiment of an object-based three-dimensional audio service system using a preset audio scene according to the present invention.

As shown in FIG. 2, the object-based three-dimensional audio service system receives an audio signal through various input means, generates one or more object-based three-dimensional audio scene information that can be selected by a user (viewer), and generates object-based information. The object-based three-dimensional audio service providing apparatus 30 for transmitting to the three-dimensional audio reproduction apparatus 40, the object-based three-dimensional audio service providing apparatus 30 and the object-based three-dimensional audio service reproducing apparatus 40 are networked. Object-based 3 for generating one or more object-based 3D audio scenes based on the object-based 3D audio scene information received from the digital broadcasting network 50 for connecting to the object and the object-based 3D audio service providing apparatus 30. And a three-dimensional audio service reproducing apparatus 40.

Next, the components of the object-based 3D audio service system using the preset audio scene according to the present invention will be described in detail.

First, referring to the configuration of the object-based three-dimensional audio service providing apparatus 30 of the object-based three-dimensional audio service system using a preset audio scene, the input unit 31 for receiving an audio signal through various input means and the input unit ( 31) extract the object-based audio signal (object audio signal) from the audio signal input through the, and place the extracted object-based audio signal (object audio signal) in the three-dimensional space, the position, size of each object A preset audio scene generator 32 for generating one or more three-dimensional audio scene information by editing properties such as a direction, a sound field environment, and an audio signal and a preset audio scene generator 32 input to the input unit 31. After encoding the object-based three-dimensional audio scene information generated by the to transmit to the object-based three-dimensional audio service playback device 40, multiplexing (for example, In a full broadcasting network, an encoder 33 for multiplexing an MPEG (MPEG-4: Moving Picture Experts Group 4) file format and object-based audio content (audio signal, object-based 3) multiplexed by the encoder 33 And a transmission unit 34 for converting the dimensional audio scene information) according to a transmission format (for example, in a digital broadcasting network, converting it to MPEG-2 TS).
In this case, the converted object-based audio content (audio signal, object-based 3D audio scene information) may be transmitted through the transmission medium by the transmission unit 34 as described above, but may also be stored in the storage medium.
Here, the transmitter 34 uses the object-based audio content (audio signal, object-based 3D audio scene information) as an example through the digital broadcasting network (terrestrial DMB channel 50). Can be sent to.

In this case, when the sound source of the audio signal input to the input unit 31 is a mixed sound source, the preset audio scene generator 32 extracts the object audio signal using the 'Convolutive Blind Source Separation' technology. In particular, the preset audio scene generation unit 32 adjusts the ratio of each object based on the 'audio scene information of the audio signal for each object' set under the control of a user (editor), thereby adjusting one or more object-based three-dimensional images. Configure audio scene information.

Meanwhile, referring to the configuration of the object-based 3D audio service reproducing apparatus 40, the decoder 42 for decoding (demultiplexing) the object-based audio content (audio signal, object-based 3D audio scene information) to reproduce the object 42 is described. And object-based three-dimensional audio scene information of the object-based three-dimensional audio content decoded (demultiplexed) by the decoder 42 to the user (viewer) so that the user (viewer) can select the user (viewer). Audio scene information constructing unit 43 for constructing object-based 3D audio scene information according to selection of the "), and decoding unit 42 according to the object-based 3D audio scene information constituted by the audio scene information constructing unit 43. By controlling the object-specific properties (including the position, direction, size, and sound field environment of the audio object) of the audio signal of the object-based three-dimensional audio content decoded (demultiplexed) And an audio signal audio signal reproducing unit 45 for reproducing the audio signal synthesized by the audio signal synthesizing unit 44 into one object-based three-dimensional audio scene. .
In this case, the object-based audio content (audio signal, object-based three-dimensional audio scene information) is digital broadcasting, radio broadcasting, DMB (Digital Multimedia Broadcasting), Internet broadcasting, digital movies, DVD (Digital Video Disk), video content, etc. The audio may be provided through a broadcast service and a multimedia service. Accordingly, the object-based audio content may be received through the receiver 41, but is not limited thereto. That is, the object-based audio content may be provided through a transmission medium or a storage medium capable of providing a broadcast service and a multimedia service in which audio is provided, and is not limited thereto.

Here, the audio scene information configuration unit 43 allows a user (a viewer) to set audio object-specific properties (including the position, direction, size, and sound field environment of the audio object), and is set by the user (a viewer). New object-based three-dimensional audio scene information may be configured according to properties of each object (including the position, direction, size, and sound field environment of the audio object).

At this time, the user (viewer) can control the characteristics of the three-dimensional audio space by changing the reverberation time of the three-dimensional space by controlling the size and delay time of the initial reflection sound through the audio scene information configuration unit 43. have.

That is, an object-based three-dimensional audio service system using a preset audio scene generally generates in advance object-based three-dimensional audio scenes that are expected to be widely used and provides them to a user (a viewer), and allows the user (a viewer) to use one of them. This desired audio scene is selected and viewed so that the user (viewer) can easily watch the audio signal he / she wants.

For example, in a soccer game, the sound in the stadium, the shout of the spectators, and the voice of the narrator are defined as each independent audio object and transmitted independently, and the size of the sound in the stadium, the shout of the spectators, and the voice of the narrator are " If you send an audio scene set to 1: 1: 1 ", an audio scene set to" 1: 0.5: 1 ", and an audio scene set to" 1: 0: 1 ", you (the viewer) will be able to By selecting one of the audio scenes, the user can listen to the audio signal in a desired form.

If there is no audio scene desired among the preset audio scenes, the audio signal for each object may be directly controlled to listen to the audio signal. However, it would be more desirable to create a sufficient number of preset audio scenes so that a user (viewer) can select one of the pre-generated audio scenes without having to individually control the audio signal for each object.

3 is a flowchart illustrating an object-based 3D audio service providing method using a preset audio scene according to the present invention.

First, the input unit 31 of the object-based 3D audio service providing apparatus 30 receives an object-based audio signal through various input means (301).

Thereafter, the preset audio scene generator 32 extracts an object-based audio signal (object audio signal) from the audio signal input through the input unit 31 (302), arranges it in a three-dimensional space, and Properties of each object (including the position, direction, size, and sound field environment of the audio object) are edited (303) to generate one or more object-based three-dimensional audio scene information (304).

The encoder 33 encodes the audio signal input through the input unit 31 and the object-based three-dimensional audio scene information generated by the preset audio scene generator 32 and then multiplexes it (305). For example, in the digital broadcasting network, the encoder 33 may multiplex the encoded object-based 3D audio scene information in the form of an MPEG-4 (MPEG-4: Moving Picture Experts Group 4) file.

Next, the transmitter 34 converts the object-based audio content (audio signal, object-based three-dimensional audio scene information) multiplexed by the encoder 33 according to the transmission format (for example, MPEG- in a digital broadcasting network). 2 to convert to TS (Transport Stream) and transmit (306). For example, the transmitter 34 transmits the converted object-based audio content (audio signal, object-based 3D audio scene information) to the object-based 3D audio playback device 40 through a digital broadcasting network (terrestrial DMB channel). Can be.
In this case, the converted object-based audio content (audio signal, object-based 3D audio scene information) may be stored in a storage medium.

4 is a flowchart illustrating a method of reproducing an object-based 3D audio service using a preset audio scene according to the present invention.

First, the receiver 41 of the object-based 3D audio service reproducing apparatus 40 is an object-based audio content (audio signal, object-based 3D audio scene information) through, for example, a digital broadcasting network (terrestrial DMB channel 50). Received (401). In this case, the object-based audio content may be received through a transmission medium capable of providing a broadcast service and a multimedia service in which audio is provided to the receiver 41 or may be input through a storage medium.

Thereafter, the decoder 42 decodes (demultiplexes) the received or input object-based audio content (audio signal, object-based 3D audio scene information) (402).

In addition, the audio scene information configuration unit 43 may allow a user (a viewer) to select object-based three-dimensional audio scene information of the object-based three-dimensional audio content decoded (demultiplexed) by the decoder 42. ) And configure object-based 3D audio scene information according to a user (viewer's) selection (403).

Next, the audio signal synthesis unit 44 decodes (demultiplexes) the object-based three-dimensional audio by the decoder 42 according to the object-based three-dimensional audio scene information configured by the audio scene information configuration unit 43. Object-specific properties (including the position, direction, size, and sound field environment of the audio object) of the audio signal of the content are controlled and synthesized (404).

Finally, the audio signal reproducing unit 45 reproduces the audio signal synthesized by the audio signal synthesizing unit 44 into one object-based three-dimensional audio scene (405).

As described above, the method of the present invention may be implemented as a program and stored in a recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.) in a computer-readable form. Since this process can be easily implemented by those skilled in the art will not be described in more detail.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the technical spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited by the drawings.

As described above, the present invention is applicable to all broadcasting services and multimedia services in which audio is provided, such as digital broadcasting, radio broadcasting, digital multimedia broadcasting (DMB), internet broadcasting, digital movies, digital video disks (DVDs), video contents, and the like. In providing the object-based three-dimensional audio service, by providing the user (viewer) with the pre-generated preset audio scenes, the user (viewer) can eliminate the inconvenience of the operation of directly controlling the audio signal for each sound source Therefore, there is an effect that the user (viewer) can use the object-based three-dimensional audio service more easily and conveniently.
The present invention can be applied to a broadcast service and a multimedia service in which audio is provided, such as digital broadcast, radio broadcast, digital multimedia broadcasting (DMB), internet broadcast, digital movie, digital video disk (DVD), video content, and the like. The broadcast or multimedia service is not limited to the type of medium for transmitting or storing object-based audio content (object-based 3D audio scene information).

Claims (20)

In the 3D audio service providing apparatus, Audio input means for receiving an audio signal; Extracting an object audio signal from the input audio signal, placing the extracted object audio signal in a three-dimensional space, and for each of the object audio signals based on audio scene information of each preset object audio signal Audio scene generation means for editing object properties to generate a plurality of three-dimensional audio scene information having different object properties; And Encoding means for encoding (multiplexing) the object audio signals and the plurality of 3D audio scene information and outputting object-based 3D audio content Object-based 3D audio service providing apparatus using a preset audio scene comprising a. The method of claim 1, Processing means for processing the encoded (multiplexed) object-based three-dimensional audio content Device-based 3D audio service providing apparatus using a preset audio scene further comprising. The method according to claim 1 or 2, The audio scene generating means, When the sound source of the input audio signal is a mixed sound source, the object-based 3D audio service providing apparatus using a preset audio scene, characterized in that for extracting the object audio signal using the 'Convolutive Blind Source Separation' technology. The method of claim 3, wherein The audio scene generating means, The ratio of each object audio signal is adjusted based on audio scene information of each object audio signal preset by a user (editor), so that each of the plurality of three-dimensional audio scene information having different ratio combinations is obtained. Object-based 3D audio service providing apparatus using a preset audio scene, characterized in that for generating. The method of claim 2, The processing means, Apparatus for providing object-based three-dimensional audio service using a preset audio scene, characterized in that for transmitting the encoded (multiplexed) object-based three-dimensional audio content to the audio reproduction terminal through a digital broadcast network. The method of claim 4, wherein The audio playback terminal, The object-based three-dimensional audio using a preset audio scene, characterized in that the object audio signals are composed of the three-dimensional scene using the three-dimensional audio scene information selected from the plurality of three-dimensional audio scene information and reproduced Service provision device. The method of claim 4, wherein The object property is, Apparatus for providing an object-based three-dimensional audio service using a preset audio scene, comprising at least one of a position, a direction, a size, and a sound field environment of an audio object. In the three-dimensional audio service playback apparatus, Decoding means for decoding (demultiplexing) object-based three-dimensional audio content to output object audio signals and a plurality of three-dimensional audio scene information; The 3D audio scene information is selected by the user (viewer) by providing the plurality of 3D audio scene information having different object attributes decoded (demultiplexed) by the decoding means to the user (viewer). Audio scene configuration means for constituting new three-dimensional audio scene information under the control of the user (viewer); Controlling the object property of each of the decoded object audio signals according to the 3D audio scene information selected or newly configured by the user (viewer) and delivered from the audio scene composition means to synthesize the object audio signals. Audio signal synthesizing means; And Reproducing means for reproducing the audio signal synthesized by said audio signal synthesizing means; Device-based 3D audio service playback apparatus using a preset audio scene including a. delete The method of claim 8, The object property is, Apparatus for reproducing an object-based three-dimensional audio service using a preset audio scene comprising at least one of a position, a direction, a size, and a sound field environment of an audio object. The method of claim 8, The audio signal synthesizing means, According to the three-dimensional audio scene information, by controlling the size and delay time of the initial reflection sound to change the reverberation time of the three-dimensional space, the object-based 3 using a preset audio scene, characterized in that to control the characteristics of the three-dimensional audio space Dimensional audio service playback device. In the 3D audio service providing method, Receiving an audio signal; Extracting an object audio signal from the input audio signal, placing the extracted object audio signal in a three-dimensional space, and for each of the object audio signals based on audio scene information of each preset object audio signal Generating audio scene information by editing object properties to generate a plurality of three-dimensional audio scene information having different object properties; And Outputting object-based three-dimensional audio content by encoding (multiplexing) the object audio signals and the plurality of three-dimensional audio scene information. Object-based 3D audio service providing method using a preset audio scene comprising a. The method of claim 12, In the audio scene information generation step, If the sound source of the input audio signal is a mixed sound source, the object-based three-dimensional audio service providing method using a preset audio scene, characterized in that for extracting the object audio signals using the 'Convolutive Blind Source Separation' technology. The method of claim 13, In the audio scene information generation step, The ratio of each object audio signal is adjusted based on audio scene information of each object audio signal preset by a user (editor), so that each of the plurality of three-dimensional audio scene information having different ratio combinations is obtained. Method for providing an object-based three-dimensional audio service using a preset audio scene, characterized in that for generating. The method of claim 14, The object property is, A method of providing an object-based three-dimensional audio service using a preset audio scene comprising at least one of a position, a direction, a size, and a sound field environment of an audio object. delete In the 3D audio service playback method, Decoding (demultiplexing) object-based 3D audio content to output object audio signals and a plurality of 3D audio scene information; Providing the plurality of 3D audio scene information having different decoded (demultiplexed) object attributes to a user (viewer) so that any 3D audio scene information can be selected by the user (viewer). Audio scene information construction step of constructing new three-dimensional audio scene information under the control of the user (viewer); An audio signal synthesis step of synthesizing the object audio signals by controlling object properties of each of the decoded object audio signals according to the 3D audio scene information selected or newly configured and delivered by the user (viewer); And Playing the synthesized audio signal Object-based 3D audio service playback method using a preset audio scene comprising a. delete The method of claim 17, The object property is, A method of playing an object-based three-dimensional audio service using a preset audio scene comprising at least one of a position, a direction, a size, and a sound field environment of an audio object. The method of claim 19, In the audio signal synthesis step, According to the three-dimensional audio scene information, by controlling the size and delay time of the initial reflection sound to change the reverberation time of the three-dimensional space, the object-based 3 using a preset audio scene, characterized in that to control the characteristics of the three-dimensional audio space How to Play 3D Audio Services.

Images