RU2450440C1 - Audio signal processing method and device - Google Patents

Abstract

FIELD: information technology.

SUBSTANCE: audio signal processing method involves reception of an audio signal and predetermined information; deriving a predetermined matrix from the predetermined information, wherein the predetermined matrix indicates the degree of contribution of the object in the output channel; and adjusting the output level of the object using the predetermined matrix. Consequently, if there are no user settings for each object, if predetermined metadata applied to the audio signal are selected with references to predetermined metadata, the level of objects contained in the audio signal can be easily adjusted by using predetermined rendering data corresponding to selected predetermined metadata.

EFFECT: high accuracy and efficiency of adjusting the output channel level and cutting volume of excessive coding.

15 cl, 16 dwg

Description

FIELD OF THE INVENTION

The present invention relates to a method and apparatus for processing an audio signal, in particular relates to a device for processing an audio signal and to a corresponding method. Although the present invention is suitable for a wide range of applications, it is particularly suitable for processing an audio signal received in the form of a digital medium, a broadcast signal, or the like.

State of the art

In the general case, when creating a down-mix signal by down-mixing an audio signal including a plurality of objects to obtain a mono or stereo signal, parameters (information) are extracted from the said objects. These parameters (information) are used in the process of decoding the down-mix signal. You can also control the pan and gain of objects based on the selection made by the user.

SUMMARY OF THE INVENTION

Technical challenge

However, objects contained in the downmix signal should be properly managed based on the selection made by the user. When a user controls an object, it is inconvenient for him to control this object directly and it may be more difficult for him than an expert could do to restore the optimal state of the audio signal, which includes many objects corresponding to the environment.

Technical solution

Accordingly, the present invention is directed to a device and method for processing an audio signal that actually solve one or more problems arising from the limitations and disadvantages of the existing prior art.

An object of the present invention is to provide a device and method for processing an audio signal with which it is possible to control an object contained in an audio signal using preset information including preset metadata and preset rendering data.

Another objective of the present invention is to provide a device and method for processing an audio signal, with which you can adjust the level of the object in the output channel by determining the preset rendering data based on information about the audio signal in the output channel and then applying the preset rendering data to the audio signal, when the preset rendering data is of a matrix type.

Another objective of the present invention is to provide a device and method for processing an audio signal by which, step by step, a pre-set rendering matrix for setting up an object is created from a pre-installed mono-type rendering matrix transmitted from an encoder or from gain information, step by step .

Positive effects

Accordingly, the present invention provides the following beneficial effects or advantages.

First of all, according to the present invention, some of the pre-set information without installation for objects performed by the user is selected, which makes it easier to adjust the level of the output channel.

Secondly, the present invention provides preset metadata for presenting preset information in the form of text based on preset length information indicating the length of the metadata, thereby reducing unnecessary coding.

Thirdly, in the case where the preset rendering data is of a matrix type, the present invention defines a preset matrix indicating preset rendering data based on information about an audio signal in an output channel, thereby providing a more accurate and efficient adjustment of the output level channel object.

Fourth, according to the present invention, a preset matrix is created step by step, thereby reducing the data rate from the encoder.

Fifthly, in the present invention, the pre-installed matrix is used to configure objects only partially, which reduces the amount of redundant coding.

Brief Description of the Drawings

The accompanying drawings, which are provided to provide a more detailed understanding of the invention and form part of this description, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention.

In the drawings:

1 is a conceptual diagram of preset information applied to an object contained in an audio signal according to an embodiment of the present invention;

FIG. 2 is a block diagram of an audio signal processing apparatus according to an embodiment of the present invention; FIG.

FIG. 3 is a block diagram of a unit for receiving preset information in an audio signal processing apparatus according to an embodiment of the present invention; FIG.

4 is a flowchart of an audio signal processing method according to an embodiment of the present invention;

5 is a diagram of a syntax according to a variant of the present invention;

6 is a syntax diagram according to another embodiment of the present invention;

7 is a syntax diagram according to a further embodiment of the present invention;

FIG. 8 is a block diagram of a unit for receiving preset rendering data according to a further embodiment of the present invention; FIG.

FIG. 9 is a syntax diagram according to another further embodiment of the present invention; FIG.

10 is a block diagram of an audio signal processing apparatus according to another embodiment of the present invention;

11 is a block diagram of equipment that implements a unit for receiving preset information according to an embodiment of the present invention;

12 is a diagram of the relationship between the terminal and the server according to the equipment shown in FIG. 11;

FIG. 13 is a block diagram of a unit for receiving preset information for implementation with respect to digital television according to an embodiment of the present invention; FIG. and

14 is a diagram of a display unit for equipment including a unit for receiving preset information according to one embodiment of the present invention.

Best Mode for Carrying Out the Invention

Additional features and advantages of the invention are set forth in the following description and may be partly clarified from this description, or an understanding of them can be obtained as a result of the practical implementation of the invention. The objectives and other advantages of the invention are realized and supported by the structure detailed in the description of the invention and the claims, as well as in the accompanying drawings.

To achieve these and other advantages, and in accordance with the object of the present invention, an audio signal processing method according to the present invention includes: receiving an audio signal and preset information, the audio signal including at least one object; obtaining a pre-installed matrix from pre-installed information, and the pre-installed matrix indicates the degree of contribution of the object to the output channel; setting the output level of the object according to the output channel by using a pre-installed matrix; and outputting an audio signal including an object with a configured output level, wherein pre-set information is obtained based on pre-set availability information indicating that pre-set information exists and pre-set number information indicating a number of pre-set information, and pre-set a matrix is obtained based on preset type information indicating that the preset All information is presented in the matrix.

A preset matrix is preferably obtained based on the output channel information indicating that the output channel is a mono channel, a stereo channel, or multi-channel.

The preset type information is preferably 1 bit.

It is more preferable to determine the dimension of the preset matrix based on the object number and the output channel number.

In addition, to achieve these and other advantages, and in accordance with the object of the present invention, an audio signal processing apparatus according to the present invention includes: an audio signal receiving unit receiving an audio signal including at least one object; a pre-set metadata receiving unit receiving the pre-set metadata from the pre-set information, the pre-set metadata receiving unit receiving at least some of the pre-set metadata from at least some pre-set information; a unit for receiving preset rendering data receiving a preset matrix from the preset information, the preset matrix indicating the degree of contribution of the object to the output channel, and the preset matrix corresponding to the preset metadata; a display unit displaying predefined metadata; an input unit receiving a command for selecting some of the predefined metadata; an object setting unit that adjusts the output level of the object according to the output channel by using a predefined matrix corresponding to the selected predefined metadata; and an output unit outputting an audio signal including an object with a configured output level. Preferably, the display unit displays the selected predefined metadata when the output unit outputs an audio signal.

Preferably, the display unit, in addition, displays the output level of the object.

A preset matrix is preferably obtained based on the output channel information indicating that the output channel is a mono channel, a stereo channel, or multi-channel.

The preset information is obtained based on the preset information on the numbers indicating the number of the preset information, the preset matrix being obtained on the basis of the preset type information indicating that the preset information is presented in the matrix.

Preferably, the preset information further comprises preset application information for an object indicating whether there is a preset matrix applied to the objects.

Preferably, the display unit additionally displays whether there is a pre-installed matrix to be applied to the object, based on the pre-installed information about the application to the object.

More preferably, the display unit displays the preset metadata as text.

It should be understood that both the foregoing general description and the following detailed description are illustrative and explanatory in nature and are intended to provide further understanding of the claimed invention.

An embodiment of the invention

The following are detailed references to preferred embodiments of the present invention, examples of which are shown in the accompanying drawings.

First of all, the term “information” in this description is interpreted in the general case as: values, parameters, coefficients, elements, etc., and the term “object” can be interpreted as a source signal that generates the audio signal of a guitar, vocals, piano, etc. P. Their meaning can sometimes be interpreted in different ways, but the present invention is not limited to this.

When decoding an audio signal including a plurality of objects, the present invention provides a method for efficiently decoding an audio signal using some of the preset information for setting objects.

Figure 1 presents a conceptual diagram of the present invention, applicable to the object contained in the audio signal according to a variant of the present invention. In this description, pre-set information for setting up an object is called pre-set information. The preset information may indicate one of various modes selected according to the characteristics of the audio signal or the environment when listening. There may also be many kinds of preset information. In addition, the preset information includes metadata for representing the attribute of the preset information or the like, as well as rendering data used to configure the object. Metadata can be presented in text form. Metadata not only indicates an attribute (e.g., concert hall mode, karaoke mode, news mode, etc.) of preset information, but also includes relevant information for representing preset information, such as author of preset information, recording date, the name of the object having the predefined information applied to it, etc. Meanwhile, the rendering data is the data actually applied to the object. Rendering data can take one of various forms. In particular, rendering data may exist in matrix form.

Turning to FIG. 1, where the preset information 1 can be a concert hall mode to provide a stage sound effect that allows you to hear a musical signal, like in a concert hall. The preset information 1 may be a karaoke mode that reduces the level of a vocal object in the audio signal. Finally, the preset information n can be a news mode raising the level of a speech object. In addition, the preset information 2 includes metadata 2 and rendering data 2. If the user selects the preset information 2, then the karaoke mode of metadata 2 will be implemented in the display unit and it will be possible to adjust the level by applying rendering data 2 corresponding to metadata 2 to the object.

In this case, if the rendering data is of a matrix type, it may include a mono matrix, a stereo matrix, or a multi-channel matrix. The mono matrix is the rendering data used when the output channel of the object is a mono channel. The stereo matrix is the rendering data used when the output channel of the object is a stereo channel. And the multi-channel matrix is the rendering data used when the output channel of the object is multi-channel. Once the output channel of the object is determined, a matrix is determined using the specific output channel. Then, applying the mentioned matrix to the object, you can adjust the level.

Thus, using metadata and rendering data contained in the predefined information, the object is set up and an attribute or attribute of the applied predefined information is presented. Thus, it is possible to efficiently provide an audio signal with the effect needed by a particular user.

2 is a block diagram of an audio signal processing apparatus 200 according to an embodiment of the present invention.

Referring to FIG. 2, where an audio signal processing apparatus 200 according to an embodiment of the present invention may include a preset information generating unit 210 and a preset information receiving unit 2210, as well as an object setting unit 230.

The preset information creating unit 210 creates preset information for tuning an object included in the audio signal. The preset information creating unit 210 may include metadata creating unit 212 and preset rendering data creating unit 214. The metadata generating unit 212 receives input text information for presenting preset information, after which it is able to create predefined metadata. As mentioned in the preceding description, the preset metadata may be information for representing a characteristic or attribute of the preset information. In this case, the metadata generating unit 212 may further generate preset length information indicating a number for the length of the preset metadata. In this case, information about the preset length can be represented in bytes, but examples of information about the preset length are not limited to this.

Meanwhile, if gain information for adjusting the level of the object and panning the object is entered into the block 214 for creating the preset rendering data, it is possible to create the preset rendering data for applying them to the objects. In this case, predefined rendering data can be created for each object and implemented in one of various possible types. For example, the pre-set rendering data may be a pre-installed matrix implemented in a matrix type. In addition, the preset rendering data creating unit 214 may further create preset type information (preset_type_flag) indicating whether the preset rendering data is presented in a matrix form. In addition, the block 214 creating pre-set rendering data can create information about the output channel, indicating how many output channels the object has.

The preset length information and the preset metadata created by the metadata creation unit 212, as well as the preset type information, the output channel information and the preset rendering data created by the preset rendering data block 214 can be transported, being included in one a bit stream, and, in particular, being included in the service area of a bit stream including an audio signal.

Meanwhile, the preset information creating unit 210 may further create preset availability information indicating whether preset length information, preset metadata, preset type information, output channel information, and preset rendering data are included in the bitstream . The preset availability information may be of the container type, giving information about which area the preset information exists in, or the flag type, but examples of preset availability information are not limited to this.

In addition, the preset information generating unit 210 is capable of generating preset information. The preset information includes preset length information, preset metadata, preset type information, output channel information, and preset rendering information. In this case, the preset information generating unit 210 may further create preset number information indicating a preset information number.

The preset information receiving unit 220 receives the preset information created and transmitted by the preset information creating unit 210. The preset information receiving unit 220 may include a metadata receiving unit 222 and a preset rendering data receiving unit 224.

The metadata receiving unit 222 receives and then outputs the preset metadata, and the predefined rendering data receiving unit 224 receives the preset rendering data (e.g., a preset matrix), the details of which are explained with reference to FIG. 3 and FIG. 4.

The object setting unit 230 receives an audio signal including a plurality of objects and pre-set rendering data created by the rendering data receiving unit 224. In this case, the preset rendering data is applied to the object, as a result of which the level or position of the object can be adjusted.

FIG. 3 is a block diagram of a metadata reception unit 310 and a pre-set rendering data block 320 included in a pre-set information receiving unit 200 in an audio signal processing apparatus 200 according to an embodiment of the present invention.

Referring to FIG. 3, the metadata receiving unit 310 includes a predefined length information receiving unit 312 and a predefined metadata receiving unit 314. The preset length information reception unit 312 receives the preset length information indicating the length of the preset metadata to represent the preset information, and then obtains the length of the preset metadata. After that, the pre-set metadata reception unit 314 reads the length indicated in the pre-set length information from the bitstream, and then receives the pre-set metadata. In addition, the pre-set metadata reception unit 314 converts the pre-set metadata, which indicates the type or attribute of the pre-set information, into text type metadata, and then outputs the converted pre-set text type metadata.

The pre-set rendering data receiving unit 320 includes a pre-set type flag receiving unit 322, an output channel information receiving unit 324, and a pre-installed matrix receiving unit 326. The preset data type flag receiving unit 322 receives a preset type flag (preset_type_flag) indicating whether the preset rendering data is of a matrix type. In this case, the value of the preset type flag is shown in the Table.

Preset type flag Value 0 Preset rendering data is not matrix type one Preset rendering data are of matrix type

If the pre-set type flag indicates a case where the pre-set rendering data is of the matrix type, the output channel information reception unit 324 receives output channel information indicating the number of output channels through which the object included in the audio signal will be played. Information about the output channels may include a mono channel, a stereo channel, or indicate multi-channel (channel 5.1), but the example of information about the output channels is not limited to this.

The pre-installed matrix receiving unit 326 receives and outputs a pre-installed matrix indicating the degree of contribution of the object to the output channel in accordance with the pre-set metadata based on the output channel information. In this case, the pre-installed matrix may include one of the following: a pre-installed mono matrix, a pre-installed stereo matrix, and a pre-installed multi-channel matrix. The dimension of the pre-installed matrix is determined based on the object number and the output channel number. Therefore, the pre-installed matrix can be a matrix of the form (object number) * (output channel number). For example, if there are n objects contained in the audio signal, and the output channel from the output channel information receiving unit 324 corresponds to channel 5.1 (i.e., six channels), then the preset matrix receiving unit 326 can determine the preset multichannel matrix (see formula 1) implemented as n * 6.

[Formula 1]

In formula 1, the matrix component m _{a, b} is a gain value indicating a measure that characterizes the contribution of the a-th object to the b-th channel. Then, applying a pre-installed multi-channel matrix to the audio signal, you can adjust the level of the corresponding object.

Thus, the pre-set information reception unit 220 according to the present invention efficiently represents the pre-set metadata by reading the bit stream in the required volume using the pre-set length information and is able to efficiently adjust the gain of the object contained in the audio signal and the like, having previously received an established matrix based on information about the output channel.

4 is a flowchart of an audio signal processing method according to an embodiment of the present invention.

Referring to FIG. 4, in step S410, an audio signal including at least one object is received. In step S415, pre-set presence information is received indicating whether there is pre-set information for adjusting gain or whether the object is panned. If the preset information exists, then (step S420) a preset numerical information indicating how many (n) kinds of preset information exists is received. Pre-installed numerical information assumes that pre-installed information exists and can be represented in the form "(the number of truly existing pre-installed information) is 1". Then, pre-set length information is received (step S430) indicating how many metadata bits (or bytes) are available to represent the pre-set information. Based on the preset length information, the preset metadata is received (step S435). For example, a karaoke mode, a concert hall mode, a news mode, or the like are output (step S437). In this case, the predefined metadata may be of a text type. As mentioned in the above description, the preset metadata may include data disclosing the author of the preset information, the date of writing, the name of the object, customizable using the preset information, etc., as well as metadata representing the sound stage effect of the preset information, and examples of predefined metadata are not limited to this.

Then, pre-set type information indicating the type of pre-set rendering data included in the pre-set information is received (step S440). Based on the preset type information, it is determined in step S445 whether the type of the preset data is of a matrix type. If the type of the preset data is a matrix type (“yes” in step S445), then in step S450, output channel information is received indicating how many object channels exist. Based on the output channel information in step S455, a corresponding pre-set matrix is received from the encoded pre-set matrix. The dimension of the pre-installed matrix is determined based on the object number and the output channel number. For example, if the object’s output channel is a stereo channel, then the received pre-installed matrix will be a pre-installed stereo matrix such as “(object number) * 2”.

In step S460, it is determined whether the index i of the pre-set information (i-th) including the previously received pre-set length information, pre-set metadata, pre-set type information, output channel information, and a preset matrix is smaller than the number (n) presets indicated in predefined numerical information. If i is less than the number specified in the preset information (“yes” in step S460), the procedure returns to step S430, and then the step of receiving the preset length information for the next preset is repeated [(i + 1) th]. If the i-th preset is equal to the number in the preset information (“no” in step S460), then in step S465, the level of the object is adjusted using a preset matrix for the audio signal. Meanwhile, if the pre-installed matrix is not present in the matrix (“no” in step S445), then in step S457, the pre-set data implemented in the type is received, with the exception of the matrix set by the encoder. Then, in step S468, the level of the object is adjusted by applying the received preset data to the audio signal. Next, you can output an audio signal including a tuned object (S470).

In step S465, setting the object using the pre-installed matrix, you can use the pre-installed matrix selected by the user (not shown). The user is able to select the preset metadata corresponding to the preset matrix, wherein the preset metadata is output in metadata output step S437. For example, if the user selects metadata presented as a karaoke mode from the pre-set metadata, then a pre-set matrix corresponding to the pre-set metadata for the karaoke mode is selected from the pre-set matrix from the pre-set metadata in step S455. Then, using the selected pre-installed matrix corresponding to the karaoke mode to the audio signal, the level of the object is adjusted. After that, the audio signal including the tuned object is output.

5 is a syntax diagram according to an embodiment of the present invention.

Referring to FIG. 5, where information corresponding to preset information may exist in the header area of the bitstream. Thus, preset numerical information (bsNumPresets) can be obtained from the header area of the bitstream.

If pre-set numerical information exists (if (bsNumPresets)), then get the number of pre-set information, which is specified in the pre-set information about the numbers [numPresets = bsNumPresets + 1]. For example, if there is one pre-set information, then the pre-set number information can set “bsNumPresets” to 0. In this case, the actual number of the pre-set information is determined and used as “(pre-set number information) +1”. First, preset number information can be obtained from the bitstream.

Based on the preset information about the numbers, information can be obtained indicating the type of preset rendering data for each preset information (ith preset) (bsPresetType [i]). If the case of sending predefined rendering data by the matrix type is defined as a special predefined type (the case of sending bsPresetType [i] with the matrix type), then the information indicating the type of predefined rendering data may be the aforementioned preset type information (preset_type_flag), indicating whether the predefined matrix type rendering data has been created and transmitted. In this case, the preset type information can be represented as a single bit.

If the preset rendering data included in the ith preset information is of the matrix type (bsPresetType [i]), then information about the output channels (bsPresetCh [i]) is obtained, indicating how many channels are in the output channel. Finally, a pre-installed matrix is obtained for adjusting the level of the object contained in the audio signal based on information about the output channel (getRenderingMatrix ()).

6 is a syntax diagram showing an audio signal processing method according to another embodiment of the present invention. Preset information exists in the header area and can subsequently be applied to all frames in the same way. Alternatively, the preset information is applied differently depending on the time (hereinafter referred to as “time variable”) to effectively adjust the level of the object. If the preset information is variable over time, then information corresponding to the preset information should be provided for each frame. Thus, information indicating whether preset information is provided for each frame is included in the header, whereby an efficient bitstream configuration can be ensured.

Referring to FIG. 6, a syntax is shown indicating whether preset information for each frame is included. This syntax is similar to the previous syntax shown in FIG. 5, which indicates the audio processing method shown in FIG. 5. The syntax shown in FIG. 6 may also include preset time-varying flag information (bsPresetTimeVarying [i]) indicating whether the preset information is time-varying, that is, for each frame after receiving the output channel information (bsPresetCh [i]). If the preset information about the time-varying flag is included in the header area of the bitstream, the level of the object is adjusted using the preset matrix and the preset metadata included in the frame area of the bitstream. If preset information about a time-varying flag is present in the header, then it is determined if there is an update of the preset information for each frame. If there is no update, then a separate flag is set to “hold”. If there is an update, then a separate flag is set to the "read" state. Thus, it is possible to efficiently configure the bitstream by setting a separate flag.

In addition, the bitstream has predefined availability information (bsPresetExists) indicating whether predefined information exists in the bitstream. If the preset availability information indicates that the preset information does not exist in the bitstream, then the loop may not be executed to obtain the preset number information (bsNumPresets), the preset type information (bsPresetType [i]), the output channel information (bsPresetCh [i]) and preset information about the time-varying flag (bsPresetTimeVarying [i]). Preset information can be omitted in this syntax, if necessary.

7 is a syntax diagram representing an audio signal processing method according to a further embodiment of the present invention. The predefined matrix described above is a matrix of the type “(number of objects) * (number of output channels)” and indicates the degree of contribution of the object to the output channel. In this case, due to the reception and use of information about only certain objects, the number of transmitted bits can be reduced, which increases the processing efficiency. Thus, in a further embodiment of the present invention, a syntax for an audio signal processing method is provided, which enables tuning of a particular object using only preset information.

Referring to FIG. 7, where the syntax may further include preset application information for an object (bsPresetObject [i] [j]) indicating the applicability of the preset information to adjust the level of the object to each object. Using the predefined information about the applicability to the object, you can let know whether the preset information includes information about the corresponding object. Preset applicability information for the object may exist in the header area of the bitstream. If the preset information changes over time, as shown in FIG. 6, the preset information on applicability to the object may be in the frame. You can let know that the preset information for each object includes information about the corresponding object, as shown in Fig.7. Finally, an object index may be included in the bitstream indicating the presence or absence of inclusion. When using the object index, you can configure the bitstream in a more convenient way using the exit symbol.

In the case of lossless coding using a Huffman table or the like the output symbol creates a table having parameters that are 1 in excess of the current parameters. In this case, an additionally distributed parameter can be specified as the output parameter. In particular, if the output parameter is obtained from the bitstream, it can be used as determining that all relevant information has been received. For example, if the preset information includes information about only two objects, and there are 10 of them (information about the 3rd object and information about the 8th object), then you can effectively configure the bitstream by sending the Huffman index corresponding to the 3rd and 8 objects, and then the Huffman index corresponding to the exit parameter.

FIG. 8 is a block diagram of a unit for receiving preset rendering data for step-by-step creating a preset matrix according to a further embodiment of the present invention.

Referring to FIG. 8, where a block 320 for receiving preset rendering data includes a block 322 for receiving a preset data type flag, a block 324 for receiving output channel information and a block 326 for determining a preset matrix. The remaining elements have configurations and functions similar to blocks 224-320 for receiving preset rendering data shown in FIGS. 2/3, and therefore their detailed description will be omitted hereinafter.

Meanwhile, the pre-installed matrix determining unit 326 shown in FIG. 8 includes a “mono” type pre-installed matrix receiving unit 810, a “stereo” type pre-installed matrix creating unit 820, and a multi-channel type pre-installed matrix creating unit 830.

Block 810 receiving a pre-installed matrix of the type "mono" receives a pre-installed matrix of "mono", presented in the form of a matrix of the type "number of objects" from the block creating the preset information (not shown). If the output channel information obtained from the output channel information receiving unit 324 is of the “mono” type, then the pre-installed “mono” matrix is output as it is. The outputted pre-installed “mono” matrix is applied to the audio signal to adjust the level of the object.

Meanwhile, if the information about the output channel is of the type “stereo”, then the pre-installed matrix “mono” is entered into block 820 creating a pre-installed matrix of the type “stereo”. Additionally, information is added about the channel extension to create a pre-installed matrix of "stereo" type "(number of objects) * 2". If the information about the output channel indicates a multi-channel type, then the preset matrix “stereo” and multi-channel extension information are input into the block 830 for creating a pre-installed matrix of the multi-channel type to create a pre-installed multi-channel matrix of the type “(number of objects) * 6”.

Thus, the encoder only creates the “mono” pre-installed matrix, and the pre-installed matrix determining unit 326 step-by-step creates the pre-installed matrix using channel extension information. Therefore, if the playback configuration is reduced only to “stereo”, then it is possible to save a certain number of transmitted bits. And then the pre-installed matrix for the stereo channel or multi-channel matrix can be transmitted without redundancy.

In an audio signal processing method according to a further embodiment of the present invention, there is provided a method of transmitting a gain value when transmitting a preset or transmitting a normalized preset matrix, if necessary. This can be extended to the method of transmitting the gain value only if the gain is necessary to adjust the object contained in the audio signal, or to relatively easily transmit the entire pre-installed matrix. For example, in order to send the preset matrix shown in formula 1, the first thing to do is send information about n * 6 gain values. In this case, gain information can be calculated by formula 2.

[Formula 2]

In formula 2, 'i' indicates an object, 'j' indicates an output channel, and 'nCH' indicates the number of output channels. Since the number of Gi corresponds to the number of objects, a number n is required for the preset information.

If panning information and gain information are needed, then a normalized pre-installed matrix is additionally used. In this case, the normalized pre-installed matrix can be determined according to formula 3.

[Formula 3]

, причем значение десятичного логарифма для

всегда меньше или равно 0. Следовательно, в случае использования таблицы приращений канального уровня для квантования информации об усилении, будет использована только половина известной таблицы. Это поможет сэкономить объем необходимых данных, а также сохранить скорость передачи в битах по сравнению с приемом с использованием ненормализованной предварительно установленной матрицы без отдельной пересылки информации об усилении. Кроме того, поскольку информация об усилении может быть включена только в предварительно установленную информацию, появляется возможность использования предварительно установленной информации в масштабируемом виде.In the case of using gain information and a normalized pre-installed matrix in the method disclosed above, it will be necessary to send information about n * 6 gain values. In addition, in the characteristics of normalization there is such a characteristic as

, and the value of the decimal logarithm for

always less than or equal to 0. Therefore, in the case of using the channel level increment table to quantize gain information, only half of the known table will be used. This will help to save the amount of necessary data, as well as save the bit rate in comparison with the reception using an abnormal pre-installed matrix without separate transmission of gain information. In addition, since gain information can only be included in preset information, it becomes possible to use the preset information in a scalable manner.

FIG. 9 is a syntax diagram according to yet another further embodiment of the present invention, in which gain information and corresponding panning information are sent individually included in preset information. Gain information and pan information can be included in the header or frame area.

Turning to FIG. 9, a portion in italics indicates that a valid preset value is being received from the bitstream. Various jamming coding schemes are available, which are shown in FIG. 9 as functions. For example, if the above information is in the frame area, then it is checked whether there is predefined information. If pre-set information exists, then pre-set number information is received. Then, gain information is received first. Gain information is information indicating that a corresponding object will be reproduced with a prescribed gain value. In this case, the gain information may be the aforementioned parameter G_i or an arbitrary down-mix gain (hereinafter abbreviated as ADG), which is created if the audio signal level is adjusted to a value input from the outside.

Additionally, obtained panning information may be one of several different types. The panning information may include the aforementioned normalized preset matrix. The panning information can be divided into stereo panning information and multi-channel panning information.

10 is a block diagram of an audio signal processing apparatus according to another embodiment of the present invention.

Referring to FIG. 10, where an audio signal processing apparatus according to another embodiment of the present invention mainly includes a downmix unit 1010, an object information creation unit 1020, a preset information creation unit 1030, a downmix signal processing unit 1040, and an information processing unit 1050 and block 1060 multi-channel decoding.

First of all, a plurality of objects are inputted to the downmix block 1010, after which a mono or stereo downmix signal is created. Also, a plurality of objects is inputted into the object information creating block 1020, after which the object level information indicating the level of the object, information about the gain of the object, indicating the measure of the contribution of the object included in the downmix signal when the gain value of the object is included in the downmix signal is created mixing, and / or stereo down-mixing signal, as well as object information, including object correlation information indicating the presence or absence of correlation between the object ktami.

Then, the downmix signal and the object information are input to the preset information creating unit 1030 to create preset information including preset rendering data for adjusting the level of the object and preset metadata for representing the preset information. The process of creating preset rendering data and preset metadata is reasonably well explained in the previous description of the apparatus and method for processing the audio signal shown in FIGS. 1-9, and therefore, the corresponding details are omitted in the following description. Meanwhile, the object information created by the object information creating unit 1020 and the preset information created by the preset information creating unit 1030 can be sent while being included in the SAOC bitstream.

The information processing unit 1050 includes an object information processing unit 1051 and a preset information reception unit 1052. Finally, the information processing unit 1050 receives the SAOC bitstream.

The pre-set information reception unit 1052 receives from the SAOC bit stream the aforementioned pre-set availability information, pre-set number information, pre-set length information, pre-set metadata, pre-set type information, output channel information and a pre-set matrix and uses the above methods according to various explained variants of the invention for the method and processing device a the signal shown in figures 1-9. Finally, the preset information receiving unit 1052 outputs the preset metadata and the preset matrix. The object information processing unit 1051 receives the preset metadata and the preset matrix, and then generates the information necessary for downmix processing to preprocess the downmix signal and multichannel information for upmix the downmix signal using the object information included in the SAOC bitstream together with predefined metadata and a predefined matrix.

Then, when the downmix processing information is inputted to the downmix signal processing unit 1040, it becomes possible to pan the object included in the downmix signal. The down-mix signal previously processed in the manner described above is input to the multi-channel decoding unit 1060 together with multi-channel information output from the information processing unit 1050, after which up-mixing is performed to create a multi-channel audio signal.

Thus, when decoding an audio signal containing a plurality of objects into a multi-channel signal using object information, the audio signal processing apparatus of the present invention is adapted to adjust the level of an object using preset information. Acting in this way, the audio signal processing apparatus of the present invention efficiently adjusts the level of an object using matrix type data obtained based on the output channel information in the form of a pre-installed matrix applied to the object. Finally, the audio signal processing apparatus of the present invention is capable of increasing encoding efficiency by outputting preset metadata based on preset length information transmitted from the encoder.

Fig. 11 is a block diagram of equipment implementing a pre-set information reception unit, which includes a metadata reception unit and a pre-set rendering data reception unit according to an embodiment of the present invention, and Fig. 12 shows a relationship diagram between a terminal and a server according to equipment shown in Fig.11.

Referring to FIG. 11, a wired / wireless communication unit 1110 receives a bitstream using a wired / wireless communication system. In particular, the wired / wireless communication unit 1110 may include at least one unit from the group consisting of the wired communication unit 1111, the infrared communication unit 1112, the Bluetooth unit 1113, and the wireless communication unit 1114 via a LAN.

The user authentication unit 1120 receives the entered user information, and then performs user authentication. The user authentication unit 1120 may include at least one block from the group consisting of their fingerprint recognition unit 1121, the iris recognition unit 1122, the face recognition unit 1123, and the voice recognition unit 1124. In this case, user authentication can be performed by receiving the entered fingerprint information, iris information, face contour information or voice information, converting the entered information into user information, and then determining whether the user information matches the registered data about it user.

Block 1130 input is an input device that allows the user to enter commands of various kinds. The input unit 1130 may include at least one unit from the group consisting of a keyboard unit 1131, a touch panel unit 1132, and a remote controller unit 1133, and these examples of the input unit 1130 are not limited to this. Meanwhile, if the preset metadata for the preset information output from the data receiving unit 1141 described below is visualized on the screen through the display unit 1162, the user is able to select the preset metadata through the input unit 1130, and information about the selected preset metadata is entered to a control unit 1150.

The signal decoding unit 1140 includes a metadata receiving unit 1141 and a predefined rendering data receiving unit 1142. The metadata receiving unit 1141 receives the preset length information, and then receives the preset metadata based on the received preset length information. If the preset is presented in the form of a matrix using the preset type information, then the block 1142 receiving the preset rendering data receives information about the output channel, and then receives a preset matrix representing the preset rendering data based on the received information about the output channel. A signal decoding unit 1140 generates an output signal by decoding an audio signal using a received bitstream, a preset metadata and a preset matrix, and outputs a preset text type metadata.

The control unit 1150 receives signals from input devices and controls all processes in the signal decoding unit 1140 and the output unit 1160. As mentioned in the above description, if information about the selected pre-set metadata is input to the control unit 1150 from the input unit 1130, the pre-set rendering data receiving unit 1142 receives a preset matrix corresponding to the selected pre-set metadata, and then decodes the audio signal using the received pre-set matrix.

Finally, the output unit 1160 is an element for outputting an output signal or the like created by the signal decoding unit 1140. The output unit 1160 may include a speaker unit 1161 and a display unit 1162. If the output signal is an audio signal, then it is output through the block 1161 speakers. If the output signal is a video signal, then it is output through the display unit 1162. In addition, the output unit 1160 visualizes the preset metadata entered from the control unit 1150 on the screen through the display unit 1162.

On Fig shows the relationship between the terminals or between the terminal and the server, each of which corresponds to the equipment shown in Fig.11.

Turning to part (A) in FIG. 12, from which it can be seen that between the first terminal 1210 and the second terminal 1220, two-way data or bit streams can be transmitted through wired / wireless communication units.

Turning to part (B) of FIG. 12, where it can be seen that wired / wireless transmission can take place between the server 1230 and the first terminal 1240.

13 is a block diagram of a broadcast signal decoding apparatus 1300 that implements the function of a preset information receiving unit comprising a metadata receiving unit and a receiving unit of preset rendering data according to one embodiment of the present invention.

Turning to FIG. 13, a demultiplexer 1320 receives a plurality of television broadcast data from a channel selector 1310. The received data is separated by a demultiplexer 1320, and then decoded by the data decoder 1330. Meanwhile, data shared by the demultiplexer 1320 may be stored on a storage medium 1350, such as an HDD. Data separated by a demultiplexer 1320 is input to a decoder including an audio decoder 1341 and a video decoder 1342 to decode them into an audio signal and a video signal. The audio decoder 1341 includes a metadata reception unit 1341A and a predefined rendering data reception unit 1341B according to one embodiment of the present invention. The metadata receiving unit 1341A receives the preset length information, and then receives the preset metadata based on the received preset length information.

If the preset information is presented in the matrix, then the block 1341B receiving preset rendering data receives information about the output channel, and then receives a preset matrix representing the preset rendering data based on the received information about the output channel. An audio decoder 1341 generates an output signal by decoding an audio signal using a received bitstream, a preset metadata and a preset matrix, and outputs a preset text type metadata.

The display unit 1370 renders the video signal output from the video decoder 1342 and the preset metadata output from the audio decoder 1341. The display unit 1370 includes a speaker unit (not shown). An audio signal in which the level of the object output from the audio decoder 1341 is set using a pre-installed matrix is output through the speaker unit included in the display unit 1370. In addition, data decoded by the decoder 1340 may be stored on a storage medium 1350, such as an HDD,

Meanwhile, the signal decoding apparatus 1300 may further include an application manager 1360 capable of managing a plurality of data having information entered by a user.

The application manager 1360 includes a user interface manager 1361 and a service manager 1362. The user interface manager 1361 controls the interface for receiving user input. For example, the user interface manager 1361 may control the font type of the text rendered in the display unit 1370, screen brightness, menu configuration, and the like. Meanwhile, if the broadcast signal is decoded and output by the decoder 1340 and the display unit 1370, then the service manager 1362 can control the received broadcast signal using information entered by the user. For example, a service manager 1362 is able to configure a broadcast channel, configure an alarm function, an adult-only content authentication function, etc. Data provided by the application manager 1360 can be used by sending them to the display unit 1370, as well as the decoder 1340.

On Fig presents a diagram of a display unit consisting of equipment, which includes a unit for receiving preset information according to one variant of the present invention. The display unit is able to visualize all the predefined metadata contained in the bitstream. For example, the screen displays karaoke mode, concert hall mode and news mode, as shown in FIG.

If the user selects one of the predefined metadata, the display unit visualizes objects whose levels are adjusted so that a pre-installed matrix corresponding to the karaoke mode is applied to many objects. For example, if the user selects karaoke mode, then the configuration of setting the level of the vocal object to a minimum can be visualized. In addition, if the user selects the news mode, then a pre-installed matrix applied to the audio signal will lower the levels of all objects except the vocal object.

Turning to FIG. 14, when selecting a news mode, the display unit is able to visualize a configuration in which the level of the vocal object is raised higher than in karaoke mode, while the levels of the remaining objects are minimized.

Thus, when visualizing the levels of objects configured using a pre-installed matrix, as well as pre-set metadata indicating a preset in the display unit, the user is able to listen to an audio signal that has a special sound stage effect by correctly selecting a specific preset mode.

Industrial applicability

Accordingly, the present invention is applicable to encoding and decoding of audio signals.

Although the present invention has been described and illustrated here with reference to preferred embodiments thereof, it will be apparent to those skilled in the art that various modifications and modifications can be made thereto without departing from the spirit and scope of the invention. Thus, it is intended that the present invention covers the modifications and variations of this invention that come within the scope of the appended claims and their equivalents.

Claims (15)

1. A method for processing an audio signal, comprising:
receiving an audio signal and preset information, the audio signal including at least one object;
obtaining a pre-installed matrix from pre-installed information, and a pre-installed matrix indicates the degree of contribution of the object to the output channel;
setting the output level of the object according to the output channel by using a pre-installed matrix; and
outputting an audio signal including an object with a configured output level,
moreover, the pre-installed information is obtained on the basis of pre-installed information about the availability, indicating that the pre-installed information exists, and pre-installed information about the numbers indicating the number of pre-installed information,
wherein the pre-installed matrix is obtained based on the pre-installed type information indicating that the pre-installed information is presented in the matrix. 2. The method according to claim 1, in which a pre-installed matrix is obtained on the basis of information about the output channel, indicating that the output channel is one of a mono channel, stereo channel, or multi-channel. 3. The method of claim 2, wherein the pre-set type information is 1 bit. 4. The method according to claim 1, in which the dimension of the pre-installed matrix is determined based on the number of the object and the number of the output channel. 5. An apparatus for processing an audio signal, comprising:
an audio signal receiving unit receiving an audio signal including at least one object;
a pre-set metadata receiving unit receiving pre-set metadata from pre-set information;
a unit for receiving preset rendering data receiving a preset matrix from the preset information, the preset matrix indicating the degree of contribution of the object to the output channel;
an object setting unit that adjusts the output level of the object according to the output channel by using a pre-installed matrix; and
an output unit outputting an audio signal including an object with a configured output level,
wherein the pre-installed matrix is obtained based on the pre-installed type information indicating that the pre-installed information is presented in the matrix. 6. The device according to claim 5, in which the unit for receiving preset rendering data obtains a pre-installed matrix based on information about the output channel, indicating that the output channel is either a mono channel, or a stereo channel, or multi-channel. 7. The device according to claim 6, in which the preset type information is represented by 1 bit. 8. The device according to claim 5, in which the dimension of the pre-installed matrix is determined based on the number of the object and the number of the output channel. 9. Computer-readable recording medium storing digital audio data,
wherein the digital audio data comprises preset information and an audio signal including at least one object,
wherein the pre-set information contains pre-set metadata representing pre-set information, pre-set information about availability, indicating that pre-set information exists, pre-set information about numbers, indicating a number of pre-set information, a pre-set matrix indicating the degree of contribution of the object to the output channel, and preset type information, decrees ayuschuyu that preset information is represented in a matrix,
moreover, the pre-installed information is obtained on the basis of pre-installed information about the availability and pre-installed information about the numbers
wherein a pre-installed matrix is obtained based on pre-set type information. 10. The recording medium according to claim 9, in which a pre-installed matrix is obtained on the basis of information about the output channel, indicating that the output channel is either a mono channel, or a stereo channel, or multi-channel. 11. The recording medium of claim 10, wherein the pre-set type information is represented by 1 bit. 12. The recording medium according to claim 9, in which the dimension of the pre-installed matrix is determined based on the number of the object and the number of the output channel. 13. An apparatus for processing an audio signal, comprising:
an audio signal generating unit creating an audio signal performing down-mixing of at least one object;
a metadata creation unit creating predefined metadata for the predefined information; and
a unit for creating pre-set rendering data, creating a pre-installed matrix indicating the degree of contribution of the object to the output channel, and pre-set type information indicating that the pre-set information is presented in the matrix. 14. The device according to item 13, in which the unit for creating preset rendering data additionally creates information about the output channel, indicating that the output channel is either a mono channel, or a stereo channel, or multi-channel. 15. An audio signal processing method comprising:
creating an audio signal that down-mixes at least one object;
creating predefined availability information indicating whether or not predefined information exists;
creating pre-set information about the numbers indicating the number of pre-set information;
creating predefined metadata representing predefined information;
creating a pre-installed matrix indicating the degree of contribution of the object to the output signal; and
creating preset type information indicating that the preset information is presented in a matrix.

Images