KR100998913B1 - A method and an apparatus for processing an audio signal - Google Patents

Abstract

An apparatus for processing an audio signal and method thereof are disclosed. The present invention includes receiving the audio signal and preset information; obtaining preset matrix from the preset information, wherein the preset matrix indicates contribution degree of the object to output channel; and adjusting output level of the object by using the preset matrix. Accordingly, without user's setting for each object, if preset metadata to be applied to an audio signal is selected with reference to previously- set preset metadata, levels of objects included in the audio signal can be easily adjusted using preset rendering data corresponding to the selected preset metadata.

Description

A method of processing an audio signal and a device therefor {A METHOD AND AN APPARATUS FOR PROCESSING AN AUDIO SIGNAL}

The present invention relates to a method and apparatus for processing an audio signal, and more particularly, to a method and apparatus for processing an audio signal capable of processing an audio signal received through a digital medium, a broadcast signal, and the like.

In the process of downmixing an audio signal including a plurality of objects into a mono or stereo signal to generate a downmix signal, parameters are extracted from the objects. These parameters are used in the process of decoding the downmixed signal. The panning and gain of the objects can be controlled by the user's selection.

Objects included in the downmix signal should be properly adjusted according to a user's selection. However, when the user controls the object, it is cumbersome to control the object directly, and compared to the control by an expert, it may be difficult to reproduce an optimal state according to the environment of an audio signal including a plurality of objects. have.

The present invention has been devised to solve the above problems, and provides an audio signal processing method and apparatus which can adjust an object included in an audio signal using preset information including preset metadata and preset rendering parameters. Its purpose is to.

Still another object of the present invention is to determine a level of an object in an output channel by determining a preset matrix corresponding to the preset metadata and applying the preset matrix to the audio signal based on the output channel information of the audio signal when the preset data type is a matrix. The present invention provides a method and apparatus for processing an audio signal.

Still another object of the present invention is to provide a method and apparatus for processing an audio signal, which generates a preset rendering matrix for controlling an object stepwise from a mono type preset matrix or gain information transmitted from an encoder.

The present invention provides the following effects and advantages.

First, it is possible to easily adjust the level of the output channel of the object by selecting one of preset information without setting the user for the objects.

Second, unnecessary coding may be reduced by expressing preset metadata representing preset information in text form based on preset length information indicating the length of the metadata.

Third, when the type of the preset rendering data is a matrix, the level of the output channel of the object can be adjusted more accurately and efficiently by determining the preset matrix representing the preset rendering data based on the output channel information of the audio signal.

Fourth, by generating the preset matrix step by step, it is possible to reduce the bit rate transmitted from the encoder.

Fifth, unnecessary coding can be reduced by using a preset matrix that can adjust only some of a plurality of objects.

In order to achieve the above object, an audio signal processing method includes: receiving an audio signal and preset information including at least one object; Obtaining a preset matrix from the preset information, wherein the preset matrix indicates a degree of inclusion of an output channel of the object; Adjusting an output level of the object according to an output channel using the preset matrix; And outputting an audio signal including an object whose output level is adjusted, wherein the preset information is based on preset presence information indicating whether the preset information is included and preset number information indicating the number of the preset information. The preset matrix may be obtained based on preset type information indicating whether the preset information is represented by a matrix.

According to the present invention, the preset matrix is obtained based on output channel information indicating that the output channel is one of mono, stereo and multi-channel.

According to the present invention, the preset type information is characterized by being represented by 1 bit.

According to the present invention, the dimension of the preset matrix is determined based on the number of objects and the number of output channels.

According to another aspect of an exemplary embodiment, an audio signal processing apparatus includes: an audio signal receiver configured to receive an audio signal including at least one object; A preset metadata receiver for obtaining preset metadata of preset information; A preset rendering data receiving unit for obtaining a preset matrix indicating a degree of inclusion of an output channel of the object, wherein the preset rendering data receiving unit is a preset rendering data receiving unit which is the preset matrix corresponding to the preset metadata; A display unit displaying the preset metadata; An input unit configured to receive a signal for selecting one of the preset metadata; An object controller which adjusts an output level of the object according to an output channel by using the preset matrix corresponding to the selected preset metadata; And an output unit for outputting an audio signal including an object whose output level is adjusted.

According to the present invention, when the output unit outputs the audio signal, the display unit may display the selected preset metadata.

According to the present invention, the display unit may further display an output level of the object.

According to the present invention, the preset matrix is obtained based on output channel information indicating that the output channel is one of mono, stereo and multi-channel.

According to the present invention, the preset information is obtained based on preset number information indicating the number of preset information, and the preset matrix is obtained based on preset type information indicating whether the preset information is expressed in a matrix. do.

According to the present invention, the preset information may further include preset object application information indicating whether the preset matrix applied to the object exists.

According to the present invention, the display unit may further display whether there is the preset matrix applied to the object based on the preset object application information.

According to the present invention, the display unit may express the preset metadata in a text form.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Prior to this, terms or words used in the specification and claims should not be construed as having a conventional or dictionary meaning, and the inventors should properly explain the concept of terms in order to best explain their own invention. Based on the principle that can be defined, it should be interpreted as meaning and concept corresponding to the technical idea of the present invention. Therefore, the embodiments described in the specification and the drawings shown in the drawings are only the most preferred embodiment of the present invention and do not represent all of the technical idea of the present invention, various modifications that can be replaced at the time of the present application It should be understood that there may be equivalents and variations.

In particular, in the present specification, information is interpreted as a term encompassing values, parameters, coefficients, elements, and the like, and an object is a guitar, a vocal. It is interpreted as representing each source signal constituting an audio signal such as a vocal, piano, and the like, and in some cases, the meaning may be interpreted differently, but the present invention is not limited thereto.

The present invention provides a method of decoding an audio signal including a plurality of objects, the method effectively decoding the audio signal by using one of predetermined information for adjusting the object.

1 is a conceptual diagram of preset information applied to an object included in an audio signal according to an embodiment of the present invention. Preset information for adjusting the object is referred to herein as preset information. The preset information may indicate various modes that can be selected according to the characteristics of the audio signal or the listening environment, and may be plural. In addition, the preset information includes metadata for representing attributes of preset information and the like, and rendering data applied to adjust the object. The metadata may be displayed in a text form, and not only indicate the property of the preset information (for example, concert hall mode, karaoke mode, news mode, etc.), but also author, creation date, and preset information of the preset information. It may include related information for expressing the preset information, such as the name of the object to be applied. Meanwhile, the rendering data is data applied to the object substantially, and may have various forms, and in detail, may have a matrix form.

Referring to FIG. 1, preset information 1 may be a concert hall mode that provides a sound field as if a music signal is heard in a concert hall, and preset information 2 may be a vocal among audio signals. It may be a karaoke mode in which the level of the vocal object is reduced, and preset information n may be a news mode in which the level of the voice object is increased. In addition, preset information 2 (preset 2) includes metadata 2 and rendering data 2. If preset information 2 is selected by the user, the karaoke mode, which is metadata 2, will be displayed on the display unit, and rendering data 2 related to metadata 2 can be applied to the object to adjust the level.

In this case, if the rendering data is in the form of a matrix, the rendering data may include a mono matrix, a stereo matrix, and a multi-channl matrix. The mono matrix is rendering data applied when the output channel of the object is mono, and the stereo matrix is applied when the output channel of the object is stereo, and the multichannel matrix is applied when the output channel of the object is multichannel. Rendering data. When the output channel of the object is determined, a matrix is determined using this, and the matrix may be applied to the object to adjust the level.

As such, by adjusting the object using the metadata and the rendering data included in the preset information and expressing an attribute or a characteristic of the applied preset information, an audio signal having a desired effect can be efficiently provided. .

2 shows an audio signal processing apparatus 200 according to an embodiment of the present invention. Referring to FIG. 2, the audio signal processing apparatus 200 may include a preset information generator 210, a preset information receiver 220, and an object controller 230.

The preset information generator 210 may generate preset information for adjusting an object included in the audio signal, and may include a metadata generator 212 and a preset rendering data generator 214. The metadata generator 212 may generate preset metadata by receiving text information representing the preset information. The preset metadata may be information for expressing a characteristic or property of the preset information as described above. In this case, the metadata generator 212 may further generate preset length information indicating the number of character lengths of the preset metadata. The preset length information may be represented by a byte, but is not limited thereto.

Meanwhile, when gain for adjusting the level of the object and information for panning the object are input to the preset rendering data generator 214, preset rendering data applied to the object is generated. can do. The preset rendering data may be generated for each object, and may be implemented in various types. For example, the preset rendering data may be a preset matrix implemented in a matrix form. In addition, the preset rendering data generator 214 may further generate preset type information (preset_type_flag) indicating whether the preset rendering data is implemented in a matrix form. In addition, output channel information indicating how many output channels of the object may be generated. Preset length information generated by the metadata generator 212, preset type information generated by the metadata and preset render data generator 214, output channel information, and preset render data are included in one bitstream and transmitted. In more detail, it may be included in an ancillary region of a bitstream including an audio signal and transmitted.

The preset information generator 210 may include preset exist information indicating that the preset length information, the preset metadata, the preset type information, the output channel information, and the preset rendering data are included in the bitstream. You can create more. The preset presence information may be a container type indicating which area the information about the preset information is included in, and may be a flag type, but is not limited thereto.

The preset information generation unit 210 may generate a plurality of preset information, and each preset information may include the preset length information, the preset metadata, the preset type information, the output channel information, and the preset rendering data. It includes. At this time, the preset information generation unit 210 may further generate preset number information indicating the number of preset information.

The preset information receiver 220 may receive preset information generated and transmitted by the preset information generator 210, and may include a metadata receiver 222 and a preset rendering data receiver 224. The metadata receiving unit 222 receives and outputs the preset metadata, and the preset rendering data receiving unit 224 receives the preset rendering data (for example, a preset matrix). It will be described later in detail with reference to 4.

The object controller 230 receives an audio signal including a plurality of objects and preset rendering data generated by the preset rendering data receiver 224. The preset rendering data may be applied to the object to adjust the level of the object or the position of the object.

3 is a diagram illustrating a schematic configuration of the metadata receiver 310 and the preset rendering data receiver 320 included in the preset information receiver 220 of the audio signal processing apparatus 200 of the present invention.

The metadata receiver 310 includes a preset length information receiver 312 and a preset metadata receiver 314. The preset length information receiver 312 receives preset length information indicating the length of preset metadata for expressing the preset information, and obtains the length of the preset metadata. Thereafter, the preset metadata receiving unit 314 reads the bitstream by the length indicated by the preset length information and receives the preset metadata. In addition, the preset metadata receiving unit 314 converts the preset metadata, which is the metadata for identifying the type or property of the preset information, into a text format and outputs the converted metadata.

The preset rendering data receiver 320 includes a preset type flag receiver 322, an output channel information receiver 324, and a preset matrix receiver 326. The preset data type flag receiver 322 receives a preset type flag (preset_type_flag) indicating whether the preset rendering data is in a matrix form, and the meaning of the preset type flag is shown in Table 1 below.

Preset type flag
(preset_type_flag) meaning 0 If the type of preset render data is not a matrix One When the type of preset render data is matrix

When the preset type flag indicates that the type of preset rendering data is a matrix, the output channel information receiver 324 receives output channel information indicating how many output channels an object included in the audio signal is to be reproduced. The output channel information may be a mono channel, a stereo channel, or a multi-channel (5.1 channel), but is not limited thereto.

The preset matrix receiver 36 receives and outputs a preset matrix to be applied to the object by using the input channel information. The preset matrix may be one of a mono preset matrix, a stereo preset matrix, or a multichannel preset matrix, and the dimension of the preset matrix may be determined based on the number of objects and the number of output channels, and the preset matrix may be defined as (object of Number) * (number of output channels). For example, when n objects are included in the audio signal and the output channels are 5.1 channels, that is, six channels from the output channel information receiver 324, the preset matrix receiver 326 is implemented in n * 6 form. The preset multichannel matrix of Equation 1 may be output.

)은 a번째 오브젝트가 b 번째 채널에 포함되는 정도를 나타내는 게인 값이다. 이후, 상기 프리셋 멀티채널 매트릭스는 오디오 신호에 적용되어 해당 오브젝트의 레벨을 조절할 수 있게 된다.Where the matrix component (

) Is a gain value indicating the degree to which the a-th object is included in the b-th channel. Thereafter, the preset multichannel matrix is applied to an audio signal to adjust the level of the corresponding object.

As described above, the preset information receiving unit 220 of the present invention reads the bitstream as much as necessary using the preset length information to efficiently represent the preset metadata, and obtains the preset matrix based on the output channel information. The gain of the object included in the audio signal can be effectively adjusted.

4 is a flowchart illustrating an audio signal processing method according to an embodiment of the present invention. First, an audio signal including a plurality of objects is received (S410). In addition, in order to adjust gain or panning of an object, the device receives preset exist information indicating whether the preset information exists (S415), and if the preset information exists, some preset information exists. In operation S420, the preset number information indicating whether (n) is received is received. Since the preset number information assumes that the preset information exists, the preset number information may be expressed as (-1). Thereafter, preset length information indicating how many bits (or bytes) the metadata for representing preset information has is received (S430). Preset metadata is received based on the received preset length information (S435), for example, a karaoke mode, a concert hall mode, a news mode, and the like are output (S437). The preset metadata may be in the form of text, and may be metadata representing the preset creator, creation date, name of the object adjusted with the preset information, as well as metadata representing the sound field effect of the preset information as described above. This is not limitative.

Thereafter, preset type information indicating the type of preset rendering data included in the preset information is received (S440). On the basis of the preset type information, it is determined whether the type of the preset data is a matrix (S445), and when it is a matrix (YES in S445), output channel information indicating how many output channels of the object is received (S450). A corresponding preset matrix is received based on the output channel information among the encoded preset matrices (S455). For example, if the output channel of an object is stereo, the received preset matrix will be a stereo preset matrix having the form (number of objects) * 2.

Whether the preset information (i-th) including the preset length information, the preset metadata, the preset type information, the output channel information, and the preset matrix received in the above-described steps is smaller than the number n of preset information indicated by the preset number information. It is determined (S460). If it is smaller than the preset number information (YES in S460), the process returns to step S430 and repeats receiving the preset length information of the next preset information (i + 1th). If the same as the preset number information (NO in S460), the level of the object is adjusted by applying a preset matrix to the audio signal (S465). On the other hand, if the preset type is not a matrix (No in S445), the preset data implemented in a format other than the matrix set by the encoder is received (S457), and the received preset data is applied to the audio signal to adjust the level of the object. (S468). Thereafter, an audio signal including the adjusted object may be output (S470).

Adjusting the object by applying the preset matrix (S465) may use the preset matrix determined by the user's selection (not shown). The user may select desired preset information by referring to the preset metadata output in step S437 of outputting the preset metadata. For example, when the user selects the metadata expressed as the karaoke mode among the preset metadata, the preset matrix corresponding to the preset metadata in the karaoke mode is selected from the received preset matrix S455 based on the output channel information. . Subsequently, a preset matrix corresponding to the selected karaoke mode is applied to the audio signal to adjust the level of the object, and an audio signal including the adjusted object is output.

FIG. 5 illustrates syntax representing an audio signal processing method according to an embodiment of the present invention. Referring to FIG. 5, information related to preset information may exist in a header area of a bitstream. Preset number information (bsNumPresets) may be obtained from the header area of the bitstream. Thereafter, when preset number information exists (if (bsNumPresets)), the number of preset information indicated by the preset number information is obtained (numPresets = bsNumPresets + 1). For example, when one preset information exists, bsNumPresets may be set to 0, and in this case, the number of actual preset information may be used by grasping (preset number information) + 1. Preset number information may be received from the bitstream.

Also, based on the preset number information, information indicating the type of preset rendering data may be obtained for each preset information (i-th preset information) (bsPresetType [i]). If the case where the preset rendering data is transmitted as the matrix type is defined as a specific preset type (when bsPresetType [i] is transmitted when the matrix type is used), the information indicating the type of the preset rendering data indicates that the preset rendering data is the matrix type. It may be the above-described preset type information (preset_type_flag) indicating whether it is generated and transmitted. The preset type information may be represented by 1 bit.

In addition, when preset rendering data included in the i-th preset information is a matrix type (bsPresetType [i]), output channel information (bsPresetCh [i]) indicating how many channels the output channel has is obtained, and output channel information. Obtains a preset matrix for adjusting the level of an object included in the audio signal based on (getRenderingMatrix ()).

6 is a syntax diagram illustrating an audio signal processing method according to another embodiment of the present invention. The preset information may be included in the header area and may be applied to all frames in the same manner. However, the preset information may be applied in a time-variable manner according to time, thereby effectively adjusting the level of the object. When preset information changes over time, information related to preset information should be included in each frame. Therefore, the bitstream can be effectively configured by including information indicating whether the preset information is included in each frame in the header.

Referring to FIG. 6, a syntax for expressing whether preset information is included for each frame is shown. It is similar to the syntax indicating the processing method of the audio signal shown in FIG. 5, but after obtaining the output channel information bsPresetCh [i], whether the preset information is variably temporally, that is, included in each frame. Preset information may include time-variable flag information (bsPresetTimeVarying [i]). When the preset information time varying flag information is included in the header region of the bitstream, the level of the object is adjusted by using the preset matrix and the preset metadata included in the frame region of the bitstream. When the preset information time-variable flag information is present in the header, it is determined whether or not there is an update of the preset information for each frame. It is also possible to construct a bitstream.

In addition, preset presence information (bsPresetExtsts) indicating whether preset information is included in the bitstream may be included. If the preset presence information indicates that the preset information is not included in the bitstream, the preset number information (bsNumPresets), preset type information (bsPresetType [i]), output channel information (bsPresetCh [i]), and preset information A loop for acquiring time-varying flag information (bsPresetTimeVarying [i]) may not be performed. The preset presence information may be omitted in syntax syntax in some cases.

7 is a syntax diagram illustrating an audio signal processing method according to another embodiment of the present invention. The above-described preset matrix is a matrix in the form of (number of objects) * (number of output channels), and indicates how the levels of all objects included in the audio signal are adjusted and included in the output channel. However, receiving and using only information on some of the objects may be efficient by reducing the number of transmitted bits. Accordingly, another embodiment of the present invention proposes a syntax of an audio signal processing method of adjusting only a desired object using preset information.

Referring to FIG. 7, the syntax may further include preset object application information (bsPresetObject [i] [j]) indicating whether preset information for adjusting the level of the object is applied to each object. By using the preset object application information, it is possible to inform whether the preset information includes the information on the corresponding object. The preset object application information may exist in the header region of the bitstream, and may exist in a frame when preset information changes with time as shown in FIG. 6. In addition, as illustrated in FIG. 7, it is possible to inform whether each object includes information on the corresponding object in preset information, or may include an object index indicating whether to include the object index in the bitstream. If the object index is used, the bit stream may be more conveniently formed using an exit character.

When the end character is encoded using a Huffman table in lossless coding, one table is designed to be larger than the actual number of parameters, and additionally assigned parameters may be defined as end parameters. Can be. At this time, if the end parameter is acquired in the bitstream, all of the corresponding information may be defined and used. For example, if the preset information includes only information about two objects out of a total of 10 objects (information about objects 3 and 8), the Hoffman index and end corresponding to objects 3 and 8 By sequentially transmitting the Hoffman index corresponding to the parameter, the bitstream can be effectively configured.

8 is a diagram illustrating a schematic configuration of a preset rendering data receiver for generating a preset matrix step by step according to another embodiment of the present invention. Referring to FIG. 8, the preset rendering data receiver 320 includes a preset type flag receiver 322, an output channel information receiver 324, and a preset matrix determiner 326. Other components have the same configuration and effects as the preset rendering data receivers 224 and 320 of FIGS. 2 and 3, and thus, detailed descriptions thereof will be omitted. On the other hand, as shown in Figure 8, the preset matrix determiner 326 is a mono type preset matrix receiver 810, a stereo type preset matrix generator 820, and a multi-channel type preset matrix generator 830 Include.

The mono type preset matrix receiving unit 810 receives a mono preset matrix expressed as a matrix in the form of (number of objects) from the preset information generating unit (not shown). If the output channel information received from the output channel information receiver 324 is mono, the mono preset matrix is output as it is and applied to the audio signal to adjust the level of the object.

Meanwhile, when the output channel information is stereo, a mono preset matrix is input to the stereo type preset matrix generator 820, and further receives channel extension information to generate a stereo preset matrix having a form of (number of objects) * 2. . If the output channel information indicates a multi-channel, the stereo preset matrix and the multi-channel extension information are input to the multi-channel type preset matrix generator 830 to generate a multi-channel preset matrix having the form of (number of objects) * 6. do. As such, only the mono preset matrix is generated by the encoder, and the preset matrix determination unit 326 generates the preset matrix step by step using the channel extension information, thereby saving the number of bits transmitted when the playback environment is limited to stereo only. In addition, the preset matrix for stereo or multichannel may not be repeatedly transmitted.

In addition, an audio signal processing method according to another embodiment of the present invention proposes a method of transmitting a gain value in transmitting preset information and transmitting a normalized preset matrix as needed. If only gain is needed to control an object included in the audio signal, it can be extended by transmitting only a gain value and easily transmitting the entire preset matrix. For example, in order to transmit the preset matrix as shown in Equation 1, n * 6 gain information should be transmitted first. The gain information may be calculated as in Equation 2 below.

는 오브젝트의 수 만큼 존재하므로, 하나의 프리셋 정보에 대하여 n개가 필요하다.Where i is an object, j is an output channel, and nCH is the number of output channels. remind

Since n exists as many as the number of objects, n pieces of preset information are required.

If panning information is needed in addition to the gain information, a normalized preset matrix is additionally used. The normalized preset matrix may be defined as in Equation 3 below.

과 같은 특성을 갖게 되고,

의 log10 값이 항상 0보다 작거나 같게 되므로, 게인 정보의 양자화를 위하여 채널 레벨 차이 정보(Channel Level Difference Information)의 테이블을 이용하는 경우, 종래에 비하여 절반의 테이블만을 사용하게 된다. 따라서, 게인 정보를 별도로 전송하지 아니하고 정규화되지 아니한 프리셋 매트릭스를 수신하여 이용하는 것보다 전송되는 비트율 뿐만 아니라 이용되는 데이터의 양을 절약할 수 있다. 또한, 프리셋 정보에 게인 정보만을 포함시킬 수 도 있으므로 프리셋 정보를 스케일러블(scalable)하게 사용할 수 있다.When gain information and a normalized preset matrix are used as in the above-described method, n * 6 gain information should be transmitted. But by normalization characteristic

Have the same characteristics as

Since the log10 value of is always less than or equal to 0, when using a table of channel level difference information for quantization of gain information, only half of the table is used as compared to the conventional art. Therefore, it is possible to save not only the bit rate transmitted but also the amount of data used, rather than receiving and using a preset matrix that is not normalized without separately transmitting gain information. In addition, since only the gain information may be included in the preset information, the preset information may be used in a scalable manner.

FIG. 9 illustrates syntax when the gain information and the panning information are separately included in the preset information and transmitted. Such gain information and panning information may be included in a header area or a frame area. Referring to FIG. 9, an italicized portion receives an actual preset information value from a bitstream. Various noiseless coding schemes may be used, and are represented as functions in FIG. 9. For example, when the information exists in the frame area, the preset number information is received when the information exists according to whether the preset information exists. Thereafter, first, gain information is received, which indicates information about a gain value to be played with the object. In this case, the gain information may be the G_i described above, or may be an arbitrary downmix gain (ADG) generated when the level of the audio signal is adjusted by an external input value.

The additionally obtained panning information may be in various forms. The panning information may be the normalized preset matrix described above, or may be divided into stereo panning information and multichannel panning information.

10 shows an audio signal processing apparatus according to another embodiment of the present invention. The audio signal processing apparatus includes a downmixer 1010, an object information generator 1020, a preset information generator 1030, a downmix signal processor 1040, an information processor 1050, and a multichannel decoder 1060. ).

The plurality of objects are input to the downmixer 1010 to generate a mono or stereo downmix signal. Also, when the plurality of objects are input to the object information generation unit 1020 and are object level information indicating the level of the object, a gain value of an object included in the downmix signal, and / or a stereo downmix signal, Object information including object gain information indicating the degree of the object included in the downmix channel and object correlation information indicating whether the objects are related to each other is generated. Subsequently, the downmix signal and the object information are input to the preset information generation unit 1030 to generate preset information including preset rendering data for adjusting the level of the object and preset metadata for expressing the preset information. Since the process of generating the preset rendering data and the preset metadata is the same as described above with reference to the audio signal processing apparatus and method of FIGS. 1 to 9, a detailed description thereof will be omitted. The object information generated by the object information generator 1020 and the preset information generated by the preset information generator 1030 may be included in the SAOC bitstream and transmitted.

The information processor 1050 includes an object information processor 1051 and a preset information receiver 1052, and receives an SAOC bitstream. The preset information receiving unit 1052 receives the above-described preset existence information, preset number information, preset information length information, preset metadata, preset type information, output channel information, and a preset matrix from the SAOC bitstream. The method according to various embodiments described in the audio signal processing method and apparatus of FIG. 9 is used. The preset information receiving unit 1052 outputs preset metadata and a preset matrix, and the object information processing unit 1051 receives them and uses the object information included in the SAOC bitstream to pre-process the downmix signal. A downmix processing information for generating a multi-channel information for upmixing the downmix signal is generated.

Subsequently, the downmix processing information may be input to the downmix signal processor 1040 to perform panning of an object included in the downmix signal. The preprocessed downmix signal is input to the multichannel decoding unit 1060 together with the multichannel information output from the information processing unit 1050 and upmixed to generate a multichannel audio signal.

As described above, in the audio signal processing apparatus of the present invention, in decoding an audio signal including a plurality of objects into a multichannel signal using object information, the level of an object can be easily adjusted by using preset information. In this case, the preset matrix applied to the object effectively adjusts the level of the object by using the received matrix type data based on the output channel information, and preset information based on the preset information length information transmitted from the encoder. Coding efficiency can be improved by outputting preset metadata for presentation.

11 is a diagram illustrating a schematic configuration of a product implemented with a preset information receiver including a metadata receiver and a preset rendering data receiver according to an embodiment of the present invention, and FIG. 12 is a diagram illustrating an embodiment of the present invention. FIG. 3 is a diagram illustrating a relationship between products in which a preset information receiver is implemented. FIG.

Referring to FIG. 11, the wire / wireless communication unit wire / wireless communication unit 1110 receives a bitstream through a wired / wireless communication scheme. In more detail, the wired / wireless communication unit 1110 may include at least one of a wired communication unit 1111, an infrared communication unit 1112, a Bluetooth unit 1113, and a wireless LAN communication unit 1114.

The user authentication unit 1120 receives user information and performs user authentication, and includes one or more of a fingerprint recognition unit 1121, an iris recognition unit 1122, a face recognition unit 1123, and a voice recognition unit 1124. The fingerprint, iris information, facial contour information, and voice information may be input, converted into user information, and the user authentication may be performed by determining whether the user information matches the existing registered user data. .

The input unit 1130 is an input device for a user to input various kinds of commands, and may include one or more of a keypad unit 1131, a touch pad unit 1132, and a remote controller unit 1133, but the present invention is directed to the input unit 1130. It is not limited. Meanwhile, when preset metadata for a plurality of preset information output from the metadata receiving unit 1141 described later is displayed on the screen through the display unit 1162, the user selects preset metadata through the input unit 1130. The information about the selected preset metadata may be input to the controller 1150.

The signal decoder 1140 includes a metadata receiver 1141 and a preset rendering data receiver 1142. The metadata receiver 1141 receives preset information length information based on the preset information length information. In addition, when the preset information is expressed as a matrix by preset type information, the preset rendering data receiving unit 1142 receives output channel information and receives a preset matrix as preset rendering data based on the output channel information. The signal decoding unit 550 decodes the audio signal using the received bitstream, preset metadata, and the preset matrix to generate an output signal, and outputs the preset metadata in text form.

The controller 1150 receives input signals from the input devices and controls all processes of the signal decoding unit 1140 and the output unit 1160. As described above, when the information on the preset metadata selected from the input unit 1130 is input to the control unit 1150, the preset rendering data receiving unit 1142 receives a preset matrix corresponding to the selected preset metadata, and uses the preset matrix. To decode the audio signal.

The output unit 1160 is a component that outputs an output signal generated by the signal decoding unit 1140, and may include a speaker unit 1161 and a display unit 1162. When the output signal is an audio signal, the output signal is output through the speaker unit 1161, and when the output signal is a video signal, the output signal is output through the display unit 1162. In addition, the preset metadata input from the controller 1150 is displayed on the screen through the display 1162.

FIG. 12 illustrates a relationship between a terminal and a server corresponding to the product illustrated in FIG. 11. Referring to FIG. 12A, the first terminal 1210 and the second terminal 1220 may be referred to as the respective terminals. It can be seen that the data or bitstream can be bidirectionally communicated through the wired / wireless communication unit. Referring to FIG. 12B, it can be seen that the server 1230 and the first terminal 1240 may also perform wired or wireless communication with each other.

FIG. 13 is a diagram illustrating a schematic configuration of a broadcast signal decoding apparatus 1300 having a preset information receiver including a metadata receiver and a preset rendering data receiver according to an embodiment of the present invention.

Referring to FIG. 13, the demultiplexer 1320 receives data related to TV broadcasting from the tuner 1310. The received data are separated at the demultiplexer 1320 and decoded through the data decoder 1330. Meanwhile, data separated from the demultiplexer 1320 may be stored in a storage medium 1350 such as an HDD. The separated data from the demultiplexer 1320 is input to a decoder 1340 including an audio decoder 1341 and a video decoder 1342 to decode the audio signal and the video signal. The audio decoder 1341 includes a metadata receiver 1341A and a preset rendering data receiver 1341B according to an embodiment of the present invention. The metadata receiver 1341A receives preset length information based on the preset meta data. Receive data. In addition, when the preset information is expressed as a matrix by the preset type information, the preset rendering data receiving unit 1341B receives the output channel information and receives the preset matrix as preset rendering data based on the output channel information. The audio decoder 1341 generates an output signal by decoding the audio signal using the received bitstream, preset metadata, and preset matrix, and outputs the preset metadata in text form.

The display unit 1370 displays the video signal output from the video decoder 1342 and the preset metadata output from the audio decoder 1321 on the screen. In addition, the display unit 1370 includes a speaker unit (not shown), and the speaker unit included in the display unit 1370 outputs an audio signal whose level of an object output from the audio decoder 1321 is adjusted using a preset matrix. Output through In addition, the data decoded by the decoder 1340 may be stored in a storage medium 1350 such as an HDD.

The signal decoding apparatus 1300 may further include an application manager 1360 that may receive information from a user and control the received data. The application manager 1360 includes a user interface manager 1361 and a service manager 1362, which controls an interface for receiving information from a user. For example, the font of the text displayed on the display unit 1370, the brightness of the screen, the menu configuration, and the like may be controlled. Meanwhile, when the decoder 1340 and the display unit 1370 decode and output a broadcast signal, the service manager 1362 may control the received broadcast signal using information input from a user. For example, a broadcast channel setting, an alarm function setting, an adult authentication function, and the like may be provided. Data output from the application manager 1360 may be transmitted to the display unit 1370 as well as the decoder 1340 and used.

14 illustrates a display unit of a product including a preset information receiver according to an embodiment of the present invention. The display unit may display all preset metadata included in the bitstream. For example, as shown in FIG. 14, the karaoke mode, the concert hall mode, and the news mode, which are preset metadata corresponding to the audio signal, are all displayed on the screen.

When one of the preset metadata is selected by the user, the display unit displays the object whose level is adjusted by applying the preset matrix corresponding to the karaoke mode to a plurality of objects. For example, when the user selects the karaoke mode, a shape in which the level of the vocal object is set to the minimum may be manifested. Also, when the user selects the news mode, the preset matrix applied to the audio signal will reduce the level of objects other than the vocal object. Referring to FIG. 14, when the news mode is selected, the display unit may increase the level of the vocal object to be higher than that of the vocal object in the karaoke mode, and the levels of the remaining objects may be set to the lowest level. In this case, the name of the object included in the preset metadata may be further displayed on the display unit, and the user may know which object the level is adjusted.

 Therefore, by displaying not only the preset metadata representing the preset information on the display but also the level of the object adjusted by the preset matrix, the user can listen to the audio signal having the desired sound field by appropriately selecting the desired preset information mode. Will be.

As described above, although the present invention has been described by way of limited embodiments and drawings, the present invention is not limited thereto and is intended by those skilled in the art to which the present invention pertains. Of course, various modifications and variations are possible within the scope of equivalents of the claims to be described.

1 illustrates a conceptual diagram of preset information applied to an object included in an audio signal according to an exemplary embodiment of the present invention.

2 shows an audio signal processing apparatus according to an embodiment of the present invention.

3 illustrates a preset information receiver of an audio signal processing apparatus according to an embodiment of the present invention.

4 is a flowchart illustrating an audio signal processing method according to an embodiment of the present invention.

5 illustrates syntax according to an embodiment of the present invention.

6 illustrates syntax according to another embodiment of the present invention.

7 illustrates syntax according to another embodiment of the present invention.

8 illustrates a preset rendering data receiver according to another embodiment of the present invention.

9 illustrates syntax according to another embodiment of the present invention.

10 shows an audio signal processing apparatus according to another embodiment of the present invention.

11 shows a schematic configuration of a product implemented with a preset information receiver according to an embodiment of the present invention.

FIG. 12 illustrates a relationship between a terminal and a server corresponding to the product illustrated in FIG. 11.

13 illustrates a schematic configuration of a digital TV implemented with a preset information receiver according to an embodiment of the present invention.

14 illustrates a display unit of a product including a preset information receiver according to an embodiment of the present invention.

Claims (14)

An audio signal receiver configured to receive an audio signal including at least one object; A preset metadata receiver for obtaining preset metadata of preset information; A preset rendering data receiving unit obtaining a preset matrix indicating a degree of inclusion of an output channel of the object, wherein the preset rendering data receiving unit obtains the preset matrix corresponding to the preset metadata; A display unit displaying the preset metadata; An input unit configured to receive a signal for selecting one of the preset metadata; An object controller which adjusts an output level of the object according to an output channel by using the preset matrix corresponding to the selected preset metadata; And And an output unit for outputting an audio signal including an object whose output level is adjusted. The method of claim 1, And when the output unit outputs the audio signal, the display unit displays the selected preset metadata. The method of claim 2, And the display unit further displays an output level of the object. The method of claim 1, And the preset matrix is obtained based on output channel information indicating that the output channel is one of mono, stereo, and multichannel. The method of claim 1, The preset information is obtained based on preset number information indicating the number of preset information, and the preset matrix is obtained based on preset type information indicating whether the preset information is expressed in a matrix. . The method of claim 1, The preset information may further include preset object application information indicating whether the preset matrix is applied to the object. The method of claim 6, And the display unit further displays whether the preset matrix applied to the object exists based on the preset object application information. The method of claim 1, And the display unit expresses the preset metadata in text form. Receiving an audio signal comprising at least one object; Receiving preset information, the preset information being at least one and including preset metadata and a preset matrix; Displaying the preset metadata and selecting one of the preset metadata; Obtaining the preset matrix corresponding to the selected preset metadata from the preset information, wherein the preset matrix indicates a degree of inclusion of an output channel of the object; Adjusting an output level of the object according to an output channel using the preset matrix; And And outputting an audio signal including an object whose output level is adjusted. The method of claim 9, And displaying the selected preset metadata. The method of claim 10, After adjusting the output level of the object, And displaying an output level of the object. The method of claim 9, And the preset matrix is obtained based on output channel information indicating that the output channel is one of mono, stereo, and multichannel. The method of claim 9, The preset information is obtained based on preset presence information indicating whether the preset information is included and preset number information indicating the number of the preset information. And the preset matrix is obtained based on preset type information indicating whether the preset information is expressed in a matrix. The method of claim 9, The preset information further includes preset object application information indicating whether the preset matrix applied to the object exists. And displaying the preset metadata and selecting one of the preset metadata further indicates whether the preset matrix applied to the object exists based on the preset object application information.

Images