JP2011523247A - Audio signal processing method and apparatus - Google Patents

Abstract

An audio signal processing method and apparatus capable of controlling the level and position of an object using preset information and preset metadata that have already been set.
Receiving a downmix signal including at least one object, object information based on an attribute of the object, preset information for rendering the downmix signal, and preset attribute information representing an attribute of the preset information; Rendering the downmix signal by applying the preset information to all data areas of the downmix signal when the preset information is included in an extension area of the configuration information area based on the preset attribute information; When the preset information is included in an extended area of the data area based on the preset attribute information, the downmix signal is rendered by applying the preset information to one corresponding data area of the downmix signal. Audio signal processing method characterized by having the steps of ring is disclosed.
Therefore, depending on the characteristics of the sound source, the audio signal can be made efficient by selecting whether the preset information is applied to one data area of the downmix signal or the preset information is applied to all data areas of the downmix signal. Can be restored.
[Selection] Figure 2

Description

  The present invention relates to an audio signal processing method and apparatus, and more particularly to an audio signal processing method and apparatus capable of processing an audio signal received from a digital medium, a broadcast signal, or the like.

  In the process of generating a downmix signal by downmixing an audio signal including a plurality of objects into a mono or stereo signal, parameters are extracted from the objects. These parameters are used in the process of decoding the downmixed signal, and the position and gain of the object can be controlled by user selection in addition to the parameters.

  The objects contained in the downmix signal must be adjusted according to the user's selection. However, when an object is controlled by a user, there is a hassle that all object signals must be directly controlled, and it is difficult to reproduce an audio signal in an optimum state as compared with a case where it is controlled by an expert.

  The present invention is directed to an audio signal processing method and apparatus that substantially prevents one or more of the above problems due to limitations and disadvantages of the prior art.

  The present invention has been made to solve the above problems, and an object thereof is to provide an audio signal processing method and apparatus capable of controlling the level and position of an object using preset information and preset metadata that have already been set. There is.

  Another object of the present invention is to apply the preset information and the preset metadata to the entire data area of the downmix signal or to one data area of the downmix signal according to the characteristics of the sound source. It is an object to provide an audio signal processing method and apparatus capable of adjusting the frequency.

  Still another object of the present invention is to select one of preset metadata displayed on a display unit based on a user's selection, and to control the level and position of the object using preset information corresponding thereto. An audio signal processing method and apparatus capable of performing

  Still another object of the present invention is to provide an audio signal processing method capable of receiving a selection signal from a user by displaying an object adjusted by applying preset information and selected preset metadata on a display unit, and To provide an apparatus.

  To achieve the above object, an audio signal processing method according to the present invention includes a downmix signal including at least one object, object information based on an attribute of the object, preset information for rendering the downmix signal, and the preset. Receiving preset attribute information representing an attribute of information, and when the preset information is included in a configuration information area based on the preset attribute information, applying the preset information to all data areas of the downmix signal Rendering the downmix signal according to the method, and when preset information is included in the data area based on the preset attribute information, applying the preset information to one corresponding data area of the downmix signal. Rendering the downmix signal, wherein the preset information is obtained based on preset number information representing the number of the preset information and output channel information representing the number of output channels of the rendered downmix signal. Is done. The preset attribute information may indicate whether the preset information is included in an extension area of the data area.

  The preset attribute information may indicate whether the preset information is variable or fixed.

  In the preset information, the variation can indicate that the preset information exists in an extension area of the data area, and the fixation can indicate that the preset information is included in an extension area of the configuration information area. . The audio signal processing method according to the present invention uses the object information and the preset information to generate downmix processing information for adjusting panning or gain of the downmix signal and multichannel information for upmixing the downmix signal. And modifying the downmix signal using the downmix processing information.

To achieve the above object, an audio signal processing apparatus according to the present invention renders a downmix signal including a downmix signal including at least one object and object information based on an attribute of the object, and a downmix signal. A preset attribute information receiving unit that receives preset attribute information indicating preset attribute information for performing, and when the preset information is included in an extension area of a configuration information area based on the preset attribute information, A fixed preset mode receiving unit that receives preset modes corresponding to all data areas, and when the preset information is included in an extension area of the data area based on the preset attribute information, one data area of the downmix signal Corresponding preset mode A dynamic preset mode receiving unit receiving a rendering unit rendering the downmix signal by applying the preset information to all data regions or one of the data regions of the downmix signal,
The preset mode may include the preset information and preset metadata corresponding to the preset information, and the preset metadata may represent characteristics of the preset information.

  The present invention provides the following effects and advantages.

  First, the output channel level of an object can be easily selected by selecting one of a plurality of preset information using a plurality of preset metadata without user setting for each object. Can be adjusted.

  Second, depending on the characteristics of the sound source, the preset information can be individually selected and applied to each data area unit, or the same preset information can be selected and applied to all data areas of the downmix signal to apply the audio signal. It can be restored efficiently.

  Third, by checking through the display section the object adjusted with the preset information applied and the selected preset metadata, the more appropriate preset information can be selected to determine the level or position of the output channel of the object. Can be adjusted.

FIG. 6 is a conceptual diagram of a preset mode applied to an object included in a downmix signal according to an embodiment of the present invention. FIG. 6 is a conceptual diagram of adjusting an object included in a downmix signal by applying preset information based on preset attribute information according to an embodiment of the present invention. FIG. 6 is a conceptual diagram of adjusting an object included in a downmix signal by applying preset information based on preset attribute information according to an embodiment of the present invention. 1 is a diagram illustrating an audio signal processing apparatus according to an embodiment of the present invention. FIG. 5 is a block diagram illustrating a method in which preset information is applied to a rendering unit according to an embodiment of the present invention. FIG. 5 is a block diagram illustrating a method in which preset information is applied to a rendering unit according to an embodiment of the present invention. FIG. 6 is a block diagram illustrating a schematic configuration of a variable preset information receiving unit and a fixed preset information receiving unit according to another embodiment of the present invention. It is a figure which shows the audio signal processing apparatus by the other Example of this invention. In the audio signal processing method according to another embodiment of the present invention, syntax associated with preset information is expressed in various ways. In the audio signal processing method according to another embodiment of the present invention, the syntax associated with the preset information is expressed by various methods. In the audio signal processing method according to another embodiment of the present invention, the syntax associated with the preset information is expressed by various methods. In the audio signal processing method according to another embodiment of the present invention, the syntax associated with the preset information is expressed by various methods. In the audio signal processing method according to another embodiment of the present invention, the syntax associated with the preset information is expressed by various methods. It is a figure which shows the audio signal processing apparatus by other Example of this invention. It is a figure which shows an example of the display part of the audio signal processing apparatus by other Example of this invention. FIG. 10 is a diagram illustrating at least one graphic element displaying an object to which preset information is applied according to still another embodiment of the present invention. FIG. 10 is a diagram illustrating a schematic configuration of a product in which a variable preset information receiving unit and a fixed preset mode receiving unit according to still another embodiment of the present invention are implemented. FIG. 6 is a diagram illustrating a relationship between products in which a variable preset mode receiving unit and a fixed preset mode receiving unit according to another embodiment of the present invention are implemented. FIG. 6 is a diagram illustrating a relationship between products in which a variable preset mode receiving unit and a fixed preset mode receiving unit according to another embodiment of the present invention are implemented. FIG. 10 is a diagram illustrating a schematic configuration of a broadcast signal decoding apparatus in which a variable preset mode receiver and a fixed preset mode receiver according to another embodiment of the present invention are implemented.

  BRIEF DESCRIPTION OF THE DRAWINGS In order to better understand the present invention, the accompanying drawings are incorporated in and constitute a part of this specification. These accompanying drawings illustrate embodiments of the present invention and are intended to explain the gist of the present specification in conjunction with the description of the present specification.

  Other features and advantages of the invention will be set forth in the description that follows, and in part will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

  To achieve the above object, an audio signal processing method according to the present invention includes a downmix signal including at least one object, object information based on an attribute of the object, preset information for rendering the downmix signal, and the preset. Receiving preset attribute information representing an attribute of information, and when the preset information is included in a configuration information area based on the preset attribute information, applying the preset information to all data areas of the downmix signal Rendering the downmix signal according to the method, and when preset information is included in the data area based on the preset attribute information, applying the preset information to one corresponding data area of the downmix signal. Rendering the downmix signal, wherein the preset information is obtained based on preset number information representing the number of the preset information and output channel information representing the number of output channels of the rendered downmix signal. Is done. The preset attribute information may indicate whether the preset information is included in an extension area of the data area.

  The preset attribute information may indicate whether the preset information is variable or fixed.

  In the preset information, the variation can indicate that the preset information exists in an extension area of the data area, and the fixation can indicate that the preset information is included in an extension area of the configuration information area. . The audio signal processing method according to the present invention uses the object information and the preset information to generate downmix processing information for adjusting panning or gain of the downmix signal and multichannel information for upmixing the downmix signal. And modifying the downmix signal using the downmix processing information.

To achieve the above object, an audio signal processing apparatus according to the present invention renders a downmix signal including a downmix signal including at least one object and object information based on an attribute of the object, and a downmix signal. A preset attribute information receiving unit that receives preset attribute information indicating preset attribute information for performing, and when the preset information is included in an extension area of a configuration information area based on the preset attribute information, A fixed preset mode receiving unit that receives preset modes corresponding to all data areas, and when the preset information is included in an extension area of the data area based on the preset attribute information, one data area of the downmix signal Corresponding preset mode A dynamic preset mode receiving unit receiving a rendering unit rendering the downmix signal by applying the preset information to all data regions or one of the data regions of the downmix signal,
The preset mode may include the preset information and preset metadata corresponding to the preset information, and the preset metadata may represent characteristics of the preset information.

  It is to be understood that both the following general description and the following detailed description of the invention are examples and description thereof, and are intended to further illustrate the invention as claimed.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In particular, the terms in the present invention can be interpreted as referred to below. Moreover, the term which is not disclosed by this specification can be interpreted as the meaning and concept corresponding to the following technical thought of this invention. Therefore, the embodiments described in the present specification and the configurations illustrated in the drawings are only the most preferred embodiments of the present invention, and do not show all the technical ideas of the present invention. There can be various equivalents and variations that can be substituted for them.

  In particular, in the present specification, information is a term that collectively refers to values, parameters, coefficients, elements, and the like, and the meaning thereof may be appropriately interpreted depending on circumstances. Therefore, the present invention is not limited to this.

  FIG. 1 is a conceptual diagram of a preset mode applied to an object included in a downmix signal according to an embodiment of the present invention. A set of information already set to adjust the object is referred to herein as a preset mode. The preset mode may represent various modes that can be selected by the user according to the characteristics of the audio signal or the listening environment, and may include at least one of the modes. The preset mode includes preset information (preset information) applied to adjust the object, and preset metadata (metadata for expressing attributes of the preset information). Preset metadata can be expressed in text and represents the attributes of preset information (for example, concert hall mode, karaoke mode, news mode, etc.), and the preset information creator, creation date, and preset information are applied. Related information for expressing preset information such as an object name can be included. On the other hand, the preset information is data that is substantially applied to the object, corresponds to the preset metadata, and can be expressed in various forms, for example, a matrix form.

  Referring to FIG. 1, preset mode 1 is a concert hall mode that provides a sound field feeling like listening to a music signal in a concert hall, and preset mode 2 is a vocal object from a audio signal. The karaoke mode in which the level is reduced can be set, and the preset mode n can be set in the news mode in which the level of the sound object is increased. The preset mode includes preset metadata and preset information. If the preset mode 2 is selected by the user, the karaoke mode of the preset metadata 2 is displayed, and the preset information 2 associated with the preset metadata 2 is applied to the object to adjust the level. Can do.

  In this case, the preset information may include mono preset information, stereo preset information, and multi-channel preset information. Preset information is determined by the output channel of the object. The mono preset information is preset information applied when the output channel of the object is mono, and the stereo preset information is preset information applied when the output channel of the object is stereo, and the multi-channel preset information. Is preset information applied when the output channel of the object is multi-channel. When the output channel of the object is determined by the configuration information, the type of preset information is determined using the determined output channel, and the preset information can be applied to the object to adjust the level or panning.

  2A and 2B are conceptual diagrams illustrating adjustment of an object included in a downmix signal by applying preset information according to preset attribute information according to an embodiment of the present invention.

  The audio signal of the present invention is encoded into a downmix signal and object information by an encoder, and these are transferred to a decoder in the form of one bit stream or a separate bit stream.

  Referring to FIGS. 2A and 2B, the object information included in the bitstream is specifically composed of a configuration information area and a plurality of data areas (data area 1, data area 2,..., Data area n). Is done. The configuration information area is an area located at the beginning of the bit stream of object information, and includes information that is commonly applied to all data areas of object information. For example, it may include configuration information including a tree structure, data region length information, object number information, and the like. On the other hand, the data area is a unit obtained by dividing the time domain of the entire audio signal based on the data area length information, and can include a frame. The data area of the object information corresponds to the data area of the downmix signal and includes object information used for upmixing the data area of the corresponding downmix signal. The object information includes object level information and object gain information.

  First, in an audio signal processing method according to an embodiment of the present invention, preset attribute information (preset_attribute_information) is read from object information of a bitstream. This preset attribute information indicates in which area of the bit stream the preset information is included, and particularly indicates whether the preset information is included in the configuration information area or the data area of the object information. The detailed meaning of the preset attribute information is as shown in Table 1 below.

  First, referring to FIG. 2A, when the preset attribute information is 0 and the preset information is included in the configuration information area, the preset information extracted from the configuration information area is the same in all data areas of the downmix signal. Applied to render.

  On the other hand, referring to FIG. 2B, when the preset attribute information is 1 and the preset information is included in the data area, the preset information extracted from the data area is applied to the data area of the corresponding downmix signal. To render. For example, the preset information extracted from the data area 1 can be applied to the data area 1 of the downmix signal, and the preset information extracted from the data area n can be applied to the data area n of the downmix signal.

  The preset attribute information can indicate whether the preset information is dynamic or static. When the preset attribute information is 0 and is included in the configuration information area, the preset information can be fixed. On the other hand, when the preset attribute information is 1 and is included in the data area, the preset information can be dynamic. In this case, since the preset information is applied only to the corresponding data area and the downmix signal of the corresponding data area is rendered, the preset information is variably applied to each data area. At this time, if the preset information is dynamic, it is preferably present in the extension region of the data region. If the preset information is static, the preset information is an extension region of the configuration information region. It is preferable that it exists in.

  Accordingly, the audio signal processing method according to an embodiment of the present invention uses preset attribute information to use appropriate preset information for each data area based on the characteristics of the sound source, or to use the same preset information for all data areas. It will be possible to render the downmix signal.

  FIG. 3 is a diagram illustrating an audio signal processing apparatus 300 according to an embodiment of the present invention. Referring to FIG. 3, the audio signal processing apparatus 300 may include a preset mode generation unit 310, an information reception unit (not shown), a variable preset mode reception unit 320, a fixed preset mode reception unit 330, and a rendering unit 340. .

  The preset mode generation unit 310 generates a preset mode for adjusting an object included in the audio signal during rendering, and may include a preset attribute determination unit 311, a preset metadata generation unit 312, and a preset information generation unit 313. .

  As described above, the preset attribute determining unit 311 determines preset attribute information indicating whether preset information is included in the configuration information area and applied to all data areas, or is included in the data area and applied to each data area.

  Thereafter, the preset metadata generation unit 312 and the preset information generation unit 313 can generate one preset metadata and preset information, or preset metadata and preset information corresponding to the number of data areas, based on the preset attribute information.

  The preset metadata generation unit 312 can receive the text representing the preset information and generate preset metadata. On the other hand, when the gain for adjusting the level of the object and / or the position of the object are input to the preset information generation unit 313, the preset information applied to the object can be generated.

  Preset information can be generated to be applied on an object-by-object basis, and can be of various types, including, for example, a channel level difference (CLD) parameter, a matrix, etc. it can.

  Also, the preset information generation unit 313 can further generate output channel information indicating the number of output channels of the object.

  The preset metadata generated by the preset metadata generation unit 312 and the preset information and output channel information generated by the preset information generation unit 313 can be included and transferred in one bitstream, It can be transmitted by being included in ancillary region of the bitstream including the mixed signal.

  Meanwhile, the preset mode generation unit 312 can further generate preset presence information indicating that the preset metadata, the preset information, and the output channel information are included in the bitstream. Preset presence information can also be a container type that indicates in which area of the bitstream the preset information is included, and does not indicate in which area it is simply included in the bitstream. Although it can also be set as the flag type (flag type) showing whether it was contained, it is not limited to this.

  The preset mode generation unit 312 can generate a plurality of preset modes, and each preset mode includes preset information, preset metadata, and output channel information. Here, the preset mode generation unit 312 can further generate preset number information indicating the number of preset modes.

  As described above, the preset mode generation unit 310 can output the preset attribute information, the preset metadata, and the preset information in the form of a bit stream.

  The bit stream has a form as shown in FIGS. 2A and 2B and is input to an information receiving unit (not shown). First, preset attribute information is acquired from a bit stream input to an information receiving unit (not shown), and it is determined in which area of the transferred bit stream the preset information is included.

  The variable preset mode receiving unit 320 operates when the preset information is included in the data area based on the preset attribute information output from the preset attribute determining unit 311 (when preset_attribute_flag = 1 in Table 1). .

  The variation preset mode reception unit 320 may include a variation preset metadata reception unit 321 that receives preset metadata corresponding to a corresponding data region and a variation preset information reception unit 322 that receives preset information for each data region. The variable preset metadata receiving unit 321 receives and outputs the selected preset metadata, and the variable preset information receiving unit 322 receives the preset information. Details of this will be described later with reference to FIGS. 4A to 5.

  The fixed preset mode receiving unit 330 operates when the preset information is included in the configuration information area based on the preset attribute information (when preset_attribute_flag = 0 in Table 1).

  The fixed preset mode receiving unit 330 may include a fixed preset metadata receiving unit 331 that receives preset metadata corresponding to all data areas and a fixed preset information receiving unit 332 that receives preset information.

  The fixed preset metadata receiving unit 331 and the fixed preset information receiving unit 332 of the fixed preset mode receiving unit 330 have substantially the same configuration as the variable preset metadata receiving unit 321 and the variable preset information receiving unit 322 of the variable preset mode receiving unit 320, and However, the range of the downmix signal corresponding to the preset information and preset metadata received and output is different.

  The rendering unit 340 includes a downmix signal generated by downmixing an audio signal including a plurality of objects and preset information output from the variation preset information receiving unit 322 or preset information output from the fixed preset information receiving unit 332. Receive. This preset information can be applied to the object included in the downmix signal to adjust the level of the object or the position of the object.

  When the audio signal processing apparatus 300 includes a display unit (not shown), the selected preset metadata output from the variable preset metadata receiving unit 321 or the selected preset metadata receiving unit 331 is selected. The preset metadata can be displayed on the display unit.

  4A and 4B are block diagrams illustrating a method in which preset information is applied to a rendering unit according to an embodiment of the present invention.

  First, FIG. 4A is a diagram illustrating a method in which the preset information output from the variation preset mode receiving unit 320 is applied to the rendering unit 440. The variation preset mode reception unit 320 is the same as the variation preset mode reception unit 320 in FIG. 3, and includes a variation preset metadata reception unit 321 and a variation preset information reception unit 322.

  The variable preset mode receiving unit 320 receives and outputs preset metadata and preset information for each data area, and the preset information is input to the rendering unit 440.

  The rendering unit 440 receives the downmix signal in addition to the preset information, and performs rendering for each data area. The rendering unit 441 for the data area 1, the rendering part 442 for the data area 2,. 44n included. Here, each data region rendering unit 44X of the rendering unit 440 receives preset information corresponding to each data region and renders it by applying it to the downmix signal.

  For example, preset information_1 that is stadium mode is applied to the first data area, preset information_3 that is karaoke mode is applied to the second data area, and preset that is news mode is applied to the sixth data area. Information_2 (here, n of the preset information_n represents an index of the data area mode) can be applied. In this case, of course, preset metadata is also output for each data area.

  FIG. 4B is a diagram illustrating a method in which the preset information output from the fixed preset mode receiving unit 330 is applied by the rendering unit 440. The fixed preset mode receiving unit 330 is configured in the same manner as the fixed preset mode receiving unit 330 of FIG.

  The fixed preset mode receiving unit 330 receives and outputs preset metadata and preset information corresponding to all data areas, and the rendering unit 440 receives the preset information.

  Similar to the rendering unit in FIG. 4A, the rendering unit 440 in FIG. 4B includes as many data region rendering units 44X as the number of data regions. When receiving preset information from the fixed preset mode receiving unit 330, the rendering unit 440 renders the preset information received by the all data region rendering unit 44X by applying the same to the downmix signal.

  For example, when the preset information output from the fixed preset information receiving unit 332 is the preset information 2 representing the news mode, the news mode can be applied to all data areas from the first data area to the nth data area.

  FIG. 5 shows a schematic configuration of the variable preset information receiving unit 322 included in the variable preset mode receiving unit 320 and the fixed preset information receiving unit 332 included in the fixed preset mode receiving unit 330 of the audio signal processing apparatus 300 of the present invention. FIG.

  Referring to FIG. 5, the variable or fixed preset information receiving units 322 and 332 include output channel information receiving units 322a and 332a and preset information determining units 322b and 332b.

  The output channel information receiving units 322a and 332a receive and output output channel information indicating how many output channels the object included in the downmix signal is reproduced. This output channel information can be mono channel, stereo channel or multi-channel (5.1 channel), but is not limited to this.

  The preset information determination units 322b and 332b receive and output corresponding preset information based on the output channel information input from the output channel information reception units 322a and 332b. This preset information can be one of mono preset information, stereo preset information or multi-channel preset information.

  When the preset information is a matrix type, the dimension of the preset information can be determined based on the number of objects and the number of output channels. The preset matrix is (number of objects) * (number of output channels). It can have the form. For example, when n objects are included in the downmix signal and the output channels from the output channel information receiving units 322a and 332a are 5.1 channels, that is, 6 channels, the preset information determining unit 322b, 332b can output multi-channel preset information in n * 6 form. Here, the element of the matrix is a gain value representing the degree to which the a-th object is included in the i-th channel.

  FIG. 6 is a diagram illustrating an audio signal processing apparatus 600 according to another embodiment of the present invention. Referring to FIG. 6, an audio signal processing apparatus 600 mainly includes a downmixing unit 610, an object information generating unit 620, a preset information generating unit 630, a downmix signal processing unit 640, an information processing unit 650, and a multi-channel decoding unit. 660.

  The plurality of objects are input to the downmixing unit 610 to generate a mono or stereo downmix signal. The plurality of objects are input to the object information generation unit 620, and are the object level information indicating the object level, the gain value of the object included in the downmix signal, and the stereo downmix signal. The object information including the object gain information including the degree of the object included in the object and the object related information indicating the presence or absence of the relationship between the objects is generated.

  Thereafter, the downmix signal and the object information are input to the preset mode generation unit 630, and preset attribute information indicating whether the preset information is included in the data area in the bitstream or the configuration information area in the bitstream, an object A preset mode including preset information for adjusting the level of the preset data and preset metadata for expressing the preset information is generated. Since the process of generating the preset attribute information, the preset information, and the preset metadata is as described above in the audio signal processing apparatus and method in FIGS. 1 to 5, detailed description thereof is omitted.

  The preset mode generation unit 630 also includes preset presence information indicating whether or not the preset information exists in the bitstream, preset number information indicating the number of preset information, and preset metadata length information indicating the length of the preset metadata. Furthermore, it can be generated.

  The object information generated by the object information generation unit 620 and the preset attribute information, preset information, preset metadata, preset presence information, preset number information, and preset metadata length information generated by the preset mode generation unit 630 are SAOC bitstreams. And can be transferred in the form of one bit stream including a downmix signal. In this case, the bitstream including the downmix signal and the preset related information can be input to a signal receiving unit (not shown) of the decoding apparatus.

  The information processing unit 650 includes an object information processing unit 651, a variable preset mode receiving unit 652, and a fixed preset mode receiving unit 653, and receives the SAOC bitstream. Whether the SAOC bit stream is input to the variable preset mode receiving unit 652 or the fixed preset mode receiving unit 653 depends on whether the preset is included in the SAOC bit stream as described above with reference to FIGS. Determined based on attribute information.

  The variable preset mode receiving unit 652 and the fixed preset mode receiving unit 653 receive the preset attribute information, preset presence information, preset number information, preset metadata, output channel information, and preset information (for example, preset matrix) from the SAOC bitstream. Receive and use methods according to various embodiments described in the audio signal processing methods and apparatus of FIGS.

  The variable preset mode receiving unit 652 or the fixed preset mode receiving unit 653 outputs preset metadata and preset information.

  The object information processing unit 651 uses the received preset metadata and preset information together with the object information included in the SAOC bitstream to perform downmix processing information for pre-processing the downmix signal. And generating multi-channel information for rendering downmix signals. In this case, the preset information and preset metadata output from the variable preset mode receiving unit 652 correspond to one data area of the downmix signal, and the preset information and preset meta data output from the fixed preset mode receiving unit 653 are used. Data corresponds to the entire data area of the downmix signal.

  Thereafter, the downmix processing information is input to the downmix signal processing unit 640, and panning can be performed by changing the channel in which the object included in the downmix signal is included. The premixed downmix signal is input to the multichannel decoding unit 660 together with the multichannel information output from the information processing unit 650 and is upmixed to generate a multichannel audio signal. be able to.

  As described above, when the audio signal processing apparatus of the present invention decodes a downmix signal including a plurality of objects into a multi-channel signal using object information, the preset information and preset metadata that have already been set are used. Furthermore, the level of the object can be easily adjusted by using it. Also, at this time, the preset information applied to the object is applied to each data area individually based on the preset attribute information, or applied to all data areas in the same manner, so that the sound can be appropriately controlled according to the characteristics of the sound source. The feeling of the place can be improved.

  7 to 11 show various methods of expressing syntax indicating an audio signal processing method according to another embodiment of the present invention. Referring to FIG. 7, information related to the preset information may exist in the configuration information area (SAOCSpecificConfig ()) of the bitstream.

  First, preset number information (bsNumPresets) can be obtained from the configuration information area of the bitstream. Also, output channel information (bsPresetLevel [i]) indicating the output channel of the object to which the preset information is applied can be obtained for each preset information (i-th preset information) based on the preset number information. The meaning of the output channel information is as shown in Table 2 below.

  Thereafter, preset attribute information (bsPresetDynamic [i]) indicating whether the preset information is included in the configuration information area or the data area can be acquired. As shown in FIG. 7, when the preset attribute information (bsPresetDynamic [i]) is 0, it represents a fixed preset mode (static preset mode), and the object level or panning of the downmix signal is adjusted corresponding to the entire data area. Preset information (getPreset ()) is acquired. At this time, preset metadata (PresetMetaData (numPresets)) can also be included in the configuration information area corresponding to the preset information. The meaning of the preset attribute information is as shown in Table 3 below.

  FIG. 8 shows the syntax for the data area information when the preset attribute information (bsPresetDynamic [i]) shown in FIG. 7 indicates that the preset information is included in the data area. Referring to FIG. 8, when the preset attribute information (bsPresetDynamic [i]) in FIG. 7 is 1, the if (! BsPresetDynamic [i]) loop is removed, so that the preset information is not acquired from the configuration information area. Thereafter, as shown in FIG. 8, the condition (SAOCFrame () {if (bsPresetDynamic [i])}) is satisfied in the data area, so that the preset information (getPreset ()) can be acquired. Since this preset information is acquired from the data area, the preset information of FIG. 7 can be applied only to the corresponding data area, unlike the case where the preset information of FIG.

  On the other hand, in FIGS. 7 and 8, the preset information is included in the configuration information area (SAOCSpecificConfig ()) and the data area (SAOCFrame ()), but the configuration information area extension area (SAOCExtensionConfig ()) and the data area extension area are included. It can also be included in (SAOCEXtensionFrame ()).

  At this time, the preset information included in the configuration information area extension area and the data area extension area is the same as the preset information described with reference to FIGS. In addition to the preset information, the configuration information area extension area and the data area extension area may further include preset metadata corresponding to the preset information, output channel information, preset presence information, and the like.

  FIG. 9 is a syntax representing preset information according to another embodiment of the present invention. Referring to FIG. 9, the preset information may be generated using EcData. On the other hand, the preset information can use the method of transferring and using the gain value itself instead of EcData. In addition to the method of quantizing using the channel difference information (CLD) table, using another independent table It can also be quantized.

  FIG. 10 is a syntax representing preset metadata according to another embodiment of the present invention. As shown in FIG. 10, the preset metadata first acquires preset metadata length information (bsNumCharMetaData [prst]) indicating the length of the metadata corresponding to the preset information. Thereafter, preset metadata (bsMetaData [prst]) corresponding to each preset information can be obtained for each preset information based on the preset metadata length information.

  As described above, the audio signal processing method and apparatus of the present invention reduce extra coding by expressing the preset metadata expressing the preset information in a text form based on the preset length information indicating the length of the metadata. be able to.

  FIG. 11 is a syntax of a data area including preset information according to still another embodiment of the present invention. Referring to FIG. 11, preset information can transfer information mapped to an output channel (numRenderingChannel [i]) for each object based on the number of objects (numObjects). As shown in FIG. 11, the preset information can be acquired from the data area of the bit stream, but when included in the data area extension area, the data area extension area (SAOCExtensionFrame ()), the configuration information of the bit stream If it is included in the area, it can be acquired from the configuration information area.

  FIG. 12 is a diagram illustrating an audio signal processing apparatus 1200 according to another embodiment of the present invention. The audio signal processing device 1200 mainly includes a preset mode generation unit 1210, an information reception unit (not shown), a preset mode input unit 1220, a preset mode selection unit 1230, a variable preset mode reception unit 1240, and a fixed preset mode reception unit 1250. A rendering unit 1260 and a display unit 1270.

  The preset mode generation unit 1210, the information reception unit (not shown), the variation preset mode reception unit 1240, the fixed preset mode reception unit 1250, and the rendering unit 1260 of FIG. 12 are the same as the preset mode generation unit 310 and the variation preset mode reception of FIG. Since the configuration and function are the same as those of the unit 320, the fixed preset mode reception unit 330, and the rendering unit 340, detailed description thereof is omitted.

  Referring to FIG. 12, the preset mode input unit 1220 first displays a plurality of preset metadata received from the preset metadata generation unit 1212 on the screen of the display unit 1270, and selects one of the preset metadata. A selection signal is received. The preset mode selection unit 1230 selects one preset metadata selected by the selection signal and preset information corresponding to the preset metadata.

  At this time, if the preset attribute information (preset_attribute_information) received from the preset attribute determination unit 1211 indicates that the preset information is included in the data area, the preset metadata selected by the preset mode selection unit 1230, the preset metadata, Corresponding preset information is input to the preset metadata receiving unit 1241 and the preset information receiving unit 1242 of the variation preset mode receiving unit 1240, respectively. In this case, the display unit 1270, the preset mode input unit 1220, and the preset mode selection unit 1230 can perform the above operation by repeating the number of data areas.

  On the other hand, when the preset attribute information received from the preset attribute determination unit 1211 indicates that the preset information is included in the configuration information area, the preset metadata selected by the preset mode selection unit 1220 and the preset corresponding to the preset metadata. The information is input to the preset metadata receiving unit 1251 and the preset information receiving unit 1252 of the fixed preset mode receiving unit 1250, respectively.

  The selected preset information is output to the rendering unit 1260, while the selected preset metadata is output to the display unit 1270 and displayed on the screen.

  The display unit 1270 may be the same unit as a unit that displays a plurality of preset metadata so that the preset mode input unit 1220 can receive a selection signal, or can be a different unit. When the display unit for displaying preset metadata for the display unit 1270 and the preset mode input unit 1220 uses the same unit, explanations displayed on the screen (for example, “Please select a preset mode”, “Preset mode”) X has been selected "), and the like, by distinguishing the visual objects and characters, it is possible to distinguish the respective actions.

  FIG. 13 is a diagram illustrating an example of the display unit 1270 of the audio signal processing apparatus 1200. In addition to the selected preset metadata, the display unit 1270 may include at least one graphic element representing the level or position of the object adjusted using preset information corresponding to the preset metadata.

  Referring to FIG. 13, first, among a plurality of preset metadata (eg, stadium mode, cave mode, news mode, live mode, etc.) displayed on the display unit 1270 of FIG. When the mode is selected, preset information corresponding to the news mode is applied to each object included in the downmix signal. In this case, the level of vocals will increase and the level of other objects (guitar, violin, drum, ..., cello) will decrease.

  The graphic elements included in the display unit 1270 are transformed to represent the activation or change of the level or position of the object. For example, as shown in FIG. 13, the switch of the graphic element representing the vocal can be moved to the right, and the switch of the graphic element representing the other object can be moved to the left.

  The graphic element can represent the level or position of the object adjusted using the preset information in various ways. There can be at least one graphic element representing each object, in which case the first graphic element represents the level or position of the object before the preset information is applied, and the second graphic element applies the preset information. The level or position of the adjusted object. In this case, since the level or position of the object before and after applying the preset information can be easily compared, it can be easily understood how the preset information adjusts each object.

  FIG. 14 is a diagram illustrating at least one graphic element having another shape representing an object to which the preset information is applied. Referring to FIG. 14, the first graphic element may have a bar shape, and the second graphic element may be an extended line inside the first graphic element. Here, the first graphic element represents the level or position of the object before the preset information is applied, and the second graphic element represents the level or position of the object adjusted by applying the preset information.

  As shown in FIG. 14, the upper graphic element shows a case where the level of the object before the preset information is applied is the same as the level of the object after the preset information is applied. The middle graphic element indicates that the level of the object adjusted by applying preset information is higher than before the application, and the lower graphic element is when the object level is decreased by applying the preset information. Indicates.

  In this way, it is easy to see how the preset information adjusts each object by using at least one graphic element that represents the level or position of the object before and after applying the preset information. As a result, the characteristics of the preset information can be easily grasped, which can help the user to select an appropriate preset mode as necessary.

  FIG. 15 is a diagram illustrating a schematic configuration of a product in which a variable preset mode receiving unit and a fixed preset mode receiving unit according to still another embodiment of the present invention are implemented. FIGS. It is a figure which shows the relationship between the products in which the fluctuation | variation preset mode receiver by the Example and the fixed preset mode receiver were implemented.

  Referring to FIG. 15, the wired / wireless communication unit 1510 receives a bitstream through a wired / wireless communication scheme. Specifically, the wired / wireless communication unit 1510 may include at least one of a wired communication unit 1511, an infrared communication unit 1512, a Bluetooth unit 1513, and a wireless run communication unit 1514.

  The user authentication unit 1520 receives user information and performs user authentication, and may include at least one of a fingerprint recognition unit 1521, an iris recognition unit 1522, a face recognition unit 1523, and a voice recognition unit 1524. In this case, user authentication receives fingerprint, iris information, facial contour information, and voice information, respectively, converts them into user information, and determines whether the user information matches the existing registered user data. User authentication can be performed.

  The input unit 1530 is an input device for a user to input various types of commands, and may include at least one of the keypad unit 1531, the touchpad unit 1532, and the remote control unit 1533. Is not limited to this. On the other hand, when preset metadata for a plurality of preset information output from the metadata receiving unit 1541 described later is displayed on the screen through the display unit 1562, the user can select preset metadata through the input unit 1530. Information regarding the selected preset metadata is input to the control unit 1550.

  The signal decoding unit 1540 includes a variable preset mode receiving unit 1541 and a fixed preset mode receiving unit 1542. The variable preset mode receiving unit 1541 is based on preset attribute information, and preset information and preset metadata corresponding to each data area. Receive. Further, the fixed preset mode receiving unit 1542 receives preset information and preset metadata corresponding to all data areas based on the preset attribute information. The preset metadata is received based on preset metadata length information indicating the length of the metadata. The preset information is preset presence information indicating whether or not the preset information exists, and a preset indicating the number of the preset information. Based on the number information and the number of output channels, for example, based on output channel information indicating that the output channel is one of mono, stereo, and multi-channel. If the preset information is expressed in a matrix, the output channel information is received and the preset matrix is received based on the output channel information.

  The signal decoding unit 1540 generates an output signal by decoding the audio signal using the received bitstream, preset metadata, and preset information, and outputs the preset metadata in the form of text.

  The control unit 1550 receives an input signal from the input device and controls the overall process of the signal decoding unit 1540 and the output unit 1560. As described above, information regarding the preset metadata selected from the input unit 1530 is input to the control unit 1550 as the form of the input signal, and from which area of the bitstream the preset information is included from the wired / wireless communication unit 1510. When preset attribute information (preset_attribute_information) is input, the variable preset mode receiving unit 1541 and the fixed preset mode receiving unit 1542 are preset information corresponding to the selected preset metadata based on the preset attribute information and the input signal. Is used to decode the audio signal.

  The output unit 1560 is a component that outputs an output signal generated by the signal decoding unit 1540 and may include a speaker unit 1561 and a display unit 1562. When the output signal is an audio signal, the output signal is output from the speaker unit 1561, and when the output signal is a video signal, the output signal is output from the display unit 1562. The preset metadata input from the control unit 1550 is displayed on the screen through the display unit 1562.

  FIG. 16 is a diagram illustrating a relationship between terminals corresponding to the product illustrated in FIG. 15 and a relationship between the terminal and the server. Referring to FIG. 16A, it can be seen that the first terminal 1610 and the second terminal 1620 can communicate data or a bit stream in both directions through the wired / wireless communication unit.

  The data or bit stream communicated through the wired / wireless communication unit may be in the form of the bit stream shown in FIGS. 2A and 2B. The preset attribute information, preset information, and the like described with reference to FIGS. Data including preset metadata may be used.

  Referring to FIG. 16B, the server 1630 and the first terminal 1640 can also perform wired / wireless communication with each other.

  FIG. 17 is a diagram illustrating a schematic configuration of a broadcast signal decoding apparatus 1700 in which a preset receiving unit including a metadata receiving unit and a preset rendering data receiving unit according to an embodiment of the present invention is implemented.

  Referring to FIG. 17, the demultiplexer 1720 receives data related to the TV broadcast from the tuner 1710. The received data is separated by the demultiplexer 1720 and decoded by the data decoder 1730. On the other hand, the data separated by the demultiplexer 1720 can be stored in a storage medium 1750 such as an HDD.

  The data separated by the demultiplexer 1720 is input to a decoder 1740 including an audio decoder 1741 and a video decoder 1742, and the audio signal and the video signal are decoded. The audio decoder 1741 includes a variable preset mode receiving unit 1741A and a fixed preset mode receiving unit 1741B according to an embodiment of the present invention. The variable preset mode receiving unit 1741A is preset information corresponding to each data area based on preset attribute information. And preset metadata. The fixed preset mode receiving unit 1741B receives preset information and preset metadata corresponding to all data areas based on the preset attribute information.

  The preset metadata is received based on preset metadata length information indicating the length of the metadata. The preset information is preset presence information indicating whether or not the preset information exists, and a preset indicating the number of the preset information. The number information is obtained based on the output channel information indicating that the output channel is one of mono, stereo, and multi-channel. If the preset information is expressed in a matrix, the output channel information is received and the preset matrix is received based on the output channel information.

  The audio decoder 1741 generates an output signal by decoding the audio signal using the received bitstream, preset metadata, and preset information, and outputs the preset metadata as a text form.

  The display unit 1770 displays the video signal output from the video decoder 1742 and the preset metadata output from the audio decoder 1741 on the screen. The display unit 1770 includes a speaker unit (not shown), and an audio signal in which the level of an object output from the audio decoder 1741 is adjusted using preset information is transmitted from the speaker unit included in the display unit 1770. Output. The data decoded by the decoder 1740 can be stored in a storage medium 1750 such as an HDD.

  Meanwhile, the signal decoding apparatus 1700 may further include an application manager 1760 that can receive information from a user and control the received data.

  The application manager 1760 includes a user interface manager 1761 and a service manager 1762. The user interface manager 1761 controls an interface for receiving information from the user. For example, the typeface of text displayed on the display unit 1770, the brightness of the screen, the menu configuration, and the like can be controlled. On the other hand, the service manager 1762 can control the received broadcast signal using information input from the user when the decoder 1740 and the display unit 1770 decode and output the broadcast signal. For example, broadcast channel settings, alarm function settings, adult authentication functions, and the like can be provided. Data output from the application manager 1760 can be transferred to the display unit 1770 and used in addition to the decoder 1740.

  The present invention has been described above based on specific embodiments and drawings. However, the present invention is not limited to these specific examples, and the present invention is not limited to those skilled in the art to which the present invention belongs. Obviously, various modifications and variations can be made within the technical idea of the invention and the appended claims and their equivalents.

  The present invention can be applied to encoding and decoding audio signals.

Claims (13)

Receiving a downmix signal including at least one object, object information based on an attribute of the object, preset information for rendering the downmix signal, and preset attribute information representing an attribute of the preset information;
Rendering the downmix signal by applying the preset information to the entire data area of the downmix signal when the preset information is included in an extension area of a configuration information area based on the preset attribute information;
Rendering the downmix signal by applying the preset information to one corresponding data area of the downmix signal when the preset information is included in an extension area of the data area based on the preset attribute information; When,
An audio signal processing method comprising:   The audio signal processing method according to claim 1, wherein the preset attribute information represents whether the preset information is included in an extension area of the data area.   The audio signal processing method according to claim 1, wherein the preset attribute information indicates that the preset information is variable or fixed.   The variation represents that the preset information is included in an extended area of the data area, and the fixed represents that the preset information is included in an extended area of the configuration information area. 4. The audio signal processing method according to 3. Using the object information and the preset information to generate downmix processing information for adjusting panning or gain of the downmix signal and multichannel information for upmixing the downmix signal;
Modifying the downmix signal using the downmix processing information;
The audio signal processing method according to claim 4, further comprising: A signal receiving unit for receiving a downmix signal including at least one object and object information based on an attribute of the object;
A preset attribute information receiving unit that receives preset attribute information representing attributes of preset information for rendering the downmix signal;
When the preset information is included in the extension area of the configuration information area based on the preset attribute information, a fixed preset mode receiving unit that receives a preset mode corresponding to all data areas of the downmix signal;
When the preset information is included in an extension area of the data area based on the preset attribute information, a variable preset mode receiving unit that receives a preset mode corresponding to one data area of the downmix signal;
A rendering unit that renders the downmix signal by applying the preset information to the entire data region or one data region of the downmix signal;
Have
The audio signal processing apparatus, wherein the preset mode includes the preset information and preset metadata corresponding to the preset information, and the preset metadata represents a characteristic of the preset information. The fixed preset mode receiver
A fixed preset information receiving unit for receiving the preset information;
A fixed metadata receiver for receiving the preset metadata;
The audio signal processing apparatus according to claim 6, further comprising: The variable preset mode receiver is
A variable preset information receiving unit for receiving the preset information;
A variable preset metadata receiving unit for receiving the preset metadata;
The audio signal processing apparatus according to claim 6, further comprising:   The audio signal processing apparatus according to claim 6, wherein the rendering unit includes a plurality of data region rendering units for rendering a data region of the downmix signal.   The audio signal processing apparatus according to claim 9, wherein when the preset information is received from the fixed preset mode receiving unit, the preset information is applied to the plurality of data area rendering units.   The audio according to claim 9, wherein when the preset information is received from the variable preset mode receiving unit, the preset information is applied to one data area rendering unit corresponding to the preset information. Signal processing device. Downmixing at least one object to generate a downmix signal;
Generating object information based on attributes of the object;
Generating preset information for adjusting the object by applying to the downmix signal;
Generating preset metadata corresponding to the preset information;
Determining preset attribute information representing attributes of the preset information;
An audio signal processing method comprising: A downmixing unit that downmixes at least one object to generate a downmix signal;
An object information generation unit that generates object information based on the attribute of the object;
A preset information generating unit for generating preset information for adjusting the object by applying to the downmix signal;
A preset metadata generation unit for generating preset metadata corresponding to the preset information;
A preset attribute information determination unit for determining preset attribute information representing an attribute of the preset information;
An audio signal processing apparatus comprising:

Images