JP5426680B2 - Signal processing method and apparatus - Google Patents

Description

  The present invention improves the sound quality of a signal by using a signal obtained by shifting the phase of an input signal and using an inter-channel phase difference value of the signal whose phase is shifted. The present invention relates to a signal processing method and apparatus capable of restoring a complete signal more completely.

  In general, a signal can be encoded using a decorrelator to generate a stereo signal from a mono signal.

  Further, the signal processing apparatus can encode the signal using the inter-channel level difference value and the inter-channel correlation value.

  When an audio signal is generated using a decorrelator, there is a problem that the decorrelator cannot accurately reproduce a phase difference or delay difference existing between channel signals.

  Also, when a signal is encoded using the inter-channel level difference value and the inter-channel correlation value, the inter-channel phase difference of the input signal cannot be restored and reflected, and accurate sound image localization is performed. In addition, there is a problem that reverberation of the input signal cannot be restored.

  The present invention has been devised to solve the above-described problems, and its purpose is to restore and decode the phase of a decoded audio signal or audio signal using an inter-channel phase difference value and a phase shift flag. It is an object of the present invention to provide a signal processing method and apparatus capable of improving sound quality and approaching an original sound by shifting.

  The present invention provides the following effects and advantages.

  First, the signal processing method and apparatus according to the present invention shifts the phase of the decoded audio signal or audio signal based on the phase shift flag, so that it is difficult to efficiently reproduce by the decorrelator at the time of decoding. There is an effect that the phase difference or the delay difference can be efficiently reproduced.

  Second, the signal processing method and apparatus according to the present invention uses the inter-channel phase difference value based on the inter-channel phase difference encoding flag and the inter-channel phase difference mode flag, so that the inter-channel level difference value and the inter-channel phase difference value Depending on the correlation value, reverberation that is difficult to restore can be restored, and the localization of the sound image can be made accurate.

  Third, the signal processing method and apparatus according to the present invention receives an inter-channel phase difference mode flag indicating whether or not an inter-channel phase difference value is used for each frame, so that an inter-channel phase difference is obtained as necessary. The value can be used to decode the signal.

  Fourth, the signal processing method and apparatus of the present invention corrects (smoothings) the inter-channel phase difference value of the current parameter time slot using the inter-channel phase difference value of the preceding parameter time slot. ), It is possible to remove noise that may be temporarily generated due to the difference in the phase difference value between channels.

  Fifth, the signal processing method and apparatus of the present invention can improve the coding efficiency by transmitting the inter-channel phase difference value only when a certain condition is satisfied, and can decode it as a signal close to the original sound.

  Sixth, the signal processing method and apparatus of the present invention converts the inter-channel phase difference value measured by the encoder into an inter-channel level difference value and transmits it, thereby not allowing the transmission of the inter-channel phase difference value. In the case of using the signal processing apparatus and method, the reverberation is enhanced and the sound image localization can be restored as a signal close to the original sound (backward compatibility).

It is a conceptual diagram which shows the concept of the signal processing method by one Example of this invention. 1 is a block diagram illustrating a signal processing apparatus according to an embodiment of the present invention. It is a graph which shows the relationship between the phase in a signal, and time. FIG. 3 is a block diagram specifically illustrating an IPD value measurement unit and an IPD value acquisition unit in FIG. 2. It is a block diagram which shows the signal processing apparatus by the other Example of this invention. It is a block diagram which shows the signal processing apparatus by other Example of this invention. It is a conceptual diagram which shows the conventional parameter time slot. It is the schematic which shows the method of correct | amending (smoothing) the phase difference value between channels by other Example of this invention. FIG. 9 is a block diagram illustrating a signal processing device according to still another embodiment of the present invention in FIG. 8. It is a conceptual diagram which shows the problem which the signal processing method and apparatus by other Example of this invention are going to solve. It is a block diagram which shows the signal processing apparatus by other Example of this invention. It is a block diagram which shows the signal processing apparatus by other Example of this invention. FIG. 10 is a conceptual diagram illustrating a concept in which a global frame channel phase difference value (global frame IPD) is used according to another embodiment of the present invention. It is a block diagram which shows the signal processing apparatus by other Example of this invention. It is a block diagram which shows the signal processing apparatus by other Example of this invention. It is a block diagram which shows the signal processing apparatus by other Example of this invention. It is a block diagram which shows the signal processing apparatus by other Example of this invention. It is a figure which shows the schematic structure of the product by which the IPD encoding flag acquisition part by the further Example of this invention, the IPD mode flag acquisition part, the IPD value acquisition part, and the up-mixing part are embodied. It is a figure which shows the relationship between the products in which the IPD encoding flag acquisition part by the further another Example of this invention, the IPD mode flag acquisition part, the IPD value acquisition part, and the up-mixing part are embodied. FIG. 7 is a diagram illustrating a schematic configuration of a broadcast signal decoding apparatus in which an IPD encoding flag acquisition unit, an IPD mode flag acquisition unit, an IPD value acquisition unit, and an upmixing unit are implemented according to another embodiment of the present invention. .

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Prior to this, the terms and words used in the specification and claims should not be construed in a normal or lexical sense, and the inventor will explain his invention in the best possible manner. Therefore, it should be clarified that it should be interpreted as a meaning and concept consistent with the technical idea of the present invention based on the principle that the concept of the term can be defined as appropriate. Therefore, the configuration shown in the embodiments and drawings described in the present specification is only the most preferred embodiment of the present invention and does not represent the technical idea of the present invention. It will be understood that there may be various equivalents and variations that can be substituted in

  In particular, the encoding in the present invention should be understood as a concept including both encoding and decoding.

  In addition, the information in the present specification is a term that collectively refers to values, parameters, coefficients, elements, and the like, and is interpreted as meanings that differ depending on the case, but the present invention is not limited thereto. In this specification, a stereo signal is described as an example of a signal. However, the present invention is not limited to this, and a multi-channel signal having three or more channels may be used.

  FIG. 1 is a conceptual diagram showing a concept of a signal processing method according to an embodiment of the present invention, and shows a bit stream of spatial information. Referring to FIG. 1, the spatial information can be divided into a header and a plurality of frames. Here, the spatial information is information that represents attributes of a plurality of channel signals that are input signals, a channel-to-channel level difference value that represents a level difference between two channels of the plurality of channels, and a channel that represents the degree of correlation between two channels An inter-channel correlation value and an inter-channel phase difference value representing a phase difference between two channels can be included. These can be used by a decoder to upmix and restore a downmix signal generated by downmixing a plurality of channel signals.

  The header of the spatial information includes an inter-channel phase difference encoding flag (bsPhaseCoding) indicating whether or not there is a frame using the inter-channel phase difference value in all frames. That is, by including the inter-channel phase difference encoding flag in the header, it can be determined whether or not the inter-channel phase difference value is used in all frames of the spatial information. The meaning of the inter-channel phase difference encoding flag is shown in Table 1 below.

  The spatial information includes an inter-channel phase difference mode flag (bsPhaseMode) indicating whether or not an inter-channel phase difference value is used in the frame for each frame. The inter-channel phase difference mode flag is only included in the frame when the inter-channel phase difference encoding flag is 1, that is, when the inter-channel phase difference encoding flag indicates that IPD encoding is used for spatial information. included. The specific meaning of the inter-channel phase difference mode flag (bsPhaseMode) is as shown in Table 2 below.

  Referring to FIG. 1 again, if the inter-channel phase difference mode flag of frame 2 is 1 (bsPhaseMode = 1), the frame 2 includes a non-zero value as the inter-channel phase difference value (IPD), and the frame 3 channel If the interphase difference mode flag is 0 (bsPhaseMode = 0), the frame 3 includes a value of 0 as the interchannel phase difference value (IPD).

  Therefore, an inter-channel phase difference value is acquired based on the inter-channel phase difference encoding flag and the inter-channel phase difference mode flag, and this can be applied to the downmix signal and upmixed to a plurality of channel signals.

  FIG. 2 is a block diagram illustrating a signal processing apparatus according to an embodiment of the present invention. Referring to FIG. 2, the signal processing apparatus 200 includes a downmixing unit 210, a spatial information generation unit 220, an information acquisition unit 230, and an upmixing unit 240.

  The downmixing unit 210 can receive a plurality of channel signals and generate a downmix signal (DMX). The multi-channel signal may be a signal having three or more channels, or a signal having a mono or stereo channel. The downmixing unit 210 can generate a downmix signal having a smaller number of channels than the number of channels of the plurality of channel signals by downmixing the plurality of channel signals.

  As described with reference to FIG. 1, the spatial information generation unit 220 generates spatial information for upmixing a downmix signal later by a decoder, and the spatial information can indicate attributes of a plurality of channel signals. As described above, the spatial information can include an inter-channel level difference value, an inter-channel correlation value, an inter-channel phase difference value, and the like. Here, referring to the spatial information generation unit 220 in FIG. The phase difference value will be specifically described.

  The spatial information generation unit 220 includes an IPD usage determination unit 221, an IPD value measurement unit 222, an IPD mode flag generation unit 223, and an IPD encoding flag generation unit 224. The IPD usage determining unit 221 can determine whether or not to include a phase difference (IPD) value between channels in the spatial information, and in particular, a characteristic of a plurality of channel signals, a ratio between the channel phase difference value and the channel level difference value. Whether to include an inter-channel phase difference value or not can be determined.

  For example, when the multi-channel signal is an audio signal, it can be determined that the inter-channel phase difference value is included in the spatial information. Details thereof will be described later.

  When the IPD usage determining unit 221 determines to use the inter-channel phase difference value, the IPD value measuring unit 222 measures the phase difference between the two channels from the plurality of channel signals input to the spatial information generating unit 200. The measured phase difference may be a phase and / or an angle, a time difference, or an index value corresponding to the angle or time difference. In the signal, the phase and the time difference are closely related, and details thereof will be described later with reference to FIG.

  The IPD mode flag generation unit 223 generates the inter-channel phase difference mode flag (bsPhaseMode) described above with reference to FIG. That is, it indicates whether an inter-channel phase difference value is used in a frame, where the frame may be a current frame including an inter-channel phase difference value. Therefore, the inter-channel phase difference mode flag can be variably present for each frame. In particular, when the inter-channel phase difference encoding flag indicates that the inter-channel phase difference value is not used in all frames of spatial information, the inter-channel phase difference mode flag may not be included in the frame. The inter-channel phase difference mode flag can have a value of 0 or 1.

  The IPD coding flag generation unit 224 generates an inter-channel phase difference encoding flag (bsPhaseCoding) as described with reference to FIG. That is, since an IPD encoding flag indicating whether or not IPD encoding is used in spatial information is generated, an inter-channel phase difference value is set in at least one frame of the partitioned spatial information as shown in FIG. When used, it is natural that the inter-channel phase difference encoding flag represents 1.

  The information acquisition unit 230 receives the spatial information from the spatial information generation unit 220. This spatial information may include an inter-channel phase difference encoding flag (bsPhaseCoding) and an inter-channel phase difference mode flag (bsPhaseMode) in addition to the inter-channel phase difference (IPD) value. The information acquisition unit 230 includes an IPD encoding flag acquisition unit 231, an IPD mode flag acquisition unit 232, and an IPD value acquisition unit 233. The IPD encoding flag acquisition unit 231 acquires an inter-channel phase difference encoding flag indicating whether or not an inter-channel phase difference value is used in at least one frame of all the spatial information frames from the spatial information header. To do. The meaning of the inter-channel phase difference encoding flag is as shown in Table 1 above.

  The IPD mode flag acquisition unit 232, based on the inter-channel phase difference encoding flag, indicates whether or not the inter-channel phase difference value is used in the frame from the spatial information frame. The inter-phase phase difference mode flag (bsPhaseMode) To get. In particular, when the inter-channel phase difference encoding flag indicates that the inter-channel phase difference value is used (bsPhaseCoding = 1), the IPD mode flag acquisition unit 232 can acquire the inter-channel phase difference mode flag.

  The IPD value acquisition unit 233 can acquire the inter-channel phase difference value from the spatial information based on the inter-channel phase difference mode flag. This inter-channel phase difference value can exist for each parameter band. The parameter band in the present specification means at least one sub-band including the same inter-channel phase difference value, which will be described later with reference to FIGS.

  The up-mixing unit 240 can generate the multi-channel signal by applying the inter-channel phase difference value acquired from the information acquisition unit 230 to the downmix signal input from the down-mixing unit 210. Here, upmix refers to applying an upmixing matrix in order to generate a larger number of channel signals than channels of a downmix signal, and an upmixed signal is applied with an upmixing matrix. Refers to the signal. Therefore, the multi-channel signal is a signal having a larger number of channels than the downmix signal. Further, the upmixed signal may refer to the signal itself to which the upmixing matrix is applied, or may be a QMF domain signal generated to have a plurality of channels by applying the upmixing matrix. Alternatively, it may be a final signal obtained by converting the QMF domain signal into a signal on the time domain.

  As described above, the signal processing apparatus and method according to the present invention uses the inter-channel phase difference value based on the inter-channel phase difference encoding flag and the inter-channel phase difference mode flag, so that The reverberation that is difficult to restore with the correlation value is restored, and the localization of the sound image can be made accurate.

  FIG. 3 is a graph showing the relationship between phase and time in a signal. The left graph of FIG. 3 shows the signal on the phase-amplitude region. (A) The signal is a signal input without phase change, and (b) the signal indicates a signal delayed in phase by π / 2 from (a) signal.

  On the other hand, the right graph of FIG. 3 shows the signals on the time-amplitude region, and shows the (a) ′ and (b) ′ signals corresponding to the (a) and (b) signals of the left graph. That is, the signal (b) which is a signal delayed in phase by π / 2 from the signal (a) is the same as the signal (b) which is a signal input 33 ms behind the signal (a) ′ in time. be able to. Thus, phase-time has a close relationship in a signal, and these have the same effect even when converted into values corresponding to each other.

  FIG. 4 is a block diagram specifically illustrating the IPD value measurement unit and the IPD value acquisition unit of FIG. The IPD measurement unit 410 includes an IPD value measurement unit 411, an IPD quantization unit 412, and a quantization mode flag generation unit 413. The IPD value measurement unit 411 measures inter-channel phase difference information from the input multiple channel signals. As described above, the phase difference value between channels may be a phase angle, a time delay value, or an index value corresponding to these.

  The IPD quantization unit 412 quantizes the inter-channel phase difference value measured by the IPD value measurement unit 411. The IPD quantization unit 412 may further include a detailed structure that can quantize the inter-channel phase difference value using different methods according to the quantization interval. For example, a first quantization unit (not shown) can quantize an inter-channel phase difference value using a fine quantization interval (fine interval), and a second quantization unit (not shown) can perform coarse quantization. An inter-channel phase difference value can be quantized using an interval (coarse interval).

  Further, the IPD quantization mode flag generation unit 413 can generate a quantization mode flag (quant_mode_flag) indicating a method for quantizing the inter-channel phase difference value. Specifically, the quantization mode flag can indicate whether or not the inter-channel phase difference value is quantized using a fine interval or a coarse interval.

  The inter-channel phase difference value acquisition unit (IPD value acquisition unit) 420 includes an IPD quantization mode flag acquisition unit 421, a first inverse quantization unit 422, a second inverse quantization unit 423, and an inverse quantization IPD value acquisition unit 424. Including.

  First, the quantization mode flag acquisition unit 421 acquires a quantization mode flag (quant_mode_flag) indicating the quantization method applied to the inter-channel phase difference value from the spatial information received from the encoder. The meaning of this quantization mode flag is shown in Table 3 below.

  When the quantization flag is 0 (IPD_quant_flag = 0), the first inverse quantization unit 422 receives the interchannel phase difference value and dequantizes the interchannel phase difference value at a coarse interval. On the other hand, when the quantization flag is 1 (IPD_quant_flag = 1), the second inverse quantization unit 423 receives the inter-channel phase difference value and de-quantizes the inter-channel phase difference value at fine intervals. Next, the dequantized IPD value acquisition unit 424 can acquire the dequantized inter-channel phase difference value from the first dequantization unit 422 or the second dequantization unit 423.

  FIG. 5 is a diagram illustrating a signal processing device 500 that compensates for phase restoration of a plurality of channel signals using a phase shift flag. The signal processing device 500 includes a global band IPD value determination unit 510, a signal correction unit 520, a downmixing unit 530, a spatial information generation unit 540, a spatial information acquisition unit 550, an upmixing unit 560, and a phase shift unit 570.

  Global band IPD value determination section 510 first receives a multi-channel signal. The multi-channel signal may be a signal in which phases of one or more channels do not match, a stereo signal, or a signal having three or more channels. Global band IPD value determining section 510 determines a phase shift flag indicating the degree of phase shifted to match the phases of the input multiple channel signals from the multiple channel signals.

  This phase shift flag may be flag information indicating that the phase of a plurality of channel signals has shifted, or in addition to the flag information, information on the phase shift and the channel on which the phase is shifted. Information related to the phase shift may be further included, such as a signal, a frequency band where the phase shift occurs, and time information corresponding to the phase shift.

  First, when the phase shift flag indicates only flag information, the phase of the multi-channel signal can be shifted using a fixed value. For example, if the multi-channel signal is a stereo signal, the left and right channels of the stereo signal can be reduced by decreasing the right channel phase by π / 2 or increasing the left channel phase by π / 2. The plurality of channel signals can be generated by shifting the phase so that the two are orthogonal to each other. The phase shift is not limited to π / 2, and a multi-channel signal can be generated by shifting the phase so that the left and right channels are orthogonal.

  Here, the phase to be shifted can be equally applied to all frequency bands of a plurality of channel signals. In addition, information that the phase of one or more channels of a plurality of channel signals is corrected by π / 2, in particular, information regarding the phase to be corrected or the phase shifted to be orthogonal is not transmitted separately. The information already set at the decoder end can be used later, but is not limited to this.

  In this way, the amount of information transmission can be reduced compared to the case where inter-channel phase difference values are transmitted to a plurality of parameter bands, respectively, which can occur when the inter-channel phase difference values are applied to each parameter band. The problem of phase difference can be prevented.

  On the other hand, the phase shift flag can further include detailed information regarding the phase shift in addition to the flag information. The detailed information may include phase shift information, information on a channel signal whose phase is shifted, frequency band and time information where the phase shift occurs, and the like.

  In addition, the phase shift flag can variably indicate the degree to which the phase of a plurality of channel signals is shifted for each frame. When this phase shift flag includes only flag information, the phase is shifted for each frame. It can indicate whether it has been moved or not. Further, when the phase shift flag includes flag information and detailed information about the shifted phase, the detailed information can variably indicate the degree of phase shift for each subband or parameter band, and can be set within a certain time range. For each, for example, the degree of phase shift at a corresponding time can be variably indicated, such as a frame or a time slot.

Further, the phase shift flag can be used in parallel with the inter-channel phase difference value described with reference to FIGS.
The signal correction unit 520 receives the phase shift flag and the multi-channel signal. The multi-channel signal can be generated as a multi-channel signal whose phase is shifted by correcting the phase of one or more channels using a phase shift flag. As described above, in the present specification, a method of correcting the phase of a plurality of channel signals so as to match the phases of the plurality of channel signals that do not match in phase, and generating a phase shift flag related thereto As described above, the phase of at least one channel included in a plurality of channel signals having the same phase is intentionally shifted to obtain an out-phase signal, and a phase shift flag related thereto Can also be generated.

  The downmixing unit 530 generates a downmix signal by receiving and downmixing a plurality of channel signals whose phases are shifted. The multi-channel signal is not limited to a stereo signal, and can be a signal having three or more channels. When the multi-channel signal is a stereo signal, the downmix signal may be a mono signal, and when the multi-channel signal is a signal having three or more channels, the downmix signal is a stereo signal or the number of channels of the multi-channel signal. It may be a signal having a smaller number of channels.

  Spatial information generation section 540 can receive a plurality of channel signals whose phases are shifted and generate spatial information indicating attributes of the plurality of channel signals. Spatial information is used for upmixing a downmix signal into a plurality of phase-shifted channel signals by a decoder, and can include interchannel level difference information, interchannel correlation values, and channel prediction coefficients. Therefore, the spatial information generated by the spatial information generation unit 540 of the present invention may not be the same as the spatial information generated from a plurality of channel signals whose phases are not shifted.

  In addition, the bitstream generation unit (not shown) can generate one bitstream including spatial information and a phase shift flag, and one bitstream including a downmix signal, spatial information, and a phase shift flag Can also be generated.

  The information acquisition unit 550 acquires spatial information and a phase shift flag for upmixing the downmix signal from the bitstream.

  The up-mixing unit 560 has the same configuration and function as the up-mixing unit 240 of FIG. The upmixed multi-channel signal may be an upmixed signal to which an upmixing matrix is applied, an upmixed signal generated on the QMF domain, or on the time domain. The final output signal may be used as the signal. Further, the signal upmixed by the upmixing unit 560 may be a multi-channel signal whose phase is shifted by the signal correction unit 520.

  The phase shift unit 570 receives the phase shift flag from the spatial information acquisition unit 550 and the phase-shifted multi-channel signal from the upmixing unit 560. Thereafter, a phase shift flag is applied to the plurality of channel signals whose phases are shifted, thereby restoring the phase of the shift of the plurality of channel signals.

  As described above, the phase shift flag can include only flag information indicating whether or not the phase of at least one channel of the multi-channel signal has shifted, and further includes detailed information related to the phase shift. Can be included. When only the flag information is included, the phase shifting unit 570 determines whether to shift the phase of the upmixed multiple channel signal based on the flag information, and uses the fixed value to determine the multiple channel signal. The phase of at least one of the channels can be shifted. At this time, the fixed value may be a value already set by the decoder and may not be separately measured and transmitted by the encoder. For example, one or more channels of a multi-channel signal may be transmitted by π / 2. It can be increased or decreased. In this case, π / 2 can be equally applied to all frequency bands of a plurality of channel signals. Further, since the phase shift flag can be determined for each frame, it is possible to variably indicate for each frame whether the phase of the plurality of channel signals is shifted or whether the phase is shifted.

  FIG. 6 is a diagram illustrating a signal processing apparatus 600 according to another embodiment of the present invention that compensates for phase restoration of a plurality of channel signals using a phase shift flag. Referring to FIG. 6, the signal processing apparatus 600 includes a downmixing unit 610, a spatial information generation unit 620, a signal correction unit 630, a global band IPD value acquisition unit 640, a phase shift unit 650, and an upmixing unit 660.

  The downmixing unit 610 generates a downmix signal DMX by downmixing the input multiple channel signals. Here, the multi-channel signal is a signal that has not been shifted in phase and has been input.

  The spatial information generation unit 620 can generate spatial information that represents the attributes of the input multiple channel signals. This spatial information has the same configuration and function as the spatial information in FIG. 5, except that it is generated from a plurality of channel signals whose phases are not shifted. Meanwhile, the spatial information generation unit 620 includes a global band IPD value determination unit 621. The global band IPD value determination unit 621 has the same configuration and function as the global band IPD value determination unit of FIG. Is omitted.

  The signal correction unit 630 corrects the phase of at least one channel of the downmix signal output from the downmixing unit 610 based on the phase shift flag output from the global band IPD value determination unit 621, and corrects the phase. The generated downmix signal DMX ′ can be generated.

  Next, the global band IPD value acquisition unit 640 acquires a phase shift flag, and the phase shift unit 650 determines at least one channel of the input modified downmix signal MDX ′ based on the phase shift flag. By restoring by shifting the phase, it can be restored as the downmix signal DMX. At this time, the downmix signal DMX whose phase is shifted by the phase shifting unit 650 may be the same as the signal DMX input to the signal correcting unit 630.

  The upmixing unit 660 can receive the spatial information from the spatial information generation unit 620 and the downmix signal DMX from the phase shift unit 650 and decode the multi-channel signal.

  On the other hand, the signal processing method and apparatus of the present invention performs various methods for removing noise temporarily generated at the point where the inter-channel phase difference value fluctuates. For this, refer to FIGS. To explain.

  First, FIG. 7 is a conceptual diagram showing parameter time slots. The signal can be shown in the time-frequency domain. Referring to FIG. 7, the parameter set is applied to two time slots (time slot 2, time slot 4) of N time slots in one frame. The entire frequency range of the signal is divided into five parameter bands. Therefore, the unit of the time axis can be a time slot, and the unit of the frequency axis can be a parameter band (pb). The parameter band is a subband on at least one frequency region including the same inter-channel phase difference value. It can be. Of the time slots, a time slot defined such that a parameter set is applied, that is, an inter-channel phase difference value is applied, is referred to as a parameter time slot.

  FIG. 8 is a schematic diagram illustrating a method of correcting (smoothing) the inter-channel phase difference value according to still another embodiment of the present invention. Referring to FIG. 8, the lower left graph is a graph showing the inter-channel phase difference value included in the second parameter band in the parameter time slot. The inter-channel phase difference value applied to the parameter time slot [0] may be 10 °, and the inter-channel phase difference value applied to the parameter time slot [1] may be 60 °. Thus, unexpected noise may occur at the point where the phase difference value between channels fluctuates greatly. Therefore, the signal processing method and apparatus of the present invention uses the inter-channel phase difference value applied to the preceding parameter time slot to smooth the inter-channel phase difference value applied to the current parameter time slot. The effect that noise can be removed is produced.

  Referring again to FIG. 8, if the current parameter time slot is the parameter time slot [1], the preceding parameter time slot can be the parameter time slot [0]. As shown in the lower right graph of FIG. 8, the inter-channel phase difference value (60 °) applied to the current parameter time slot is changed to the inter-channel phase difference value (10 °) applied to the preceding parameter time slot. So that the inter-channel phase difference value of the current parameter time slot that has been smoothed and modified can have a value less than 60 °.

  A time slot where the parameter set is not defined to be applied, for example by interpolating and / or duplicating the smoothed inter-channel phase difference value applied to the current and / or preceding parameter time slots, e.g. , Time slot 1, time slot 3,..., Time slot N can be obtained.

  FIG. 9 is a block diagram showing a signal processing apparatus according to still another embodiment of the present invention shown in FIG. 9, the downmixing unit 910, the IPD usage determining unit 921, the IPD value measuring unit 922, the IPD mode flag generating unit 923, the IPD encoding flag generating unit 924, the IPD encoding flag acquiring unit 931, the IPD mode flag acquiring unit 932, The IPD value acquisition unit 933 and the upmixing unit 940 are the downmixing unit 210, the IPD usage determination unit 221, the IPD value measurement unit 222, the IPD mode flag generation unit 223, the IPD encoding flag generation unit 224, and the IPD encoding in FIG. Since it has the same configuration and function as the flag acquisition unit 231, the IPD mode flag acquisition unit 232, the IPD value acquisition unit 233, and the upmixing unit 240, detailed description thereof is omitted.

  The information acquisition unit 930 can further include an IPD value smoothing unit 934. The IPD value smoothing unit 934 can correct the inter-channel phase difference value applied to the current parameter time slot using the inter-channel phase difference value applied to the preceding parameter time slot. This can prevent noise that may occur when the inter-channel phase difference value applied to the current parameter time slot is significantly different from the inter-channel phase difference value applied to the preceding parameter time slot.

  Further, the IPD value smoothing unit 934 can generate a phase angle representing an angle between two channels of a plurality of channels from the inter-channel phase difference value applied to the current parameter time slot. Can be corrected using the phase angle of the preceding parameter time slot. The corrected phase angle is output to the upmixing unit 640 later. The corrected phase angle may be applied to the downmix signal by the upmixing unit 640 to generate a multi-channel signal.

  In the following, various embodiments of the present invention for solving problems that occur when signals are generally encoded using inter-channel level differences and inter-channel correlation values without using inter-channel phase difference values. Will be described.

  FIG. 10 is a conceptual diagram illustrating a problem to be solved by a signal processing method and apparatus according to another embodiment of the present invention.

  In many signal coding apparatuses, especially in PS used in EAAC + or HE AAC Plus and USAC standardized by 3GPP and MPEG, the inter-channel phase difference value and the inter-channel correlation value are not used. Only information is used as spatial information. This is because a phase wrapping phenomenon that may occur when generating an inter-channel phase difference value and a deterioration in sound quality that occurs when synthesizing the inter-channel phase difference value.

  However, when a multi-channel signal is encoded without using the inter-channel phase difference value, a serious problem may occur in sound image localization. In other words, there is no problem with a signal encoded mainly using the interchannel level difference value, such as a signal recorded with two or more microphones arranged adjacent to each other, but the two or more microphones are separated from each other. If the signals are arranged and recorded in this manner, an accurate sound image localization cannot be performed when a plurality of channel signals are decoded unless the phase difference value between channels is used.

  FIG. 10A shows the result when a stereo signal having only an inter-channel phase difference value is decoded without an inter-channel phase difference value. Referring to FIG. 10A, the original signal is a signal formed only by the phase difference value between channels (IPD = 30 °). However, if decoding is performed using only the inter-channel level difference value and the inter-channel correlation value, there is no effective spatial information (IPD value), so the sound image of the decoded signal (synthesized signal) is a stereo signal regardless of the original signal. It will be located in the center of In this case, the inter-channel correlation value affects the sound image localization, but accurate sound image localization is impossible without the inter-channel phase difference value.

  On the other hand, FIG. 10B shows a result in the case of decoding a stereo signal in which an inter-channel phase difference value and an inter-channel level difference value are mixed without an inter-channel phase difference value. Referring to FIG. 10B, the sound image localization of the stereo signal is determined as a linear sum of the adjustment angle determined from the inter-channel phase difference value and the adjustment angle determined from the inter-channel level difference value. When the original stereo signal has a larger value by 8 dB than the right signal and is faster by 0.5 ms as shown in FIG. 10B, the level difference of 8 dB causes the sound image to be centered. Can be moved 20 ° to the left side (-20 °), and a time difference of 0.5 ms (same as the phase difference value between channels of -10 °) moves the sound image 10 ° (−10 °) to the left. It has the feature of being able to. Therefore, the original stereo signal is present at the -30 ° position. However, if the signal is decoded without using the inter-channel phase difference value, the sound image of the decoded signal is located at −20 °, so that accurate sound image localization is impossible.

  Therefore, the signal processing method and apparatus according to still another embodiment of the present invention further provides various methods for solving the problem in sound image localization.

  11 and 12 are block diagrams illustrating a signal processing method and apparatus according to another embodiment of the present invention.

  First, based on the ratio between the inter-channel phase difference information and the inter-channel level difference value of a plurality of channel signals, the inter-channel phase difference information can be used only when a certain condition is satisfied. As illustrated in FIG. 11, the signal processing device 1100 includes a downmixing unit 1110, a spatial information generation unit 1120, an information acquisition unit 1130, and an upmixing unit 1140.

  The downmixing unit 1110 and the upmixing unit 1140 have the same configuration and function as the downmixing unit 210 and the upmixing unit 240 in FIG. The spatial information generation unit 1120 includes an ILD value measurement unit 1121, an IPD value measurement unit 1122, an information determination unit 1123, and an IPD flag generation unit 1124. The ILD value measuring unit 1121 and the IPD value measuring unit 1122 measure an inter-channel level difference value and an inter-channel phase difference value from a plurality of channel signals. The inter-channel level difference value and the inter-channel phase difference value can be measured for each parameter band.

  The information determination unit 1123 uses the measured inter-channel level difference value and inter-channel phase difference value to calculate how much the sound image is localized, and the inter-channel level difference value and the inter-channel phase difference value are determined as the overall sound image localization. It is determined to use the inter-channel phase difference value only when the ratio of the inter-channel phase difference value is higher. For example, when the measured inter-channel phase difference value corresponds to + 20 ° and the measured inter-channel level difference value corresponds to 4 dB and a value shifted by + 10 °, the whole sound image localization (20 ° + 10 ° = The degree of contribution of the inter-channel phase difference value and the inter-channel level difference value at 30 ° can be 20/30 and 10/30, respectively. In this case, since the inter-channel phase difference value can be said to be relatively important, the information determination unit 1123 can determine that the inter-channel phase difference value is further used.

  If the information determination unit 1123 further determines that the inter-channel phase difference value is to be used, the IPD flag generation unit 1124 can generate an inter-channel phase difference value flag indicating that the inter-channel phase difference value is used.

  Meanwhile, the information acquisition unit 1130 can include an IPD flag acquisition unit 1131 and an IPD value acquisition unit 1132. The IPD flag acquisition unit 1131 acquires an inter-channel phase difference value flag and stores the inter-channel phase difference value in the spatial information. It is determined whether or not is included. When the inter-channel phase difference value flag is 1, the IPD value acquisition unit 1132 is activated to acquire the inter-channel phase difference value from the spatial information. Thereafter, the up-mixing unit 1140 uses the spatial information including the inter-channel phase difference value to decode the multiple channel signal by up-mixing the down-mix signal, compared to the case where the inter-channel phase difference value is not used. Accurate sound image localization of multi-channel signals becomes possible. Also, it is possible to increase the coding efficiency by transmitting the inter-channel phase difference value only when a certain condition is satisfied.

  Second, the inter-channel phase difference value can be replaced with an equivalent inter-channel level difference value, and vice versa. In this case, the inter-channel phase difference value and the inter-channel level difference value necessary for sound image localization may vary depending on the frequency, so a database defined for each frequency band is referred to.

  FIG. 12 shows a signal processing apparatus 1200 that is used by changing the inter-channel phase difference value to an equivalent inter-channel level difference value. The signal processing device 1200 includes an ILD value measurement unit 1210, an IPD value measurement unit 1220, an information determination unit 1230, an IPD value conversion unit 1240, and an ILD value correction unit 1250.

  Since the ILD value measuring unit 1210, the IPD value measuring unit 1220, and the information determining unit 1230 have the same configurations and functions as the ILD value measuring unit 1121, the IPD value measuring unit 1122, and the information determining unit 1130 in FIG. Description is omitted. When the information determination unit 1130 determines to use the inter-channel phase difference value, the measured inter-channel phase difference value is input to the IPD value conversion unit 1240.

  The IPD value conversion unit 1240 uses the database to convert the inter-channel phase difference value measured in the corresponding frequency band into an equivalent inter-channel level difference value ILD ′. Next, the ILD value correcting unit 1250 is corrected by adding the inter-channel level difference value ILD ′ obtained by converting the inter-channel phase difference value to the inter-channel level difference value ILD input from the ILD value measuring unit 1210. An inter-channel level difference value ILD ″ is calculated.

  As described above, when the inter-channel phase difference value is converted into an equivalent inter-channel level difference value, the inter-channel phase difference value is received, including HE AAC Plus used in 3GPP and MPEG, or PS used in the USAC standard. Even when using an existing signal processing apparatus and method that does not allow the signal, the phase difference value between channels can be reflected, and the signal can be decoded as a signal with improved reverberation and sound image localization.

  Third, by applying the inter-channel phase difference value in common to at least one continuous frame, accurate sound image localization can be realized and encoding efficiency can be increased. In this specification, an inter-channel phase difference value used in several consecutive frames is referred to as a global frame inter-channel phase difference value (global frame IPD value). FIG. 13 is a conceptual diagram illustrating a concept in which a phase difference value between global frame channels is used according to still another embodiment of the present invention. Referring to FIG. 13, numerals 0 to 13 represent frames, shaded frames are frames that use interchannel phase difference values, and frames that are not are frames that do not use interchannel phase difference values. These can be determined based on the inter-channel phase difference mode flag (bsPhaseMode) described herein.

  As shown in FIG. 13, when only the frames 1 to 3 and the frames 8 to 12 use the inter-channel phase difference value, the inter-channel phase difference value is not transmitted for each frame, and the representative value is calculated and the inter-channel phase value is calculated. Apply the same to consecutive frames determined to apply the phase difference value, only the first frame of the consecutive frames contains the global frame channel phase difference value, and each frame contains the global frame channel phase difference value A global frame channel phase difference flag indicating whether or not is used can be included. The meaning of the global frame channel phase difference flag is as shown in Table 4 below.

  For example, based on the global frame channel phase difference flag, frame 0 does not use the global frame channel phase difference value, and frame 1 uses the global frame channel phase difference value. Accordingly, the frame 1 includes global frame channel phase difference values, and the same global frame channel phase difference value can be applied to the frames 1 to 3. Similarly, the frame 8 includes global frame channel phase difference values, and the same global frame channel phase difference value can be applied to the frames 8 to 12.

  FIG. 14 is a diagram illustrating a signal encoding apparatus 1400 according to an embodiment of the present invention using the global frame channel phase difference value of FIG. Referring to FIG. 14, the signal encoding apparatus 1400 includes a preceding frame global frame IPD value receiving unit 1410, a global frame IPD value calculating unit 1420, a global frame IPD flag generating unit 1430, a global frame IPD flag acquiring unit 1440, and a global frame IPD. A value acquisition unit 1450 and an upmixing unit 1460 are included.

  The preceding frame global frame IPD value receiving unit 1410 receives the global frame channel phase difference value of the preceding frame. For example, when the current frame is the first frame including the global frame channel phase difference value, there is no global frame channel phase difference value of the received previous frame. On the other hand, when the current frame is the second or subsequent frame among consecutive frames including the global frame channel phase difference value, the global frame channel phase difference value can be received from the preceding frame.

  When the current frame is the first frame including the global frame channel phase difference value, that is, when there is no global frame channel phase difference value of the preceding frame, the global frame IPD value calculation unit 1420 The interphase difference value can be calculated. The global frame inter-channel phase difference value of the current frame may be an average of the inter-channel phase difference values of consecutive frames in which the inter-channel phase difference value is used.

  The global frame IPD flag generation unit 1430 generates a global frame IPD flag (global_frame_IPD_flag) indicating whether or not the global frame inter-channel phase difference value (IPD) is used in the current frame.

  Thereafter, the global frame IPD flag acquisition unit 1440 acquires the global frame channel phase difference value, and the global frame IPD value acquisition unit 1450 outputs the global frame channel of the preceding frame output from the preceding frame global frame IPD value receiving unit 1410. The inter-phase difference value or global frame inter-channel phase difference value of the current frame output from the global frame IPD value calculation unit 1420 can be acquired. Preferably, the global frame IPD value acquisition unit 1450 acquires the global frame inter-channel phase difference value of the preceding frame when the current frame is the first frame among consecutive frames to which the inter-channel phase difference value is applied. To do. If the current frame is the second and subsequent frames, the calculated global frame inter-channel phase difference value of the current frame can be obtained.

  The upmixing unit 1460 generates a multi-channel signal by applying the global frame channel phase difference value to the downmix signal.

  Fourth, the inter-channel correlation value can be adjusted so that the decoded multi-channel signal has reverberation most similar to the multi-channel signal input to the encoder. Referring back to FIG. 10B, when a signal is decoded using the inter-channel phase difference value and the inter-channel correlation value, there is a problem that reverberation is exaggerated compared to the original signal. Reverberation refers to the effect that the ambience causes the signal to exist in a wider or narrower space. Exaggeration of reverberation in this specification means that the original signal was recorded in a narrow recording room, but was decoded. Sometimes it sounds like it was recorded in a large auditorium.

  This type of problem frequently occurs in conventional signal processing methods and devices that do not transmit inter-channel phase difference values, but may also occur when transmitting inter-channel phase difference values.

  FIG. 15 is a block diagram showing a signal processing device 1500 according to still another embodiment of the present invention for solving the above problem. The signal processing device 1500 includes an ICC value measurement unit 1510, an IPD value measurement unit 1520, an ILD value measurement unit 1530, an information determination unit 1540, an ICC value correction unit 1550, an IPD mode flag generation unit 1560, an IPD mode flag acquisition unit 1570, an IPD. A value acquisition unit 1580, an ICC value acquisition unit 1590, and an upmixing unit 1595 are included. The ICC value measuring unit 1510, the IPD value measuring unit 1520, and the ILD value measuring unit 1530 can measure an inter-channel correlation value, an inter-channel phase difference value, and an inter-channel level difference value from a plurality of channel signals, respectively.

  Information determination unit 1540 and IPD mode flag generation unit 1560 have the same configurations and functions as information determination unit 1123 and IPD flag generation unit 1124 in FIG. Further, the information determination unit 1540 calculates the ratio of the measured inter-channel level difference value and inter-channel phase difference value in the overall sound image localization, and only when the ratio of the inter-channel phase difference value is higher The IPD mode flag generation unit 1560 determines to use the interphase phase difference value, and generates an interchannel phase difference mode flag indicating whether or not to use the interchannel phase difference value.

  When the information determining unit 1540 determines that the inter-channel phase difference value is used, the ICC value correcting unit 1550 can correct the inter-channel correlation value input from the ICC value measuring unit 1510. Preferably, the parameter band using the inter-channel phase difference value may not include the measured inter-channel correlation value. In order to solve the problem that reverberation is exaggerated, the magnitude of the value represented by the inter-channel correlation value can be modified and used.

  The IPD mode flag acquisition unit 1570 and the IPD value acquisition unit 1580 also have the same configuration and functions as the IPD flag acquisition unit 1131 and the IPD value acquisition unit 1132 in FIG.

  When the IPD mode flag acquisition unit 1570 indicates that the inter-channel phase difference flag indicates that the inter-channel phase difference value is used, the ICC value acquisition unit 1590 receives the corrected inter-channel correlation value from the ICC value correction unit 1550. To do.

  The upmixing unit 1595 can generate a multi-channel signal by applying the interchannel phase difference value and the corrected interchannel correlation value to the received downmix signal. Therefore, it is possible to prevent the signal from being distorted by exaggerating the reverberation due to the inter-channel correlation value in the signal processing method and apparatus using the inter-channel phase difference value.

  Fifth, it is possible to use the feature that the importance of the phase difference value between channels is larger as the signal has a simple sound source.

  FIG. 16 is a block diagram illustrating a signal processing apparatus 1600 according to still another embodiment of the present invention. The signal processing apparatus 1600 may include an input signal classification unit 1610, an IPD value measurement unit 1620, an IPD flag generation unit 1630, an IPD flag acquisition unit 1640, an IPD value acquisition unit 1650, and an upmixing unit 1660.

  The input signal classification unit 1610 determines whether the input signal is a pure speech signal including only speech, a music signal, or a signal in which a music signal and a speech signal are mixed. Preferably, the input signal classifier 1610 may include an SAD (Sound Activity Detector) or an SMC (Speech and Music Classifier).

  The IPD value measuring unit 1620 measures the inter-channel phase difference value only when the input signal classifying unit 1610 determines that the input signal is a signal including only an audio signal. The IPD flag generation unit 1630, the IPD flag acquisition unit 1640, the IPD value acquisition unit 1650, and the upmixing unit 1660 include the IPD flag generation unit 1124, the IPD flag acquisition unit 1131, the IPD value acquisition unit 1132, and the upmixing unit 1140 in FIG. Since it has the same structure and function, the detailed description is abbreviate | omitted.

  A mixed signal in which a music signal or a sound signal including various signals is mixed with a music signal does not use an inter-channel phase difference value, but a certain level of sound image localization is obtained using an inter-channel level difference value and an inter-channel correlation value. Is possible. However, in the case of a simple sound source such as an audio signal, since the importance of the inter-channel phase difference value is relatively high, accurate sound image localization is impossible without the inter-channel phase difference value. Therefore, when the input signal is classified as an audio signal by the input signal classification unit 1610, it can be decoded as a multi-channel signal that is localized more accurately by using the inter-channel phase difference value.

  FIG. 17 is a diagram illustrating a signal processing apparatus 1700 according to still another embodiment of the present invention. The signal processing apparatus 1700 includes a multi-channel encoding unit 1710, a bandwidth extension signal encoding unit 1720, and an audio signal encoding. Unit 1730, audio signal encoding unit 1740, audio signal decoding unit 1750, audio signal decoding unit 1760, bandwidth extension signal decoding unit 1770, and multi-channel decoding unit 1780.

  First, a downmix signal generated by downmixing a plurality of channel signals in the plurality of channel encoding unit 1710 is hereinafter referred to as an all-band downmix signal, and a high-frequency band signal is removed from the all-band downmix signal. A downmix signal that only exists is called a low-frequency band downmix signal.

  The multi-channel encoding unit 1710 receives a signal having a plurality of channels (hereinafter, “multi-channel”). The received multi-channel signal is downmixed to generate an all-band downmix signal, while spatial information corresponding to the multichannel signal is generated. This spatial information may include channel level difference information, channel prediction coefficients, inter-channel correlation values, downmix gain information, and the like.

  The multi-channel encoder 1710 according to an embodiment of the present invention determines whether to use an inter-channel phase difference value, measures the inter-channel phase difference value, and determines whether to use the inter-channel phase difference value in a frame. Among the inter-channel phase difference mode information and all frames, inter-channel phase difference coding information indicating whether or not there is a frame using the inter-channel phase difference value can be generated and transmitted together with the mix information. Since this process is as described with reference to FIGS. 1 to 4, the specific description thereof is omitted.

  On the other hand, although not shown in the multi-channel encoding unit 1710, the signal processing apparatus described with reference to FIGS. 1 to 4 or the signal according to another embodiment of the present invention described with reference to FIGS. An encoding device in the processing device may be included.

  The bandwidth extension signal encoding unit 1720 can receive the all-band downmix signal and generate extension information corresponding to the high-frequency band signal of the all-band downmix signal. This extended information is information for restoring the low-frequency band downmix signal from which the high-frequency band has been removed at the decoder end to the full-band downmix signal later, and can be transmitted together with the spatial information.

  Further, it is determined whether the downmix signal is encoded by the audio signal encoding method or the audio signal encoding method based on the characteristics of the signal, and this encoding method is determined. Mode information is generated (not shown). Here, the audio encoding method may use MDCT (modified discrete cosine transform), but the present invention is not limited to this. The speech coding scheme may conform to the AMR-WB (Adaptive Multiple Rate Wideband) standard, but the present invention is not limited to this.

  The audio signal encoding unit 1730 uses the extension information input from the bandwidth extension signal encoding unit 1720 and the entire band downmix signal to encode the low frequency band downmix signal from which the high frequency region is removed into an audio signal encoding method. It encodes by.

  The signal encoded by the audio signal encoding method may be an audio signal or a signal in which a part of the audio signal is included in the audio signal. Also, the audio signal encoding unit 1730 can be a frequency domain encoding unit.

  The audio signal encoding unit 1740 uses the extension information and the entire band downmix signal input from the bandwidth extension signal encoding unit 1720 to convert the low frequency band downmix signal from which the high frequency region is removed into an audio signal encoding method. It encodes by.

  The signal encoded by the audio signal encoding method may be an audio signal or a signal in which an audio signal is partly included in the audio signal. Also, the audio signal encoding unit 1740 can further use a linear predictive coding (LPC) method. If the input signal has high redundancy on the time axis, it can be modeled by linear prediction that predicts the current signal from the past signal, but in this case, the use of the linear prediction encoding scheme may increase the encoding efficiency. it can. On the other hand, the audio signal encoding unit 1740 may be a time domain encoding unit.

  The audio signal decoding unit 1750 decodes the signal using an audio signal encoding method. The signal input to the audio signal decoding unit 1750 and decoded may be an audio signal or a signal in which a part of the audio signal is included in the audio signal. Also, the audio signal decoding unit 1750 can include a frequency domain decoding unit, and can use IMDCT (Inverse Modified Discrete Cosine Transform).

  The audio signal decoding unit 1760 decodes the signal using an audio signal encoding method. The signal decoded by the audio signal decoding unit 1760 may be an audio signal or a signal in which a part of the audio signal is included in the audio signal. Also, the audio signal decoding unit 1760 can include a time domain decoding unit, and can further use a linear predictive coding method.

  The bandwidth extension signal decoding unit 1770 receives the low frequency band downmix signal and the extension information, which are the signal decoded by the audio signal decoding unit 1750 or the signal decoded by the audio signal decoding unit 1760, and performs the encoding process. A full-band downmix signal in which a signal corresponding to the removed high frequency region is restored is generated.

  The full-band downmix signal can be generated using all of the low-frequency band downmix signal and the extended information, but can also be generated using a part of the low-frequency band downmix signal.

  The multi-channel decoding unit 1780 receives the full-band downmix signal, the spatial information, the inter-channel phase difference value, the inter-channel phase difference mode flag, and the inter-channel phase difference encoding flag, and converts these information into the full-band down-mix signal. A multi-channel signal is generated by application, but a detailed description of this process is the same as described with reference to FIGS.

  As described above, the signal processing method and apparatus according to the present invention effectively reproduces the phase difference or delay difference that is difficult to reproduce by the multi-channel decoder by generating the multi-channel signal using the inter-channel phase difference value. Can do.

  18 is a diagram illustrating a schematic configuration of a product in which an IPD encoding flag acquisition unit 1841, an IPD mode flag acquisition unit 1842, an IPD value acquisition unit 1843, and an upmixing unit 1844 are implemented according to an embodiment of the present invention. FIG. 19 is a diagram illustrating a relationship between products in which an IPD encoding flag acquisition unit 1841, an IPD mode flag acquisition unit 1842, an IPD value acquisition unit 1843, and an upmixing unit 1844 according to an embodiment of the present invention are implemented. It is.

  Referring to FIG. 18, the wired wireless communication unit 1810 receives a bit stream using a wired wireless communication method. Specifically, the wired wireless communication unit 1810 may include one or more of a wired communication unit 1811, an infrared communication unit 1812, a Bluetooth unit 1813, and a wireless LAN communication unit 1814.

  The user authentication unit 1820 takes in user information and performs user authentication, and may include one or more of a fingerprint recognition unit 1821, an iris recognition unit 1822, a face recognition unit 1823, and a voice recognition unit 1824. Each of them can capture and convert fingerprint information, iris information, face contour information, and voice information into user information, and determine whether the user information matches the registered user data. Authentication can be performed.

  The input unit 1830 is an input device for a user to input various commands. The input unit 1830 may include one or more of a keypad unit 1831, a touchpad unit 1832, and a remote control unit 1833. It is not limited.

  The signal decoding unit 1840 includes an IPD encoding flag acquisition unit 1841, an IPD mode flag acquisition unit 1842, an IPD value acquisition unit 1843, and an upmixing unit 1844, which have the same configuration as units having the same name in FIG. The detailed description thereof is omitted.

  The control unit 1850 receives an input signal from the input device and controls the overall processes of the signal decoding unit 1840 and the output unit 1860. As described above, when user input, for example, on / off of phase shift of the output signal, input / output of metadata, operation on / off of the signal decoding unit, or the like is input from the input unit 1830 to the control unit 1850. And use it to decode the signal.

  The output unit 1860 is a component that outputs an output signal generated by the signal decoding unit 1840 and may include a signal output unit 1861 and a display unit 1862. If the output signal is an audio signal, the output signal is output from the signal output unit 1861. If the output signal is a video signal, the output signal is output from the display unit 1862. Further, when metadata is input to the input unit 1830, it is displayed on the screen via the display unit 1862.

  FIG. 19 is a diagram illustrating a relationship between a terminal corresponding to the product illustrated in FIG. 18 and a relationship between the terminal and the server. Referring to FIG. 19A, it can be seen that the first terminal 1910 and the second terminal 1920 can perform bidirectional data or bitstream communication via wired wireless communication. Here, the data or the bit stream exchanged via the wired wireless communication may be in the form of the bit stream in FIG. 1 according to the present invention, or the data stream or the bit stream of the present invention described with reference to FIGS. It may be data including a phase shift flag, a global frame channel phase difference value, and the like. Referring to FIG. 19B, the server 1930 and the first terminal 1940 can similarly perform wired wireless communication with each other.

  FIG. 20 is a broadcast signal decoding in which a multi-channel decoding unit including an IPD encoding flag acquisition unit 2041, an IPD mode flag acquisition unit 2042, an IPD value acquisition unit 2043, and an upmixing unit 2044 according to an embodiment of the present invention is implemented. 2 is a diagram illustrating a schematic configuration of an apparatus 2000. FIG.

  Referring to FIG. 20, the demultiplexer 2020 receives data related to the TV broadcast from the tuner 2010. These data are separated by the demultiplexer 2020 and decoded by the data decoder 2030. On the other hand, the data separated by the demultiplexer 2020 can be stored in a storage medium 2050 such as an HDD.

  The data separated by the demultiplexer 2020 is input to a signal decoding unit 2040 including a multi-channel decoding unit 2041 and a video decoding unit 2042, and is decoded as an audio signal and a video signal. The signal decoding unit 2040 includes an IPD encoding flag acquisition unit 2041, an IPD mode flag acquisition unit 2042, an IPD value acquisition unit 2043, and an upmixing unit 2044 according to an embodiment of the present invention, which have the same names in FIG. Since it has the same configuration and function as the unit, detailed description is omitted. The signal decoding unit 2040 decodes the signal using the received inter-channel phase difference value, etc., and when the video signal is input, also decodes and outputs the video signal. Output as a form.

  When the video signal is decoded and the output video signal and metadata are generated, the output unit 2070 displays the output metadata on the screen. The output unit 2070 includes a speaker unit (not shown), and a multi-channel signal decoded using the inter-channel phase difference value output from the signal decoding unit 2040 is received from the speaker unit included in the output unit 2070. Output. The data decoded by the signal decoding unit 2040 can be stored in a storage medium 2050 such as an HDD.

  Meanwhile, the signal decoding apparatus 2000 may further include an application manager 2060 that can receive information from a user and control the received data. The application manager 2060 includes a user interface manager 2061 and a service manager 2062. The user interface manager 2061 controls an interface for receiving information from the user. For example, it is possible to control the typeface of the text displayed on the output unit 2070, the brightness of the screen, the menu configuration, and the like. On the other hand, when the service manager 2062 decodes and outputs the broadcast signal by the signal decoding unit 2040 and the output unit 2070, the service manager 2062 can control the received broadcast signal using information input from the user. For example, broadcast channel settings, alarm function settings, adult authentication functions, and the like can be provided. Data output from the application manager 2060 is transmitted to the output unit 2070 as well as the signal decoding unit 2040 and can be used.

  As described above, the actual product includes the signal processing device of the present invention, so that the channel is compared with the conventional technique using a plurality of channel signals upmixed using only the inter-channel level difference value and the inter-channel correlation value. By using the interphase difference value, the sound quality is further improved, and it is possible to listen to a multi-channel signal similar to the original input signal.

  The decoding / encoding method to which the present invention is applied can be produced as a computer-executable program and stored in a computer-readable recording medium. Multimedia data having the data structure according to the present invention is also It can be stored in a computer readable recording medium. The computer-readable recording medium may include any type of storage device that stores data that can be read by a computer system. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc., and carrier wave (for example, transmission via the Internet). It can also be in the form. The bit stream generated by the encoding method can be stored in a computer-readable recording medium or transmitted using a wired / wireless communication network.

  In the above, the present invention has been described with reference to limited embodiments and drawings. However, the present invention is not limited thereto, and the present invention is not limited to those who have ordinary knowledge in the technical field to which the present invention belongs. It is understood that various modifications and changes can be made within the scope of the technical idea of the present invention and the appended claims and their equivalents.

  The present invention can be applied to encode and decode signals.

Claims (10)

A method of processing a signal, comprising:
Receiving a downmix signal generated from a plurality of channel signals and spatial information representing attributes of the plurality of channel signals to upmix the downmix signals;
Obtaining an inter-channel phase difference encoding flag indicating whether inter-channel phase difference (IPD) encoding is used in the spatial information from the header of the spatial information;
Based on the phase difference coding flag between said channel, from the frame of the spatial information, the step of phase difference value between the switch Yaneru to obtain the inter-channel phase difference mode flag indicating whether used in the frame of the spatial information When,
Obtaining an inter-channel phase difference value of a parameter band corresponding to a parameter time slot in the frame based on the inter-channel phase difference mode flag;
Smoothing the inter-channel phase difference value by modifying the inter-channel phase difference value using the inter-channel phase difference value of the preceding parameter time slot;
Applying the smoothed inter-channel phase difference value to the downmix signal to generate the multi-channel signal,
The spatial information is divided into the header and a plurality of the frames,
The inter-channel phase difference value represents a phase difference between two channels of the plurality of channel signals,
The parameter time slot indicates a time slot to which the inter-channel phase difference value is applied,
The method, wherein the parameter band is at least one subband of a frequency domain to which the inter-channel phase difference value is applied. Generating a phase angle representing an angle between two channels of the plurality of channel signals using the inter-channel phase difference value;
The method of claim 1, further comprising modifying the phase angle using the phase angle of the preceding parameter time slot.   The method further includes determining an inter-channel phase difference value of a time slot to which the inter-channel phase difference value is not applied using at least one of the inter-channel phase difference value and the smoothed inter-channel phase difference value. The method of claim 1. The inter-channel phase difference value is received when the contribution degree of the inter-channel phase difference value in the whole sound image localization is higher than the contribution degree of the inter-channel level difference (ILD) value in the whole sound image localization.
The method of claim 1, wherein the inter-channel level difference value indicates a level difference between two channels of the plurality of channel signals included in the downmix signal. A device for processing signals,
A signal receiving unit that receives a downmix signal generated from a plurality of channel signals and spatial information representing attributes of the plurality of channel signals to upmix the downmix signal;
An inter-channel phase difference encoding flag acquisition unit that acquires, from the header of the spatial information, an inter-channel phase difference encoding flag indicating whether or not inter-channel phase difference (IPD) encoding is used in the spatial information;
Based on the phase difference coding flag between said channel, said from the frame of the spatial information, Chi Yaneru between positions where the phase difference value to obtain the inter-channel phase difference mode flag indicating whether used in the frame of the spatial information A phase difference mode flag acquisition unit;
Based on the inter-channel phase difference mode flag, an inter-channel phase difference value acquisition unit that acquires an inter-channel phase difference value of a parameter band corresponding to a parameter time slot;
An inter-channel phase difference value smoothing unit that smoothes the inter-channel phase difference value by correcting the inter-channel phase difference value using the inter-channel phase difference value of the preceding parameter time slot;
An upmixing unit that applies the smoothed inter-channel phase difference value to the downmix signal to generate the plurality of channel signals, and
The spatial information is divided into the header and a plurality of the frames, the inter-channel phase difference value represents a phase difference between two channels of the multi-channel signal, and the parameter time slot is between the channels. The apparatus indicates a time slot to which a phase difference value is applied, and the parameter band is at least one subband of a frequency domain to which the inter-channel phase difference value is applied. The inter-channel phase difference value smoothing unit is
A phase angle generation unit that generates a phase angle representing an angle between two channels of the plurality of channel signals using the inter-channel phase difference value;
The apparatus according to claim 5, further comprising: a phase angle correction unit that corrects the phase angle using a phase angle of the preceding parameter time slot.   An inter-channel phase difference that determines an inter-channel phase difference value of a time slot to which the inter-channel phase difference value is not applied using at least one of the inter-channel phase difference value and the smoothed inter-channel phase difference value. The apparatus according to claim 5, further comprising a value interpolation unit. The inter-channel phase difference value is received when the contribution degree of the inter-channel phase difference value in the whole sound image localization is higher than the contribution degree of the inter-channel level difference (ILD) value in the whole sound image localization.
The apparatus according to claim 5, wherein the inter-channel level difference value indicates a level difference between two channels of the plurality of channel signals included in the downmix signal. A method of processing a signal, comprising:
Downmixing multiple channel signals to generate a downmix signal;
Generating spatial information representing attributes of the multi-channel signal to upmix the downmix signal;
The step of generating the spatial information includes:
Measuring an inter-channel phase difference (IPD) value representing a phase difference between two channels of the multi-channel signal;
Measuring an inter-channel level difference (ILD) value representing a level difference between two channels of the multi-channel signal;
Indicates whether or not IPD encoding is used in the spatial information when the contribution degree of the inter-channel phase difference value in the whole sound image localization is higher than the contribution degree of the inter-channel level difference value in the whole sound image localization. Generating an inter-channel phase difference encoding flag;
Generating an inter-channel phase difference mode flag indicating whether or not the inter-channel phase difference value is used in a frame;
Including the inter-channel phase difference value and the inter-channel phase difference mode flag in the spatial information frame, and including the inter-channel phase difference encoding flag in the spatial information header. A device for processing signals,
A downmixing unit that downmixes multiple channel signals to generate a downmix signal;
A spatial information generating unit that generates spatial information representing attributes of the plurality of channel signals in order to upmix the downmix signal;
The spatial information generator is
An inter-channel phase difference value measuring unit that measures an inter-channel phase difference (IPD) value representing a phase difference between two channels of the plurality of channel signals;
An inter-channel level difference value measuring unit that measures an inter-channel level difference (ILD) value representing a level difference between two channels of the plurality of channel signals;
Indicates whether or not IPD encoding is used in the spatial information when the contribution degree of the inter-channel phase difference value in the whole sound image localization is higher than the contribution degree of the inter-channel level difference value in the whole sound image localization. An inter-channel phase difference encoding flag generating unit for generating an inter-channel phase difference encoding flag;
An inter-channel phase difference mode flag generating unit that generates an inter-channel phase difference mode flag indicating whether or not the inter-channel phase difference value is used in a frame,
The apparatus, wherein the inter-channel phase difference value and the inter-channel phase difference mode flag are included in the spatial information frame, and the inter-channel phase difference encoding flag is included in the spatial information header.

Images