JP2011182142A - Sound signal false localization system, method thereof, sound signal false localization decoding device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To add sound signals from multiple points without impairing the presence in a multi-point communication conference system etc. <P>SOLUTION: In this system, an MS converting section 3 adds a first input signal to a second input signal to form an M signal, and subtracts the second input signal from the first input signal so as to form an S signal. An expanded false localization imparting section 1 calculates a decoded M signal S<SP>o</SP><SB>M</SB>(t) and a decoded S signal S<SP>o</SP><SB>S</SB>(t) defined by S<SP>o</SP><SB>M</SB>(t)=S<SB>M</SB>(t), S<SP>o</SP><SB>S</SB>(t)=(N-2n-1)*S<SB>M</SB>(t)/N+(1/N)*S<SB>S</SB>(t), where a point number N≥2 is the total number of directions where localization can be imparted, point information n is the number of a direction where localization is imparted, the M signal is S<SB>M</SB>(t) and the S signal is S<SB>S</SB>(t). An LR converting section 2 generates the first output signal by adding the decoded M signal to the decoded S signal and dividing the sum by 2, and generates the second output signal by subtracting the decoded S signal from the decoded M signal and dividing the balance by 2. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a technique for giving a pseudo three-dimensional effect to a sound signal including an audio signal.

  In a multipoint communication conference system, a technique is known in which audio signals collected in stereo at each point are added as they are. There is no prior art document.

  However, if the audio signals collected in stereo at each point are added as they are, the virtual sound source position reproduced in the audio signal obtained as a result of the addition overlaps between the points, giving the communication person an unnatural impression, There is a problem of impairing the presence of the meeting.

In order to solve the above problem, a sound signal pseudo-localization system according to claim 1 adds a first input signal and a second input signal to obtain an M signal, and the second input signal is converted into the second input signal. The MS conversion unit which subtracts the input signal to obtain the S signal, the total number of directions in which the localization can be given when the number of points N ≧ 2, the number of the direction in which the localization is given to the point information n, and the M signal as S _M (t ), the S signal as ^{_{S S (t), S o}} M (t) = S M (t), S o S (t) = (N-2n-1) * S M (t) / N + (1 / N) _{* S} decoded M signal is defined by _{^{S (t) S o M (}} t) and the decoded S signal ^S _o S and extended pseudo localization imparting unit that calculates a (t), the decoded M signal and the decoded S Add the signal and divide by 2 to produce the first output signal, subtract the decoded S signal from the decoded M signal and divide by 2 And an LR converter that generates a second output signal.

  Since different sound source positions can be determined for each point, the sense of reality in a meeting or the like is not impaired.

The functional block diagram of the example of the sound signal pseudo-localization system of 1st embodiment. The functional block diagram of the example of the sound signal pseudo-localization system of 2nd embodiment. The functional block diagram of the example of the sound signal pseudo-localization system of 3rd embodiment. The functional block diagram of the example of the sound signal pseudo-localization system of 3rd embodiment. The functional block diagram of the example of the sound signal pseudo-localization system of 4th embodiment. The functional block diagram of the example of the mixer of the sound signal pseudo-localization system of 4th embodiment. The functional block diagram of the example of the decoding apparatus of the sound signal pseudo-localization system of 4th embodiment. The functional block diagram of the example of the mixer of the sound signal pseudo-localization system of 5th embodiment. The functional block diagram of the example of the encoding apparatus of the sound signal pseudo-localization system of 5th embodiment. The functional block diagram of the example of the extended encoding part of the sound signal pseudo-localization system of 5th embodiment. The functional block diagram of the example of the extended encoding part of the sound signal pseudo-localization system of 5th embodiment. The functional block diagram of the example of the extended encoding part of the sound signal pseudo-localization system of 5th embodiment. The functional block diagram of the example of the decoding apparatus of the sound signal pseudo-localization system of 5th embodiment. The flowchart of the example of the sound signal pseudo-localization method of 1st embodiment. The flowchart of the example of the sound signal pseudo-localization method of 2nd embodiment. The flowchart of the example of the sound signal pseudo-localization method of 3rd embodiment. The flowchart of the example of the sound signal pseudo-localization method of 4th embodiment. The flowchart of the example of the sound signal pseudo-localization method of 5th embodiment. The flowchart of the example of the sound signal pseudo-localization method of 5th embodiment. The figure which illustrates band division. The figure which illustrates band division.

[First embodiment]
The sound signal pseudo-localization device according to the first embodiment includes an extended pseudo-localization providing unit 1, an LR conversion unit 2, and an MS conversion unit 3.

The first input signal S ⁱ ₁ (t) and the second input signal S ⁱ ₂ (t) are input to the MS conversion unit 3. The L channel audio signal is the first input signal S ⁱ ₁ (t), and the R channel audio signal is the second input signal S ⁱ ₂ (t). t is a sample number.

The MS conversion unit 3 converts the first input signal S ⁱ ₁ (t) and the second input signal S ⁱ ₂ (t) into the M signal S _M (t) and the S signal S _S according to the following expressions (1) and (2). Conversion into (t) (step S1, FIG. 14). That is, the first input signal S ⁱ ₁ (t) and the second input signal S ⁱ ₂ (t) are added to obtain the M signal S _M (t), and the second input signal S ⁱ ₁ (t) is changed to the second input signal S ⁱ ₁ (t). The input signal S ⁱ ₂ (t) is subtracted to obtain an S signal S _S (t). The converted M signal S _M (t) and S signal S _S (t) are sent to the extended pseudo-localization providing unit 1.
S _M (t) = S ⁱ ₁ (t) + S ⁱ ₂ (t) (1)
S _S (t) = S ⁱ ₁ (t) −S ⁱ ₂ (t) (2)

The extended pseudo-localization providing unit 1 outputs the decoded M signal S ^o _M (t) and the decoded S signal S ^o _S (t) according to the following expressions (3) and (4) (step S2). The decoded M signal S ^o _M (t) and the decoded S signal S ^o _S (t) are sent to the LR converter 2. N is the number of points and the total number of directions in which localization can be given. N is an integer of 2 or more. n is point information to be given a localization, and in this example, is a direction number for giving a localization. n is an integer of 0 or more and N−1 or less.
S ^o _M (t) = S _M (t) (3)
S ^o _S (t) = (N−2n−1) * S _M (t) / N + (1 / N) * S _S (t) (4)

  The number N of points may be acquired by a protocol when starting communication and stored in each device constituting the sound signal pseudo-localization system, or may be incorporated in the header information of the packet. You may incorporate in a part of code | symbol separately. The number N of points may be determined in advance.

  The number of the direction in which the localization is given can be arbitrarily determined between 0 and N-1, but a point number that can be acquired by a protocol at the start of communication may be used. Of course, in order not to overlap the spot numbers, n is selected from spot numbers other than the spot numbers of the spots that have already been localized.

The LR converter 2 uses the decoded M signal S ^o _M (t) and the decoded S signal S ^o _S (t), and according to the following equations (5) and (6), the first output signal S ^o ₁ (t) and A second output signal S ^o ₂ (t) is generated and output (step S3). That is, the LR converter 2 adds the decoded M signal S ^o _M (t) and the decoded S signal S ^o _S (t) and divides by 2 to generate a first output signal, and the decoded M signal S ^o _M The decoded S signal S ^o _S (t) is subtracted from (t) and divided by 2 to generate a second output signal.
S ^o ₁ (t) = (S ^o _M (t) + S ^o _S (t)) / 2 (5)
S ^o ₂ (t) = (S ^o _M (t) −S ^o _S (t)) / 2 (6)
Thus, by performing signal processing according to the point information n on the M signal and the S signal, it is possible to determine a different sound source position for each point.

[Second Embodiment]
The sound signal pseudo-localization device according to the second embodiment includes an encoding device 100 and a decoding device 200 as illustrated in FIG. The encoding device 100 includes an MS conversion unit 3, a first encoding unit 4, and a second encoding unit 5. The decoding device 200 includes an extended pseudo-localization adding unit 1, an LR conversion unit 2, a first decoding unit 6, and a second decoding unit 7.

  As in the first embodiment, the MS conversion unit 3 of the encoding device 100 adds the first input signal and the second input signal to obtain an M signal, and subtracts the second input signal from the first input signal. S signal (step S1, FIG. 15). The generated M signal is sent to the first encoding unit 4, and the generated S signal is sent to the second encoding unit 5.

The first encoding unit 4 encodes the M signal into an M code (step S4). For example, G. 711.1, G.G. It can be encoded by the method defined in H.711. The same applies to the case of “encoding” in the present invention.
The second encoding unit 5 encodes the S signal into an S code (step S5).
The M code and S code are sent to the decoding apparatus 200.

  The first decoding unit 6 of the decoding device 200 decodes the M code by a decoding method corresponding to the encoding by the first encoding unit 4 to generate a provisionally decoded M signal. The provisional decoded M signal is sent to the extended pseudo-localization providing unit 1 (step S6).

  The second decoding unit 7 decodes the S code by a decoding method corresponding to the encoding by the second encoding unit 5 to generate a provisionally decoded S signal. The provisional decoding S signal is sent to the extended pseudo-localization providing unit 1 (step S7).

Extended pseudo localization imparting unit 1, the preliminary decoding M signal S _{M (t),} a temporary decoded S signal as S _{S (t),} similarly to the extended pseudo localization imparting unit 1 of the first embodiment, the equation (3 ) And (4), the decoded M signal S ^o _M (t) and the decoded S signal S ^o _S (t) are output (step S2). The decoded M signal S ^o _M (t) and the decoded S signal S ^o _S (t) are sent to the LR converter 2.

Similarly to the LR converter 2 of the first embodiment, the LR converter 2 uses the decoded M signal S ^o _M (t) and the decoded S signal S ^o _S (t), and the above equations (5), (6 ), The first output signal S ^o ₁ (t) and the second output signal S ^o ₂ (t) are generated and output (step S3).

  As described above, even when the M signal and the S signal are encoded, different sound source positions can be determined for each point by performing signal processing corresponding to the point information n on the decoded M signal and S signal. It becomes possible.

[Third embodiment]
The sound signal pseudo localization system of the third embodiment includes an encoding device 100 and a decoding device 200. As illustrated in FIG. 3, the encoding device 100 includes an MS conversion unit 3, a first signal encoding unit 41, a second signal encoding unit 51, a first gain encoding unit 42, and a second gain encoding unit 52. The first code multiplexing unit 43 and the second code multiplexing unit 53 are included. As illustrated in FIG. 4, the decoding device 200 includes a first code separation unit 91, a second code separation unit 92, a first partial decoding unit 61, a second partial decoding unit 62, a first gain decoding unit 81, and a second gain. A decoding unit 82, a first multiplication unit 101, a second multiplication unit 102, a third multiplication unit 103, an addition unit 111 and an LR conversion unit 2 are included.

  As in the first embodiment, the MS conversion unit 3 of the encoding device 100 adds the first input signal and the second input signal to obtain an M signal, and subtracts the second input signal from the first input signal. S signal (step S1, FIG. 16). The generated M signal is sent to the first signal encoding unit 41 and the first gain encoding unit 42, and the generated S signal is sent to the second signal encoding unit 51 and the second gain encoding unit 52.

The first gain encoding unit 42 calculates the gain g of the M signal S _M (t) according to the following equation, and quantizes the calculated gain g to obtain an M gain code C _gm (step S8). The gain g is a representative value representing the magnitude of the input signal. An average value of samples constituting one frame is used as the gain. In addition to the method shown in the following equation, scalar quantization can also be used.
g = (1 / K) * ΣK ⁻¹ _{t = 0} ( _SM (t)) ² (calculation of gain)
C _gm = (1/2) * [log ₂ (g)]-const (gain quantization)

K is the number of samples in one frame, [•] is a function that outputs the integer part of •, and const is an arbitrary constant that is appropriately determined according to the performance and specifications required of the sound signal pseudo-localization device. . The first gain encoding unit 42 inversely quantizes the M gain code C _{gm according} to the following equation to obtain a decoded M gain A′m, and inputs the decoded M gain A′m to the first signal encoding unit 41.
A'm = 2 ^{Cgm + const}

The first signal encoding unit 41 normalizes the M signal S _M (t) with the decoded M gain A′m and then encodes it using vector quantization or the like to obtain a normalized M signal code (step S9). . For example, normalization is performed by setting S _M (t) / A′m.

The first code multiplexing unit 43 generates an extended M code including the M gain code C _gm and the normalized M signal code (step S10). For example, an M gain code C _gm and a normalized M signal code are arranged in a predetermined order to form an extended M code. When it is necessary to transmit the extended M code through the network, header information or the like may be added. The generated extended M code is sent to decoding apparatus 200.

Similar to the first gain encoding unit 42, the second gain encoding unit 52 calculates the gain g of the S signal S _S (t) according to the equation (calculation of gain), and calculates the calculated gain g (gain Quantization is performed to obtain an S gain code C _gs (step S11). Further, the second gain encoding unit 52 dequantizes the S gain code C _{gs according} to the following equation to obtain a decoded S gain A ′s, and inputs the decoded S gain A ′s to the second signal encoding unit 51.
A ′ = 2 ^{Cgs + const}

Similarly to the first signal encoding unit 41, the second signal encoding unit 51 normalizes the S signal S _S (t) with the decoded S gain A ′s, and then encodes it using vector quantization or the like. The normalized S signal code is set (step S12).

Similar to the first code multiplexing unit 43, the second code multiplexing unit 53 generates an extended S code including the S gain code C _gs and the normalized S signal code (step S13).

The first code separation unit 91 (FIG. 4) of the decoding device 200 separates the M gain code C _gm and the normalized M signal code from the extended M code (step S14). The M gain code is sent to the first gain decoding unit 81, and the normalized M signal code is sent to the first partial decoding unit 61.

The first partial decoding unit 61 decodes the separated normalized M signal code by, for example, inverse quantization to obtain a decoded normalized M signal S ′ _M (t) (step S15). The decoded normalized M signal S ′ _M (t) is sent to the first multiplication unit 101.

The first gain decoding unit 81 decodes the M gain code C _gm by, for example, inverse quantization according to the following equation to obtain a decoded M gain A′m (step S16). The decoded M gain A′m is sent to the first multiplier 101.
A'm = 2 ^{Cgm + const}

The first multiplication unit 101 multiplies the decoded normalized M signal S ′ _M (t) and the decoded M gain A′m to generate a decoded M signal (step S17). The decoded M signal is sent to the LR converter 2 and the second multiplier 102.

The second code separation unit 92 separates the S gain code C _gs and the normalized S signal code from the extended S code (step S18). The S gain code is sent to the second gain decoding unit 82, and the normalized S signal code is sent to the second partial decoding unit 62.

The second partial decoding unit 62 decodes the separated normalized S signal code by inverse quantization, for example, to obtain a decoded normalized S signal S ′ _S (t) (step S19). The decoded normalized S signal S ′ _S (t) is sent to the third multiplication unit 103.

The second gain decoding unit 82 decodes the S gain code C _gs by, for example, inverse quantization using the following equation to obtain a decoded S gain A ′s (step S20). The decoded S gain A ′s is sent to the extended pseudo-localization gain calculator 11.
A's = 2 ^{Cgs + const}

The extended pseudo localization gain calculator 11 calculates the first pseudo S gain A ¹ _s and the second pseudo S gain A ² _s defined by the following equations (step S21). The first pseudo S gain A ¹ _s is sent to the second multiplication unit 102, and the second pseudo S gain A ² _s is sent to the third multiplication unit 103.
A ¹ _s = (N−2n−1) / N
A ² _s = A's / N
Here, as in the first embodiment, the number of points N ≧ 2 is the total number of directions in which localization can be given, and the point information n is the number of the direction in which localization is given.

The second multiplication unit 102 multiplies the decoded M signal and the first pseudo S gain to obtain a first constant S signal (step S22). The first constant S signal is sent to the adding unit 111.
The third multiplication unit 103 multiplies the decoded normalized S signal by the second pseudo S gain to obtain a second localization S signal (step S23). The second localization S signal is sent to the adding unit 111.

The adding unit 111 adds the first localization S signal and the second localization S signal to obtain a decoded S signal S ^o _S (t) (step S24 ′). The decoded S signal is sent to the LR converter 2.
Similarly to the LR converter 2 of the first embodiment, the LR converter 2 uses the decoded M signal S ^o _M (t) and the decoded S signal S ^o _S (t), and the above equations (5), (6 ), The first output signal S ^o ₁ (t) and the second output signal S ^o ₂ (t) are generated and output (step S3).

As described above, even when the encoding apparatus uses an encoding method including gain encoding, a sound source that differs for each point is obtained by performing signal processing corresponding to the point information n on the decoded M signal and S signal. The position can be determined.
Further, as in the third embodiment, only the gain is decoded by the mixer 300, and the pseudo localization is given using the gain, so that the processing amount of the mixer becomes smaller than that of the conventional method. This is because the mixer 300 does not decode the entire sound signal.

[Fourth embodiment]
The sound signal pseudo-localization system of the fourth embodiment includes an encoding device 100, a decoding device 200, and a mixer 300, as illustrated in FIG.

  Similar to the encoding device 100 of the third embodiment, the encoding device 100 includes an MS conversion unit 3, a first signal encoding unit 41, a second signal encoding unit 51, a first gain, as illustrated in FIG. An encoding unit 42, a second gain encoding unit 52, a first code multiplexing unit 43, and a second code multiplexing unit 53 are included. As illustrated in FIG. 6, the mixer 300 includes, for example, a code separation unit 9, a gain decoding unit 8, a gain encoding unit 12, a first extended pseudo-localization gain calculating unit 161, and a code multiplexing unit 13. As illustrated in FIG. 7, the decoding device 200 includes a first code separation unit 91, a second code separation unit 92, a first partial decoding unit 61, a second partial decoding unit 62, a first gain decoding unit 81, and a second gain. A decoding unit 82, a first multiplication unit 101, a second multiplication unit 104, a third multiplication unit 105, a second extended pseudo-localization gain calculation unit 162, an addition unit 112 and an LR conversion unit 2 are included.

  The encoding apparatus 100 is the same as the encoding apparatus 100 of the third embodiment, and performs the processing from step S1 to step S13 illustrated in FIG. The extended M code generated by the encoding apparatus 100 is sent to the decoding apparatus 200, and the extended S code is sent to the mixer 300. The extended M code may be sent to the decoding device 200 via the mixer 300.

The code separation unit 9 (FIG. 6) of the mixer 300 separates the S gain code and the normalized S signal code from the extended S code (step S18). The normalized S signal code is sent to the code multiplexing unit 13, and the S gain code is sent to the gain decoding unit 8.
The gain decoding unit 8 decodes the S gain code C _gs by, for example, inverse quantization using the following equation to obtain a decoded S gain A ′s (step S20). The decoded S gain A ′s is sent to the first extended pseudo-localization gain calculator 161.
A's = 2 ^{Cgs + const}

The first extended pseudo-localization gain calculator 161 calculates a pseudo S gain A ^pseudo _s defined by the following equation (step S24). The number of points N ≧ 2 is the total number of directions in which localization can be given. The pseudo S gain A ^pseudo _s is sent to the gain encoding unit 12.
A ^pseudo _s = A's / N

The gain encoding unit 12 encodes the pseudo S gain A ^pseudo _s into an S gain code (step S25). The S gain code is sent to the code multiplexing unit 13.
The code multiplexing unit 13 generates an S code including the normalized S signal code and the S gain code generated by the gain encoding unit 12 (step S26). The generated S code is sent to the decoding device 200.

The first code separation unit 91 (FIG. 7) of the decoding device 200 separates the M gain code C _gm and the normalized M signal code from the extended M code (step S14). The M gain code is sent to the first gain decoding unit 81, and the normalized M signal code is sent to the first partial decoding unit 61.

The first partial decoding unit 61 decodes the separated normalized M signal code by, for example, inverse quantization to obtain a decoded normalized M signal S ′ _M (t) (step S15). The decoded normalized M signal S ′ _M (t) is sent to the multiplication unit 101.

The first gain decoding unit 81 decodes the M gain code C _gm by, for example, inverse quantization according to the following equation to obtain a decoded M gain A′m (step S16). The decoded M gain A′m is sent to the first multiplier 101.
A'm = 2 ^{Cgm + const}

The first multiplication unit 101 multiplies the decoded normalized M signal S ′ _M (t) and the decoded M gain A′m to generate a decoded M signal (step S17). The decoded M signal is sent to the LR converter 2 and the third multiplier 105.

The second code separation unit 92 separates the S gain code C _gs and the normalized S signal code from the S code (step S18 ′). The S gain code is sent to the second gain decoding unit 82, and the normalized S signal code is sent to the second partial decoding unit 62.

The second partial decoding unit 62 decodes the separated normalized S signal code by inverse quantization, for example, to obtain a decoded normalized S signal S ′ _S (t) (step S19). The decoded normalized S signal S ′ _S (t) is sent to the second multiplication unit 104.

The second gain decoding unit 82 decodes the S gain code C _gs by, for example, inverse quantization using the following equation to obtain a decoded S gain A ′s (step S20). The decoded S gain A ′s is sent to the second multiplier 104.
A's = 2 ^{Cgs + const}

The second multiplication unit 104 multiplies the decoded normalized S signal S ′ _S (t) and the decoded S gain A ′s to generate a first decoded S signal (step S27). The first decoded S signal is sent to the adding unit 112.
The second extended pseudo localization gain calculation unit 162 calculates a pseudo M gain gm2 defined by the following equation (step S28). The pseudo M gain gm2 is sent to the third multiplication unit 105.
gm2 = (N−2 * n−1) / N

The third multiplication unit 105 multiplies the decoded M signal and the pseudo M gain gm2 to obtain a second decoded M signal (step S29). The second decoded M signal is sent to the adding unit 112.
The adder 112 adds the first decoded S signal and the second decoded M signal to obtain a decoded S signal (step S30). The decoded S signal is sent to the LR converter 2.

Similarly to the LR converter 2 of the first embodiment, the LR converter 2 uses the decoded M signal S ^o _M (t) and the decoded S signal S ^o _S (t), and the above equations (5), (6 ), The first output signal S ^o ₁ (t) and the second output signal S ^o ₂ (t) are generated and output (step S3).
As described above, even when the encoding apparatus uses an encoding method including gain encoding, a sound source that differs for each point is obtained by performing signal processing corresponding to the point information n on the decoded M signal and S signal. The position can be determined.

[Fifth embodiment]
The sound signal pseudo localization system of the fifth embodiment performs communication at three points. Hereinafter, an operation of performing mixing on the sound signal code transmitted from the encoding device at the first point and the second point and transmitting it to the encoding device at the third point will be described.

  First, it is assumed that one of the three encoding devices is selected as the main point according to the importance level or the speech state. For example, an encoding device that encodes a sound signal having the largest power is selected as the main point. In addition, the encoding device serving as the main point may be selected by a technique such as VAD (Voice Activity Detector) described in Japanese Patent No. 4033840. In this example, it is assumed that the encoding device at the first point is selected as the main point.

  The extended signal mixing unit 171 (FIG. 8) of the mixer 300 receives the extended M code and the extended S code transmitted from the encoding device selected as the main point. The extended signal mixing unit 172 receives the extended M code and the extended S code transmitted from the encoding device that has not been selected as the main point.

  The extended M code includes an M gain code obtained by encoding an M gain, which is a representative value representing the magnitude of the M signal obtained by adding the first input signal and the second input signal input to the encoding device, and the M signal. A code including a normalized M signal code obtained by encoding a normalized M signal that has been normalized by the M gain and a quality extended M code obtained by encoding additional information for improving the quality of a decoded sound signal It is. The extended S code includes an S gain code obtained by encoding an S gain, which is a representative value representing the magnitude of the S signal obtained by subtracting the second input signal from the first input signal input to the encoding device, and the S signal as S It is a code including a normalized S signal code obtained by encoding a normalized S signal normalized by gain, and a quality extended S code obtained by encoding additional information for improving the quality of a decoded sound signal.

The extended M code and the extended S code are generated, for example, by the encoding apparatus 100 including the configuration illustrated in FIG. 9 described later.
The first code separation unit 93 separates the M gain code, the normalized M signal code, and the quality extension M code from the extended M code input to the extended signal mixing unit 171 (step A1, FIG. 18). The M gain code is sent to the first gain decoding unit 81, the separated normalized M signal code is sent to the first code multiplexing unit 131, and the quality extended M code is sent to the first quality extended decoding unit 141. .

The first quality extension decoding unit 141 decodes the quality extension M code to obtain a first quality extension M signal (step A2). The first quality extension M signal is sent to the first multiplication unit 106 and the third addition unit 115.
The second code separation unit 94 separates the S gain code, the normalized S signal code, and the quality extended S code from the extended S code input to the extended signal mixing unit 171 (step A3). The S gain code is sent to the second gain decoding unit 82, the separated normalized S signal code is sent to the second code multiplexing unit 132, and the quality extended S code is sent to the second quality extended decoding unit 142. .

  The second quality extension decoding unit 142 decodes the quality extension S code to obtain a first quality extension S signal (step A4). The first quality extension S signal is sent to the second multiplication unit 107.

The first extended pseudo localization gain calculation unit 163 sets the first pseudo M gain to (2n ₁ + 1−N) / N and the first pseudo S gain to 1 / N (step A5). N ≧ 2 is the number of points and the total number of directions that can be given, and the point information n ₁ is the number of the direction that gives a localization to the sound signal collected by the encoding device selected as the main point. The first pseudo M gain is sent to the first multiplication unit 106 and the fifth multiplication unit 1010. The first pseudo S gain is sent to the second multiplication unit 107 and the sixth multiplication unit 1011.

The first multiplication unit 106 multiplies the first quality extension M signal and the first pseudo M gain to obtain a first pseudo localization M signal (step A6). The first pseudo localization M signal is sent to the first addition unit 113.
The second multiplication unit 107 multiplies the first quality extension S signal and the first pseudo S gain to obtain a first pseudo localization S signal (step A7). The first pseudo localization S signal is sent to the first addition unit 113.
The first adder 113 adds the first pseudo-localization M signal and the first pseudo-localization S signal to obtain a first localization conversion S signal (step A8). The first constant conversion S signal is sent to the fourth adder 116.

The third code separation unit 95 separates the quality extension M code from the extension M code input to the extension signal mixing unit 172 (step A9). The quality extension M code is sent to the third quality extension decoding unit 143.
The third quality extension decoding unit 143 decodes the quality extension M code to generate a second quality extension M signal (step A10). The third quality extension M signal is sent to the third multiplication unit 108 and the second addition unit 115.

The fourth code separation unit 96 separates the quality extended S code from the extended S code input to the extended signal mixing unit 172 (step A11). The quality extended S code is sent to the fourth quality extended decoding unit 144.
The fourth quality extension decoding unit 144 decodes the quality extension S code to obtain a second quality extension S signal (step A12). The second quality extended S signal is sent to the fourth multiplier 109.

The second extended pseudo localization gain calculation unit 164 sets the second pseudo M gain to (2n ₂ + 1−N) / N and sets the second pseudo S gain to 1 / N (step A13). N ≧ 2 is the number of points and the total number of directions that can be given, and the point information n ₂ is the number of the direction in which the localization is given to the sound signal collected by the encoding device not selected as the main point. The second pseudo M gain is sent to the third multiplier 108. The second pseudo S gain is sent to the fourth multiplier 109.

The third multiplication unit 108 multiplies the second quality extension M signal and the second pseudo M gain to obtain a second pseudo localization M signal (step A14). The second pseudo localization M signal is sent to the second adder 114.
The fourth multiplication unit 109 multiplies the second quality extension S signal and the second pseudo S gain to obtain a second pseudo localization S signal (step A15). The second pseudo localization S signal is sent to the second adder 114.

The second adder 114 adds the second pseudo-localization M signal and the second pseudo-localization S signal to obtain a second localization transformation S signal (step A16). The second localization conversion S signal is sent to the fourth adder 116.
The third adding unit 115 adds the first quality extended M signal and the second quality extended M signal to obtain a localization mixed M signal (step A17). The localization mixed M signal is sent to the first quality extension encoding unit 151.

The first quality extension encoding unit 151 encodes the localization mixed M signal to obtain a localization mixed M code (step A18). The localization mixed M code is sent to the first code multiplexing unit 131.
The first gain decoding unit 81 decodes the M gain code separated by the first code separation unit 93 to obtain a decoded M gain (step A19). The decoded M gain is sent to the fifth multiplier 1010.

  The fifth multiplication unit 1010 multiplies the decoded M gain and the first pseudo M gain to obtain a localization M gain (step A20). The localization M gain is sent to the first gain encoding unit 121.

The first gain encoding unit 121 encodes the localization M gain to obtain a localization M gain code (step A21). The localization M gain code is sent to the first code multiplexing unit 131.
The first code multiplexing unit 131 generates an extended M code including the localization mixed M code, the localization M gain code, and the normalized M signal code separated by the first code separation unit 93 (step A22). The extended M code is sent to the decoding device 200.

The fourth adder 116 adds the first localization transformation S signal and the second localization transformation S signal to obtain a localization mixed S signal (step A23). The localization mixed S signal is sent to the second quality extension encoding unit 153.
The second quality extension encoding unit 153 encodes the localization mixed S signal to obtain a localization mixed S code (step A24). The localization mixed S code is sent to the second code multiplexing unit 132.
The second gain decoding unit 82 decodes the S gain code separated by the second code separation unit 94 to obtain a decoded S gain (step A25). The decoded S gain is sent to the sixth multiplier 1011.

The sixth multiplier 1011 multiplies the decoded S gain and the first pseudo S gain to obtain a localization S gain (step A26). The localization S gain is sent to the second gain encoding unit 122.
The second gain encoding unit 122 encodes the localization S gain to obtain a localization S gain code (step A27). The localization S gain code is sent to the second code multiplexing unit 132.
The second code multiplexing unit 132 generates an extended S code including the localization mixed S code, the localization S gain code, and the normalized S signal code separated by the second code separation unit 94 (step A28). The extended S code is sent to the decoding device 200.

  The extended M code and the extended S code generated by the mixer 300 are input to the decoding device 200. The decoding apparatus 200 includes the configuration illustrated in FIG. 13, and includes a localization mixed M code, a normalized M signal code, a localization M gain code, a localization mixed S code, a normalized S signal, and an extended M code and an extended S signal. The localization S gain code is decoded, and a sound signal obtained by mixing the first input signal and the second input signal input to the encoding device is generated.

  Hereinafter, an example of the encoding device 100 according to the fifth embodiment will be described with reference to FIG. 9 includes, for example, an MS conversion unit 3, a first extension encoding unit 44, and a second extension encoding unit 45.

  As in the first embodiment, the MS conversion unit 3 adds the first input signal and the second input signal to obtain an M signal, and subtracts the second input signal from the first input signal to obtain an S signal. (Step C1). The generated M signal is sent to the first extended encoding unit 44, and the generated S signal is sent to the second extended encoding unit 45.

The first extended encoding unit 44 generates and outputs an extended M code using the input M signal (step C2). The extended M code is sent to the mixer 300.
The second extended encoding unit 45 generates and outputs an extended S code using the input S signal (step C3). The extended S code is sent to the mixer 300.
As the first extension encoding unit 44 and the second extension encoding unit 45, for example, the extension encoding units 46, 47, and 48 described in FIGS. 10, 11, and 12 can be used.
10 includes a band division unit 461, a signal encoding unit 462, a gain encoding unit 463, a quality extension encoding unit 464, and a code multiplexing unit 465, for example.

The band dividing unit 461 divides the band of the input signal (M signal or S signal) into two, one being a first band signal and the other being a second band signal. The first band signal is sent to the signal coding unit 462 and the gain coding unit 463, and the second band signal is sent to the quality extension coding unit 464.
For example, as illustrated in FIG. 20, the signal is divided into a low-frequency signal (1) and a high-frequency signal (2), the low-frequency signal (1) is set as the first band signal, and the high-frequency signal (2) is set as the first frequency signal. A two-band signal is assumed. The low frequency signal (1) may be the second band signal and the high frequency signal (2) may be the first band signal. The number of bits allocated to the low frequency signal (1) and the high frequency signal (2) need not be the same. For example, as illustrated in FIG. 21, the number of bits allocated to the low frequency signal (1) may be larger than the number of bits allocated to the high frequency signal (2).

  The gain encoding unit 463 calculates and encodes a gain (M gain or S gain), which is a representative value representing the magnitude of the first band signal, to obtain a gain code (M gain code or S gain code). The gain code is sent to the code multiplexer 465. For example, the average value of the sample values of one frame of the first band signal is calculated as the gain. The gain encoding unit 463 decodes the generated gain code to obtain a decoding gain (decoded M gain or decoded S gain), and sends the decoded gain to the signal encoding unit 462.

The signal encoding unit 462 normalizes and encodes the first band signal using the decoding gain to obtain a normalized signal code (normalized M signal code or normalized S signal code). The normalized signal code is sent to the code multiplexing unit 465.
The quality extension encoding unit 464 encodes the second band signal to obtain a quality extension code (quality extension M code or quality extension S code). The quality extension code is sent to the code multiplexing unit 465.
The code multiplexing unit 465 generates an extended code (an extended M code or an extended S code) including a normalized signal code, a gain code, and a quality extension code.

  11 includes a signal encoding unit 471, a gain encoding unit 472, a partial decoding unit 473, a gain decoding unit 474, a multiplication unit 475, a subtraction unit 476, a quality extension encoding unit 477, and code multiplexing. Part 478 is included, for example.

  The gain encoding unit 472 calculates and encodes the gain (M gain or S gain) of the input signal (M signal or S signal) to obtain a gain code (M gain code or S gain code). The gain code is sent to the code multiplexing unit 478 and the gain decoding unit 474. The gain encoding unit 472 decodes the generated gain code to obtain a decoding gain (decoded M gain), and sends the decoding gain to the multiplying unit 475.

  The signal encoding unit 471 normalizes and encodes the input signal using the decoding gain to obtain a normalized signal code (normalized M signal code or normalized S signal code). The normalized signal code is sent to the code multiplexing unit 478 and the partial decoding unit 473.

  The partial decoding unit 473 decodes the normalized signal code into a normalized decoded signal (normalized decoded M signal or normalized decoded S signal). The normalized decoded signal is sent to multiplication section 475.

  Multiplier 475 multiplies the normalized decoded signal and the decoding gain to obtain a first band decoded signal. The first band decoded signal is sent to the subtracting unit 476. The subtracting unit 476 subtracts the first band decoded signal from the input signal to obtain a residual signal (residual M signal or residual S signal). The residual signal is sent to the quality extension encoding unit 477.

The quality extension encoding unit 477 encodes the residual signal into a quality extension code (quality extension M code or quality extension S code). The quality extension code is sent to the code multiplexing unit 478.
The code multiplexing unit 478 generates an extension code (an extension M code or an extension S code) including a normalized signal code, a gain code, and a quality extension code.

  12 includes a quality extension encoding unit 481, a quality extension decoding unit 482, a subtraction unit 483, a gain encoding unit 484, a partial encoding unit 485, and a code multiplexing unit 486.

The quality extension encoding unit 481 encodes the input signal (M signal or S signal) to obtain a quality extension code (quality extension M code or quality extension S code). The quality extension code is sent to the code multiplexing unit 486 and the quality extension decoding unit 482.
Quality extension decoding section 482 decodes the quality extension code to obtain a second band decoded signal. The second band decoded signal is sent to subtracting section 483.

  The subtracting unit subtracts the second band decoded signal from the input signal to obtain a residual signal. The residual signal is sent to the gain encoding unit 484 and the partial encoding unit 485.

  The gain encoding unit 484 calculates a gain representing the magnitude of the residual signal and encodes it to obtain a gain code (gain M code or gain S code). The gain code is sent to the code multiplexing unit 486. For example, the average value of the sample values of one frame of the residual signal is set as the gain. Also, the gain encoding unit 484 decodes the generated gain code and sends it to the partial encoding unit 485 as a decoding gain (decoded M gain or decoded S gain).

The partial encoding unit 485 normalizes and encodes the residual signal using the decoding gain to obtain a normalized signal code (normalized M signal code or normalized S signal code). The normalized signal code is sent to the code multiplexing unit 486.
The code multiplexing unit 486 generates an extension code (extended M code or extended S code) including a quality extension code, a gain code, and a normalized signal code.

  An example of the decoding device 200 of the sound signal pseudo-localization system according to the fifth embodiment will be described with reference to FIG. The first code separation unit 641 separates the normalized M signal code, the localization M gain code, and the localization mixed M code from the extended M code generated by the mixer (step D1). The normalized M signal code is sent to the first signal decoding unit 642, the localization M gain code is sent to the first gain decoding unit 643, and the localization mixed M code is sent to the first quality extension decoding unit 644.

The first signal decoding unit 642 decodes the normalized M signal code to obtain a normalized decoded M signal (step D2). The normalized decoded M signal is sent to the first multiplier 645.
The first gain decoding unit 643 decodes the localization M gain code to obtain a decoded M gain (step D3). The decoding gain is sent to the first multiplication unit 645.
The first multiplication unit 645 multiplies the normalized decoded M signal and the decoded M gain to obtain a first decoded M signal (step D4). The first decoded M signal is sent to the first adder 646 and the third multiplier 6413.
The first quality extension decoding unit 644 decodes the localization mixed M code to obtain a second decoded M signal (step D5). The second decoded M signal is sent to the first adder 646.

  The first adder 646 combines the first decoded M signal and the second decoded M signal into a decoded M signal (step D6). The decoded M signal is sent to the LR converter 6415. When the first extension encoding unit 44 and the second extension encoding unit 45 of the encoding device 100 are the extension encoding unit 46 of FIG. 10, the first decoded M signal corresponds to the first band signal, The two decoded M signals correspond to the second band signal. In this case, the first addition unit 646 sets a signal obtained by combining the band of the first decoded M signal and the band of the second decoded M signal as a decoded M signal. When the first extension encoding unit 44 and the second extension encoding unit 45 of the encoding device 100 are the extension encoding unit 47 of FIG. 11 or the extension encoding unit 48 of FIG. 12, the second decoded M signal or The first decoded M signal corresponds to the residual signal. In this case, the first addition unit 646 sets a signal obtained by adding the first decoded M signal and the second decoded M signal as a decoded M signal.

  The second code separation unit 647 separates the normalized S signal code, the localization S gain code, and the localization mixed S code from the extended S code generated by the mixer (step D7). The normalized S signal code is sent to the second signal decoding unit 648, the localization S gain code is sent to the second gain decoding unit 649, and the localization mixed S code is sent to the second quality enhancement decoding unit 6410.

The second signal decoding unit 648 decodes the normalized S signal code to obtain a normalized decoded S signal (step D8). The normalized decoded S signal is sent to the second multiplier 6411.
The second gain decoding unit 649 decodes the localization S gain code to obtain a decoded S gain (step D9). The decoded S gain is sent to the second multiplier 6411.
The second multiplier 6411 multiplies the normalized decoded S signal and the decoded S gain to obtain a provisional first decoded S signal (step D10). The temporary first decoded S signal is sent to the second adder 6412.
The second quality extension decoding unit 6410 decodes the localization mixed S code to obtain a second decoded S signal (step D11). The second decoded S signal is sent to the third adder 6414.

The second extended pseudo localization gain calculator 6416 calculates pseudo gain (N-2n ₁ -1) / N (step D12). The pseudo gain is sent to the third multiplication unit 6413. The point information n ₁ is a number in a direction in which the sound signal collected by the encoding device selected as the main point is localized. The point information n ₁ is sent from the mixer 300 to the decoding device 200. For example, the point information n ₁ may be included in the extended M code or the extended S code generated by the first code multiplexing unit 131 or the second code multiplexing unit 132, or the extended M code or the extended S code is transmitted. It may be included in the header.

The third multiplication unit 6413 multiplies the first decoded M signal and the pseudo gain to obtain a provisional second decoded S signal (step D13). The provisional second decoded S signal is sent to the second adder 6412.
The second adder 6412 adds the provisional first decoded S signal and the provisional second decoded S signal to obtain a first decoded S signal (step D14). The first decoded S signal is sent to the third adder 6414.
The third adder 6414 combines the first decoded S signal and the second decoded S signal into a decoded S signal (step D15). The decoded S signal is sent to the LR converter 6415.

Similarly to the LR converter 2 of the first embodiment, the LR converter 2 uses the decoded M signal S ^o _M (t) and the decoded S signal S ^o _S (t), and the above equations (5), (6 ), The first output signal S ^o ₁ (t) and the second output signal S ^o ₂ (t) are generated and output (step D16).

  Each device of the sound signal pseudo-localization system (the sound signal pseudo-localization system itself in the first embodiment, and the encoding device 100, the decoding device 200, and the mixer 300 in the other embodiments) can be realized by a computer. In this case, the processing contents of each unit that the apparatus should have are described by a program. And each part in this apparatus is implement | achieved on a computer by running this program with a computer.

  The program describing the processing contents can be recorded on a computer-readable recording medium. In this embodiment, these apparatuses are configured by executing a predetermined program on a computer. However, at least a part of these processing contents may be realized by hardware.

  The present invention is not limited to the above-described embodiment, and can be modified as appropriate without departing from the spirit of the present invention.

Claims (13)

An MS converter that adds the first input signal and the second input signal to obtain an M signal, subtracts the second input signal from the first input signal, and obtains an S signal;
The total number of directions in which localization can be given when the number of points N ≧ 2, the number of the direction in which localization is given as the point information n, the M signal as S _M (t), and the S signal as S _S (t), S ^o Decoding M defined by _M (t) = S _M (t), S ^o _S (t) = (N−2n−1) * S _M (t) / N + (1 / N) * S _S (t) An extended pseudo-localization providing unit for calculating the signal S ^o _M (t) and the decoded S signal S ^o _S (t);
The decoded M signal and the decoded S signal are added and divided by 2 to generate a first output signal, and the decoded S signal is subtracted from the decoded M signal and divided by 2 to generate a second output signal. An LR converter;
Sound signal pseudo localization system including An MS conversion unit that adds a first input signal and a second input signal to obtain an M signal, subtracts the second input signal from the first input signal to obtain an S signal, and encodes the M signal to obtain an M signal. An encoding device including a first encoding unit that is a code and a second encoding unit that is an S code that encodes the S signal;
A first decoding unit that decodes the M code to obtain a decoded M signal, a second decoding unit that decodes the S code to obtain a decoded S signal, and a direction in which the number of points N ≧ 2 can be localized S ^o _M (t) = S _M (t) where the total number, the point information n is a direction number giving the localization, the provisional decoded M signal is S _M (t), and the provisional decoded S signal is S _S (t). , S ^o _S (t) = (N−2n−1) * S _M (t) / N + (1 / N) * S _S (t) defined by the decoded M signal S ^o _M (t) and the decoded S An extended pseudo-localization unit for calculating a signal S ^o _S (t), and adding the decoded M signal and the decoded S signal to divide by 2 to generate a first output signal. A decoding device including an LR converter that subtracts the S signal and divides by 2 to generate a second output signal;
Sound signal pseudo localization system including An MS converter that adds the first input signal and the second input signal to obtain an M signal, subtracts the second input signal from the first input signal to obtain an S signal, and represents the magnitude of the M signal A first gain encoder that calculates and encodes a gain that is a representative value to obtain an M gain code, and normalizes the M signal by normalizing and encoding with the decoded M gain obtained by decoding the M gain code. A first signal encoding unit that generates a normalized M signal code, a first code multiplexing unit that generates an extended M code including the M gain code and the normalized M signal code, and a representative representing the magnitude of the S signal A second gain encoding unit that calculates and encodes a gain that is a value to obtain an S gain code, and normalizes the S signal by normalizing with the decoded S gain obtained by decoding the S gain code Second signal encoding with S signal code When the coding device and a second code multiplexing unit which generates an extended S code containing the S gain code and the normalization S signal code,
A first code separation unit that separates an M gain code and a normalized M signal code from the extended M code, a first partial decoding unit that decodes the separated normalized M signal code into a decoded normalized M signal, A first gain decoding unit that decodes the separated M gain code to generate a decoded M gain; a first multiplication unit that multiplies the decoded normalized M signal and the decoded M gain to obtain a decoded M signal; A second code separation unit for separating the S gain code and the normalized S signal code from the extended S code, and a second partial decoding unit for decoding the separated normalized S signal code to obtain a decoded normalized S signal A second gain decoding unit that decodes the separated S gain code to generate a decoded S gain, a total number of directions in which localization can be given when the number of points N ≧ 2, and a direction in which localization is given to the point information n And the decoding S gain as A's, A ¹ _s = (N−2n−1) / N, A ² _s = Extended pseudo-localization gain for calculating the first pseudo S gain A ¹ _s and the second pseudo S gain A ² _s defined by A ′ _s / N An arithmetic unit, a second multiplication unit that multiplies the decoded M signal and the first pseudo S gain to obtain a first fixed S signal, a multiplication normalized S signal and the second pseudo S gain. A third multiplying unit for obtaining a second localization S signal, an adding unit for adding the first localization S signal and the second localization S signal to obtain a decoded S signal, the decoded M signal and the decoded S signal And a LR converter that subtracts the decoded S signal from the decoded M signal and divides by 2 to generate a second output signal; ,
Sound signal pseudo localization system including An MS converter that adds the first input signal and the second input signal to obtain an M signal, subtracts the second input signal from the first input signal to obtain an S signal, and represents the magnitude of the M signal A first gain encoder that calculates and encodes a gain that is a representative value to obtain an M gain code, and normalizes the M signal by normalizing and encoding with the decoded M gain obtained by decoding the M gain code. A first signal encoding unit that generates a normalized M signal code, a first code multiplexing unit that generates an extended M code including the M gain code and the normalized M signal code, and a representative representing the magnitude of the S signal A second gain encoding unit that calculates and encodes a gain as a value to obtain a first S gain code, and normalizes and codes the S signal with a decoded S gain obtained by decoding the first S gain code Second signal to be normalized S signal code A coding unit, the coding apparatus and a second code multiplexing unit which generates an extended S codes including the first S gain code and the normalization S signal code,
A code separation unit that separates the S gain code and the normalized S signal code from the extended S code, a gain decoding unit that generates the decoded S gain by decoding the separated S gain code, and a pseudo for changing localization a first extended pseudo localization gain calculator for calculating the S gain a ^pseudo _s, the pseudo S gain a and gain coding section to the second S gain code the ^pseudo _s by encoding the separated normalized S signal A mixer including a code and a code multiplexing unit for generating an S code including the second S gain code;
A first code separation unit that separates the normalized M signal code and the M gain code from the extended M code, and a first partial decoding unit that decodes the separated normalized M signal code to generate a decoded normalized M signal. A first gain decoding unit that decodes the separated M gain code to generate a decoded M gain, and a first multiplication unit that multiplies the decoded normalized M signal and the decoded M gain to obtain a decoded M signal. A second code separation unit that separates the normalized S signal code and the S gain code from the S code, and a second partial decoding that decodes the separated normalized S signal code to generate a decoded normalized S signal A second gain decoding unit that decodes the separated S gain code to generate a decoded S gain, and multiplies the decoded normalized S signal and the decoded S gain to obtain a first decoded S signal. The second multiplying unit and the person who gives the location information n The second extended pseudo-localization gain calculation unit for calculating the pseudo M gain gm2 defined by gm2 = (N−2 * n−1) / N, the decoded M signal, and the pseudo M gain gm2 A third multiplying unit that multiplies to obtain a second decoded M signal; an adder that adds the first decoded S signal and the second decoded M signal to obtain a decoded S signal; and the decoded M signal and the decoded Decoding including an LR converter that adds the S signal and divides by 2 to generate a first output signal, subtracts the decoded S signal from the decoded M signal and divides by 2 to generate a second output signal Equipment,
Sound signal pseudo localization system including An M gain code obtained by encoding an M gain, which is a representative value representing the magnitude of the M signal obtained by adding the input first input signal and the second input signal, and a normal value obtained by normalizing the M signal by the M gain. An extended M code including a normalized M signal code obtained by encoding a normalized M signal and a quality extended M code obtained by encoding additional information for improving the quality of a decoded sound signal, and the first input An S gain code obtained by encoding an S gain, which is a representative value representing the magnitude of the S signal obtained by subtracting the second input signal from the signal, and a normalized S signal obtained by normalizing the S signal by the S gain. Two encoding devices that generate an extended S code including the normalized S signal code and a quality extended S code obtained by encoding additional information for improving the quality of the decoded sound signal;
A first code separation unit that separates an M gain code, a normalized M signal code, and a quality extension M code from an extension M code generated by one of the two encoding devices; A first quality extension decoding unit that sets the quality extension M signal, and a second code separation unit that separates the S gain code, the normalized S signal code, and the quality extension S code from the extension S code generated by the one encoding device. The second quality extension decoding unit which decodes the quality extension S code to obtain the first quality extension S signal, the total number of directions in which localization can be given with the number of points N ≧ 2, and the localization of the point information n ₁ As a direction number, a first extended pseudo-localization gain calculator that sets the first pseudo M gain to (2n ₁ + 1−N) / N and the first pseudo S gain to 1 / N, and the first quality extended M signal Multiplied by the first pseudo M gain and the first pseudo localization A first multiplication unit that is a signal, a second multiplication unit that multiplies the first quality extended S signal and the first pseudo S gain to form a first pseudo localization S signal, and the first pseudo localization M signal, A first adder that adds the first pseudo-localization S signal to obtain a first fixed-conversion S signal; and a third that separates a quality extension M code from an extension M code generated by the other of the two encoding devices. A code separation unit, a third quality extension decoding unit that decodes the quality extension M code to obtain a second quality extension M signal, and a quality extension S code from the extension S code generated by the other encoding device a fourth code separating unit, and a fourth quality extension decoding unit for the second quality extended S signal by decoding the quality extended S code, the direction giving the localization point information n ₂ number, the second pseudo M gain and _{(2n 2 + 1-N)} / N, the second extension of the second pseudo S gain and 1 / N A similar localization gain calculation unit, a third multiplication unit that multiplies the second quality extension M signal and the second pseudo M gain to form a second pseudo localization M signal, the second quality extension S signal, and the first A fourth multiplication unit that multiplies two pseudo-S gains to obtain a second pseudo-localization S signal, and adds the second pseudo-localization M signal and the second pseudo-localization S signal to obtain a second localization transformation S signal; A second addition unit that adds the first quality extended M signal and the second quality extended M signal to obtain a localization mixed M signal, and encodes the localization mixed M signal to perform localization mixing Multiplying the first quality extended encoding unit for M code, the first gain decoding unit for decoding the separated M gain code to obtain decoded M gain, and the decoded M gain and the first pseudo M gain A fifth multiplication unit for setting the localization M gain, and encoding the localization M gain to determine the localization M gain code. A first gain encoding unit that generates a signal, a first code multiplexing unit that generates an extended M code including the localization mixed M code, the localization M gain code, and the separated normalized M signal code, A fourth addition unit that adds the first localization transformation S signal and the second localization transformation S signal to obtain a localization mixture S signal, and a second quality extension that encodes the localization mixture S signal to obtain a localization mixture S code. An encoding unit; a second gain decoding unit that decodes the separated S gain code to obtain a decoded S gain; and a second gain decoding unit that multiplies the decoded S gain and the first pseudo S gain to obtain a localization S gain. A six-multiplying unit, a second gain encoding unit that encodes the localization S gain to obtain a localization S gain code, the localization mixed S code, the localization S gain code, and the separated normalized S signal code A second code multiplexing unit for generating an extended S code including And the mixer,
A first code separation unit that separates a normalized M signal code, a localization M gain code, and a localization mixed M code from the extended M code generated by the mixer, and a normalized decoded M signal by decoding the normalized M signal code A first signal decoding unit, a first gain decoding unit that decodes the localization M gain code to obtain a decoded M gain, a first decoded M signal obtained by multiplying the normalized decoded M signal and the decoded M gain. A first multiplying unit that is a signal, a first quality extension decoding unit that decodes the localization mixed M code to form a second decoded M signal, and the first decoded M signal and the second decoded M signal A first adder that generates a decoded M signal; a second code separation unit that separates a normalized S signal code, a localization S gain code, and a localization mixed S code from the extended S code generated by the mixer; and the normalized S The second signal decoding is performed by decoding the signal code to obtain a normalized decoded S signal. A second gain decoding unit that decodes the localization S gain code to obtain a decoded S gain, and multiplies the normalized decoded S signal and the decoded S gain to obtain a temporary first decoded S signal. A multiplying unit; a second quality extended decoding unit that decodes the localization mixed S code into a second decoded S signal; and a second extended pseudo localization gain calculation that calculates pseudo gain (N−2n ₁ −1) / N A third multiplication unit that multiplies the first decoded M signal and the pseudo gain to obtain a provisional second decoded S signal, and adds the provisional first decoded S signal and the provisional second decoded S signal. A second adder that generates a first decoded S signal, a third adder that combines the first decoded S signal and the second decoded S signal to generate a decoded S signal, the decoded M signal, and the decoded The S signal is added and divided by 2 to generate the first output signal, and the decoded S signal is subtracted from the decoded M signal. A decoding device including an LR converter that calculates and divides by 2 to generate a second output signal;
Sound signal pseudo localization system including The M code is a code obtained by encoding the M signal obtained by adding the input first input signal and the second input signal.
The S code is a code obtained by encoding the S signal obtained by subtracting the second input signal from the first input signal,
A first decoding unit that decodes an input M code to obtain a decoded M signal, a second decoding unit that decodes an inputted S code to obtain a decoded S signal,
The total number of directions in which localization can be given when the number of points N ≧ 2, the number of the direction in which localization is given as the point information n, the temporary decoded M signal S _M (t), and the temporary decoded S signal S _S (t) S ^o _M (t) = S _M (t), S ^o _S (t) = (N−2n−1) * S _M (t) / N + (1 / N) * S _S (t) An extended pseudo-localization providing unit that calculates the decoded M signal S ^o _M (t) and the decoded S signal S ^o _S (t),
The decoded M signal and the decoded S signal are added and divided by 2 to generate a first output signal, and the decoded S signal is subtracted from the decoded M signal and divided by 2 to generate a second output signal. An LR converter;
A sound signal pseudo-localization decoding device including: An extended M code, an M gain code obtained by encoding an M gain, which is a representative value representing the magnitude of the M signal obtained by adding the input first input signal and the second input signal, and the M signal A code including a normalized M signal code obtained by encoding the normalized M signal normalized by the M gain,
The extended S code is normalized by an S gain code obtained by encoding an S gain that is a representative value representing the magnitude of the S signal obtained by subtracting the second input signal from the first input signal, and the signal is normalized by the S gain. And a normalized S signal code obtained by encoding the normalized S signal,
A first code separation unit for separating an M gain code and a normalized M signal code from the input extended M code;
A first partial decoding unit that decodes the separated normalized M signal code into a decoded normalized M signal;
A first gain decoding unit that decodes the separated M gain code to generate a decoded M gain;
A first multiplier that multiplies the decoded normalized M signal and the decoded M gain to obtain a decoded localization M signal;
A second code separation unit for separating the S gain code and the normalized S signal code from the input extended S code;
A second partial decoding unit that decodes the separated normalized S signal code into a decoded normalized S signal;
A second gain decoding unit for decoding the separated S gain code to generate a decoded S gain;
A ¹ _s = (N−2n−1) / N, where the number of points N ≧ 2 is the total number of directions where localization can be given, the location information n is the number of the direction giving localization, and the decoding S gain is A ′ _s . An extended pseudo-localization gain calculator that calculates a first pseudo S gain A ¹ _s and a second pseudo S gain A ² _s defined by A ² _s = A ′ _s / N;
A second multiplication unit that multiplies the decoded M signal and the first pseudo S gain to obtain a first constant S signal;
A third multiplier that multiplies the decoded normalized S signal and the second pseudo S gain to form a second localization S signal;
An adder that adds the first localization S signal and the second localization S signal to obtain a decoded S signal;
The decoded M signal and the decoded S signal are added and divided by 2 to generate a first output signal, and the decoded S signal is subtracted from the decoded M signal and divided by 2 to generate a second output signal. An LR converter;
A sound signal pseudo-localization decoding device including: An MS conversion step in which an MS conversion unit adds the first input signal and the second input signal to obtain an M signal, and subtracts the second input signal from the first input signal to obtain an S signal;
The total number of directions in which the extended pseudo-localization providing unit can provide localization with the number of points N ≧ 2, the number of the direction in which localization information is provided with the point information n, the M signal as S _M (t), and the S signal as S _S As (t), S ^o _M (t) = S _M (t), S ^o _S (t) = (N−2n−1) * S _M (t) / N + (1 / N) * S _S (t An extended pseudo-localization step for calculating the decoded M signal S ^o _M (t) and the decoded S signal S ^o _S (t) defined by
An LR converter adds the decoded M signal and the decoded S signal and divides by 2 to generate a first output signal, subtracts the decoded S signal from the decoded M signal and divides by 2 to obtain a second output signal. An LR conversion step for generating an output signal;
Sound signal pseudo-localization method including The M code is a code obtained by encoding the M signal obtained by adding the input first input signal and the second input signal.
The S code is a code obtained by encoding the S signal obtained by subtracting the second input signal from the first input signal,
A second decoding unit that decodes an inputted M code to obtain a decoded M signal; a second decoding step that decodes an inputted S code to obtain a decoded S signal;
The total number of directions in which the extended pseudo-localization providing unit can provide localization with the number of points N ≧ 2, the number of the direction in which localization information is provided with the point information n, the temporary decoding M signal as S _M (t), and the temporary decoding S _Assuming that the signal is S _S (t), S ^o _M (t) = S _M (t), S ^o _S (t) = (N−2n−1) * S _M (t) / N + (1 / N) * and extended pseudo localization imparting step of calculating decoded M signal ^S _o M (t) and the decoded S signal ^S _o S (t) which is defined by S _S (t),
An LR converter adds the decoded M signal and the decoded S signal and divides by 2 to generate a first output signal, subtracts the decoded S signal from the decoded M signal and divides by 2 to obtain a second output signal. An LR conversion step for generating an output signal;
A sound signal pseudo-localization decoding method including: An extended M code, an M gain code obtained by encoding an M gain, which is a representative value representing the magnitude of the M signal obtained by adding the input first input signal and the second input signal, and the M signal A code including a normalized M signal code obtained by encoding the normalized M signal normalized by the M gain,
The extended S code is normalized by an S gain code obtained by encoding an S gain that is a representative value representing the magnitude of the S signal obtained by subtracting the second input signal from the first input signal, and the signal is normalized by the S gain. And a normalized S signal code obtained by encoding the normalized S signal,
A first code separation step, wherein a first code separation unit separates an M gain code and a normalized M signal code from the input extended M code;
A first partial decoding unit that decodes the separated normalized M signal code to obtain a decoded normalized M signal;
A first gain decoding step in which a first gain decoding unit decodes the separated M gain code to generate a decoded M gain;
A first multiplication unit that multiplies the decoded normalized M signal and the decoded M gain to obtain a decoded M signal;
A second code separation step, wherein the second code separation unit separates the S gain code and the normalized S signal code from the input extended S code;
A second partial decoding step, wherein the second partial decoding unit decodes the separated normalized S signal code into a decoded normalized S signal;
A second gain decoding step in which a second gain decoding unit generates a decoded S gain by decoding the separated S gain code;
The extended pseudo-localization gain calculator calculates the total number of directions in which the number of points N ≧ 2 can be localized, the number of directions in which the point information n is localized, and the decoding S gain as A ′ _s , and A ¹ _s = (N -2n-1) / N, A ² _s = A's / N, an extended pseudo-localization gain calculation step for calculating a first pseudo S gain A ¹ _s and a second pseudo S gain A ² _s defined by
A second multiplying unit that multiplies the decoded M signal and the first pseudo S gain to obtain a first constant S signal;
A third multiplication unit that multiplies the decoded normalized S signal and the second pseudo S gain to obtain a second localization S signal;
An adding unit that adds the first localization S signal and the second localization S signal to obtain a decoded S signal;
An LR converter adds the decoded M signal and the decoded S signal and divides by 2 to generate a first output signal, subtracts the decoded S signal from the decoded M signal and divides by 2 to obtain a second output signal. An LR conversion step for generating an output signal;
A sound signal pseudo-localization decoding method including: An MS conversion step in which an encoding device adds a first input signal and a second input signal to obtain an M signal, and subtracts the second input signal from the first input signal to obtain an S signal;
A first gain encoding step in which an encoding device calculates and encodes a gain, which is a representative value representing the magnitude of the M signal, to obtain an M gain code;
A first signal encoding step in which the encoding device normalizes and encodes the M signal with a decoded M gain obtained by decoding the M gain code to obtain a normalized M signal code;
A first code multiplexing step in which an encoding device generates an extended M code including the M gain code and the normalized M signal code;
A second gain encoding step in which an encoding device calculates and encodes a gain that is a representative value representing the magnitude of the S signal to form a first S gain code;
A second signal encoding step in which the encoding device normalizes and encodes the S signal with a decoded S gain obtained by decoding the first S gain code to obtain a normalized S signal code;
A second code multiplexing step in which an encoding device generates an extended S code including the first S gain code and the normalized S signal code;
A code separating step in which a mixer separates an S gain code and a normalized S signal code from the extended S code;
A gain decoding step in which a mixer decodes the separated S gain code to generate a decoded S gain;
A first extended pseudo-localization gain calculation step in which the mixer calculates a pseudo-S gain A ^pseudo _s for changing the localization;
A gain encoding step in which the mixer encodes the pseudo S gain A ^pseudo _s into a second S gain code;
A code multiplexing step in which a mixer generates an S code including the separated normalized S signal code and the second S gain code;
A first code separation step in which the decoding device separates the normalized M signal code and the M gain code from the extended M code;
A first partial decoding step in which a decoding device decodes the separated normalized M signal code to generate a decoded normalized M signal;
A first gain decoding step in which a decoding device decodes the separated M gain code to generate a decoded M gain;
A first multiplication step in which the decoding device multiplies the decoded normalized M signal and the decoded M gain to obtain a decoded M signal;
A second code separation step in which the decoding device separates the normalized S signal code and the S gain code from the S code;
A second partial decoding step in which a decoding device decodes the separated normalized S signal code to generate a decoded normalized S signal;
A second gain decoding step in which the decoding device decodes the separated S gain code to generate a decoded S gain;
A second multiplication step in which the decoding device multiplies the decoded normalized S signal and the decoded S gain to obtain a first decoded S signal;
A second extended pseudo-localization gain calculating step in which the decoding device calculates a pseudo M gain gm2 defined by gm2 = (N−2 * n−1) / N, with the point information n as a direction number for giving localization;
A decoding device that multiplies the decoded M signal by the pseudo M gain gm2 to obtain a second decoded M signal;
An adding step in which the decoding device adds the first decoded S signal and the second decoded M signal to obtain a decoded S signal;
A decoding device adds the decoded M signal and the decoded S signal and divides by 2 to generate a first output signal, subtracts the decoded S signal from the decoded M signal and divides by 2 to provide a second output. An LR conversion step for generating a signal;
Sound signal pseudo-localization method including The first encoding device encodes an M gain code, which is a representative value representing the magnitude of the M signal obtained by adding the input first input signal and the second input signal, and the M signal to the M signal. Extended M code including a normalized M signal code obtained by encoding a normalized M signal normalized by M gain, and a quality extended M code obtained by encoding additional information for improving the quality of a decoded sound signal And an S gain code obtained by encoding an S gain, which is a representative value representing the magnitude of the S signal obtained by subtracting the second input signal from the first input signal, and the S signal is normalized by the S gain. A first code for generating an extended S code including a normalized S signal code obtained by encoding a normalized S signal and a quality extended S code obtained by encoding additional information for improving the quality of a decoded sound signal Step,
An M gain code obtained by encoding an M gain, which is a representative value representing the magnitude of the M signal obtained by adding the input first input signal and the second input signal, and the M signal Extended M code including a normalized M signal code obtained by encoding a normalized M signal normalized by M gain, and a quality extended M code obtained by encoding additional information for improving the quality of a decoded sound signal And an S gain code obtained by encoding an S gain, which is a representative value representing the magnitude of the S signal obtained by subtracting the second input signal from the first input signal, and the S signal is normalized by the S gain. A second code for generating an extended S code including a normalized S signal code obtained by encoding the normalized S signal and a quality extended S code obtained by encoding additional information for improving the quality of the decoded sound signal Step,
A first code separation step in which a mixer separates an M gain code, a normalized M signal code, and a quality extension M code from an extended M code generated by one of the two encoding devices;
A first quality extended decoding step in which the mixer decodes the quality extended M code into a first quality extended M signal;
A second code separation step in which the mixer separates the S gain code, the normalized S signal code and the quality extended S code from the extended S code generated by the one encoding device;
The mixer decodes the quality-enhanced S code to obtain the first quality-enhanced S signal, and the total number of points in which the localization can be given localization number N ≧ 2, localization information n ₁ A first extended pseudo-localization gain calculation step in which the first pseudo M gain is (2n ₁ + 1−N) / N and the first pseudo S gain is 1 / N,
A first multiplication step in which a mixer multiplies the first quality extended M signal and the first pseudo M gain to form a first pseudo localization M signal;
A second multiplication step in which the mixer multiplies the first quality extended S signal and the first pseudo S gain to form a first pseudo localization S signal;
A first addition step in which the mixer adds the first pseudo-localization M signal and the first pseudo-localization S signal to form a first localization transformation S signal;
A third code separation step in which the mixer separates the quality extension M code from the extension M code generated by the other of the two encoding devices;
A third quality extended decoding step in which the mixer decodes the quality extended M code into a second quality extended M signal;
A fourth code separation step, wherein the mixer separates the quality extended S code from the extended S code generated by the other encoding device;
A fourth quality extended decoding step, wherein the mixer decodes the quality extended S code into a second quality extended S signal;
The mixer calculates the second extended pseudo-localization gain by setting the location information n ₂ as the direction number for giving the localization, the second pseudo M gain as (2n ₂ + 1−N) / N, and the second pseudo S gain as 1 / N. Steps,
A third multiplying step by which the mixer multiplies the second quality extended M signal and the second pseudo M gain to form a second pseudo localization M signal;
A fourth multiplying step by which the mixer multiplies the second quality extended S signal and the second pseudo S gain to form a second pseudo localization S signal;
A second addition step in which the mixer adds the second pseudo-localization M signal and the second pseudo-localization S signal to form a second localization transformation S signal;
A third addition step in which the mixer adds the first quality extended M signal and the second quality extended M signal to obtain a localization mixed M signal;
A first quality extension encoding step in which the mixer encodes the localization mixed M signal into a localization mixed M code;
A first gain decoding step in which a mixer decodes the separated M gain code to obtain a decoded M gain;
A fifth multiplication step in which the mixer multiplies the decoded M gain and the first pseudo M gain to obtain a localization M gain;
A first gain encoding step in which the mixer encodes the localization M gain to obtain a localization M gain code;
A first code multiplexing step in which a mixer generates an extended M code including the localization mixed M code, the localization M gain code, and the separated normalized M signal code;
A mixer adding a first localization transformation S signal and the second localization transformation S signal to obtain a localization mixed S signal; a fourth addition step;
A second quality extension encoding step in which the mixer encodes the localization mixed S signal into a localization mixed S code;
A mixer, a second gain decoding step of decoding the separated S gain code to obtain a decoded S gain;
A mixer that multiplies the decoded S gain and the first pseudo S gain to obtain a localization S gain;
The mixer encodes the localization S gain to obtain a localization S gain code, and a mixer obtains the localization mixed S code, the localization S gain code, and the separated normalized S signal code. A second code multiplexing step for generating an extended S code including:
A first code separation step in which the decoding device separates the normalized M signal code, the localization M gain code, and the localization mixed M code from the extended M code generated by the mixer;
A first signal decoding step in which a decoding device decodes the normalized M signal code into a normalized decoded M signal;
A first gain decoding step in which a decoding device decodes the localization M gain code to obtain a decoded M gain;
A decoding device that multiplies the normalized decoded M signal and the decoded M gain to obtain a first decoded M signal;
A first quality extended decoding step in which a decoding device decodes the localization mixed M code into a second decoded M signal;
A first adding step in which the decoding device combines the first decoded M signal and the second decoded M signal into a decoded M signal;
A second code separation step in which the decoding device separates the normalized S signal code, the localization S gain code, and the localization mixed S code from the extended S code generated by the mixer;
A second signal decoding step in which the decoding device decodes the normalized S signal code into a normalized decoded S signal;
A second gain decoding step in which the decoding device decodes the localization S gain code to obtain a decoded S gain;
A second multiplication step in which the decoding device multiplies the normalized decoded S signal and the decoded S gain to obtain a provisional first decoded S signal;
A second quality extended decoding step in which the decoding device decodes the localization mixed S code into a second decoded S signal;
A second extended pseudo-localization gain calculating step in which the decoding device calculates a pseudo gain (N-2n ₁ -1) / N;
A third multiplication step in which the decoding device multiplies the first decoded M signal and the pseudo gain to obtain a provisional second decoded S signal;
A second adding step in which the decoding device adds the temporary first decoded S signal and the temporary second decoded S signal to form a first decoded S signal;
A third adding step in which the decoding device combines the first decoded S signal and the second decoded S signal into a decoded S signal;
A decoding device adds the decoded M signal and the decoded S signal and divides by 2 to generate a first output signal, subtracts the decoded S signal from the decoded M signal and divides by 2 to provide a second output. An LR conversion step unit for generating a signal;
Sound signal pseudo-localization method including   A computer functions as each part of the sound signal pseudo-localization system according to claim 1, each part of the sound signal pseudo-localization decoding apparatus according to claim 6, or each part of the sound signal pseudo-localization decoding apparatus according to claim 7. Program to let you.

Images