JPH06301390A - Stereoscopic sound image controller - Google Patents

Abstract

PURPOSE:To provide a much realer three-dimensional stereoscopic video acoustic equipment by positioning respective sound sources at the positions of spaces corresponding to the spatial positions of respective objects in a stereoscopic image and matching the image and the sound. CONSTITUTION:This device is provided with three-dimensional video data containing a three-dimensional voice signal composed of an angle thetan from a front face to each object in the image with the position of a listener as a reference, distance rn and acoustic signal Sn generated by each object together with the three-dimensional video signal of a still picture or a moving image, plural speaker means arranged around the listener and signal processing part to distribute the acoustic signal Sn to the plural speaker means corresponding to the positions of objects in each image by inputting the three-dimensional voice signals (thetan, rn and Sn), the plural speakers are divided into plural areas, and the signal processing part specifies an area, where the sound image corresponding to the object is positioned, corresponding to the angle thetan, selects the speaker to be used and calculates the distance attenuation of the acoustic signal Sn corresponding to the distance rn.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a stereophonic sound image control device for stereoscopically producing sounds of individual objects in a stereoscopic image to a listener.

[0002]

2. Description of the Related Art For example, Japanese Unexamined Patent Application Publication No. 3-9700 discloses 3
The technology of controlling the sound image of the space using two speakers is disclosed, but the obtained sound images are located in the same plane,
Although the sound image position in the plane can be controlled, there is a problem that all sounds can be heard only from the front of the listener.

Further, Japanese Patent Laid-Open No. 4-56500 discloses a technique of controlling a sound image by using 2n speakers at n listening positions, but it is processed before 2n speakers. The acoustic signal itself does not have depth information,
Since it has only left-right linear position information for the listener, the sound image emitted from this speaker is still flat for each listener, and the sound image cannot be localized at any position in the listening space. There was a problem that a stereoscopic sound image could not be obtained in the sense of.

[0004]

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned problems of the prior art, in which each sound source is positioned at a spatial position corresponding to the spatial position of each object in a stereoscopic video image. It is intended to obtain a more realistic three-dimensional stereoscopic audiovisual apparatus by matching the sound and the sound.

[0005]

The present invention can be applied to a still image or
Is based on the position of the listener together with the 3D video signal of the moving image.
Angle θ from the front to each object in the image_n , Distance r
_n , And the acoustic signal S generated by each of the objects_n Consisting of 3
Three-dimensional image data including a three-dimensional audio signal, and the listener
A plurality of speaker means arranged around, and the three-dimensional
Audio signal (θ_n, r _n, S_n ) Enter the item in each image
Corresponding to the position of the body, the acoustic signal is transmitted to the plurality of speaker means.
Issue S_n And a signal processing unit that distributes the
The peaker is divided into a plurality of areas, and the signal processing unit
Angle θ_n The area where the sound image corresponding to the object is located
Select the speaker to be specified and use the distance r_n To
Therefore, the acoustic signal S_n Compute the distance attenuation of.

[0006]

In the above structure, the three-dimensional audio signal is taken into the signal processing unit at the same time when the video signal is reproduced, and the processing such as the distance attenuation of the acoustic signal, the specification of the sound image area, the selection of the output speaker, etc. is performed from the selected speaker The processed three-dimensional audio signal is output, and a stereoscopic sound image is obtained.

[0007]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the stereophonic image device of the present invention will be described in detail below with reference to the drawings. FIG. 1 is a circuit block diagram showing a main part of a stereoscopic sound image device when six speakers are used. In the figure, 11 to 1n are three-dimensional audio signals (θ ₁ , r ₁ , S ₁ ) of the objects 1 to n in the three-dimensional stereoscopic image.
_{~ (Θ n, r n,} S n) inputs a signal processing unit for performing the processing described below, 21 to 26 adders for adding the output of the signal processing unit 11 to 1n, 31 to 36 are adders 21-2
6 are speakers A to F driven by the output of FIG. An amplifier or the like is required before each of the speakers A31 to F36, but they are omitted in this figure.

Here, the three-dimensional voice signal (θ ₁ , r ₁ ,
_{S 1) ~ (θ n,} r n, the S _n) will be described with reference to FIG. In order to reflect each object in the stereoscopic image in the space where the listener is present, the listener O is set as the origin, and the object (sound source) 1 is displayed in polar coordinates from the origin O (θ
_{Since the} condition is that the acoustic signal S ₁ is emitted at the position of ₁ , ₁ , r ₁ ), the audio signal input to the signal processing units 11 to 1n needs to include such information. Therefore, it is assumed that the original stereoscopic video signal includes such an audio signal, and the audio signal is taken out at the same time when the video is reproduced.

Next, the arrangement of the speakers A31 to F36 will be described with reference to FIG. These six speakers A31
F36 is equidistant from the listener O and the front is 0 °-
30 ° (speaker A31), 30 ° (speaker B3)
2) 90 ° (speaker C33), 150 ° (speaker D34), 210 ° (speaker E35) and 270 ° (speaker F36). The angle should be clockwise when the direction is positive. In this way, each speaker A
31 to F36 are arranged around the listener O every 60 °. Then, a range (−30 ° ≦ θ <30 °) surrounded by the listener O and the speakers A31 and B32 is set as a region I, and the regions II to VI are set in the same manner hereinafter. The signal processing units 11 to 1n calculate the distance attenuation for the acoustic signal S _n , specify the regions I to VI, select the speakers A31 to F36 to be used, and select the selected speaker A31. The sound signal S _n is distributed to F36.

That is, first, with respect to the input acoustic signal S _n and distance r _n as shown in FIG.

[0011]

[Equation 1]

The distance attenuation S _n 'of the acoustic signal is obtained by using.

Next, based on the input angle θ _n , I to IV
Area is specified. The data of a pair of corresponding speakers A31 to F36 is given to each area I to IV in advance, and if the area I is specified, the speaker to be used is A31.
And B32, region II B32 and C33, region III C33 and D34, region IV D34 and E35, region V E35 and F36, region VI F36 and A31.
And so on. And the angle θ _n is

[0014]

[Equation 2]

By θ _n '(−30 ° ≦ θ _n '<30 °)
Is converted to. Thus, the result of the processing shown in FIG. 4 is output to the next processing as S _n ', θ _n ' and the information M of the specified area.

The next process is the distribution of the acoustic signal. This is the input signal S _n ', θ as shown in FIG. 5 or 6.
Based on _n ', an acoustic signal is paired with a speaker (speakers A31 and B32 in FIG. 5, speakers C33 and D3 in FIG. 6).
4), and the distributed acoustic signals S _n '(A) and S _n ' (B)
, S _n '(C) and S _n ' (D) are obtained.

For example, the area information M obtained in the preceding processing of the signal processing units 11 to 1n is "area I, speaker A3 used.
1, B32 ”,

[0018]

[Equation 3]

The distributed acoustic signals S _n '(A), such that
Determine S _n '(B). In the above mathematical expression 3, k is the level difference between the distributed acoustic signals S _n '(A) and S _n ' (B),

[0020]

[Equation 4]

Is given by In addition, ΔI in Equation 4
Is in dB, and if the levels of the distributed acoustic signals S _n '(A) and S _n ' (B) are A [dB] and B [dB],

[0022]

[Equation 5]

Is given by

The distributed acoustic signals S _n '(A) and S _n ' (B) obtained as a result of the above processing in the signal processing units 11 to 1 _n.
Is finally mixed through the adders 21 to 26, and amplified through the amplifier to obtain the corresponding speakers A31 to F.
By supplying the sound image to the object 36, it is possible to localize a sound image as if the object exists at a position in the listening space corresponding to the object in the image and sound is emitted from the object.

In the three-dimensional sound image control device having the above configuration
For example, if there are three objects (sound sources) in the image
Let this be Object 1, Object 2, and Object 3, and Object 1 is an image
Is in region I in the listening space corresponding to the space
It is assumed that 2 is in area II and object 3 is in area IV. in this case
As shown in FIG. 7, the audio signals (θ₁ , R
₁ , S₁ ), (Θ₂ , R₂ , S₂ ), (Θ₃ , R₃ , S
₃ ) Is processed by the corresponding signal processing unit 11, 12, 13
Distributed audio signal S₁'(A), S₁'(B), S₂'(B), S
₂'(C), S₃'(D), S₃Become '(E), S₁'(A) is
To the calculator 21, S₁'(B) and S₂'(B) goes to adder 22, S₁'
(C) goes to the adder 23, and S₃'(D) goes to adder 24, S₃'
(E) is supplied to the adder 25. 41-46 are amplifiers
Yes Divided sound mixed by each of the adders 21 to 25
Sound signal S₁'(A), S₁'(B), S₂'(B), S₂'(C), S₃'
(D), S₃'(E) corresponds to the desired acoustic signal
Driving the speakers A31 to E35, it is as if the regions I and I
An object is located at I and IV, and sounds can be heard from there.
A stereoscopic sound image is obtained.

[0026]

As described above, according to the present invention, the three-dimensional sound which has not been realized in the past can be realized and the viewer can see an object appearing to jump out of the screen. On the other hand, it is possible to easily create a situation in which sound is heard from the position where it pops out, or VR (Virtual) where a listener exists in the center of the image.
In the field of (Reality), it is possible to easily create a situation in which an object is placed around a viewer and sound is heard from there, so that it is possible to more effectively provide a simulated experience in a three-dimensional space.

[Brief description of drawings]

FIG. 1 is a circuit block diagram showing an embodiment of a three-dimensional sound image control device of the present invention.

FIG. 2 is a conceptual diagram illustrating the meaning of the audio signal of FIG.

FIG. 3 is a schematic diagram illustrating the arrangement of the speakers in FIG.

FIG. 4 is a functional block diagram for explaining the processing of the preceding stage of the signal processing unit in FIG.

FIG. 5 is a functional block diagram illustrating processing in the latter stage of the signal processing unit in FIG.

FIG. 6 is a functional block diagram for explaining another embodiment of the processing subsequent to the signal processing unit in FIG.

FIG. 7 is a circuit block diagram showing a sound image control device according to the present invention when there are three objects.

[Explanation of symbols]

 11-1n Signal processing part 21-26 Adder 31-36 Speaker A-F 41-46 Amplifier

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁵ Identification code Internal reference number FI Technical indication H04R 3/12 A 7346-5H H04S 1/00 K 8421-5H 7/00 F 8421-5H

Claims (1)

[Claims] 1. An angle θ _n from a front surface to each object in the image, a distance r _n , and a sound generated by each object based on the position of the listener together with a three-dimensional video signal of a still image or a moving image. inputs and three-dimensional image data including three-dimensional audio signal and a signal S _n, and a plurality of speaker means disposed around the listener, the 3D audio signal _{(θ n, r n, S} n) the And a signal processing unit for distributing the acoustic signal S _n to the plurality of speaker means corresponding to the position of the object in each image, and dividing the plurality of speakers into a plurality of regions. The signal processing unit specifies the region where the sound image corresponding to the object is located by the angle θ _n , selects the speaker to be used, and calculates the distance attenuation of the acoustic signal S _n by the distance r _n . Control device.