JP2007266967A - Sound image localizer and multichannel audio reproduction device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a device capable of making a sound image synchronize with an object in a video and localizing the sound image in three dimensions, and enhancing presence, and its program. <P>SOLUTION: This device is provided with a controller for dealing with the sound signals of multichannels, a projector 3, a screen 6 for displaying an image of the projector 3 on, and a frontal speaker array 2. The controller is provided with a signal processor and a parameter computation portion. The signal processor processes a frontal sound input out of the sound signals of these multichannels, and outputs it to the speaker array 2. The parameter computation portion takes in information on a sound source position synchronized with a figure 104 in a video input and determines the coordinates (X, Y, Z) of a virtual sound source VS, and moreover set a delay amount, a volume, and parameters of high-frequency attenuation on the basis of the travelling distance Li(i=1 to N) up to a speaker SPi(i=1 to N) of the speaker array 2 from the virtual source VS. Based on this setting, the signal processor processes the front sound input. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an apparatus for controlling the localization of a center channel audio signal in accordance with video when multi-channel audio is reproduced together with video.

  2. Description of the Related Art Conventionally, in movie theater video systems and home theater devices, devices that output multi-channel audio along with video have been put to practical use. In such an apparatus, various sound effects are output as multi-channel sound not only from the front but also from the rear. The dialogue of the person appearing in the video is output from the center channel set at one point in front of the front.

  In addition, in order to further enhance the sense of reality, an apparatus that provides sound image localization in synchronization with an object (including a character and a natural object) in an image is disclosed (for example, see Patent Documents 1 and 2).

Patent Document 1 discloses an image-linked sound reproduction method that is configured using a screen that also serves as an acoustic reflector and a directional speaker. This patent document describes that the direction of the speaker is changed so that the directivity of the speaker matches the point of the sounding body projected on the screen, and the sound generated from the sounding body is reproduced.
Japanese Patent Application Laid-Open No. 2004-228561 describes that a speaker at a projection position of a sounding body is driven using a screen in which a large number of speakers are embedded in a matrix. Patent Document 3 is similar to Patent Document 2, but discloses that the screen itself vibrates as a diaphragm.
Japanese Patent No. 2714647 JP-A-4-115692 Japanese Utility Model Publication No. 5-38639

However, the configuration of the conventional literature is still not sufficient.
In Patent Document 1, since the sound of one sounding body is reproduced by a single directional speaker, the difference in the depth of the person position cannot be reproduced, and the sound image localization has to be planar. In addition, a screen that also serves as an acoustic reflector must be used, and there is a problem that the material shape of the screen is limited.

  Further, in the configurations of Patent Documents 2 and 3, simply by driving a speaker driving unit corresponding to the position according to an object on the screen, the difference in depth cannot be expressed, and the sound image localization is planar. There was a problem that had to be done.

  SUMMARY OF THE INVENTION An object of the present invention is to provide an apparatus and a program that can improve a sense of reality by locating a sound image in three dimensions in synchronization with an object in a video.

In the present invention, means for solving the above-described problems are configured as follows.

(1) The present invention
A multi-channel audio signal that includes a center channel and is synchronized with the video signal; and an input unit that inputs position information indicating a generation position of the audio signal of the center channel in the video displayed by the video signal;
Left and right channel output units for outputting audio signals other than the center channel to the corresponding speakers;
A control unit for controlling a speaker array having a plurality of speaker units arranged in an array, wherein each speaker unit receives an audio signal of the center channel so that an audio beam is focused on a position indicated by the position information. A localization control unit for controlling the timing of input to
Is a multi-channel audio playback device.

  In the present invention, the input unit inputs a multi-channel audio signal that includes a center channel and is synchronized with the video signal, and position information that indicates a generation position of the audio signal of the center channel in the video displayed by the video signal. . In the localization control unit, the center speaker that outputs this audio signal usually outputs speech such as speech at one point in the image and lacks a sense of reality. However, the present invention accepts input of position information. Since the timing at which the audio signal of the center channel is input to each speaker unit is controlled so that the audio beam is focused on the position indicated by the position information, accurate sound image localization can be performed in synchronization with the video signal. It becomes possible.

  Further, according to the present invention, the position of the sound image localization can be set to an arbitrary position without requiring mechanical elements such as a ceiling or a wall. Furthermore, according to this apparatus, the Doppler effect or the like can be accurately expressed as a result of accurate sound image localization, instead of simulating the sound effect such as the Doppler effect.

In the present invention, if an input of an audio signal and an input of position information are processed by the signal processing unit through the “input unit”, these inputs are stored in an external storage unit (hard disk, magneto-optical disk, etc.). Or streaming data provided through a communication line. The “input unit” may be a temporary storage device (memory), for example.
The present invention also relates to a sound image localization device, and is not limited to those used in movie theaters and home theaters, but includes devices used for these devices.

(2) The present invention
An input unit for inputting a video signal and an audio signal synchronized with the video signal;
A generation position estimation unit that estimates a generation position of the audio signal based on the video signal;
A control unit that controls a speaker array having a plurality of speaker units arranged in an array, and inputs the audio signal to each speaker unit so as to form an audio beam focused on the estimated generation position. A localization control unit for controlling timing;
Is a sound image localization apparatus.

  In the present invention, the position information is not provided as in the structure (1), but the generation position estimation unit estimates the generation position of the signal. Further, the localization control unit controls the timing at which the audio signal is input to each speaker unit of the speaker array so that the audio beam is focused on the estimated generation position. Even when an audio input that is not given is input, the audio signal can be stereoly localized at the position where the audio signal is generated in synchronization with the video signal.

(3) The present invention
An input unit for inputting a video signal and an audio signal of a multi-channel audio signal input channel including a center channel and synchronized with the video signal;
Left and right channel output units for outputting audio signals other than the center channel to the corresponding speakers;
A generation position estimation unit that estimates a generation position of the audio signal of the center channel based on the video signal;
A control unit for controlling a speaker array having a plurality of speaker units arranged in an array, wherein each speaker unit receives an audio signal of the center channel so as to form an audio beam focused on the estimated generation position. A localization control unit for controlling the timing of input to
Is a multi-channel audio device.

  In the present invention, the position information is not provided as in the structure (1), but the generation position estimation unit estimates the generation position of the signal. Since such an estimation is performed, the generation position of the signal is estimated even when an audio input for which position information is not given is input to the audio input for the center channel. .

  (4) In the present invention, the speaker array is arranged on a screen surface on which an image based on the image signal is displayed.

  If comprised in this way, a sound can be output from the position close | similar to the object on a screen synchronizing with the object which appears on a screen. Also, unlike the conventional literature, the effect of the above configuration is achieved, so that it is possible to output the sound image localization spread on the screen from the virtual sound source behind the screen. Therefore, the sound image can be localized three-dimensionally.

  According to the present invention, in synchronism with an object appearing on the screen, a sound image spread from the virtual sound source can be reproduced instead of simply projecting the sound image localization to one point on the screen. Sound image can be localized.

<Description of Theater System of First Embodiment>
The configuration of the theater system according to the first embodiment will be described with reference to the drawings. FIG. 1 shows this configuration. This theater system inputs and reproduces video signals and multi-channel audio signals.
As shown in FIG. 1, a screen 6 for displaying an image and a front speaker array 2 in which speakers SPi (i = 1 to N) are arranged in an array are provided in front of a viewer 999. In addition, a left front speaker SPL and a right front speaker SPR are provided diagonally forward of the viewer 999. Further, a bass speaker SPW is provided in front of or obliquely forward of the viewer 999. Further, the projector 3 installed on the rear upper part or on the front desk is provided with the left rear speaker SPLR and the right rear speaker SPRR obliquely rearward. Furthermore, the control apparatus 10 which inputs the various signals 100-102 to the input part 11, and controls the above speaker and projector is provided. Each configuration will be described below.

The screen 6 displays the image output from the projector 3.
The projector 3 includes a projection element that converts an electric signal into light and outputs the light. The projector 3 converts the electric signal of the video signal 100 that has passed through the control device 10 into light and displays the light on the screen 6.

  The speakers SPL, SPR, SPLR, SPRR, SPW and the speakers SPi (i = 1 to N) of the front speaker array 2 can be composed of, for example, dynamic speakers, and convert the electrical signal output from the control device 10 into sound. Here, the speakers SPL, SPR, SPLR, and SPRR may be configured by a speaker system including a plurality of speaker units so as to cover a wide frequency band. The SPW is composed of a bass speaker for reinforcing the bass.

  The front speaker array 2 in FIG. 1 outputs a center channel audio signal among multi-channel audio signals. The audio signal of the center channel includes the sound of the object displayed in the video, the dialogue of the characters, and the like.

  Further, one channel of each of the multi-channel audio signals 102 is assigned to the speakers SPL, SPR, SPLR, and SPRR. In addition, a heavy bass signal extracted from each channel is input to the speaker SPW.

  Here, the input signals 100, 101, and 102 will be described. The video signal 100 is a video image, and may be an analog video signal or a digital video signal. Input image data such as MPEG. The sound source position information 101 is information indicating the position of a predetermined object in the video signal 100, that is, an object or person whose sound is assigned to the center channel, and not only the coordinates (x, y) on the screen. This is three-dimensional information including the coordinate (z) in the depth direction. This information is input every moment in synchronization with the video signal. The position information 101 may be information in a polar coordinate system with the center of the screen 6 as the origin. Further, a combination of these coordinate systems may be used. The audio signal 102 is a multi-channel audio signal and corresponds to each of the above-described speakers.

  Next, center channel localization control in the theater system will be described with reference to FIGS.

  FIG. 2 is a diagram for explaining the concept of the localization position of the sound of the center channel. On the screen 6, an image such as a movie by the image signal projected on the input unit by the projector 3 is displayed. In the figure, a person 104 is included in the projected video. The dialogue spoken by the person 104 is assigned to the center channel. Therefore, in the theater system 1 of this embodiment, the center channel audio signal is localized at the position of the person 104.

  The position information of the person 104 is input as sound source position information in synchronization with the video signal. The sound source position information 101 is given by three-dimensional coordinates (X, Y, Z). As shown in FIG. 2, the X coordinate represents the horizontal direction, the Y coordinate represents the height direction, and the Z coordinate represents the depth from the screen 6. The control device 10 uses the front speaker array 2 to form a wavefront such that the center channel sound signal is emitted from the virtual sound source VS in order to localize the sound image of the center channel on the virtual sound source VS (X, Y, Z). .

  Next, a method for reproducing the sound image localization of the virtual sound source VS will be described with reference to FIG. First, how to transmit sound waves will be described with reference to FIG. As shown in FIG. 3A, if the wavefront 91 is output from the virtual sound source VS, the wavefront 91 diffuses uniformly in the same circle around the virtual sound source VS. That is, at the R position 90 where the propagation distance from the virtual sound source VS is constant, the arrival time from the virtual sound source VS is the same at any position, the sound volume is the same, and the frequency characteristics (particularly high-frequency attenuation). Is the same.

  Next, a method for reproducing the way of transmission of sound waves from the virtual sound source VS shown in FIG. 3A with the front speaker array will be described with reference to FIG. As shown in FIG. 3B, the sound wave front 109i (i = 1 to N) is output from each SPi. Since the distances from the virtual sound source VS to each SPi are different from each other, in order to reproduce the localization “uniformly diffusing from the virtual sound source VS” as described above with reference to FIG. In consideration of the arrival time difference obtained by dividing the distance 92i (i = 1 to N) = R−Li by the sound speed, it is necessary to adjust the timing of outputting sound, that is, the delay amount. For example, if the distance 92N is shorter than the other distances 92i, it is necessary to reduce the volume of the speaker SPN so that the volume is equal when listening at the position 90. Further, the high frequency is attenuated by making the frequency characteristic proportional to the inclination angle from the virtual sound source VS or the square of the distance propagation distance Li (i = 1 to N) from the virtual sound source VS. If the delay amount, volume, and frequency characteristics are adjusted in this way, the wavefront 911 synthesized by the speakers SPi (i = 1 to N) becomes the wavefront 91 of the sound propagated from the virtual sound source VS (FIG. 3A). The center channel can be localized to the virtual sound source VS.

  Note that an audio signal that spreads with the virtual sound source VS as a focal point is referred to as a “sound emission beam”.

  Next, the internal configuration of the control device 10 will be described with reference to FIG. As shown in FIG. 1, the control device 10 includes an input unit 11 that inputs various signals, a signal processing device 5 that processes a signal input from the input unit 11 and outputs a signal output to each speaker, And a parameter calculator 12 that calculates parameters for adjusting the sound output to each speaker SPi (i = 1 to N) of the front speaker array 2 based on the sound source position information 101 described above.

  The input unit 11 has an interface for inputting each signal and a readable / writable buffer for storing the input signal. Various AV devices such as the Internet and VTR are connected to the input unit 11.

  The signal processing device 5 (inside the two-dot chain line) is configured by a DSP or the like and functionally includes the following processing blocks. That is, a delay unit 52i (i = 1 to N), a gain adjuster 53i (i = 1 to N), an equalizer 54i (i = 1 to N) for sequentially processing the center channel audio signal 1021, and the D / A described above. A converter 56i (i = 1 to N) is provided. In addition, a delay control device 51 that controls the delay state of the delay device 52i (i = 1 to N) is provided. Also, a left / right channel input signal processing unit 581 and a D / A converter 591 for processing and outputting a signal 1022 of a channel other than the center channel are provided. Further, a bass sound input signal processing unit 582 and a D / A converter 592 for processing the bass sound signal 1023 extracted from each channel are provided.

  The delay device 52i (i = 1 to N) is configured by a ring buffer or the like that is a memory that reads and writes in a ring shape, and gives a predetermined delay to the front audio signal 1021 under the control of the delay control device 51, and the speaker Output to SPi (i = 1 to N).

The gain adjuster 53i (i = 1 to N) has a bit shift function, and based on the gain adjustment information 106 that is a parameter output of the parameter calculation unit 12, as described with reference to FIG. The output volume of i = 1 to N) is adjusted. This adjustment is performed based on a value calculated by a parameter calculation unit 12 described later.
The equalizer 54i (i = 1 to N) has a function of performing a convolution operation on the audio signal with the FIR filter, and adjusts the high frequency as described with reference to FIG. The coefficients of the FIR filter are obtained by inputting equalizer information 107 including FIR parameters calculated by the parameter calculation unit 12 provided outside the signal processing device 5.

  The D / A converter 56i (i = 1 to N) is constituted by the D / A converter IC as described above. The digital audio output of the equalizer 54i (i = 1 to N) is converted into an analog audio output.

  Note that an amplifier that amplifies these audio signals is provided between the D / A converter 56i (i = 1 to N) and the front speaker array 2, but illustration thereof is omitted in FIG.

  The delay control device 51 is configured as a part of a DSP function for processing the entire signal processing device 5 or includes an IC having a calculation function. The delay control device 51 controls the reading position and sampling rate of the delay unit 52i (i = 1 to N) based on the delay rate calculated by the parameter calculation unit 12, and the delay amount information 105 is stored in the delay unit 52i (i = 1 to N).

  The left and right channel signal processing unit 581 in FIG. 4 processes the signal 1022 of the channels other than the center channel and outputs the processed signal 1022 to the D / A converter 59. The delay unit 52i, the gain adjuster 53i, the equalizer 54i, It has the same configuration. However, unlike the above-described 52i and 53i, the left and right channel signal processing unit 581 does not necessarily need to process the surround input 1022 based on the calculation result of the parameter calculation unit 12.

  The D / A converter 591 has the same configuration as the D / A converter 56i (i = 1 to N), and converts each digital audio output of the left and right channel signal processing unit 581 into an analog audio output.

The bass sound input signal processing unit 582 in FIG. 4 processes the bass sound signal 1023 and outputs the processed signal to the D / A converter 59, and is similar to the delay unit 52i, the gain adjuster 53i, and the equalizer 54i described above. It has a configuration.
The D / A converter 592 has a configuration similar to that of the D / A converter 56i (i = 1 to N), and converts the digital sound output of the bass sound input signal processing unit 582 into an analog sound output.

  The parameter calculation unit 12 includes an IC for calculating various parameters and a ROM for storing control data (for example, data such as sound speed) used for the calculation. Alternatively, a CPU may be provided in the control device 10 instead of the IC, and this may be configured as one function of this CPU. As described above, the parameter calculation unit 12 calculates parameters for adjusting the sound output to each speaker SPi (i = 1 to N) of the front speaker array 2 based on the sound source position information 101.

  Next, the parameter setting process of the parameter calculation unit 12 will be described with reference to FIGS.

  In order to realize the localization of the virtual sound source VS as shown in FIG. 5, as described in FIG. 3, the synthesized wave front 911 is output so that the wave front of the sound diffused from the virtual sound source VS becomes uniform. There is a need to. For this reason, the delay unit 52i (i = 1 to N) adjusts the timing of outputting the sound by delaying the signal input to the input unit 11. The gain adjuster 53i (i = 1 to N) adjusts the volume. The equalizer 54i (i = 1 to N) adjusts the high frequency. The parameter calculation unit 12 controls these 52i, 53i, and 54i to generate a parameter for outputting a sound emission beam that focuses on the virtual sound source VS.

  Note that the left and right channel signal processing unit 581 in FIG. 4 may perform sound image localization at a position in a predetermined direction using crosstalk cancellation or a model head related transfer function.

  FIG. 6A is a plan view of the front speaker array 2 shown in FIG. 1 as viewed from above, and shows the positional relationship of the virtual sound source VS set on the back side of the front speaker array 2. FIG. 6B shows an example of specific values for parameter setting based on the positional relationship shown in FIG.

  The propagation distance Li (i = 1 to N) shown in FIG. 6A corresponds to the distance shown in FIG. 2, FIG. 3, and FIG. 5, and the angle αi (i = 1 to N) is This is the angle between the virtual sound source VS and the front speaker array 2. The parameter calculation unit 12 determines the position of the virtual sound source VS based on the sound source position information 101 and obtains the coordinate values X, Y, and Z of the virtual sound source VS. Based on this, the propagation distance Li (i = 1 to N) [m] as shown in FIG. 6A, that is, the virtual sound source VS set above and each speaker SPi of the front speaker array 2 The propagation distance Li (i = 1 to N) is calculated. Also, the angle between the receiving side unit 1B and the virtual sound source VS is calculated (in FIG. 4, the angle is seen from directly above, but the angle αi (i = 1 to N) with the speaker SPi is actually calculated). .

Next, as shown in FIG. 6B, parameters of the parameter calculation unit 32 are set based on the distance calculation result of FIG.
In the delay amount setting 121, the time delay is calculated and set by dividing the propagation distance Li (i = 1 to N) by the speed of sound. This delay amount is set to a value obtained by dividing the propagation distance Li [m] by the sound velocity V [m / s] (indicated by minus in the figure). In FIG. 3, the delay amount R-Li is described as being divided by the sound speed, but the constant R is relatively negligible.

In the sound volume setting 122 in FIG. 6, the sound volume is inversely proportional to the square of the distance. Therefore, the predetermined reference sound volume is divided by the distance propagation distance Li (i = 1 to N). For SP1, the volume setting can be set to the reference volume volume × 1 [m] / propagation distance Li ² [m].

  In addition, in the high frequency gain setting 123 for adjusting the frequency characteristics of FIG. 6B, the high frequency of the sound reaching each speaker SPi is attenuated by the directivity of the high frequency, so that this attenuation is taken into consideration. It is possible to set a filter parameter having a frequency characteristic that attenuates. For SP1, the high-frequency equalizer level can be (cosαi) times the average gain level in the frequency domain, for example.

  Next, the configuration of the delay device 52i (i = 1 to N) (see FIG. 4) of the system of the first embodiment will be described in more detail with reference to FIG. FIG. 7 shows a configuration diagram when the delay device is configured by a ring buffer. The audio signal input 1021 is stored in the input unit 11 constituted by a memory that can read and write the data, and the ring buffer 111 is provided in a part of the input unit 11 that is separate from this, or the ring buffer 111. Is a readable / writable memory provided in the signal processing device 5. The delay control device 51 divides the ring buffer 111 into data address sections as shown in the data section 112, and writes the front audio signal 1021 into the data address section. The writing position 511 of the data section 112 is sequentially written in a ring shape in the direction of 512 along the reading path 514 at the sampling frequency of the audio signal. In addition, when the data written in the ring buffer 111 is read, the delay control device 51 reads from the read position TAPi (i = 1 to N) with a predetermined delay with respect to the write address. As a result, a plurality of audio signals delayed with respect to one front audio signal 1021 can be read. The data read by the delay control device 51 is input to the gain adjuster 53i (i = 1 to N) as shown in FIG.

  The delay amount of the read position TAPi with respect to the write position 511 shown in FIG. 7 is the delay amount of the delay amount setting 121 described with reference to FIG. 6, and the delay control device 51 moves the read position TAPi 513i (i = 1 to N). To control each. This control corresponds to the delay control device 51 shown in FIG.

  The movement 513i of the reading position TAPi (i = 1 to N) in FIG. 7 is the same as the sampling speed at which the front audio signal 1021 is written when the person 104 shown in FIG. 2 is stationary. Read at speed. On the other hand, when the person 104 (not limited to a person may be an object) moves, the parameter calculation unit 12 changes the position of the virtual sound source VS along with this movement, so the delay amount shown in FIG. In the setting 121, the propagation distance Li (i = 1 to N) between the virtual sound source VS and the speaker SPi (i = 1 to N) varies. As a result, the delay amount of the reading position reading position TAPi with respect to the writing position 511 fluctuates with time. As a result, reading is performed at a speed different from the sampling speed at which the front audio signal 1021 is written, and is emitted from the virtual sound source VS. The audio tone goes up and down. Thus, according to the system of this embodiment, the Doppler effect accompanying the movement of the sound source can be expressed as a result of accurate sound image localization.

<Application of the first embodiment>
Note that the reading of the audio signal when the person 104 moves as described with reference to FIG. 7 is performed by changing the address movement 513i. Thus, when changing the address movement 513i, since the address has a fractional part, the data of the address close to this address value is obtained by interpolation calculation.

  Further, in the apparatus of the present embodiment, the multi-channel audio signal is not limited to the configuration shown in FIG. 4, but it is necessary that at least the front audio signal 1021 is provided and the input as a whole is multi-channel, that is, three or more channels. is there. Although FIG. 1 shows a diagram in which real speakers are arranged for the multi-channel, the surround input 1022 is set to 2ch of the front speakers SPR and SPL by performing a crosstalk cancellation process or the like by a surround input signal processing unit 58 described later. It may be configured to mix down.

  Further, the front speaker array 2 of FIG. 1 may be installed under the screen 6 or may be installed around the screen 6 (left and right, up and down).

<Second Embodiment>
Next, a theater system according to a second embodiment related to application of the system according to the first embodiment will be described with reference to FIG. FIG. 8 shows the internal configuration of the control device of this theater system. In this system, instead of inputting the sound source position information 101 from the outside, a sound generation position estimation device 15 is provided and input to the parameter calculation unit 12. Since the other points are the same as those described with reference to FIGS. 1 to 7, the above description is applied mutatis mutandis using the same reference numerals.

  The sound generation position estimation apparatus 15 of FIG. 8 includes a ROM that stores a program for the operation of the sound generation position estimation apparatus 15, a RAM that processes data of the video signal 100, and an IC or CPU that executes the program (not shown). .

  The sound generation position estimation device 15 in FIG. 8 takes in the video signal 100 and performs image analysis, estimates the position of the person 104 shown in FIG. 2, grasps the information, and gives it to the parameter calculation unit 12. Human recognition may be performed by a method such as face determination, and the distance (z coordinate) in the depth direction can be estimated based on the size of the face or body. It is also conceivable that the position of a moving object is grasped by image analysis and given to the parameter calculation unit 12.

<Application of Second Embodiment>
Note that the RAM for image processing of the data of the video signal 100 may be provided in a part of the section inside the input unit 11 configured by a readable / writable memory. Further, the IC that executes the operation program of the sound generation position estimation device 15 may be shared with the DSP or CPU provided in the control device 10.

<Third Embodiment>
Next, the theater system of the third embodiment according to the application of the system of the first and second embodiments will be described with reference to FIG. The theater system of the third embodiment is different in that speakers SPi (i = 1 to N) arranged in an array corresponding to the front speaker array 2 are provided on the back side of the screen 6. Since the other points are the same as those described with reference to FIGS. 1 to 8 above, the above description is applied mutatis mutandis using the same reference numerals.

  In the third embodiment shown in FIG. 9, unlike the front speaker array 2 placed around the screen 6, it can be completely matched with the person 104 shown in FIG. 2. Further, as shown in the above description, particularly in the description of FIGS. 2 and 3, the parameter calculation unit 12 sets the position of the virtual sound source VS based on the position of the person 104. Further, by the parameter setting as shown in FIG. 6, the sound synthesized by the speakers SPi (i = 1 to N) arranged in an array as shown in FIG. 3B is diffused from the virtual sound source VS. The reproduced voice is reproduced as it is. Therefore, this embodiment can realize three-dimensional sound image localization, unlike Patent Documents 2 and 3 listed above, which simply switch and output a speaker at a position that matches the person 104.

<Application of Third Embodiment>
Note that the speaker SPi (i = 1 to N) shown in FIG. 9 may be embedded with a dynamic speaker on the back side, and a plurality of independent voice coils are arranged on the back side as in Patent Document 3, and the screen itself. May be a diaphragm.

The structure of the theater system of 1st Embodiment is shown. The conceptual diagram of the theater system of 1st Embodiment is shown. The figure showing the method of reproducing the sound image localization of a virtual sound source using a speaker array is shown. The internal structure of the control apparatus of the theater system of 1st Embodiment is shown. The figure explaining the method of the distance between the virtual sound source VS and the speaker SPi (i = 1-N) in the system of 1st Embodiment, and various parameter setting is shown. An example in which various parameters are set from the distance and angle between the virtual sound source VS and the speakers SPi (i = 1 to N) in the system of the first embodiment will be described. The block diagram in the case of performing the structure of the delay device in the system of 1st Embodiment with a ring buffer is shown. The internal structure of the control apparatus of the theater system of 2nd Embodiment which concerns on the application of 1st Embodiment is shown. The theater system of 3rd Embodiment which concerns on the application of the system of 1st, 2nd embodiment is shown.

Explanation of symbols

1-theater system, 10-control device, 11-input unit 111-ring buffer, 112-data partition, 12-parameter calculation unit 121-delay amount setting, 122-volume setting, 123-high-frequency gain setting 15-sound generation position Estimating device, 2-front speaker array, 3-projector 5-signal processing device, 51-delay control device, 511-writing position 512-movement, 513i (i = 1 to N) -movement, 514-reading path 52i (i = 1-N) -delay device, 53i (i = 1-N) -gain adjuster 54i (i = 1-N) -equalizer, 56i (i = 1-N) -D / A converter 581-left and right channels Signal processing unit for input, 582-Signal processing unit for bass sound input 591-D / A converter, 592-D / A converter, 6-screen SPi (i = 1 to N) Speaker, SPL-Left front speaker SPR-Right front speaker, SPLR-Left rear speaker, SPRR-Right rear speaker SPW-Low tone speaker, Li (i = 1-N) -Propagation distance VS-Virtual sound source, αi (i = 1-N) ) -Angle TAPi (i = 1 to N) -reading position 100-video signal, 101-sound source position information, 102-audio signal 1021-center channel audio signal 1022-signal other than the center channel, 1023-bass audio signal 104-person, 105-delay information, 106-gain adjustment information 107-equalizer information, 109i (i = 1-N) -wavefront 911-combined wavefront, 92i (i = 1-N) -distance, 999- Audience

Claims (4)

A multi-channel audio signal that includes a center channel and is synchronized with the video signal; and an input unit that inputs position information indicating a generation position of the audio signal of the center channel in the video displayed by the video signal;
Left and right channel output units for outputting audio signals other than the center channel to the corresponding speakers;
A control unit for controlling a speaker array having a plurality of speaker units arranged in an array, wherein each speaker unit receives an audio signal of the center channel so that an audio beam is focused on a position indicated by the position information. A localization control unit for controlling the timing of input to
Multi-channel audio playback device. An input unit for inputting a video signal and an audio signal synchronized with the video signal;
A generation position estimation unit that estimates a generation position of the audio signal based on the video signal;
A control unit that controls a speaker array having a plurality of speaker units arranged in an array, and inputs the audio signal to each speaker unit so as to form an audio beam focused on the estimated generation position. A localization control unit for controlling timing;
Sound image localization device with An input unit for inputting a video signal and an audio signal of a multi-channel audio signal input channel including a center channel and synchronized with the video signal;
Left and right channel output units for outputting audio signals other than the center channel to the corresponding speakers;
A generation position estimation unit that estimates a generation position of the audio signal of the center channel based on the video signal;
A control unit for controlling a speaker array having a plurality of speaker units arranged in an array, wherein each speaker unit receives an audio signal of the center channel so as to form an audio beam focused on the estimated generation position. A localization control unit for controlling the timing of input to
Multi-channel audio playback device.   4. The multi-channel audio reproduction device according to claim 1, wherein the speaker array is disposed on a screen surface on which an image based on the image signal is displayed.

Images