JP6087760B2 - Sound field recording / reproducing apparatus, method, and program - Google Patents

Description

  The present invention relates to a wave field synthesis technique (Ambisonics) that collects a sound signal with a microphone installed in a certain sound field and reproduces the sound field with a speaker using the sound signal. Related to technology.

  The wavefront synthesis method and ambisonics are technologies that virtually reproduce a sound field in a remote place using a plurality of microphones and a plurality of speakers. As such a technique, for example, a technique described in Non-Patent Document 1 is known. In applications such as remote communication systems, real-time sound collection and reproduction is required, so the sound pressure collected by a general microphone array is unique to a sound field reproduction signal for output by a general speaker array. It must be convertible to

Oyama, Furuya, Hiwazaki, Haneda, “Spatio-temporal frequency domain signal conversion for sound field collection and reproduction,” September 2011, pp. 635-636.

  In the technique described in Non-Patent Document 1, the sound field could be reproduced at the same position or a position translated in the front / rear and left / right directions, but the sound field could not be reproduced by rotating it at a predetermined angle. .

  An object of the present invention is to provide a sound field collecting and reproducing apparatus, method, and program capable of reproducing a sound field by rotating it at a predetermined angle.

  In order to solve the above-described problem, a sound field sound collecting / reproducing apparatus according to an embodiment of the present invention rotates a frequency domain signal generated from a signal collected by a microphone array including two or more microphones with a predetermined rotation. It includes a spatial frequency modulation section that generates a spatial frequency modulation signal that is a signal that is spatially shifted by an angle, and obtains a reproduction signal from the spatial frequency modulation signal.

  The sound field can be reproduced by rotating it at a predetermined angle.

The functional block diagram which shows the example of the sound field sound collection reproducing | regenerating apparatus of 1st embodiment. The figure for demonstrating the example of arrangement | positioning of the microphone and speaker of 1st embodiment. The functional block diagram which shows the example of the sound field sound collection reproducing | regenerating apparatus of 2nd embodiment. The figure for demonstrating the example of arrangement | positioning of the microphone and speaker of 2nd embodiment. The flowchart which shows the example of the sound field sound collection reproduction | regeneration method.

  Embodiments of the present invention will be described below with reference to the drawings. In the following description, the symbol “˜” and the like used in the text should be described immediately above the immediately preceding character, but are described immediately after the character due to restrictions on text notation. In the formula, these symbols are written in their original positions. Further, the processing performed for each element of a vector or matrix is applied to all elements of the vector or matrix unless otherwise specified.

[First embodiment]
<Arrangement of microphone array and speaker array>
As shown in FIG. 2, the sound field sound collecting and reproducing apparatus and method according to the first embodiment includes N _x microphones arranged linearly at positions y = 0 and z = 0 in the first space. .., MN _x and N _x speakers arranged linearly at positions y = 0, z = 0 in a second space different from the first space. , SN _x is used to reproduce the sound field of the first space formed by the sound generated by the sound source S in the second space.

At this time, the sound field is reproduced in a state rotated by a predetermined rotation angle. Specifically, it is possible to provide exemplified by dotted lines in FIG. 1, the speaker array S1, is rotated by a predetermined rotation angle, S2, ..., the perception that the sound field is reproduced by the SN _x.

  Compared with the second embodiment described later, the first embodiment can reduce the number of microphones, the number of speakers, and the number of channels, so that mounting is relatively easy.

N _x is an integer of 2 or more. In this embodiment, the microphone array M1, M2, ..., the number and the speaker array S1 of microphone constituting the MN _x, S2, ..., the number of speakers constituting the SN _x is the same. The microphones Mi constituting the microphone arrays M1, M2,..., MN _x are arranged at equal intervals. Further, the speakers constituting the speaker arrays S1, S2,..., SN _x are also arranged at equal intervals. Microphone array M1, M2, ..., and the size of MN _x, speaker array S1, S2, ..., the magnitude of SN _x is about the same. Microphone array M1, M2 of the microphone Mi, ..., position in MN _x is speaker Si speaker array S1, S2 corresponding to the respective microphones Mi, ..., but it is desirable that the same as the position in the SN _x, different May be. If this position is the same, the sound field can be reproduced more faithfully.

The position of the microphone Mi corresponding to the index i [i = 1,..., N _x ] constituting the microphone arrays M1, M2,..., MN _x arranged at the positions y = 0, z = 0 in the first space. Is expressed as r _{m, i} = (x _{m, i} , 0,0).

  Note that the number of microphones arranged in the first space and the number of speakers arranged in the second space may be different. If the number of microphones is larger than the number of speakers arranged in the second space, the reproduction signal may be thinned out. On the other hand, when the number of microphones is smaller than the number of speakers arranged in the second space, the reproduction signal may be interpolated by taking an average between channels. As a method for performing the interpolation, for example, linear interpolation, sinc interpolation, or the like can be applied.

<Sound field recording and playback device>
As shown in FIG. 1, the sound field sound collecting / reproducing apparatus of the first embodiment includes a frequency conversion unit 1, a spatial frequency modulation unit 2, a spatial frequency conversion unit 3, a conversion filter unit 4, a spatial frequency inverse conversion unit 5, and a frequency inverse unit. The conversion unit 6 and the window function unit 7 are included, for example, and the processing of each step illustrated in FIG. F1 is performed.

The microphone arrays M1, M2,..., MN _x arranged in the first space pick up the sound emitted from the sound source S in the first space and generate a time domain signal. The generated signal is sent to the frequency converter 1. A signal at time t in the time domain picked up by the microphone Mi located at r _{m, i} = (x _{m, i} , 0,0) corresponding to the index i is denoted as p _i (t).

<Frequency conversion unit 1>
The frequency converter 1 converts the signal p _i (t) collected by the microphone arrays M1, M2,..., MN _x into a frequency domain signal P _i (ω) by Fourier transform (step S1). The generated frequency domain signal P _i (ω) is provided to the spatial frequency modulation unit 2. ω is a frequency. For example, the frequency domain signal P _i (ω) is generated by short-time discrete Fourier transform. Of course, the frequency domain signal P _i (ω) may be generated by other existing methods. Further, the frequency domain signal P _i (ω) may be generated using a method such as overlap add. When the input signal is long or when the signal is continuously input as in real time processing, the processing is performed for each frame such as every 10 ms. For example, the frequency domain signal P _i (ω) is defined as follows. J in the argument of the function exp is an imaginary unit.

<Spatial frequency modulation unit 2>
The spatial frequency modulation unit 2 generates a spatial frequency modulation signal P _{mod, i} (ω) that is a signal obtained by shifting the frequency domain signal P _i (ω) by a spatial frequency at a predetermined rotation angle (step S2). The generated spatial frequency modulation signal P _{mod, i} (ω) is provided to the spatial frequency conversion unit 3. The predetermined rotation angle is a rotation angle whose angle in the elevation angle direction is θ _rot .

The spatial frequency modulation unit 2 calculates a spatial frequency modulation signal P _{mod, i} (ω) defined by the following equation, for example. j is an imaginary unit, k is a wave number, and k = ω / c where c is the speed of sound.

  As described above, the spatial frequency modulation unit 2 is a spatial frequency modulation which is a signal obtained by shifting a frequency domain signal generated from a signal collected by a microphone array including two or more microphones by a predetermined rotational angle. Generate a signal. Thereafter, the sound field sound collecting / reproducing apparatus obtains a reproduced signal from the spatial frequency modulation signal as follows.

<Spatial frequency converter 3>
The spatial frequency conversion unit 3 converts the frequency domain signal P _{mod, i} (ω) into a spatio-temporal frequency domain signal P _n (ω) by Fourier transform of space (step S3). Spatio-temporal frequency domain signal P ~ _n (ω) is derived from the frequency domain signal P _mod, the _i (omega). The spatio-temporal frequency domain signal P _n (ω) is calculated for each ω. The converted spatio-temporal frequency domain signal P _n (ω) is provided to the conversion filter unit 4. Specifically, the spatial frequency conversion unit 3 calculates P _n (ω) defined by the following equation (1).

k _{x, n} is a wave number in the x-axis direction, n is an index of the wave number k _{x, n} , and the wave number is a so-called spatial frequency or angular spectrum. The above formula (1) is an example of conversion to the spatio-temporal frequency domain, and spatial Fourier transform may be performed by other methods.

<Conversion filter unit 4>
Conversion filter unit 4, the spatio-temporal frequency domain signal P ~ _n (omega) by applying the equation (2) filters F ~ _n defined by (omega) to the filter processed signal D ~ _n the (omega) Generate (step S4). The generated post-filtering signal D _n (ω) is provided to the spatial frequency inverse transform unit 5.

A (ω) is a predetermined complex number for adjusting the frequency characteristic. For example, A (ω) = 1 + 0 × j = 1. y _ref is a speaker array S1, S2, ..., a distance in the y-axis direction from the SN _x to a position to match the amplitude. In other words, y _ref can be said to be a position where the amplitudes are matched.

Also, w _n is determined by, for example, in the following manner based on n, it is a predetermined weight to attenuate the evanescent wave. In the following equations, k _c is a predetermined value and is a cutoff value of k _{x, n} respectively. k _c is set to a value that suppresses evanescent waves, for example. α _x is a predetermined value for determining the smoothness of the cutoff, and is 0.05, for example. Of course, other weight functions may be used as w _n .

H _n ⁽¹⁾ (·) is an nth-order first-class Hankel function, where • is an arbitrary real number. Therefore, H ₀ ⁽¹⁾ (·) is a zeroth-order first-class Hankel function. H _n ⁽¹⁾ (•) is defined as follows. J _n (•) is an nth-order Bessel function, Γ (z) is a gamma function, and Y _n (z) is a Neumann function.

The conversion filter unit 4, instead of the filter F ~ _n (omega) of the above formula (2), Equation (3) applies a filter F ~ _n (omega) which is defined by the filter processed signal D ~ _n (ω) may be generated. d _x and d _y are amounts by which the sound field to be reproduced is shifted in the x-axis direction and the y-axis direction, respectively. Applying this filter F ~ _n (ω), in the second space, the sound field can be reproduced shifted by d _y in the y-axis direction by d _x in the x-axis direction.

<Spatial frequency inverse transform unit 5>
The spatial frequency inverse transform unit 5 transforms the filtered signal _D˜n (ω) into the frequency domain signal D _i (ω) by inverse Fourier transform of the space (step S5). The transformed frequency domain signal D _i (ω) is provided to the frequency inverse transform unit 6. Specifically, the spatial frequency inverse transform unit 5 calculates a frequency domain signal D _i (ω) defined by the following equation (4). J in the argument of the function exp is an imaginary unit.

<Inverse frequency converter 6>
The frequency inverse transform unit 6 transforms the frequency domain signal D _i (ω) into a time domain signal P ^d _i (t) by inverse Fourier transform (step S6). The time domain signal P ^d _i (t) obtained for each frame by the inverse Fourier transform is appropriately shifted to obtain a linear sum to be a continuous time domain signal. For the inverse Fourier transform, an existing method such as a short-time discrete inverse Fourier transform may be used. The time domain signal P ^d _i (t) is sent to the window function unit 7.

<Window function part 7>
The window function unit 7 multiplies the time domain signal P ^d _i (t) by the window function to generate a post-window function time domain signal d _i (t) (step S7). Window function after a time-domain signal d _i (t) is the speaker array S1, S2, ..., are provided in the SN _x.

For example, a so-called Tukey window function w _i defined by the following equation is used as the window function. N _tpr is the number of points to which the taper is applied, and is an integer from 1 to N _x . Of course, other window functions may be used.

The speaker arrays S1, S2,..., SN _x reproduce sound based on the time domain signal d _i (t) after the window function. Specifically, with i = 1,..., N _x , the speaker Si reproduces sound based on the time domain signal d _i (t) after the window function.

Thus, the first y = 0 of the space, z wavefront position = 0 in the second space speaker array S1, S2, ..., and reproduced in SN _x, the sound field of the first space second Can be reproduced in the space.

At this time, the amplitude of the reproduced signal matches at a position on a straight line represented by y _ref . Specifically, as shown in FIG. 1, the speaker array S1, S2, ..., in a position at a distance y _ref from SN _x to y-axis direction, the speaker array S1, S2, ..., and SN _x is located The amplitude matches at a position on a straight line parallel to the straight line.

In addition, the sound field is reproduced in a state rotated by a predetermined rotation angle. Specifically, it is possible to provide indicated by a dotted line in FIG. 1, the speaker array S1, it is rotated by a predetermined rotation angle, S2, ..., the perception that the sound field is reproduced by the SN _x.

[Second Embodiment]
<Arrangement of microphone array and speaker array>
As shown in FIG. 3, the sound field sound collecting / reproducing apparatus and method according to the second embodiment are configured by N _x × N _z microphones arranged in a plane at a position y = 0 in the first space. , MN _x -N _z and N _x × N arranged in a plane at a position y = 0 in a second space different from the first space. _{Using the} two-dimensional speaker arrays S1-1, S2-1,..., SN _x -N _z composed of _z speakers, the sound field of the first space formed by the sound generated by the sound source S is obtained. Reproduce in the second space.

At this time, the sound field is reproduced in a state rotated by a predetermined rotation angle. Specifically, the perception that the sound field is reproduced by the speaker arrays S1-1, S2-1,..., SN _x -N _z rotated by a predetermined rotation angle, as exemplified by the dotted line in FIG. Can be given.

N _x and N _z are integers of 2 or more. N _x and N _z may be the same value or different values. In this embodiment, the microphone array M1-1, M2-1, ..., _MN x the number and the speaker array microphones constituting the -N _z S1-1, S2-1, ..., constituting the _SN x -N _z speaker The number of is the same. The microphones Mi-j constituting the microphone arrays M1-1, M2-1,..., MN _x -N _z are arranged at equal intervals. Further, the speakers constituting the speaker arrays S1-1, S2-1,..., SN _x -N _z are also arranged at equal intervals. Microphone array M1-1, M2-1, ..., and the size of _MN x -N _z, a speaker array S1-1, S2-1, ..., the magnitude of _SN x -N _z are approximately the same. Microphone array M1-1 of the microphones Mi-j, M2-1, ..., position in _MN x -N _z is the speaker Si-j of the speaker array S1-1 corresponding to the respective microphones Mi-j, S2-1 ,..., SN _x −N _z is desirably the same as the position, but may be different. If this position is the same, the sound field can be reproduced more faithfully.

Indexes (i, j) constituting the microphone arrays M1-1, M2-1,..., MN _x −N _z arranged at the position of y = 0 in the first space [i = 1 _,. The position of the microphone Mi-j corresponding to j = 1,..., N _z ] is represented as r _{m, ij} = (x _{m, i} , 0, z _{m, j} ).

  Note that the number of microphones arranged in the first space and the number of speakers arranged in the second space may be different. If the number of microphones is larger than the number of speakers arranged in the second space, the reproduction signal may be thinned out. On the other hand, when the number of microphones is smaller than the number of speakers arranged in the second space, the reproduction signal may be interpolated by taking an average between channels. As a method for performing the interpolation, for example, linear interpolation, sinc interpolation, or the like can be applied.

<Sound field recording and playback device>
As shown in FIG. 1, the sound field sound collecting and reproducing apparatus according to the second embodiment includes a frequency conversion unit 1, a spatial frequency modulation unit 2, a spatial frequency conversion unit 3, a conversion filter unit 4, a spatial frequency inverse conversion unit 5, and a frequency inverse unit. The conversion unit 6 and the window function unit 7 are included, for example, and the processing of each step illustrated in FIG. F1 is performed.

The microphone arrays M1-1, M2-1,..., MN _x -N _z arranged in the first space pick up sounds emitted from the sound source S in the first space and generate signals in the time domain. To do. The generated signal is sent to the frequency converter 1. A signal at time t in the time domain picked up by the microphone Mi-j located at r _{m, ij} = (x _{m, i} , 0, z _{m, j} ) corresponding to the index i, j is represented by p _ij (t) Is written.

<Frequency conversion unit 1>
The frequency converter 1 converts the signal p _ij (t) collected by the microphone arrays M1-1, M2-1,..., MN _x −N _z into a frequency domain signal P _ij (ω) by Fourier transform ( Step S1). The generated frequency domain signal P _ij (ω) is provided to the spatial frequency modulation unit 2. ω is a frequency. For example, the frequency domain signal P _ij (ω) is generated by short-time discrete Fourier transform. Of course, the frequency domain signal P _ij (ω) may be generated by other existing methods. Further, the frequency domain signal P _ij (ω) may be generated using a method such as overlap add. When the input signal is long or when the signal is continuously input as in real time processing, the processing is performed for each frame such as every 10 ms. For example, the frequency domain signal P _ij (ω) is defined as follows. J in the argument of the function exp is an imaginary unit.

<Spatial frequency modulation unit 2>
The spatial frequency modulation unit 2 generates a spatial frequency modulation signal P _{mod, ij} (ω) that is a signal obtained by shifting the frequency domain signal P _ij (ω) by a spatial frequency by a predetermined rotation angle (step S2). The generated spatial frequency modulation signal P _{mod, ij} (ω) is provided to the spatial frequency conversion unit 3. The predetermined rotation angle is a rotation angle in which the azimuth angle is θ _rot and the elevation angle is φ _rot .

The spatial frequency modulation unit 2 calculates a spatial frequency modulation signal P _{mod, ij} (ω) defined by the following equation, for example. J in the argument of the function exp is an imaginary unit. k is the wave number, and k = ω / c where c is the speed of sound.

  As described above, the spatial frequency modulation unit 2 is a spatial frequency modulation which is a signal obtained by shifting a frequency domain signal generated from a signal collected by a microphone array including two or more microphones by a predetermined rotational angle. Generate a signal. Thereafter, the sound field sound collecting / reproducing apparatus obtains a reproduced signal from the spatial frequency modulation signal as follows.

<Spatial frequency converter 3>
Spatial frequency transformation unit 3, the frequency domain signal P _mod by the Fourier transform of the _{spatial, ij} (omega) is converted to the spatio-temporal frequency domain signal P ~ _nm (ω) (Step S3). Spatio-temporal frequency domain signal P ~ _nm (ω) are derived from the frequency domain signal P _mod, the _{ij (ω).} The spatio-temporal frequency domain signal P _nm (ω) is calculated for each ω. The converted spatio-temporal frequency domain signal P _nm (ω) is provided to the conversion filter unit 4. Specifically, the spatial frequency converter 3 calculates _P˜nm (ω) defined by the following equation (6). J in the argument of the function exp is an imaginary unit.

k _{x, n} is the wave number in the x-axis direction, n is the index of the wave number k _{x, n} , k _{z, m} is the wave number in the z-axis direction, m is the index of the wave number k _{z, m} , The wave number is a so-called spatial frequency or angular spectrum. The above equation (6) is an example of conversion to the spatio-temporal frequency domain, and spatial Fourier transform may be performed by other methods.

<Conversion filter unit 4>
Conversion filter unit 4, the spatio-temporal frequency domain signal P ~ _nm filter F is defined for (omega) by Equation (7) ~ _nm (ω) applied to filtering after signal D ~ _nm to the (omega) Generate (step S4). The generated filtered signal _D˜nm (ω) is provided to the spatial frequency inverse transform unit 5.

  A (ω) is a predetermined complex number for adjusting the frequency characteristic. For example, A (ω) = 1 + 0 × j = 1.

W _nm is a predetermined weight for attenuating the evanescent wave, which is determined as follows based on n and m, for example. In the following equation, k _c is a predetermined value and is a cutoff value of k _{x, n} , k _{z, m} . k _c is set to a value that suppresses evanescent waves, for example. α _x and α _z are predetermined values for determining the smoothness of the cutoff, and are 0.05, for example. Of course, other weight functions may be used as w _nm .

Note that the conversion filter unit 4 applies the filter _F˜nm (ω) defined by the equation (8) instead of the filter _F˜nm (ω) of the above equation (7) to apply the filtered signal D˜ _nm (ω) may be generated. d _x , d _y , and d _z are amounts by which the sound field to be reproduced is shifted in the x-axis direction, the y-axis direction, and the z-axis direction, respectively. Applying this filter F ~ _nm (ω), can be first in a two-space, to reproduce the sound field shifted by d _y in the z-axis direction by the y-axis direction d _x in the x-axis direction by d _z .

<Spatial frequency inverse transform unit 5>
The spatial frequency inverse transform unit 5, converts the filtered signal after D ~ _nm (ω) on the frequency domain signal D _ij (omega) by inverse Fourier transform of the space (step S5). The converted frequency domain signal D _ij (ω) is provided to the frequency inverse transform unit 6. Specifically, the spatial frequency inverse transform unit 5 calculates a frequency domain signal D _ij (ω) defined by the following equation (9). J in the argument of the function exp is an imaginary unit.

<Inverse frequency converter 6>
The frequency inverse transform unit 6 transforms the frequency domain signal D _ij (ω) to the time domain signal P ^d _ij (t) by inverse Fourier transform (step S6). The time domain signal P ^d _ij (t) obtained for each frame by the inverse Fourier transform is appropriately shifted to obtain a linear sum to be a continuous time domain signal. For the inverse Fourier transform, an existing method such as a short-time discrete inverse Fourier transform may be used. The time domain signal P ^d _ij (t) is sent to the window function unit 7.

<Window function part 7>
The window function unit 7 multiplies the time domain signal P ^d _ij (t) by the window function to generate a post-window function time domain signal d _ij (t) (step S7). After the window function time domain signal d _ij (t) is the speaker array S1, S2, ..., it is provided in the SN _x.

For example, a so-called tukey window function w _ij defined by the following equation is used as the window function. N _tpr is the number of points to which the taper is applied, and is an integer of 1 or more and N _x or N _z . Of course, other window functions may be used.

The speaker arrays S1-1, S2-1,..., SN _x -N _z reproduce sound based on the time domain signal _dij (t) after the window function. Specifically, with i = 1,..., N _x , j = 1,..., N _z , the speaker Si-j reproduces the sound based on the post-window function time domain signal _dij (t).

Thereby, the wavefront of the position of y = 0 in the first space the second space of the speaker array S1-1, S2-1, ..., and reproduced in SN _x -N _z, the sound field of the first space Can be reproduced in the second space.

In addition, the sound field is reproduced in a state rotated by a predetermined rotation angle. Specifically, it is possible to provide indicated by a dotted line in FIG. 1, the speaker array S1, it is rotated by a predetermined rotation angle, S2, ..., the perception that the sound field is reproduced by the SN _x.

[Modifications, etc.]
Any filter can be used as long as it is a filter according to the arrangement of speaker arrays including two or more speakers from which a reproduction signal is output for converting the sound field where the sound is collected into a signal to be reproduced. There may be. The filters described in the first embodiment and the second embodiment are examples.

  For example, in the first embodiment, a filter defined by the following formula (10) or formula (11) may be used.

In Equation (10), p and q are preset orders, and d _{p and q} are multipole coefficients obtained by multipole expansion of the transfer characteristics of the speakers constituting the speaker array with the orders p and q. For example, one or more of p and q are positive values other than 0, such as setting all of p and q to 1.

H ₀ ⁽²⁾ is a second kind Hankel function with n = 0. The second kind Hankel function H _n ⁽²⁾ is defined as follows using the first kind Bessel function J _n (x) and the second kind Bessel function Y _n (x).

k _ρ is defined by the following equation.

In Expression (11), G to _2D are functions obtained by subjecting a two-dimensional free space Green function representing ideal transfer characteristics to a spatial Fourier transform in the x-axis direction. G ~ _sp is a function obtained by performing a Fourier transform of the space in the x-axis direction on the pre-measured transfer characteristics between the position of the speaker array in the space where the sound field is reproduced and the position away from that position by _yref. is there.

  Further, for example, in the second embodiment, a filter defined by the following formula (12) or formula (13) may be used.

In Equation (12), p, q, and s are preset orders, and d _{p, q, and s} are multipole expansions of the transfer characteristics of each speaker constituting the speaker array at the orders p, q, and s. Multipole coefficient. For example, one or more of p, q, and s are positive values that are not 0, such as setting all of p, q, and s to 1.

In Expression (13), G˜ is a function obtained by subjecting a three-dimensional free space Green function representing ideal transfer characteristics to a spatial Fourier transform in the x-axis direction and the z-axis direction. G ~ _sp is the Fourier transform of space in the x-axis and z-axis directions, measured in advance in the x-axis and z-axis directions, between the position of the speaker array in the space where the sound field is reproduced and the position away from that position by y _ref It is a function that

  The positions of the first space and the second space are not limited to those shown in FIGS. The first space and the second space may be adjacent to each other or separated from each other. Also, the orientation of the first space and the second space may be any.

  The window function processing by the window function unit 7 may be performed at any stage or in multiple stages. That is, the window function unit 7 is connected between the microphone array and the frequency conversion unit 1, between the frequency conversion unit 1 and the spatial frequency modulation unit 2, between the spatial frequency modulation unit 2 and the spatial frequency conversion unit 3, and spatial frequency. It is provided between at least one between the conversion unit 3 and the conversion filter unit 4, between the conversion filter unit 4 and the spatial frequency inverse transform unit 5, and between the spatial frequency inverse transform unit 5 and the frequency inverse transform unit 6. It may be. When the window function processing is performed on the signal input to each section, each section of the sound field sound collecting / reproducing apparatus performs the window function processing in the same manner as described above instead of the input signal. The processed signal is processed.

  As long as the sound field sound collecting / reproducing apparatus includes the spatial frequency modulation unit 2, it may not include other units. In other words, the frequency conversion unit 1, the spatial frequency conversion unit 3, the conversion filter unit 4, the spatial frequency reverse conversion unit 5, the frequency reverse conversion unit 6, and the window function unit 7 are not essential.

For example, the window function unit 7 may not be provided. In this case, in the first embodiment, i = 1,..., _Nx , the speaker Si reproduces the sound based on the time domain signal ^Pd _i (t), and in the second embodiment, i = 1,. The speaker Si-j reproduces the sound based on the time domain signal P ^d _ij (t) as N _x , j = 1,..., N _z .

  When the spatial frequency conversion unit 3 and the spatial frequency inverse conversion unit 5 are not provided, a spatial frequency modulation signal is provided to the conversion filter unit 4. The conversion filter unit 4 applies a filter to the spatial frequency modulation signal to obtain a filtered signal. The filtered signal is converted into a time domain signal by the frequency inverse converter 6.

  The processing of the frequency conversion unit 1, the processing of the spatial frequency modulation unit 2, and the processing of the spatial frequency conversion unit 3 may be performed simultaneously. Similarly, the process of the spatial frequency inverse transform unit 5 and the process of the frequency inverse transform unit 6 may be performed simultaneously. Further, the spatial frequency conversion unit 3 and the spatial frequency inverse conversion unit 5 may be interchanged.

  The sound field sound collecting / reproducing apparatus can be realized by a computer. In this case, the processing content of each part of this apparatus is described by a program. Then, by executing this program on a computer, each unit in this apparatus is realized on the computer.

  The program describing the processing contents can be recorded on a computer-readable recording medium. In this embodiment, these apparatuses are configured by executing a predetermined program on a computer. However, at least a part of these processing contents may be realized by hardware.

  The present invention is not limited to the above-described embodiment, and can be modified as appropriate without departing from the spirit of the present invention.

DESCRIPTION OF SYMBOLS 1 Frequency conversion part 2 Spatial frequency modulation part 3 Spatial frequency conversion part 4 Conversion filter part 5 Discrete spherical harmonic inverse transformation part 6 Frequency inverse transformation part 7 Window function part

Claims (9)

A spatial frequency modulation unit that generates a spatial frequency modulation signal, which is a signal obtained by shifting a frequency domain signal generated from a signal collected by a microphone array including two or more microphones at a predetermined rotational angle, and
A sound field collecting and reproducing apparatus for obtaining a reproduction signal from the spatial frequency modulation signal. The sound field collecting and reproducing device according to claim 1,
A filter corresponding to the arrangement of speaker arrays including two or more speakers from which the reproduction signal is output for converting the sound field where the sound is collected into a signal to be reproduced is used as the spatial frequency modulation signal or the space. Further including a transform filter unit that applies a spatiotemporal frequency domain signal derived from the frequency modulation signal to generate a filtered signal;
A sound field sound collecting / reproducing apparatus that obtains the reproduced signal from the filtered signal instead of the spatial frequency modulation signal. The sound field collecting and reproducing apparatus according to claim 2 ,
The microphone array is linear, the speaker array is linear, the array direction of the speaker array is the x-axis direction, and the predetermined rotation angle is a rotation angle whose angle of elevation is θ _rot. , P _i (ω) is the frequency domain signal, j is an imaginary unit, ω is the frequency, c is the speed of sound, k = ω / c, and the position of the microphone corresponding to the index i constituting the microphone array R _{m, i} = (x _{m, i} , 0,0), P _{mod, i} (ω) as the spatial frequency modulation signal,
The spatial frequency modulation unit calculates a spatial frequency modulation signal P _{mod, i} (ω) defined by the following equation:

Sound field recording and playback device. The sound field collecting and reproducing device according to claim 3,
k _{x, n} is the wave number in the x-axis direction, n is its index, w _n is a weight determined based on n, A (ω) is a predetermined complex number, and the sound field to be reproduced is in the x-axis direction and the y-axis The amount of shift in the direction is dx, dy, H ₀ ⁽¹⁾ (・) is the 0th kind Hankel function, and y _ref is the position where the amplitudes match,
The transform filter unit applies a filter F _n (ω) defined by one of the following two expressions to the spatio-temporal frequency domain signal to generate a filtered signal D _n (ω).

Sound field recording and playback device. The sound field collecting and reproducing apparatus according to claim 2 ,
The microphone array is arranged on the xz plane, and the predetermined rotation angle is a rotation angle in which the azimuth angle is θ _rot and the elevation angle is φ _rot , and P _ij (ω) Is the frequency domain signal, j is an imaginary unit, ω is the frequency, c is the speed of sound, k = ω / c, and the position of the microphone corresponding to the index i, j constituting the microphone array is r _{m, ij} = (x _{m, i} , 0, z _{m, j} ) and P _{mod, ij} (ω) as the spatial frequency modulation signal,
The spatial frequency modulation unit calculates a spatial frequency modulation signal P _{mod, ij} (ω) defined by the following equation:

Sound field recording and playback device. The sound field collecting and reproducing apparatus according to claim 5,
k _{x, n} is the wave number in the x-axis direction, n is its index, k _{z, m} is the wave number in the z-axis direction, m is its index, w _nm is a weight determined based on n, m, and A (ω) is a predetermined complex number, and the amounts by which the sound field to be reproduced is shifted in the x-axis direction, y-axis direction, and z-axis direction are dx, dy, and dz, respectively.
The transform filter unit applies a filter F _n (ω) defined by one of the following two expressions to the spatio-temporal frequency domain signal to generate a filtered signal D _n (ω).

Sound field recording and playback device. The sound field recording and reproducing device according to any one of claims 2 to 6,
A spatial frequency converter that converts the spatial frequency modulation signal into the spatio-temporal frequency domain signal by Fourier transform of the space;
A spatial frequency inverse transform unit for transforming the filtered signal into a frequency domain signal by inverse Fourier transform of space;
A frequency inverse transform unit for transforming the frequency domain signal into the reproduction signal that is a time domain signal by inverse Fourier transform;
A sound field collecting and reproducing apparatus further comprising: A space in which a spatial frequency modulation unit generates a spatial frequency modulation signal, which is a signal obtained by shifting a frequency domain signal generated from a signal collected by a microphone array including two or more microphones at a predetermined rotation angle. Including a frequency modulation step;
A sound field collection and reproduction method for obtaining a reproduction signal from the spatial frequency modulation signal.   A sound field sound recording / reproducing program for causing a computer to function as each unit of the sound field sound collecting / reproducing apparatus according to claim 1.

Images