JP3282201B2 - Sound collecting device, reproducing device, sound collecting method and reproducing method, and sound signal processing device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a sound pickup device for recording sound and
Sound collection method, reproduction device for reproducing collected sound, and reproduction
Method and sound combining sound pickup device and playback device
The present invention relates to a signal processing device . In particular, a sound collection device and a sound collection device capable of reproducing the original sound state more faithfully as a real sound image.
Method, playback device, playback method, and sound signal processing device
About the installation .

[0002]

2. Description of the Related Art Various recording methods and reproduction methods have been proposed and tried to faithfully reproduce (reproduce) a sound such as sound or voice having a spatial extent as a real sound image. In particular, stereoscopic televisions and the like are required to reproduce sound more faithfully as well as stereoscopically. For example, the “intensity stereo method”, which is a general sound pickup reproduction method, picks up sound by using a large number of microphones and sets a plurality of channels such as N.
Information such as a level difference and a time difference is added to the channel and the sound is distributed and recorded. At the time of reproduction, a sound image is generated by N speakers arranged at a predetermined position. Also, a binaural sound pickup reproduction method and a one-point sound pickup reproduction method are known.

[0003]

The conventional sound collecting and reproducing systems represented by the above-described examples all reproduce an imaginary sound image, so that the original object of generating a real sound image can still be achieved. Can not. As a result, there is still a problem caused by the virtual sound image, for example, a problem that the reproduction position of the sound is limited, a sound image is not formed when the position is shifted, and there is no real feeling when approaching the position of the virtual sound image.

Generally speaking, the generation of a real sound image is not limited to sound collection or reproduction, but it is, of course, necessary to consider the overall conditions from the sound collection process to the reproduction process. For that purpose, it is necessary to consider the method of recording and editing the sound pickup. SUMMARY OF THE INVENTION The present invention solves the above-described problems in the conventional sound collection and reproduction method, and in order to generate a real sound image, a sound collection device, a sound collection method, and a reproduction device in a process from sound collection to reproduction. And playback method, and sound pickup device and playback device
It is an object of the present invention to provide a sound signal processing device combining the above.

[0005]

A sound pickup apparatus according to the present invention comprises a first sound pickup device for multiplexing an output signal from sound detection means for detecting an audible sound from each sound source with respect to a plurality of sound sources.
Signal multiplexing means, a position information signal indicating at least one of a position of the sound source and a corresponding position of the sound detecting means, and a sound source indicating a size of the sound source
A second signal multiplexing unit that multiplexes the dimensional information signal in association with the output signal from the sound detection unit, and a second signal multiplexing unit that multiplexes the output signal from the sound detection unit or the first multiplexing unit. Recording means for recording the multiplexed signal and the second multiplexed signal multiplexed by the second multiplexing means on independent channels of a recording medium.

[0006] Preferably, the second signal multiplexing means includes:
Further, a directional information signal indicating at least one of the directivity of the sound source and the directivity of the sound detecting means is multiplexed on a channel different from the channel on which the output signal is recorded.

[0007] The reproducing apparatus of the present invention provides a sound signal recorded on at least one channel or a multiplexed sound signal, and a multiplexed sound signal recorded on a channel different from the channel on which the sound signal is recorded. A position information signal indicating a sound source position related to the sound signal and / or a position information signal indicating a disposition position of the sound detection means related to the sound signal, and a sound source size information signal of the sound signal. Means for reading and separating, and means for comprehensively adjusting the amplitude and delay time of the read sound signal to generate a real sound image based on the read position information signal and sound source size information signal. I do.

In the reproducing apparatus of the present invention, the sound signal recorded on at least one channel or the multiplexed recorded sound signal and the multiplexed recorded sound signal on a channel different from the channel on which the sound signal is recorded are recorded. At least one of a position information signal indicating a sound source position related to the sound signal and a position information signal indicating an arrangement position of sound detection means related to the sound signal, a sound source size information signal of the sound signal Means for reading and separating a directivity information signal indicating at least one of the directivity of the sound source and the directivity of the sound detection means; and the read position information signal, sound source size information signal, and directivity. Means for comprehensively adjusting the amplitude and delay time of the read sound signal to generate a real sound image based on the sex information signal.

Preferably, the apparatus further comprises a sound reproducing means for converting the adjusted sound signal into an audible sound and outputting the sound signal to generate a real sound image.

The sound collection method according to the present invention is characterized in that at least one of a sound source position related to the output signal and an arrangement position of the sound detection unit is provided on a channel different from a channel for recording the output signal detected by the sound detection unit. A signal obtained by multiplexing a position information signal indicating one position and a sound source size information signal indicating the size of the sound source in association with the output signal from the sound detecting means is recorded simultaneously.

[0011] The reproduction method of the present invention is characterized in that the sound signal recorded on at least one channel or the multiplexed sound signal and the multiplexed sound signal recorded on a channel different from the channel on which the sound signal is recorded are recorded. A position information signal indicating at least one of a position information signal indicating a sound source position related to the sound signal and a position information signal indicating a disposition position of the sound detection means related to the sound signal, and indicating a size of the sound source.
Separating read and to source dimensional information signal, comprehensively adjust the amplitude and delay time of the sound signal to produce an actual sound on the basis of the above read position information signal and the sound source dimension information signal, the The adjusted sound signal is converted into an audible sound and output.

The sound signal processing apparatus according to the present invention comprises a first signal multiplexing means for multiplexing an output signal from a sound detecting means for detecting an audible sound from each sound source with respect to a plurality of sound sources; Second signal multiplexing for multiplexing a position information signal indicating at least one of a position of a sound source and a corresponding arrangement position of the sound detecting means and a sound source size information signal indicating a size of the sound source. Means, an output signal from the sound detection means or a first multiplexed signal multiplexed by the first multiplexing means, and a second multiplexed signal multiplexed by the second multiplexing means. A sound pickup device having recording means for recording on an independent channel of a recording medium;
A playback device connected to the sound collection device via signal mediating means, wherein the sound signal recorded on at least one channel or the multiplexed recorded sound signal, and the channel on which the sound signal is recorded Is a position information signal indicating at least one of a position information signal indicating a sound source position related to the sound signal and a position information signal indicating an arrangement position of sound detection means related to the sound signal, multiplexed and recorded on different channels. Means for reading and separating a sound source size information signal indicating the size of the sound source and the read position information signal
And a means for comprehensively adjusting the amplitude and delay time of the read sound signal to generate a real sound image based on the sound source size information signal .

Preferably, the second signal multiplexing means of the sound pickup device further includes a directional information signal indicating at least one of the directivity of the sound source and the directivity of the sound detecting means. Multiplexing the output signal on a channel different from the channel on which the output signal is recorded, and the demultiplexing means of the playback device records the sound signal recorded on at least one channel or the multiplexed recorded sound signal, and the sound signal At least one of a position information signal indicating a sound source position related to the sound signal and a position information signal indicating an arrangement position of sound detection means related to the sound signal, which is multiplexed and recorded on a channel different from the selected channel. Position information signal, the sound source dimension information signal of the sound signal, and the directivity of the sound source and / or the directivity of the sound detecting means. Read out and separate the directivity information signal, and the adjusting means generates an actual sound image based on the read position information signal, sound source size information signal and directivity information signal, and adjusts the amplitude of the read sound signal. And adjust the delay time comprehensively.

Preferably, the reproducing apparatus further includes a sound reproducing means for converting the adjusted sound signal into an audible sound and outputting the audible sound to generate a real sound image.

[0015]

[0016]

[0017]

[0018]

[0019]

[Action] In the sound collection device and a sound collecting method of the present invention, in addition to the record of the sound signal, the position indicating at least one of the position of the arrangement position of the position and the sound detection means of the sound source
Information is also multiplexed and recorded on a channel different from the channel on which the sound signal is recorded . Since the sound signal and its positional relationship corresponds, the positional relationship of the sound source Te its editing step and the regeneration step odor, and edit sound generating an actual sound by considering the arrangement position of the sound detection means and the reproduction Becomes possible. In particular, since the channel on which the sound signal is recorded is different from the channel on which the position information is multiplexed, the handling of the signal in the editing operation and the reproducing operation performed as post-processing is facilitated. If the size information of the sound source is added to the multiplexing, the generation of the real sound image becomes more accurate. The multiplexing of the size information of the sound source may be different from the channel on which the sound signal is multiplexed, and the same channel as the channel on which the position information is multiplexed should be used.
Can also . Normally, since the sound signal changes continuously, the amount of information is large, but the position change is slow and the size of the sound source does not change. Thus, the switch Yaneru sound signals is convenient in terms of when the signal processing Oke varied. More directivity
By adding information , the generation of a real sound image can be realized more accurately. The channel that multiplexes this directivity information records the sound signal.
It may be different from the recorded channel.

In the reproducing apparatus and reproducing method of the present invention,
Then, an actual sound image is generated based on the position information , the sound source size information , and the directivity information .

The sound signal processing device according to the present invention includes the above sound collection device and
The sound pickup described above is organically combined with the above playback device.
An efficient operation is performed between the device and the playback device.

[0022]

FIG. 1 is a block diagram of a sound collecting apparatus according to a first embodiment of the present invention. The sound pickup device shown in FIG.
A specific example, for example, a case where a live performance of a performance at a concert venue is performed will be described.

Generally speaking, sound processing is, for example,
Sound collection conditions such as the performance sound of a concert, the sound source to be picked up and reproduced, such as the engine sound in a car stadium, the position of the sound pickup microphone, the sensitivity characteristics, the directivity, etc.
Looking at a series of related matters such as the editing method and its device conditions, the reproduction method, and the performance of the device used for sound processing as a whole, from the viewpoint of how it is possible to generate a real sound image, The conditions in the process will be determined. This sound pickup device collects sound so that a real sound image can be reproduced in consideration of editing and reproducing sounds from the plurality of sound sources.

In FIG. 1, a sound from the audience at the concert hall 5 is present at the concert hall in addition to a plurality of musical instruments such as a piano 1 and a violin 3 as sound sources to be collected. The sound pickup device shown in FIG.
, The M-th microphone 12 for detecting the sound from the violin 3, and the sound signals from the (M + 1) -th microphone 14 to the N-th microphone 15 for detecting the sound from the venue 5 are input.
You. The sound pickup device includes a first position detecting device 21 for providing information indicating the position of the first microphone 11 and an M-th position detecting device 22 for providing information indicating the position of the M-th microphone 12. Have. Further, the sound pickup device has a first multiplexer 31, a second multiplexer 32, and a sound pickup signal processing and recording device 40.

The first microphone 11 is disposed in the vicinity of the piano 1, and mainly detects sound using the piano 1 as a sound source and outputs the sound to the second multiplexer 32. Similarly,
The M-th microphone 12 is disposed near the violin 3, and mainly detects sound using the violin 3 as a sound source and outputs the sound to the second multiplexer 32. The first position detecting device 21 outputs position information of the piano 1, and the M-th position detecting device 22 outputs position information of the violin 3. These microphone position information detection signals M
P ₁ and MP _M are input to the first multiplexer 31. The position information provided from the first position detecting device 21 and the M-th position detecting device 22 is, for example, the relative position in the orthogonal coordinate system, using the position of the conductor of the concert hall 5 as the origin of the coordinate position. Or as an absolute position. Further, the position information is not limited to the rectangular coordinates, but may be indicated in a polar coordinate system. Piano 1,
The musical instrument such as the violin 3 is usually arranged at a fixed position in the concert hall 5. Therefore, in this example, the first position detecting device 21 and the M-th position detecting device 22 provide the arrangement position information of the fixed piano 1 and the violin 3. The positional information of the sound from the audience at the concert hall 5 is the (M + 1) th microphone.
14 to the Nth microphone 15
Even if it is set in the sound pickup signal processing and recording device 40 as information.
Good.

The first multiplexer 31 receives the microphone position information detection signal MP from the first position detection device 21.
₁ and that a microphone position information detection signal MP _M from the M-th position detecting apparatus 22 turn into multiplexing. Similarly, the second multiplexer 32 is <br/> multiplexes microphone detected sound signal S _M from the microphone detected sound signals S ₁ and the M-th microphone 12 from the first microphone 11. These are multiplexed signal as the input multiplexed signal IM ₁ and IM ₂ collected signals processing recording apparatus 40
Respectively are recorded in corresponds association positions are entered into. Thus is recorded in a state with the microphone detected sound signals S and microphone position information detection signal MP corresponding thereto multiplexed in <br/> Ru voice channel different respectively.

The multiplexing method of the sound signal and the position information in the first multiplexer 31 and the second multiplexer 32 is, for example, a frequency multiplexing method suitable for analog signal processing or a time division multiplexing method suitable for digital signal processing. And so on. With reference to FIG. 2, a frequency multiplexing method of position information will be described. First position detecting device 21
Are frequency multiplexed in different frequency bands from the microphone position information detection signal MP _M from the microphone position information detection signal MP ₁ and the M-th position detecting apparatus 22 from. The position information is multiplexed for a certain audio channel, and the microphone detection sound signals S ₁ and S _M are multiplexed to a channel different from this channel. When the multiplex channel of the position information and the multiplex channel of the sound signal are different from each other in this manner, the same frequency band can be used independently, and the handling of the signal in the subsequent editing processing and reproduction operation is facilitated.

The time division multiplexing process will be described with reference to FIG. A plurality of Ma Ikurofon position information detection signal MP ₁ to MP _M are time division multiplexed on the same channel.
In the figure, _the symbol FM indicates a frame marker. Multiplexing of sound signals is performed in the same manner as described above. However, as described above, the multiplexing of the position information and the multiplexing of the sound signal are performed using different channels.

As multiplexing in the first multiplexer 31 and the second multiplexer 32, time-division multiplexing in which digital processing is performed is easy. However, frequency multiplexing is performed in consideration of cost factors. It is somewhat difficult to perform the operations individually by the two multiplexers 32. Therefore, when performing frequency multiplexing, the microphone detection sound signal S and the microphone position information detection signal MP are once input to the sound collection signal processing and recording device 40,
Frequency multiplexing may be performed in the sound pickup signal processing and recording device 40. Further, time-division multiplexing may be performed in the sound pickup signal processing and recording device 40. In any case, sound pickup signal processing
And sound signal to the different audio channels from the recording apparatus 40 and the position information corresponding thereto are outputted are respectively multiplexed. As described later, the sound pickup signal processing and recording device 40
Provided a circuit for separating the multiplexed signal in
These signals may be output.

The sound pickup signal processing and recording device 40 is the (M + 1) th
Th microphone detected sound of the microphone 14 to the N-th microphone 15 signals to input S _{M + 1} ~ S _N, and outputs not directly multiplexed. These (M +
In the present embodiment, the 1) -th microphone 14 to the N-th microphone 15 are arranged at various places in the concert hall 5 and detect the sound of the entire audience in the concert hall 5. These acoustic is usually used to give a sense of realism, without association with the particular location information, the background sound (back
Ground sound) may be used as.

The recording on the N-channel audio channel in the sound pickup signal processing / recording device 40 is performed for each audio channel independent of various recording media, such as recording on a magnetic tape, recording on an optical disk, and recording on a semiconductor memory. Recorded in
Is done. The recording signal for each audio channel recorded on the recording medium by the sound pickup signal processing recording device 40 is edited by the editing device 50 as necessary, and reproduced by the sound reproducing device 100. In the editing processing in the editing device 50, the sound signal and the position information are multiplexed and recorded on different channels, respectively, so that a sound editing operation with spatial signal processing can be performed. Further, the sound information including the position information recorded by the sound collecting device can be directly reproduced by the sound reproducing device 100 without performing the editing operation. Alternatively, the sound signal processing and recording device 40 outputs a signal in which the sound signal and the position information are multiplexed to the direct sound reproducing device 100 without recording it on the recording medium, and outputs a signal that is not multiplexed. , Can be directly reproduced by the sound reproducing device 100. The reproduction process in the sound reproduction device 100 will be described later.

[0032] In the embodiments described above, Piano 1, by <br/> Olin 3 of which the dimensions of the sound source (magnitude) when multiplexed in addition to the above Kemah acme <br/> Rofon position information detection signal MP information ,
This is preferable in that the information is enriched and information editing processing and reproduction are performed to form a real sound image. The size information of the sound source is also multiplexed in the same manner as the position information, but a channel different from the channel on which the sound signal is multiplexed is used. The channel may be the same channel as the channel on which the position information is multiplexed or a new channel different from the multiplexed channel. The sound signal is continuous and changes rapidly. However, the change in the position information and the size of the sound source is small with respect to the change in the sound signal. Therefore, from the viewpoint of reducing the channel usage, the same channel may be used for the multiplexing of the position information and the multiplexing of the size information of the sound source. On the other hand, from the viewpoint of facilitating signal processing, it is desirable to multiplex the sound source size information on a channel different from the position information multiplexing channel.

Furthermore piano 1, directional information, such as violin 3 or, above directivity information, such as the first microphone 11 and the M-th microphone 12 Kemah <br/> Ikurofon position information detection signal MP, the sound source in addition to size information <br/> be multiplexed, similarly to the addition of the size information of the sound source, it is preferable in editing processing and reproduction. The multiplexing of the directivity information is also performed on a channel different from the multiplexing channel of the sound signal, similarly to the multiplexing of the size information of the sound source. Similarly to the above, multiplexing may be performed on the same or different channel as the multiplexing channel of the position information.

The provision of the position information in the first position detection device 21 and the M-th position detection device 22 includes the provision of the sound source position as the position information, and the provision of the first microphone 11 and the M-th microphone 12. It also provides location information . Or, as the location information,
Position detecting device 21 and Mth position detecting device 22
Is provided as position information. By recording the accurate position information together with the sound signal in this way, it becomes possible to form a more accurate real sound image through editing processing and reproduction processing.

In this embodiment, the sound is collected at the concert hall 5, the piano 1, the violin 3 and the like are at fixed positions, and the arrangement positions of the first microphone 11 and the M-th microphone 12 are also fixed. It is. Therefore, in this embodiment, the first position detecting device 2
Without using the first and M-th position detecting devices 22, the position information indicating the above-mentioned arrangement relation is previously stored in the sound-collecting signal processing and recording device 4.
0, the first position detecting device 21 and the M-th
But it may also not be provided the second of the position detecting device 22. Since position information is fixed, not always time multiplexed, may also be recorded like the head portion of the correlated audio channels.

In FIG. 1, the microphone detection sound signal S is not multiplexed because of the high frequency characteristics of the microphone detection sound signals S ₁ and S _M from the first microphone 11 and the M-th microphone 12. , Like the (M + 1) th microphone 14 to the Nth microphone 15, they can be recorded in different audio channels without multiplexing. In this case, multiplexing, such as location information and records the multiplexed with the recording and temporal-sound signals with different channels and voice channels.

FIG. 4 shows a sound collecting apparatus according to a second embodiment of the present invention. This sound pickup device is especially useful when the sound source moves.
Shows a configuration suitable for sound pickup . As an example of the movement of the sound source, there is a case where a singer holding a microphone sings while moving on the stage in a performance hall. As described above, in the sound pickup when the singer holding the first microphone 11 is moving, it is preferable to detect the position of the singer using the first position detection device 24 of the wireless system. .

In FIG. 4, the first microphone 11 is not fixed near the piano 1 as shown in FIG. 1, but is held by the singer. The M-th microphone 12 is owned by another moving singer.
The sound from the piano 1 (not shown) is detected by the (M + 1) th microphone 14, and the sound from the violin 3 is detected by the Nth microphone 15.

Ultrasonic waves are radiated from the first position detecting device 24 integrated with the first microphone 11 held by the moving singer, and the ultrasonic receiving devices arranged at various places in the concert hall 5 Receives the ultrasonic wave and notifies the microphone position detecting device 35 by radio waves or the like. The microphone position detecting device 35 detects the radio wave to detect the position of the first microphone 11. Similarly, an M-th position detection device integrated with an M-th microphone 12
Ultrasonic waves can also be emitted from the microphone 25 to detect the position of the M-th microphone 12 via the microphone position detecting device 35. As the position detection in the microphone position detecting device 35, the first position detecting device 2
4 the radio wave is radiated from a method of locating the position from the strength of the received radio wave in distant more than one position, it is possible to take other ways.

In this example, the positions of musical instruments such as piano 1 and violin 3 not shown in FIG. 4 are fixed. Accordingly, the microphone from these positions of the instrument may be recorded in the collected sound signal processing recording apparatus 40 as location information of the previously fixed, the microphone position detecting apparatus 35 that indicates the position of the first microphone 11 that has a moving singer position information detection signal MP ₁ and multiplexes simultaneously Ruchi Yaneru each microphone detected sound signals S ₁ is <br/> different from the first microphone 11. In this case, as described with reference to FIG. 1, the microphone detection sound signals S _{M + 1 to} S _N from the (M + 1) -th microphone 14 to the N-th microphone 15 are not multiplexed.

Multiplexing in the first multiplexer 31 and the second multiplexer 32 or the sound pickup signal processing and recording device 40 is the same as in the first embodiment. Also in the sound pickup apparatus of the second embodiment, similarly to the first embodiment, information on the size of a sound source such as a singer, a piano 1 and a violin 3, a microphone or the directivity of these sound sources is added.
It can be multiplexed to the microphone position information detection decyne No. MP.

Further, also in this embodiment, the second multiplexer 32 is deleted and the first microphone 11
Alternatively, the microphone detection sound signal S from the M-th microphone 12 may be input to the sound collection signal processing and recording device 40 without being multiplexed, and may be recorded in independent sound channels. And the position information is multiplexed recording at the same timing as that recorded in the voice channel to a different channel from the voice channel.

[0043] showing a configuration of a playback device as a real施例of the present invention in FIG. Playback apparatus of this is, first of sound reproduction system 11
0, second sound reproducing system 120 and third sound reproducing system 1
30 and a speaker system 140. In the above-described sound collection device , the case where there are N channels of audio channels has been described.
Only the channel will be described.

The first sound reproduction system 110 includes a decoder 11
1, respectively, the signal delay circuit 112 and the amplitude adjustment circuit 1
13, a signal delay circuit 114 and an amplitude adjustment circuit 115,
It comprises a signal delay circuit 116 and an amplitude adjustment circuit 117, and four parallel sound adjustment circuits including a signal delay circuit 118 and an amplitude adjustment circuit 119. The circuit configurations of the second sound reproduction system 120 and the third sound reproduction system 130 are the same as those of the first sound reproduction system 110. The speaker system 140 includes a signal addition circuit 141, a power amplification circuit 142, a speaker 151, a signal addition circuit 143,
Power amplification circuit 144 and speaker 152, signal addition circuit 145, power amplification circuit 146 and speaker 153
And a signal addition circuit 147, a power amplification circuit 148, and a speaker 154.

Before the first sound reproducing system 110, the second sound reproducing system 120, and the third sound reproducing system 130,
FIG 1 position information detection signal P _1, each multi-duplex recorded sound signal and position information on a recording medium in the collected sound signal processing recording apparatus 40 which is illustrated apart min <br/> separate to, P _2,
P ₃ and microphone detection sound signals S ₁ , S ₂ , S ₃
Binary release circuits are _provided, but not shown. Alternatively, when a multiplexed signal is directly applied from the sound collection signal processing and recording device 40 shown in FIG. 1 to the sound reproducing device 100, only a circuit for separating the multiplexed signal may be provided. Further, the sound collecting device and the reproducing device of the present invention can be integrally formed, and this is called a sound signal processing device. In that case the first
Microphone 11 and M-th microphone 12
The signals and the first position detection device 21 and the signal of the M-th position detecting apparatus 22 without multiplexing, may also be used directly. In the following description, it will be described how the position information separated from the signal readout and the microphone detection sound signal are used for reproduction.

FIG. 6 shows a speaker array of the speaker system 140 shown in FIG. FIG. 6A shows the speaker system 14.
0 shows a front view, and FIG. 6B shows a cross-sectional view thereof. In this example, M speakers are arranged in a concave shape. The speaker arrangement itself has been proposed by Olson (for example, by Olson, translated by Nishimaki, "Acoustic Engineering", 1959). In this loudspeaker system, when a large number of loudspeakers are arranged in an array and the delay of the signal to be added is adjusted to create a focal point of the sound wave at one point in space, a point with a very high sound pressure is synthesized at one point near the listener. Then, at this point, a situation occurs as if an actual sound source exists.
Based on the grounds that a sound image is perceived at the position in terms of psychoacoustics (for example, Komiyama et al., "Development of technology for controlling the perspective of sound images for 3D television", NHK STRL R & D, 19
February 1991, No. 2, pages 10-14). 5, the speaker 151 to 154 are shown only four, generally speaking, the M speakers as shown in FIG. 6 are arranged.

[0047] The decoder 111 is the actual position information is input is separated detection signal P ₁ from the microphone detected sound signals S ₁ signal is applied to the delay circuit 112 and 114,
The delay amounts of 116 and 118 are changed. Further, the decoder 111 converts the amplitude of the microphone detection sound signal delayed in the signal delay circuits 112, 114, 116 and 118 into amplitude adjustment circuits 113, 115, 117 and 11.
Adjust at 9. The amount of delay due to the position information in the signal delay circuit 112 is determined based on the position of the sound source, the position of the microphone, or any one of the position information. How to use the position information of the sound source and the position information of the microphone is defined according to the object, condition, purpose, and the like of sound collection and reproduction. When the sound reproduction processing is performed using the actual position information in this manner, the reproduced sound areas 161, 162,
163 is generated.

In the above sound pickup device, the size of the sound source
When the information is also multiplexed, the decoder 111 changes the respective amplitude adjustment amounts in the amplitude adjustment circuits 113, 115, 117, and 119 in accordance with the size of the sound source and, if necessary, in consideration of the position information. . Thereby, a more accurate real sound image can be generated.

Similarly, when the directional information is multiplexed in the sound pickup device, the decoder 111 calculates a delay amount and an amplitude adjustment amount based on the directional information , and
2, 114, 116, 118 and amplitude adjustment circuit 1
13, 115, 117 and 119 are adjusted.

[0050] In the reproduction method described above has dealt with the case of adjusting the delay amount and the amplitude amount independently for each audio channel, in the present invention, the sound signal and position information of each channel, and further, the sound source In addition to the information such as the size of the sound and the directivity, from the overall viewpoint of sound reproduction, the delay amounts of the respective signal delay circuits in the respective sound reproduction systems 110, 120, and 130, and the respective amplitude adjustment circuits Specifies the amplitude adjustment amount of The overall coordination may be carried in the editing apparatus 50 in the editing stage, or position information, calculates a coefficient depending on the size information of the sound source, it may be adjusted each line in the coefficients.

[0051]

As described above, the sound pickup apparatus of the present invention
And according to the sound collecting method, in addition to the sound collection sound, since at least a multi-redundant position information corresponding to the picked-up sound, edited in a later stage, in the reproduction, to generate the actual sound Will be possible. In particular, by varying the multiplexed recording channel recording tea <br/> channel and location information of the sound signals, subsequent processing, for example, signal processing is facilitated in the editing process and the regeneration process.

According to the sound pickup apparatus and the sound pickup method of the present invention , information such as the size and directivity of the sound source is added to the position information.
It makes it possible to realize a more real sound by multi duplex Te.

[0053] Further, according to the reproducing apparatus and reproducing method of the present invention, are collected by the sound collecting apparatus and the sound collection method
Based on the multi-duplexed signal it becomes possible to produce a real sound since the reproduction of the sound by using a plurality of speakers.

According to the sound signal processing device of the present invention,
Integrated sound pickup device and playback device
The effect as a device is obtained.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of a sound pickup device as a first embodiment of a sound pickup device of the present invention.

FIG. 2 is a diagram illustrating frequency multiplexing processing of position information or a sound signal in the sound collection device illustrated in FIG.

3 is a diagram illustrating time-division multiplexing processing of position information or a sound signal in the sound collection device illustrated in FIG. 1;

FIG. 4 is a configuration diagram of a sound pickup device as a second embodiment of the sound pickup device of the present invention.

FIG. 5 is a configuration diagram of a sound reproducing device as an embodiment of the reproducing device of the present invention.

6A and 6B are diagrams showing an arrangement of a plurality of speakers shown in FIG. 5, wherein FIG. 6A is a front view and FIG. 6B is a sectional view thereof.

[Explanation of symbols]

1. Piano, 3. Violin, 5. Concert venue,
11, 12, 14, 15 · · microphone, 21,
2 ··· Position detector, 31, 32 ·· multiplexer,
35 ··· Microphone position detection device, 40 ·· Sound signal processing and recording device, 50 ··· Editing device, 100 ·· Sound reproducing device, 110,120,130 ·· Sound reproducing system, 111
..Decoders, 112, 114, 116, 118 .. signal delay circuits, 113, 115, 117, 119 ... amplitude adjustment circuits, 141, 143, 145, 147 ... signal addition circuits, 142, 144, 146, 148. ..Power amplifier circuits, 151 to 154, loudspeakers, 161 to 163
・ Playback sound area.

Continued on the front page (51) Int.Cl. ⁷ Identification code FI H04S 7/00 H04S 7/00 Z

Claims (10)

(57) [Claims] A first signal multiplexing means for multiplexing an output signal from a sound detecting means for detecting an audible sound from each sound source with respect to a plurality of sound sources; A position information signal indicating at least one of the positions at which the sound detecting means is provided
And multiplexing a sound source size information signal indicating the size of the sound source with the output signal from the sound detecting means.
Signal multiplexing means, an output signal from the sound detecting means or a first multiplexed signal multiplexed by the first multiplexing means, and a second multiplexed signal multiplexed by the second multiplexing means. Recording means for recording the converted signals on independent channels of a recording medium. 2. The second signal multiplexing means further records a directivity information signal indicating at least one of the directivity of the sound source and the directivity of the sound detection means, and records the output signal. 2. The sound collection device according to claim 1 , wherein the sound is multiplexed on a channel different from the selected channel. 3. A sound signal recorded on at least one channel or a multiplexed sound signal, and the sound signal multiplexed and recorded on a channel different from the channel on which the sound signal is recorded. Means for reading and separating at least one of a position information signal indicating a sound source position and a position information signal indicating an arrangement position of the sound detection means related to the sound signal and a sound source size information signal of the sound signal; A reproducing apparatus comprising: means for comprehensively adjusting the amplitude and delay time of the read sound signal in order to generate a real sound image based on the read position information signal and sound source size information signal. 4. A sound signal recorded on at least one channel or a multiplexed sound signal, and the sound signal multiplexed and recorded on a channel different from the channel on which the sound signal is recorded. At least one of a position information signal indicating a sound source position and a position information signal indicating a disposition position of the sound detection means related to the sound signal, a sound source dimension information signal of the sound signal, and directivity of the sound source Means for reading and separating a directivity information signal indicating at least one of the directivities of the sound detection means, and a read-out position information signal, a sound source size information signal and a directivity information signal. Means for comprehensively adjusting the amplitude and delay time of the read sound signal to generate a real sound image. 5. A sound reproducing means for converting the adjusted sound signal into an audible sound and outputting the converted sound signal to generate a real sound image.
The playback device according to 3 or 4 . 6. A position indicating at least one of a sound source position related to the output signal and an arrangement position of the sound detection means on a channel different from a channel for recording an output signal detected by the sound detection means. A sound collection method for simultaneously recording a multiplexed signal in which an information signal and a sound source size information signal indicating the size of the sound source are associated with an output signal from the sound detection means. 7. A sound signal recorded on at least one channel or a multiplex-recorded sound signal, and the sound signal recorded on a channel different from the channel on which the sound signal is recorded. A position information signal indicating at least one of a position information signal indicating a sound source position and a position information signal indicating a disposition position of the sound detection means related to the sound signal, and a sound source size information signal indicating the size of the sound source. Read and separate, and comprehensively adjust the amplitude and delay time of the sound signal to generate a real sound image based on the read position information signal and sound source size information signal. A playback method that converts it into audible sound and outputs it. 8. A first signal multiplexing means for multiplexing a plurality of sound sources with output signals from sound detecting means for detecting audible sounds from the respective sound sources, and a position of the sound source and a corresponding one of the plurality of sound sources. Second signal multiplexing means for multiplexing a position information signal indicating at least one of the positions of the sound detecting means and a sound source size information signal indicating the size of the sound source; Or the first multiplexed signal multiplexed by the first multiplexing means,
A sound pickup device having recording means for recording the second multiplexed signals multiplexed by the second multiplexing means on independent channels of a recording medium, respectively, connected to the sound pickup device via signal mediating means A sound signal recorded on at least one channel or a multiplexed recorded sound signal, and the sound signal multiplexed and recorded on a channel different from the channel on which the sound signal is recorded. At least one of a position information signal indicating a sound source position related to the sound source and a position information signal indicating an arrangement position of the sound detection means related to the sound signal, and a sound source size information signal indicating a size of the sound source Means for reading out and separating, and the read out position information signal
A reproduction device comprising: a reproduction device that comprehensively adjusts the amplitude and delay time of the read sound signal to generate a real sound image based on the sound source size information signal . 9. The sound pickup apparatus according to claim 2, wherein said second signal multiplexing means further comprises: a directivity information signal indicating at least one of the directivity of said sound source and the directivity of said sound detection means. Multiplexing the output signal on a channel different from the channel on which the output signal is recorded, wherein the demultiplexing means of the playback device includes a sound signal recorded on at least one channel or a multiplexed recorded sound signal,
And a position information signal indicating a sound source position related to the sound signal multiplexed and recorded on a channel different from the channel on which the sound signal is recorded, and a position indicating an arrangement position of sound detection means related to the sound signal. At least one of the information signal, the sound source size information signal of the sound signal, and the directivity information signal indicating at least one of the directivity of the sound source and the directivity of the sound detection unit are read out. Separately, the adjusting means comprehensively adjusts the amplitude and delay time of the read sound signal to generate a real sound image based on the read position information signal, sound source size information signal and directivity information signal. Claim 8 to adjust
A sound signal processing device as described in the above. 10. The sound signal processing device according to claim 8, wherein said reproducing device further comprises a sound reproducing means for converting said adjusted sound signal into an audible sound and outputting it to generate a real sound image.