JP2019029878A - All sky orientation multi-channel audio equipment - Google Patents

Abstract

To provide all sky orientation multi-channel audio equipment to realize high sound quality high realistic sound system of an ultra high definition video system.SOLUTION: All sky orientation multi-channel audio equipment includes an all sky orientation multi-channel audio microphone unit and a function to rotate this unit by a motor 17, and four-dimensional azimuth point group acoustic data for each azimuth angle is picked up by a microphone 01 at an arbitrary sound pickup azimuth angle, and picked up sound data information in which video and sound pickup at this time are synchronized is acquired.EFFECT: There is provided a video and audio space that can follow the movement of the head of a viewer by making the video and the sound image at an arbitrary four-dimensional image position of ultra high definition video coincide with each other to achieve an acoustic scheme in which sound arrives from all directions surrounding the viewing position.SELECTED DRAWING: Figure 11

Description

  The present invention provides a video and audio space that can match a video image and a sound image at an arbitrary four-dimensional image position of an ultra-high-definition video image and can follow the movement of the viewer's head, and can generate sound from all directions surrounding the viewing position. The present invention relates to a sound collection device that realizes an acoustic system in which sound waves arrive.

  In a stereophonic sound system represented by a 22.2 multi-channel sound system, it is necessary to record sound coming from the front, back, top and bottom, and from left to right, and each microphone needs to collect sound independently regarding the phase and amplitude of the incoming sound wave. There is.

  For the above purpose, there is a sound collecting device for a multi-channel sound system using a microphone array device.

  A sound collecting device structure provided with a sound insulation space having openings corresponding to the number of microphones is provided with a plurality of microphones that receive sound incident through the openings, and the sound insulation structures are formed radially in a horizontal plane. A plurality of sound insulation space arrays including a plurality of sound insulation spaces, the sound insulation space arrays being formed at different positions in the vertical direction perpendicular to the horizontal plane, and the plurality of microphones being radially arranged in the horizontal plane. There is a sound collecting device for a multi-channel acoustic system, wherein a microphone array including a plurality of microphones is formed, and each microphone array is formed at a different position in the vertical direction (see Patent Document 1).

  The 22.2 multi-channel sound, which is an 8K Super Hi-Vision sound system, is a sound technology that realizes a high sense of realism through three-dimensional sound composed of three layers of channels.

  The channel arrangement of 22.2ch sound is composed of a channel arrangement consisting of three layers: the middle layer located at the listener's listening height, the upper layer located above (ceiling surface), and the lower layer located below (floor surface). Yes. The channels of each layer are the middle layer 10 channel, the upper layer 9 channel, the lower layer 3 channel, and the two LEF (for bass effect) channels, but the horizontal, vertical arrangement of the upper layer, the middle layer, and the lower layer channel arrangement is equi-oriented. It is not.

  22.2 Multi-channel arrangement makes it difficult to pick up sound between appropriate channels, and can follow the coincidence of the image and sound image at any 4D image position of the ultra-high-definition video and movement of the viewer's head There was a difficulty in providing an audiovisual space (see Non-Patent Document 1).

JP 2010-245737 A

Toshiyuki Nishiguchi, two others, “8K Super Hi-Vision Sound Production System Development and Standardization Trend”, [online], May 25, 2017, NHK Science and Technology Research Laboratory, [Search May 28, 2017], Internet (URL: www.nhk.or.jp/strl/publica/rd/rd148/PDF/P12-21.pdf)

  8K Super Hi-Vision (8K Super Hi-Vision) is a super high-definition video system that has a wide viewing angle of about 100 ° on a horizontal plane and can reproduce a high sense of realism as if you were on the spot. A highly realistic sound system that is a three-dimensional sound that exceeds the two-dimensional sound of only front, rear, left and right is desirable.

  It consists of multiple layers such as upper layer, middle layer, lower layer, etc. to match the image and sound image at any 4 dimensional (XYZ coordinate axis and W depth recognition) image position of ultra high definition video, vertical direction, horizontal direction etc. An arrangement of an azimuth multi-channel acoustic microphone unit is required.

  In a stereophonic sound system, it is necessary to record sound coming from the front, back, top, bottom, and left and right, and each microphone needs to collect sound independently with respect to the phase, amplitude, and sound pressure of the incoming sound wave.

  In order to provide an audio-visual space that can follow the movement of the viewer's head and to match the direction of the image and sound image at any position on the screen, a smartphone, digital camera, VR, AR, MR equipment and multi-channel microphones are used in an external connection, spatial memory (XYZ coordinate axes) and depth recognition (W), three-dimensional point cloud image data for motion analysis, azimuth sound (XYZ coordinate axes), and point cloud It is necessary to obtain the sound pressure (P) by synchronizing the three-dimensional point group sound pressure data.

  A portable multi-channel sound pickup device is required to enable live sound collection and live transmission.

  Multi-channel sound pickup is required to achieve backward compatibility with the 2-channel stereo system and 5.1-channel stereo system that have been put to practical use as existing multi-channel sound systems.

  The multi-channel microphone is equipped with a multi-channel sound pickup function for all directions from all directions of 360 ° from all directions with the same azimuth between horizontal and vertical microphones.

  A microphone unit equipped with a multi-channel microphone is rotated stepwise with a motor at an arbitrary speed and an arbitrary rotation angle, and from each microphone direction at each rotation stop after a rotation operation, four-dimensional azimuth point acoustic data and front signs, rotation speed, Sound pickup data information including the azimuth angle, the elapsed time from the start of sound pickup (time stamp), and the like is collected.

  Smartphones, digital cameras, VR, AR, MR devices and multi-channel microphones are used in an external connection, and the four-dimensional solid point cloud image data and the four-dimensional solid point cloud are obtained from the collected sound data information. By synchronizing the acoustic data, processing is performed to match the video and the sound image at an arbitrary image position of the ultra-high definition video.

  Recording and storage of analog signals picked up by multi-channel microphones, digital signals obtained by digital conversion of these analog signals, and audio signals added with sound pickup data information at the time of sound pickup, and audio that outputs these data to the outside A signal processor is provided.

  An audio system in which sound is arriving from all directions surrounding the viewing position can be realized by audio signal processing of all-directional and multidirectional sound pickup from all directions of 360 ° from all directions.

  By connecting video imaging equipment and multi-channel microphone sound pickup equipment, video at any image position of ultra high-definition video can be obtained by synchronizing 4D stereoscopic point group video data and 4D stereoscopic point group acoustic data. It is possible to realize an audiovisual space that matches sound images with high accuracy and can follow the movement of the viewer's head with high accuracy.

  The omnidirectional multi-channel sound pickup system can record sounds coming from the front, back, top and bottom, and left and right, and each microphone can pick up the sound independently with respect to the phase, amplitude, and sound pressure of the incoming sound wave.

  When the sound collection azimuth angle during rotation is set to 1 ° by step rotation using the servo motor and stepping motor of the omnidirectional multi-channel acoustic microphone unit, 360 times the total sky, etc. An azimuth multi-channel acoustic device can be realized.

  Generation of 22.2ch, 5.1ch, 2ch sound material from 26.2ch sound material by analog signal, digital signal obtained by digital conversion of this analog signal, and audio signal material of sound collection data information at the time of sound collection, In addition, an upmix preprocessor process capable of generating the opposite is possible.

Microphone unit plan view Microphone unit bottom view Microphone unit front view Microphone unit rear view Microphone unit right side view Microphone unit left side view 26.2ch audio channel upper layer layout schematic 26.2ch acoustic channel middle layer layout schematic 26.2ch acoustic channel lower layer layout schematic Microphone unit rotation / rotation speed / sound pickup direction angle setting explanation diagram Front view of a omnidirectional multi-acoustic sound pickup device Developed view of rotating column opening Sound pickup device pedestal and head case / pop filter cross section Front view of control unit for all-directional multi-channel sound pickup device Diagram of digitization of audio-acoustic signals A-A 'line cross section (fixed support, rotating support, rotary connector) Front view of a omnidirectional multichannel spherical microphone sound pickup device Top view of an all-directional multi-channel spherical microphone sound pickup device Fixed type microphone unit front view 60 ° azimuth microphone unit plan view 60 ° azimuth microphone unit bottom view Front view of 60 ° azimuth microphone unit 60 ° azimuth microphone unit rear view 60 ° acoustic channel upper layer schematic diagram 60 ° acoustic channel middle layer layout schematic 60 ° acoustic channel lower layer schematic diagram Headphone driver unit left side layout Headphone driver unit right side layout Headphone driver unit structure diagram

  8K Super Hi-Vision (8K Super Hi-Vision) is an ultra-high-definition video system with horizontal, 680x vertical and 320 pixels, 16 times that of HDTV, and a wide viewing angle of about 100 ° on the horizontal plane The present invention is equipped with a omnidirectional 26.2 multi-channel acoustic microphone in order to realize a highly realistic sound system capable of dealing with this image quality. .

  The omnidirectional 26.2 multi-channel acoustic microphone has a 01 microphone 26 channel and 02 bass effect microphone 2 channel incorporated in a 03 microphone holding material, a plan view of FIG. 1, a bottom view of FIG. 2, and a front view of FIG. 4, a right side view of FIG. 5, and a left side view of FIG. 6.

  In the microphone unit plan view of FIG. 1, 01 is a microphone, 02 is a microphone for low-frequency effects, 03 is a microphone holding material, and 01 microphones are horizontally arranged at intervals of 05 lateral azimuths. Arranged at an arbitrary interval of 90 ° or less. The lateral azimuth angle in the case of FIG. 1 is 45 °.

  In the bottom view of the microphone unit in FIG. 2, 01 is a microphone, 02 is a microphone for low-frequency effects, 03 is a microphone holding material, and 01 microphones are horizontally arranged at intervals of 05 lateral azimuths. Large, arranged at an arbitrary interval of 90 ° or less, and equipped with 04 sound collecting data and power cables. In the case of FIG. 2, the lateral azimuth is 45 °.

  In the front view of the microphone unit in FIG. 3, 01 is a microphone, 02 is a microphone for low-frequency effects, 03 is a microphone holding material, and 01 microphones are vertically arranged at intervals of 06 longitudinal azimuths. Large, arranged at an arbitrary interval of 90 ° or less, and equipped with 04 sound collecting data and power cables. The longitudinal azimuth angle in the case of FIG. 3 is 45 °.

  In the rear view of the microphone unit of FIG. 4, 01 is a microphone, 02 is a microphone for low-frequency effects, 03 is a microphone holding material, and 01 microphones are vertically arranged at intervals of 06 longitudinal azimuths. Large, arranged at an arbitrary interval of 90 ° or less, and equipped with 04 sound collecting data and power cables. The longitudinal azimuth angle in the case of FIG. 4 is 45 °.

  5 is a microphone unit right side view, FIG. 6 microphone unit left side view 01 is a microphone, 02 is a low-frequency effect microphone, 03 is a microphone holding material, and 01 microphones are vertically arranged at intervals of 06 longitudinal azimuth angles. The longitudinal azimuth angle is greater than 0 ° and is arranged at an arbitrary interval of 90 ° or less, and includes 04 sound collecting data and power supply cables. The longitudinal azimuth angle in the case of FIGS. 4 and 5 is 45 °.

  A total of 26 microphones in the plan view of FIG. 1, the bottom view of FIG. 2, the front view of FIG. 3, the rear view of FIG. 4, the right side view of FIG. 5, and the left side view of FIG. Based on the azimuth and length from the center of the holding material, four-dimensional azimuth point group acoustic data is determined by calculating three-dimensional azimuth basic data (XYZ coordinate axes) for sound collection.

  The omnidirectional multichannel acoustic microphone unit realizes omnidirectional multichannel with the azimuth angle between horizontal and vertical microphones set to the same angle. In the case of the omnidirectional 26.2 multi-channel acoustic microphone unit shown in FIGS. 1 to 6, the microphone 26 and the bass effect at 45 ° intervals of the horizontal azimuth angle and 45 ° intervals of the vertical azimuth angle of the vertical microphone. A total of 28 channels of the microphone 2 are used. In addition, as an example of obtaining a higher realistic sensation sound, a total of 36. of the microphone 36 and the low-frequency effect microphone 2 at intervals of 30 ° of the horizontal azimuth angle of the horizontal microphone and 30 ° intervals of the vertical azimuth angle of the vertical microphone. It becomes a two-channel configuration. Also, as an example of low realistic sensation, a total of 6.2 channels are configured with the microphone 4, the microphone 6 of the vertical upper and lower microphones 2, and the microphone 2 for low-frequency effects at 90 ° intervals of the horizontal azimuth angle of the horizontal microphone.

  When a 01 microphone with a beam performance of about 50 ° beamwidth is used, the half-width 50 ° is close to 45 ° divided into eight horizontal directions, making it an optimal channel arrangement for 26.2 multi-channel acoustic microphones. The directional beam in this case can correspond to one channel of 26.2 multichannels.

  As shown in the plan view of the microphone unit in FIG. 1, the omnidirectional multi-channel acoustic microphone unit is front and rear, left and right from the viewer position, and as shown in the front view of the microphone unit in FIG. Sounds are collected from the same four-dimensional azimuth point acoustic data in all directions in the lower layer, enabling a 360-degree acoustic space up, down, left and right from the viewer position.

  FIG. 7 shows the channel arrangement of the upper layer, which is the upper (ceiling surface) position located at the listener's listening height of the 26.2 ch sound channel. Tn (channel upper layer north direction), Tne (channel upper layer northeast) on the upper layer horizontal surface. Direction), Te (channel upper layer east direction), Tes (channel upper layer south direction), Ts (channel upper layer south direction), Tsw (channel upper layer south direction), Tw (channel upper layer west direction), Twn (channel upper layer north direction) 8 microphones and 1 microphone of Top (channel upper layer top orientation) are arranged vertically above the center.

  FIG. 8 shows the channel arrangement of the middle layer, which is the middle position located at the listening height of the listener of the 26.2 ch sound channel, with Mn (channel middle layer north direction), Mne (channel middle layer northeast direction), 8 microphones: Me (channel middle east direction), Mes (channel middle layer south east direction), Ms (channel middle layer south direction), Msw (channel middle layer southwest direction), Mw (channel middle layer west direction), Mwn (channel middle layer northwest direction) 2 microphones LEF1 (middle layer bass effect microphone 1) on the left side of the Mw direction and LEF2 (middle layer bass effect microphone 2) on the right side of the Me direction.

  FIG. 9 shows the channel arrangement of the lower layer, which is the lower (floor surface) position located at the listener's listening height of the 26.2 ch sound channel. Bn (channel lower layer north direction) and Bne (channel lower layer northeast) Direction), Be (channel lower layer east direction), Bes (channel lower layer south direction), Bs (channel lower layer south direction), Bsw (channel lower layer south direction), Bw (channel lower layer west direction), Bwn (channel lower layer north direction) 8 microphones and 1 microphone of Bot (channel lower layer bottom orientation) are arranged vertically below the center.

  The two microphones LEF1 (middle layer bass effect microphone 1) and LEF2 (middle layer bass effect microphone 2) shown in FIG. 8 are arranged in either the middle layer or the lower layer depending on the acoustic environment.

  As an example of the sound data of the 26.2ch sound channel by other channel configuration of viewing with 26 speakers and 2 subwoofers, the upper layer arrangement is used as the left side of the stereo audio signal of FIGS. 7, 8, and 9 of this sound data. Twn, Tw, Tsw, middle layer arrangement Mwn, Mw, Msw, lower layer arrangement Bwn, Bw, Bsw are mixed by a preprocessor, and the upper layer arrangement Tne, Te, Tes, middle layer arrangement Mne, Me are used as the right side of the stereo audio signal. , Mes, lower layer arrangement Bne, Be, Bes, and 3D stereo audio reproduction for 2 channels by 2 microphones, 3D stereo audio sound with more stereoscopic effect from all directions surrounding the viewing position can be realized.

  In the case of FIG. 10, the rotation of the microphone unit is centered on the rotation axis of the 31 microphone, and the rotation direction of the 32 microphone is clockwise (clockwise) or counterclockwise, and is rotated by the motor at an arbitrarily set 33 microphone rotation speed. The 01 microphone is moved in units of 34 microphone sound collection azimuth angles that are arbitrarily set, and for each movement, four-dimensional azimuth point sound data is collected by the microphone. By collecting the sound at a stationary time for each movement, it is possible to avoid the noise of wind noise when the microphone rotates.

  When the 34-microphone sound collection azimuth angle is set to 0 °, sound is collected at all microphone fixed azimuth angles without rotation, and when it is set to 360 °, continuous sound collection is performed at each microphone.

  In the case of the omnidirectional 26.2 multi-channel acoustic microphone of FIGS. 1 to 6, if the 33 microphone rotation speed is set to 1 second and the 34 microphone sound pickup azimuth is set to 1 °, 26 × 360 per second. (9, 360) Multi-channel configuration, consisting of the 9-360 multi-channel 4D azimuth point acoustic data, front sign, rotational speed, azimuth angle information, elapsed time (time stamp) from the start of sound collection, etc. Sound collection data information can be collected.

  In the case of a sound source that does not move like a solo instrument played by a single player, the omnidirectional orientation with the microphone rotation speed set to 0 ° and non-rotating for effective sound collection Collects sound from a multi-channel acoustic microphone.

  For 8K Super Hi-Vision ultra-high-definition video viewing on TV, 360 ° omnidirectional viewing PC, smart phone, VR, AR, MR equipment headphone viewing video, spatial memory (XYZ coordinate axis) and depth recognition ( W) and three-dimensional point group azimuth data for motion analysis, and the sound corresponding to ultra high definition video is composed of three-dimensional point group sound pressure data of azimuth sound (XYZ coordinate axes) and point group sound pressure (P). The image and sound image at an arbitrary 4D image position of an ultra-high-definition image are matched to provide an audio-visual space environment that can follow the movement of the viewer's head, and sound comes from all directions surrounding the viewing position. Realize the acoustic system.

  By rotating the microphone unit in FIG. 10, it is possible to continuously collect sound with the microphone direction of the rotation destination as the front, and even if the sound source moves, the multi-channel sound environment with the sound source direction as the front is reconstructed and viewed. Provide an audiovisual space environment that can follow the movement of a person's head.

  A hollow 11 rotating strut is connected to the lower part of the 03 microphone holding member of the all-sky equal direction multi-acoustic sound pickup apparatus of FIG. 11, and this rotating strut is rotated by 17 motors. This rotating strut is rotated by being connected to 10 fixed struts connected to the 21 sound pickup device base by upper and lower 14 bearings. A 15-rotation strut opening is provided in the rotation strut so that the sound collection of the microphone in the bottom direction of the bottom channel of the Bot channel in FIG. The audio signal picked up by the 01 microphone and 02 low-frequency effect microphone is connected to the fixed support column by contacting the 12 rotation connection connector ring connected to the 11 rotation support column with the 13 rotation connection connector brush connected to the 10 fixed support column. To 20 acoustic signal / power transmission cables. 21 sound pickup device base, 16 power controller, 17 motor and 18 motor controller, 19 audio signal processor, this all-sky omnidirectional multi sound pickup device can be connected to video movie, smart phone etc. for synchronous use 30 connection adapters for connecting

  The power supply to the omnidirectional multi-acoustic sound pickup apparatus is performed by external power from the battery of the 49 battery external power supply unit of FIG.

  11 is a cross-sectional view taken along line AA ′ of the omnidirectional multi-acoustic sound pickup device. The cross-sectional view of the microphone unit unit shown in FIG. This is a structure in which a 13-rotation connector brush such as a carbon brush is pressed from the side, which is fixedly bonded to the wire, and energized while slipping, and the audio signal collected from the microphone is transmitted to the 20 acoustic signal / power transmission cable.

  The rotation detector / encoder of 48 rotation angle / rotation speed in FIG. 11 detects the rotation angle / rotation speed of the motor shaft of 17 motor that rotates 11 rotation struts and feeds it back to 18 motor controller. Used to control so that the difference in the information of the input control data is zero.

  FIG. 12 is a developed view in which the hollow rotating support column is developed to have a circumference of 07 rotating support column. The 15 rotation support column opening is provided in the 11 rotating support column so that the sound collection of the microphone is not blocked.

  A flange for 22 head cases is provided on the 21 sound pickup device pedestal of FIG. 13, and a 23 head case made of a material that is easy to transmit air vibration to protect the delicate vibration plate from the impact on this flange portion, for preventing wind noise A 24-pop filter is incorporated, and a 39 noise sound shielding plate is provided to block noise from the motor rotation sound, bearings, power controller, motor controller, and audio signal processor.

  14 sound pickup device base of FIG. 14 is equipped with a 25 power switch and a 16 power controller that provides power to the microphone unit, and a 26 rotation speed setting switch that can arbitrarily set the 33 microphone rotation speed, and supplies power to 17 motors. 18 motor controller for controlling the motor rotation speed, 27 sound pickup azimuth angle setting switch, 28 external storage medium input / output device, 29 external output socket, control data communication and audio signal communication with other devices The 19 audio signal processing processors having 51 wireless communication devices and short-range wireless communication devices are connected.

  The 17 motor shown in FIG. 11 uses the 18 motor controller to combine the control data from the 26 rotation speed setting switch and the 27 sound collection azimuth angle setting switch shown in FIG. A stepping motor that controls the rotation angle and speed of the motor rotation shaft according to the pulse signal input to the motor driver (device that drives and controls the motor), or a rotation detector (rotation angle / rotation speed of the motor shaft) Encoder), feed back to the motor driver, and use one of the servo motors that performs step control so that the difference between this feedback and the control information previously input to the motor driver becomes 0. Sound is collected by the microphone during the rotation stop period for each step.

  The 19 audio signal processor performs digitization processing of 38 voice sounds in FIG. Digitization of sound is converted into 35 analog signals with continuous voltage values through a microphone, and then discontinuous so that the computer can handle temporally and numerically continuous data (analog signals). To a new value (digital signal). Digital conversion measures voltage values at regular intervals and converts them into discontinuous values. This operation is called sampling (temporal discretization). Each voltage value at the time of the black dots in FIG. A quantization operation (value discretization) is performed to convert the voltage value of the black dot into a value in several steps, and converted into a digital signal. Since CD performs quantization with 16 bits, the sampled voltage value is divided into 65,536 (2 to the 16th power) stage, and the closest value among them is set to 37 digital signal. .

  The 19 audio signal processor generates an analog signal and a digital signal from which noises such as wind noise, motor rotation sound, bearing generation sound, rotating column rotation sound and interference sound are removed by a noise filter.

  The audio signal output to the equipment connected to the 28 external storage medium input / output device and 29 external output socket of FIG. 14 is composed of an analog signal, a digital signal, and sound collection data of a sound sound source, and these are output to the storage medium and externally. Recorded and saved, edited by all-directional multi-channel sound production based on all-orientation multi-channel sound based on a mixing system that uses these data as the main bus, and reproduced and viewed with speakers, headphones, and earphones.

  The omnidirectional multi-channel sound apparatus of the present invention is a four-dimensional azimuth point group sound data 26.2 multi-channel sound system, and an existing 2-channel stereo system, 5.12 channel is obtained by 26.2 multi-channel audio signals. It has backward compatibility to stereo system and 22.2 multi-channel sound system.

  The omnidirectional 26.2 multi-channel acoustic microphone using a 40-microphone microphone holding material incorporates a 01 microphone 26 channel and a 02 low-frequency microphone 2 channel into a 03 microphone holding material incorporated in the spherical microphone. It consists of a front view and a plan view of FIG.

40 Spherical microphone holding material holds 26.2 multi-channel acoustic microphone fixedly, and prevents the wind noise and other noises by the spherical shape that arranges the tip of the microphone sound pickup section so that there is no step with the surface of the spherical microphone holding material. , 26.2 Multi-channel acoustic microphones can be realized that have a microphone holding member combined with a multi-channel acoustic microphone.

  By using a hollow spherical microphone holding material, it becomes a compact and light all-directional omnidirectional multi-channel sound device. By making it easy to carry, it is possible to carry it in conjunction with a smartphone or video camera, and accurately synchronize shooting and sound collection. Can be done.

  11 rotation struts are vertically penetrated in the central part of the spherical microphone holding material, and rotating struts longer than the height of the spherical microphone holding material are used in both the upper and lower sides, and this longer part is rotated by a bearing connected to 10 fixed struts. Ensure that the column rotates smoothly.

  The audio signal picked up from the 01 microphone is transmitted to the 20 acoustic signal / power transmission cable while the 13 rotation connector brush connected to the fixed column is in contact with the 12 rotation connector ring connected to the rotation column.

  The rotation support is provided with a 15 rotation support opening so as not to interfere with sound collection in the top channel top orientation and the bottom channel bottom orientation.

  All-sky omnidirectional multi-channel acoustic microphone unit is joined to 10 fixed struts connected on the head case and used in a fixed state without using a motor or motor controller. The microphone is composed of a front view of a fixed-type microphone unit in FIG. 19 in which a 01 microphone 26 channel and a 02 bass effect microphone 2 channel are incorporated in a 03 microphone holding material.

  23 A fixed support is joined to the head case, and an all-sky isometric multi-channel acoustic microphone unit is joined to the top of the fixed support. 04 sound collection data / power cable, 16 power controller, 19 audio signal processor, 30 connection It has a structure with an adapter.

  The fixed-type microphone unit uses 30 connection adapters and external accessories, and is connected externally to smartphones and video camera devices. As a result, the front can be synchronized, and the shooting direction and the sound collection direction can be used in synchronization.The direction that the photographer and the wearer aim at these devices is always the front, and a fixed azimuth angle is set with respect to the front microphone. It is possible to acquire sound collection of four-dimensional azimuth point acoustic data for each sound collection azimuth angle of each microphone and sound collection data information synchronized with the sound collection at this time.

The fixed-type microphone unit can be used by connecting it externally to smartphones and video camera devices, so that it can pick up sound of the four-dimensional azimuth point acoustic data at the upper and lower positions from the shooting position and portable position. Audio-visual space environment that can acquire sound collection data information synchronized with sound collection, reconstructs a multi-channel sound environment with the sound source direction as the front even if the sound source moves, and can follow the movement of the viewer's head I will provide a.

  When the omnidirectional multi-channel acoustic microphone is constructed as a 60 ° acoustic channel, an 18.2ch multi-unit with a 60 ° azimuth microphone unit that incorporates a 01 microphone 18 channel and a 02 bass effect microphone 2 channel into a 03 microphone holding material. The channel sound device is configured by a plan view of FIG. 20, a bottom view of FIG. 21, a front view of FIG. 22, and a rear view of FIG.

  FIG. 24 shows a 60 ° acoustic channel upper layer arrangement which is an upper (ceiling surface) position located at the listening height of the listener of the 18.2ch acoustic channel, Tn 60 ° acoustic (channel upper layer 0 ° orientation), T60 60 °. Acoustic (channel upper layer 60 ° orientation), T120 60 ° acoustic (channel upper layer 120 ° orientation), Ts 60 ° acoustic (channel upper layer 180 ° orientation), T240 60 ° acoustic (channel upper layer 240 ° orientation), T300 60 ° acoustic ( 6 microphones in the channel upper layer (300 ° orientation) and 1 microphone in the top (channel upper layer top orientation) are arranged vertically above the center.

  FIG. 25 shows a 60 ° acoustic channel middle layer arrangement which is a middle position located at the listening height of the listener of the 18.2ch acoustic channel, Mn 60 ° acoustic (channel middle layer 0 ° orientation), M60 60 ° acoustic (channel Mid layer 60 ° orientation), M120 60 ° acoustic (channel middle layer 120 ° orientation), Ms 60 ° acoustic (channel middle layer 180 ° orientation), M240 60 ° acoustic (channel middle layer 180 ° orientation), M300 60 ° acoustic (channel middle layer 240) (6 degrees)) is arranged.

FIG. 26 shows a 60 ° sound channel lower layer arrangement, which is a lower position located at the listening height of the listener of the 18.2ch sound channel, Bn 60 ° sound (channel lower layer 0 ° orientation), B60 60 ° sound (channel lower layer). 60 ° acoustic), B120 60 ° acoustic (channel lower layer 120 ° orientation), Bs 60 ° acoustic (channel lower layer 80 ° orientation), B240 60 ° acoustic (channel lower layer 240 ° orientation), B300 60 ° acoustic (channel lower layer 300 °) 6 microphones in the direction), 1 microphone in the bottom vertical direction of the bottom (channel lower layer bottom direction), LEF1 (middle layer bass effect microphone 1) in the 240 ° direction, and LEF2 (middle layer bass effect microphone 2) in the 120 ° direction. It becomes the structure which arranges 2 microphones.

  A microphone is arranged at a hexagonal apex with an equal azimuth of 60 ° between the microphones, and there is no microphone with azimuth angles of 90 ° to the left and 270 ° to the right.

  The 6 output channels are 0 ° when the head is 0 °, the center channel is 0 °, the left channel is 300 °, the right channel is 60 °, the left surround channel is 240 °, the right surround channel is 120 °, and the center surround channel is 180 °. When the head orientation is 60 °, 60 ° is the center channel, and each channel moves in the clockwise direction by 60 °. When the other 120 °, 180 °, 240 °, and 300 ° face each other in the head direction, all channels move in the same manner. For example, if the head orientation is between 0 ° and 60 °, and the angle is close to 60 °, a sound source of 60 ° is used as the center channel. As a result, even when stereo headphones are attached, the motion of the video / still image screen and the position and movement of the sound are always synchronized with the direction of the viewer's head and body, without shifting, and further converted to stereo 3D sound. In combination with audio, the viewer can provide a function that allows the viewer to enjoy simulated 3D video viewing and 3D trial experience at the same time.

  The omnidirectional 18.2 multi-channel acoustic microphone enables 3D video viewing and 3D audition experience with fewer channels and simpler means than the omnidirectional 26.2 multi-channel acoustic microphone. Become.

  Four-dimensional azimuth points picked up by microphones at each azimuth angle in order to realize a three-dimensional sound system based on three-dimensional sound reproduction from all directions surrounding the viewing position of headphones, PCs and smartphones Use an analog signal or digital signal in the group sound data and an audio signal composed of the collected sound data information, adapt it to the intended use, purpose, and environment of the audio signal. Audio signals by sound direction angle are selected, and the audio signals are reproduced by a driver unit arranged at each position on the left side and right side of the headphones, PC, and smartphone.

  As a representative example of audio signal playback by headphones, PCs, and smartphones, when using headphones as an example, an all-directional omnidirectional multi-channel acoustic microphone unit is connected to each azimuth angle with a microphone at an arbitrary rotational speed and an arbitrary sound collection azimuth angle. Collecting sound data of four-dimensional azimuth point cloud and acquiring sound collection data information synchronized with the sound collection at this time, reproducing the audio signal composed of an analog signal and a digital signal and reproducing it with headphones for viewing The arrangement of the driver unit that converts the audio signal into sound is configured by the left side arrangement diagram of the headphone driver unit in FIG. 27 and the right side arrangement diagram of the headphone driver unit in FIG. Audio signal reproduction by a PC or smartphone has the same configuration.

  FIG. 27 is an arrangement diagram of an example of the left side arrangement of the headphone driver unit of the all-orientation multi-channel acoustic microphone unit according to the listener's listening height in the case of the 26.2 ch audio channel. Northwest direction of upper layer), Tsw (southwest direction of channel upper layer), Bwn (northwest direction of channel lower layer), Bsw (southwest direction of channel lower layer), Mw (west direction of channel middle layer) and LEF1 (middle layer bass effect) in lower layer configuration The microphone 1) is arranged.

  FIG. 28 is an arrangement diagram of an example of the right side arrangement of the headphone driver unit of the all-azimuth multi-channel acoustic microphone unit according to the listener's listening height in the case of the 26.2 ch audio channel. Upper layer northeast direction), Tes (channel upper layer southeast direction), lower layer arrangement Bne (channel lower layer northeast direction), Bes (channel lower layer southeast direction), middle layer arrangement Me (channel middle layer east direction) and LEF2 (middle layer bass effect) The microphone 2) is arranged.

  The headphone for reproducing and viewing the audio signal of omnidirectional multi-channel sound is joined to the headphone driver unit of FIG. 29 in the 46 housing, and 47 ear pads for attaching the headphone to the viewer's head are attached. Become.

  The arrangement of the headphone driver units shown in FIGS. 27 and 28 on the left and right sides of the headphones can realize a 3D sound system having a three-dimensional effect, a sense of presence, and a phase feeling in which sound comes from all directions surrounding the viewing position.

  The headphone driver unit shown in FIGS. 27 and 28 on the left and right of the headphones reproduces an audio signal composed of an analog signal or a digital signal.

  The headphone driver unit is a combination of a 41 baffle, which is the base for fixing the headphone unit, and a combination of 44 voice coils and 42 diaphragms (diaphragm), 43 magnets (permanent magnets), and wound around the diaphragm. The sound is produced by vibrating the diaphragm using magnetic flux attraction and repulsion created by flowing an audio signal consisting of an electrical signal through a permanent magnet placed opposite to the voice coil The sound system by the three-dimensional sound from all directions surrounding

  The omnidirectional multi-channel audio device according to the present invention provides a video and audio space that can match the movement of the viewer's head by matching the image and the sound image at an arbitrary four-dimensional image position of the ultra-high definition video. In addition, by realizing an acoustic system that allows sound to come from all directions surrounding the viewing position, it is possible to reproduce high-quality, high-quality sound that is compatible with 8K Super Hi-Vision ultra-high-performance and high-definition television, Live transmission is also possible, and playback that can follow the movement of the head that can support 360 ° stereoscopic video of smart phones, VR, AR, MR equipment is also possible, 26.2 ch, 22.2 ch, 5.1 ch, 2 ch sound This is useful as an upmix preprocessor process that can generate a material and vice versa.

01 Microphone 02 Microphone for low-frequency effect 03 Microphone holding material 04 Sound collection data / power cable 05 Horizontal azimuth 06 Vertical azimuth 07 Rotary strut circumference 08 60 ° Vertical azimuth 09 60 ° Lateral azimuth 10 Fixed strut 11 Rotating strut DESCRIPTION OF SYMBOLS 12 Rotation connection connector ring 13 Rotation connection connector brush 14 Bearing 15 Rotation support | pillar opening part 16 Power supply controller 17 Motor 18 Motor controller 19 Audio signal processor 20 Acoustic signal and power transmission cable 21 Sound pickup device base 22 Head case flange 23 Head Case 24 Pop filter 25 Power switch 26 Rotation speed setting switch 27 Sound pickup azimuth angle setting switch 28 External storage medium input / output device 29 External output socket 30 Adapter 31 for connection Microphone rotation center axis 32 Microphone rotation direction 33 Microphone rotation speed 34 Microphone sound collection azimuth angle 35 Analog signal 36 Sampling interval 37 Digital signal 38 Audio sound signal digitization processing process 39 Noise acoustic shielding plate 40 Spherical microphone holding material 41 Baffle 42 Diaphragm (Diaphragm)
43 Magnet (permanent magnet)
44 Voice coil 45 Frame 46 Housing 47 Ear pad 48 Rotation angle / rotation speed rotation detector (encoder)
49 Battery external power supply unit 50 External power supply cable 51 Wireless communication device and short-range wireless communication device Tn Channel upper layer north direction Tne Channel upper layer northeast direction Te Channel upper layer east direction Tes Channel upper layer southeast direction Ts Channel upper layer south direction Tsw Channel upper layer southwest direction Tw Channel upper layer west Twn Channel upper layer north west Top Top channel upper layer top azimuth M channel middle layer north azimuth Mne Channel middle layer north east azimu Channel mid-rise northwest LEF1 Mid-range bass effect microphone 1
LEF2 Microphone for mid-range bass effect 2
Bn Channel lower layer north direction Bne Channel lower layer northeast direction Be Channel lower layer east direction Bes Channel lower layer southeast direction Bs Channel lower layer south direction Bsw Channel lower layer south direction Bw Channel lower layer west direction Bwn Channel lower layer north direction Bot Channel lower layer bottom direction T60 60 ° Acoustic channel Upper layer 60 ° T120 60 ° acoustic channel upper layer 120 ° T240 60 ° acoustic channel upper layer 240 ° T300 60 ° acoustic channel upper layer 300 ° M60 60 ° acoustic channel middle layer 60 ° M120 60 ° acoustic channel middle layer 120 ° M240 60 ° acoustic channel middle layer 240゜ M300 60 ° Acoustic channel middle layer 300 ° B60 60 ° Acoustic channel lower layer 60 ° B120 60 ° Acoustic channel lower layer 120 ° B240 60 ° Hibiki channel lower layer 240 ° B300 60 ° acoustic channel lower layer 300 °

Claims (5)

  The omnidirectional multi-channel acoustic microphone unit is rotated by a motor at an arbitrary rotational speed, and four-dimensional azimuth point acoustic data for each azimuth angle is collected by the microphone at an arbitrary sound collection azimuth angle. Sound acquisition data information that is synchronized with the image, and by using these, the image and the sound image at an arbitrary 4D image position of the ultra-high definition image are matched to provide an audiovisual space that can follow the movement of the viewer's head , Realize the sound system that sounds come from all directions surrounding the viewing position, power controller to control the power supplied to the microphone unit, motor controller to set the rotation speed of the motor that rotates the microphone unit and control the rotation, Set the sound collection azimuth angle to collect the 4D azimuth point sound data, and analog signal of the collected sound data A digital signal obtained by converting the analog signal into a digital signal, an audio signal analog signal to which sound collection data information is added, a digital signal, and audio signal data are recorded and stored, and an audio signal processor that outputs these data to the outside. The omnidirectional multi-channel sound device that composes.   The rotating strut is passed through the center of the spherical microphone holding material, the upper and lower parts of the rotating strut are supported by the bearing of the fixed strut, and the tip of the microphone sound pickup section of the omnidirectional multichannel acoustic microphone unit is connected to the surface of the spherical microphone holding material. Arranged so as not to create a step, prevent wind noise and other noises, rotate the rotating strut and hollow spherical microphone holding material with a motor at an arbitrary rotation speed, and at any sound collection azimuth angle, 4 per azimuth angle with a microphone The omnidirectional multi-channel acoustic apparatus according to claim 1, wherein the omnidirectional multi-channel acoustic device is configured to collect the dimensional azimuth point group acoustic data and acquire the collected data information synchronized with the collected sound at this time.   A structure that does not use a motor or motor controller by joining a omnidirectional multi-channel acoustic microphone unit to a fixed support joined on the head case, and is connected externally to smartphones and video camera equipment, synchronizing the front and shooting direction The direction in which the photographer and the wearer point these devices is always in front, and the fixed sound collection angle of each microphone is a four-dimensional azimuth point group sound for each azimuth angle. 2. The omnidirectional multi-channel acoustic device according to claim 1, wherein data is collected and sound collection data information synchronized with the sound collection at this time is acquired.   A microphone is placed at the hexagonal apex where the horizontal and vertical microphones of the omnidirectional multi-channel acoustic microphone unit are set to 60 ° in the horizontal and vertical directions. The omnidirectional multi-channel acoustic microphone unit is rotated by a motor at an arbitrary rotational speed, and four-dimensional azimuth point acoustic data for each azimuth angle is collected by the microphone at an arbitrary sound collection azimuth angle. The omnidirectional multi-channel acoustic apparatus according to claim 1, which acquires sound collection data information synchronized with the omnidirectional sound.   Four-dimensional azimuth points collected by omnidirectional multi-channel acoustic microphone unit microphones to achieve a stereophonic sound system by reproducing stereophonic sound from all directions surrounding the viewing position of headphones, PCs, and smartphones Uses audio signals consisting of analog signals or digital signals in the sound data and collected sound data information for the purpose of stereo sound reproduction adapted to the intended use, purpose and environment of the audio signal. The audio signal is selected according to the direction of sound collection direction according to the sound, etc., and the audio signal is changed to the movement of the diaphragm (diaphragm) by the driver unit arranged at each position on the left side and right side of the headphones, PC, smartphone. The all-sky isotropic method according to claim 1, wherein three-dimensional sound is reproduced by Multi-channel sound system.

Images