A kind of acoustics and picture signal hybrid terminal
Technical field
The invention belongs to sound source analysis technical fields, more particularly, to a kind of acoustics and picture signal hybrid terminal.
Background technique
In recent years, the network technology is more and more flourishing, and the network technology is applied mutual in business negotiation, public place monitoring, network
The multiple fields such as moving platform.Currently, in the same space, passing through acoustic sensor in sound and image synthesis acquisition technique
Voice signal in array acquisition space, when sound source apart from acoustic sensor array farther out when, to sound source acquisition voice signal
Clarity is low, directly affects acquisition and analysis of the later period to effective sound, cannot be with when sound source surrounding environment change is larger
The variation of environment and be adjusted, lead to not accurately obtain clear errorless effective voice signal.In addition, existing acoustics passes
Sensor array is sent the signal to respectively in different sensors by different clock sources, and the synchronism of signal acquisition is caused
Difference, to influence the precision of acoustic sensor array acquisition.
Summary of the invention
The object of the present invention is to provide a kind of structures, and simple, acoustic sensor signal synchronism is high, efficiently fixed to sound source
The acoustics and picture signal hybrid terminal of position.
Technical scheme is as follows:
A kind of acoustics and picture signal hybrid terminal, comprising:
Acoustic sensor array, the voice signal for inductive pick-up sound source;
Digital sound signal processing module is handled for receiving the voice signal and is converted to digital signal;
Image sensor array, positioned at the center of the acoustic sensor array, for shooting the optical picture of the sound source
Picture;
Main control unit, for receiving the digital signal and optical imagery, and according to the digital signal and optical imagery
Processing obtains acoustic data frame and image data frame;
The acoustic sensor array is equipped with 8 branches, and 8 acoustic sensor lists are equipped on each branch road
Member, and 8 acoustic sensor units include 4 main channel sensors and 4 accessory channel sensors, each main channel
The accessory channel sensor electrical connection of sensor corresponding thereto, the acoustic sensor unit uniformly divide on curved surface or plane
Cloth;
Wherein, include: in the main control unit
Crystal oscillator, for issuing bit clock signal and byte clock signal;
Bit clock phaselocked loop, for the bit clock signal to be sent in bit clock allocation unit;
Byte phaselocked loop, for the byte clock signal to be sent in byte clock allocation unit;
Bit clock allocation unit, for receiving the bit clock signal and distributing the position of output corresponding with converter
Clock signal;
Byte clock allocation unit, for receiving the bit clock signal and distributing output corresponding with converter
Byte clock signal;
Converter, for receiving the bit clock signal of the output and byte clock signal and converting two output signals
Output is into the main channel sensor.
In the above-mentioned technical solutions, the acoustics and picture signal hybrid terminal further include for supplying the main control unit
The power supply unit of electricity.
In the above-mentioned technical solutions, said supply unit includes:
Voltage transformation module, for converting alternating current to direct current and supplying electricity to the main control unit;
Standby power supply module, for supplying electricity to the main control unit under power blackout situation;
Control switch, for controlling the opening and closing of the main control unit.
In the above-mentioned technical solutions, one converter of each corresponding electrical connection of the main channel sensor, and it is described
The quantity of converter is 32.
It in the above-mentioned technical solutions, include 8 bit clock distributors, institute's bit clock point in institute's bit clock allocation unit
Orchestration uses one point of four clock distributor.
It in the above-mentioned technical solutions, include 8 byte clock distributors, the byte in the byte clock allocation unit
Clock distributor uses one point of four clock distributor.
In the above-mentioned technical solutions, the main control unit uses fpga chip.
In the above-mentioned technical solutions, described image sensor array uses face formation visible light image sensor.
In the above-mentioned technical solutions, the acoustic sensor unit on curved surface or plane helically gradually divide by open form circle battle array
Cloth.
The advantages and positive effects of the present invention are:
1. main control unit issues clock source signals, by acoustic sensor list of the multi-layer classification on acoustic sensor array
Clock signal of the member transmitting from same clock source, is effectively ensured the clock signal synchronization of acoustic sensor unit, reduces clock
The synchronous error of signal improves the reliability of the data sampling of acoustic sensor.
2. main control unit carries out using time division multiplexing and space division multiplexing technology when acoustic data framing, to main channel sensor
It is handled with the signal of accessory channel sensor output, interception valid data carry out framing, improve the globality of data, guarantee
The uniformity of data transmission.
3. standby power supply module can continue to when power-off or other fortuitous events occur as acoustics and picture signal
Hybrid terminal continues to power, and acoustics is supported to work on picture signal hybrid terminal.
Detailed description of the invention
Fig. 1 is the structural schematic diagram of acoustics and picture signal hybrid terminal of the invention;
Fig. 2 is the clock synchronous network network schematic diagram of acoustic sensor array in the present invention;
Fig. 3 is the structural schematic diagram of power supply unit in the present invention.
Specific embodiment
Below in conjunction with specific embodiment, invention is further described in detail.It should be appreciated that described herein specific
Embodiment is used only for explaining the present invention, is not intended to limit the present invention, is never limited in protection scope of the present invention.
Embodiment 1
As shown, acoustics of the invention and picture signal hybrid terminal, comprising:
Acoustic sensor array, the voice signal for inductive pick-up sound source;
Digital sound signal processing module is handled for receiving voice signal and is converted to digital signal;
Image sensor array, positioned at the center of acoustic sensor array, for shooting the optical imagery of sound source;
Main control unit is obtained for receiving digital signal and optical imagery, and according to digital signal and optical image security
Acoustic data frame and image data frame;
Acoustic sensor array be equipped with 8 branches, and on each road be equipped with 8 acoustic sensor units, and this 8
A acoustic sensor unit includes 4 main channel sensors and 4 accessory channel sensors, each main channel sensor and its phase
Corresponding accessory channel sensor electrical connection, the helically gradually open form circle battle array distribution on curved surface or plane of acoustic sensor unit;
Wherein, include: in main control unit (fpga chip)
Crystal oscillator, for issuing bit clock signal and byte clock signal;
Bit clock phaselocked loop, for bit clock signal to be sent in bit clock allocation unit;
Byte phaselocked loop, for byte clock signal to be sent in byte clock allocation unit;
Bit clock allocation unit, for receiving bit clock signal and distributing the bit clock of output corresponding with converter
Signal;
Byte clock allocation unit, for receiving bit clock signal and distributing the byte of output corresponding with converter
Clock signal;
Converter, for receiving the bit clock signal exported and byte clock signal and exporting two output signals conversions
Into main channel sensor.
It further says, each main channel sensor one converter of corresponding electrical connection, and the quantity of converter is 32,
It include 8 bit clock distributors in bit clock allocation unit, bit clock distributor uses one point of four clock distributor, byte clock
It include 8 byte clock distributors in allocation unit, byte clock distributor uses one point of four clock distributor.
It further says, acoustics and the power supply unit that picture signal hybrid terminal further includes for powering to main control unit.
It further says, as shown in Fig. 2, when main control unit sends the position based on same clock source to acoustic sensor array
Clock signal and byte clock signal, and pass through 8 bit clocks distribution in bit clock allocation unit and byte clock unit respectively
When device (one point of four clock distributor) and 8 byte clock distributors (one point of four clock distributor) are by bit clock signal and byte
Clock signal is distributed into the bit clock signal of 32 outputs and the byte clock signals of 32 output, above-mentioned total 64 output when
Clock signal is corresponding to enter 32 converters, and converter uses two point one of converter, and 2 tunnel input signals are synthesized 1 road signal, and 64
A input signal is converted into 32 tunnel output signals after entering converter and is sent to main channel corresponding with each converter and passes
In sensor, after 32 main channel sensors on acoustic sensor array receive 32 tunnel output signals, by 32 tunnel clock outputs
Signal distributes to the 32 accessory channel sensors corresponded to, thus completes the letter of 64 sensors on acoustic sensor array
Number synchronization, the signal for having reached all acoustic sensors on acoustic sensor array by the signal that the same clock source issues are same
Step, after the completion of clock signal excitation, triggering acoustic sensor array perception sound source and the voice signal for acquiring sound source.
It further says, the sample frequency of acoustic data is 48kHz, and main channel sensor passes through with accessory channel sensor
The same line is transmitted in main control unit with 20 for one group, and main channel sensor and the transmission of accessory channel sensor are past
Data are ad eundems;The collected data of acoustic sensor are being motivated respectively with main channel sensor and accessory channel sensor
The high level and low level stage output data of clock, and the output signal is synchronous with excitation clock, and right by 32
The digital sound signal processing module that should be arranged converts digital signal for output signal and is sent in main control unit.Using the time-division
Multiplexing intercepts the position 0-15 in 20 data when sound source is most weak with space division multiplexing technology, and 20 data are intercepted when sound source is slightly strong
In the position 1-16, and so on, according to the actual conditions of sound source, can all be intercepted to obtain 16 significant figures per output signal all the way
According to i.e. 2Byte, 64 tunnel output signals, which just intercept, obtains the data of 128Byte;These data can be saved in the form of complement code to slow
It rushes in domain and carries out the conversion of clock domain, and carry out data framing as unit of the valid data that 8 samplings obtain, obtain
1024Byte data are one group of carry out acoustic data framing, frame head are added before the acoustic data framing later, to obtain one
A complete acoustic data frame.
After the optical imagery for receiving processed digital signal and image sensor array acquisition, acoustics passes main control unit
The 64 road signals that sensor array is sent, which can intercept, obtains 128Byte data, these data can be saved in the form of complement code to slow
Rush in domain and carry out the conversion of clock domain, and to carry out data framing as unit of sampling obtained valid data 8 times, i.e., with
1024Byte data are one group of carry out framing, and main control unit carries out acoustic data group using time and space two dimension framing mode
Frame;The optical image data that image sensor array is sent to is sent to main control unit as unit of 1024Byte, without carrying out
Combined treatment can be obtained image data frame.
When using acoustics and picture signal hybrid terminal, specifically includes the following steps:
(1) start acoustics and picture signal hybrid terminal, the crystal oscillator in main control unit is simultaneously emitted by bit clock letter
Number and byte clock signal, bit clock phaselocked loop and byte clock phaselocked loop bit clock signal and byte clock signal are sent out respectively
It send into bit clock allocation unit and byte clock allocation unit;
(2) bit clock allocation unit and byte clock allocation unit pass through bit clock distributor respectively and byte clock distributes
Bit clock signal and byte clock signal are distributed the bit clock signal of 32 outputs and the byte clock letter of 32 output by device
Number, and the byte clock signal of bit clock signal and 32 outputs that 32 export is sent to 32 conversions corresponding thereto
In device;
(3) 32 converters are converted into 32 output signals after receiving total 64 output signals, and will
32 output signals are sent in 32 main channel sensors corresponding thereto, are passed signal by each main channel sensor
It send into corresponding accessory channel sensor, to complete the bit clock signal and byte clock signal of acoustic sensor unit
It is synchronous;
(4) acoustic sensor array after clock signal excitation is started to work, and acquires the voice signal of sound source, sound is believed
It number is sent in digital sound signal processing module, processing is carried out to the voice signal and is converted to digital signal, intercepts acoustics sensor
20 acoustic datas in device unit in collected voice signal;
(5) by treated, digital signal is sent to main control unit to digital acoustics signal processing module, and main control unit uses
Time division multiplexing and space division multiplexing technology, intercept 20 data in acoustic sensor unit in collected voice signal, in sound
The position 0-15 in 20 data is intercepted when source is most weak, and the position 1-16 in 20 data is intercepted when sound source is slightly strong, and so on, according to
The actual conditions of sound source, acoustic sensor unit can all be intercepted to obtain 16 valid data per output signal all the way;
(6) optical imagery locating for the camera shooting sound source in image sensor array, is sent to master for optical imagery
Control unit;
(7) main control unit receives digital signal and optical imagery, and according to digital signal and optical image security at acoustics
Data frame and image data frame.
Main control unit is that the same clock source issues clock signal, motivates all acoustics sensors on acoustic sensor array
Device carries out clock signal synchronization, does not need multiple clock sources and issues signal to motivate the different acoustics on acoustic sensor array to pass
Sensor reduces the nonsynchronous phenomenon of signal, it is contemplated that the spatial characteristics of sonic transmissions channel, in order to guarantee subsequent wave beam shape
At the convergence that scheduling algorithm is handled, excitation clock synchronous error is 100 times lower than sample frequency, under 48kHz sample frequency, swashs
Clock synchronous error is encouraged lower than 200ns, ensure that the high synchronism and high reliability of sound source data sampling.
Embodiment 2
On the basis of embodiment 1, image sensor array is placed on the center of acoustic sensor array, it is seen that light image
The pixel of sensor reaches 500W, realizes that auto-focusing, auto-exposure control and automatic white balance, image sensor array can connect
The excitation clock of main control unit sending is received, main control unit can be image sensor array configuration work mode, in excitation clock
Under the action of, image sensor array starts Image Acquisition, and sample frequency is set as 30 frames/second, refreshes figure under the frequency
As display can eliminate scintillation effect.
To match with acoustic data, the image data frame length and acoustic data frame phase of imaging sensor acquisition are adjusted
Together, as every row length is 1024Byte, and the data uniformity for transmitting it externally is high.
Embodiment 3
As shown in figure 3, power supply unit includes voltage transformation module, for converting alternating current to direct current and supplying electricity to lead
Control unit;
Standby power supply module, for supplying electricity to main control unit under power blackout situation;
Control switch, for controlling the opening and closing of main control unit.
It wherein, include rechargeable lithium battary in standby power supply module.
In the case where acoustics and picture signal hybrid terminal encounter power-off or fortuitous event, by standby power supply module to master control list
Member power supply, will not be interrupted or stop the normal use of acoustics Yu picture signal hybrid terminal.
One embodiment of the present invention has been described in detail above, but the content is only preferable implementation of the invention
Example, should not be considered as limiting the scope of the invention.It is all according to equivalent variations made by the present patent application range and improve
Deng should still be within the scope of the patent of the present invention.