CN209132419U - A kind of acoustics and picture signal hybrid terminal - Google Patents

A kind of acoustics and picture signal hybrid terminal Download PDF

Info

Publication number
CN209132419U
CN209132419U CN201821844488.6U CN201821844488U CN209132419U CN 209132419 U CN209132419 U CN 209132419U CN 201821844488 U CN201821844488 U CN 201821844488U CN 209132419 U CN209132419 U CN 209132419U
Authority
CN
China
Prior art keywords
signal
acoustic sensor
clock
acoustics
hybrid terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201821844488.6U
Other languages
Chinese (zh)
Inventor
陈劲
刘荣
闫磊
佟颖
李凯凯
段发阶
关升
蒋佳佳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tianjin Xinmeng Microelectronics Technology Co ltd
Original Assignee
Tianjin Normal University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tianjin Normal University filed Critical Tianjin Normal University
Priority to CN201821844488.6U priority Critical patent/CN209132419U/en
Application granted granted Critical
Publication of CN209132419U publication Critical patent/CN209132419U/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Studio Devices (AREA)

Abstract

The utility model discloses acoustics and picture signal hybrid terminal, including acoustic sensor array, digital sound signal processing module, imaging sensor, positioned at the center of acoustic sensor array, and main control unit, acoustic sensor array is equipped with 8 branches, and 8 acoustic sensor units are equipped on each road, and 8 acoustic sensor units include 4 main channel sensors and 4 accessory channel sensors, the accessory channel sensor electrical connection of each main channel sensor corresponding thereto, acoustic sensor unit are uniformly distributed on curved surface or plane;Main control unit issues clock source signals, the clock signal from same clock source is transmitted by acoustic sensor unit of the multi-layer classification on acoustic sensor array, the clock signal synchronization of acoustic sensor unit is effectively ensured, the synchronous error for reducing clock signal, improves the reliability of the data sampling of acoustic sensor.

Description

A kind of acoustics and picture signal hybrid terminal
Technical field
The invention belongs to sound source analysis technical fields, more particularly, to a kind of acoustics and picture signal hybrid terminal.
Background technique
In recent years, the network technology is more and more flourishing, and the network technology is applied mutual in business negotiation, public place monitoring, network The multiple fields such as moving platform.Currently, in the same space, passing through acoustic sensor in sound and image synthesis acquisition technique Voice signal in array acquisition space, when sound source apart from acoustic sensor array farther out when, to sound source acquisition voice signal Clarity is low, directly affects acquisition and analysis of the later period to effective sound, cannot be with when sound source surrounding environment change is larger The variation of environment and be adjusted, lead to not accurately obtain clear errorless effective voice signal.In addition, existing acoustics passes Sensor array is sent the signal to respectively in different sensors by different clock sources, and the synchronism of signal acquisition is caused Difference, to influence the precision of acoustic sensor array acquisition.
Summary of the invention
The object of the present invention is to provide a kind of structures, and simple, acoustic sensor signal synchronism is high, efficiently fixed to sound source The acoustics and picture signal hybrid terminal of position.
Technical scheme is as follows:
A kind of acoustics and picture signal hybrid terminal, comprising:
Acoustic sensor array, the voice signal for inductive pick-up sound source;
Digital sound signal processing module is handled for receiving the voice signal and is converted to digital signal;
Image sensor array, positioned at the center of the acoustic sensor array, for shooting the optical picture of the sound source Picture;
Main control unit, for receiving the digital signal and optical imagery, and according to the digital signal and optical imagery Processing obtains acoustic data frame and image data frame;
The acoustic sensor array is equipped with 8 branches, and 8 acoustic sensor lists are equipped on each branch road Member, and 8 acoustic sensor units include 4 main channel sensors and 4 accessory channel sensors, each main channel The accessory channel sensor electrical connection of sensor corresponding thereto, the acoustic sensor unit uniformly divide on curved surface or plane Cloth;
Wherein, include: in the main control unit
Crystal oscillator, for issuing bit clock signal and byte clock signal;
Bit clock phaselocked loop, for the bit clock signal to be sent in bit clock allocation unit;
Byte phaselocked loop, for the byte clock signal to be sent in byte clock allocation unit;
Bit clock allocation unit, for receiving the bit clock signal and distributing the position of output corresponding with converter Clock signal;
Byte clock allocation unit, for receiving the bit clock signal and distributing output corresponding with converter Byte clock signal;
Converter, for receiving the bit clock signal of the output and byte clock signal and converting two output signals Output is into the main channel sensor.
In the above-mentioned technical solutions, the acoustics and picture signal hybrid terminal further include for supplying the main control unit The power supply unit of electricity.
In the above-mentioned technical solutions, said supply unit includes:
Voltage transformation module, for converting alternating current to direct current and supplying electricity to the main control unit;
Standby power supply module, for supplying electricity to the main control unit under power blackout situation;
Control switch, for controlling the opening and closing of the main control unit.
In the above-mentioned technical solutions, one converter of each corresponding electrical connection of the main channel sensor, and it is described The quantity of converter is 32.
It in the above-mentioned technical solutions, include 8 bit clock distributors, institute's bit clock point in institute's bit clock allocation unit Orchestration uses one point of four clock distributor.
It in the above-mentioned technical solutions, include 8 byte clock distributors, the byte in the byte clock allocation unit Clock distributor uses one point of four clock distributor.
In the above-mentioned technical solutions, the main control unit uses fpga chip.
In the above-mentioned technical solutions, described image sensor array uses face formation visible light image sensor.
In the above-mentioned technical solutions, the acoustic sensor unit on curved surface or plane helically gradually divide by open form circle battle array Cloth.
The advantages and positive effects of the present invention are:
1. main control unit issues clock source signals, by acoustic sensor list of the multi-layer classification on acoustic sensor array Clock signal of the member transmitting from same clock source, is effectively ensured the clock signal synchronization of acoustic sensor unit, reduces clock The synchronous error of signal improves the reliability of the data sampling of acoustic sensor.
2. main control unit carries out using time division multiplexing and space division multiplexing technology when acoustic data framing, to main channel sensor It is handled with the signal of accessory channel sensor output, interception valid data carry out framing, improve the globality of data, guarantee The uniformity of data transmission.
3. standby power supply module can continue to when power-off or other fortuitous events occur as acoustics and picture signal Hybrid terminal continues to power, and acoustics is supported to work on picture signal hybrid terminal.
Detailed description of the invention
Fig. 1 is the structural schematic diagram of acoustics and picture signal hybrid terminal of the invention;
Fig. 2 is the clock synchronous network network schematic diagram of acoustic sensor array in the present invention;
Fig. 3 is the structural schematic diagram of power supply unit in the present invention.
Specific embodiment
Below in conjunction with specific embodiment, invention is further described in detail.It should be appreciated that described herein specific Embodiment is used only for explaining the present invention, is not intended to limit the present invention, is never limited in protection scope of the present invention.
Embodiment 1
As shown, acoustics of the invention and picture signal hybrid terminal, comprising:
Acoustic sensor array, the voice signal for inductive pick-up sound source;
Digital sound signal processing module is handled for receiving voice signal and is converted to digital signal;
Image sensor array, positioned at the center of acoustic sensor array, for shooting the optical imagery of sound source;
Main control unit is obtained for receiving digital signal and optical imagery, and according to digital signal and optical image security Acoustic data frame and image data frame;
Acoustic sensor array be equipped with 8 branches, and on each road be equipped with 8 acoustic sensor units, and this 8 A acoustic sensor unit includes 4 main channel sensors and 4 accessory channel sensors, each main channel sensor and its phase Corresponding accessory channel sensor electrical connection, the helically gradually open form circle battle array distribution on curved surface or plane of acoustic sensor unit;
Wherein, include: in main control unit (fpga chip)
Crystal oscillator, for issuing bit clock signal and byte clock signal;
Bit clock phaselocked loop, for bit clock signal to be sent in bit clock allocation unit;
Byte phaselocked loop, for byte clock signal to be sent in byte clock allocation unit;
Bit clock allocation unit, for receiving bit clock signal and distributing the bit clock of output corresponding with converter Signal;
Byte clock allocation unit, for receiving bit clock signal and distributing the byte of output corresponding with converter Clock signal;
Converter, for receiving the bit clock signal exported and byte clock signal and exporting two output signals conversions Into main channel sensor.
It further says, each main channel sensor one converter of corresponding electrical connection, and the quantity of converter is 32, It include 8 bit clock distributors in bit clock allocation unit, bit clock distributor uses one point of four clock distributor, byte clock It include 8 byte clock distributors in allocation unit, byte clock distributor uses one point of four clock distributor.
It further says, acoustics and the power supply unit that picture signal hybrid terminal further includes for powering to main control unit.
It further says, as shown in Fig. 2, when main control unit sends the position based on same clock source to acoustic sensor array Clock signal and byte clock signal, and pass through 8 bit clocks distribution in bit clock allocation unit and byte clock unit respectively When device (one point of four clock distributor) and 8 byte clock distributors (one point of four clock distributor) are by bit clock signal and byte Clock signal is distributed into the bit clock signal of 32 outputs and the byte clock signals of 32 output, above-mentioned total 64 output when Clock signal is corresponding to enter 32 converters, and converter uses two point one of converter, and 2 tunnel input signals are synthesized 1 road signal, and 64 A input signal is converted into 32 tunnel output signals after entering converter and is sent to main channel corresponding with each converter and passes In sensor, after 32 main channel sensors on acoustic sensor array receive 32 tunnel output signals, by 32 tunnel clock outputs Signal distributes to the 32 accessory channel sensors corresponded to, thus completes the letter of 64 sensors on acoustic sensor array Number synchronization, the signal for having reached all acoustic sensors on acoustic sensor array by the signal that the same clock source issues are same Step, after the completion of clock signal excitation, triggering acoustic sensor array perception sound source and the voice signal for acquiring sound source.
It further says, the sample frequency of acoustic data is 48kHz, and main channel sensor passes through with accessory channel sensor The same line is transmitted in main control unit with 20 for one group, and main channel sensor and the transmission of accessory channel sensor are past Data are ad eundems;The collected data of acoustic sensor are being motivated respectively with main channel sensor and accessory channel sensor The high level and low level stage output data of clock, and the output signal is synchronous with excitation clock, and right by 32 The digital sound signal processing module that should be arranged converts digital signal for output signal and is sent in main control unit.Using the time-division Multiplexing intercepts the position 0-15 in 20 data when sound source is most weak with space division multiplexing technology, and 20 data are intercepted when sound source is slightly strong In the position 1-16, and so on, according to the actual conditions of sound source, can all be intercepted to obtain 16 significant figures per output signal all the way According to i.e. 2Byte, 64 tunnel output signals, which just intercept, obtains the data of 128Byte;These data can be saved in the form of complement code to slow It rushes in domain and carries out the conversion of clock domain, and carry out data framing as unit of the valid data that 8 samplings obtain, obtain 1024Byte data are one group of carry out acoustic data framing, frame head are added before the acoustic data framing later, to obtain one A complete acoustic data frame.
After the optical imagery for receiving processed digital signal and image sensor array acquisition, acoustics passes main control unit The 64 road signals that sensor array is sent, which can intercept, obtains 128Byte data, these data can be saved in the form of complement code to slow Rush in domain and carry out the conversion of clock domain, and to carry out data framing as unit of sampling obtained valid data 8 times, i.e., with 1024Byte data are one group of carry out framing, and main control unit carries out acoustic data group using time and space two dimension framing mode Frame;The optical image data that image sensor array is sent to is sent to main control unit as unit of 1024Byte, without carrying out Combined treatment can be obtained image data frame.
When using acoustics and picture signal hybrid terminal, specifically includes the following steps:
(1) start acoustics and picture signal hybrid terminal, the crystal oscillator in main control unit is simultaneously emitted by bit clock letter Number and byte clock signal, bit clock phaselocked loop and byte clock phaselocked loop bit clock signal and byte clock signal are sent out respectively It send into bit clock allocation unit and byte clock allocation unit;
(2) bit clock allocation unit and byte clock allocation unit pass through bit clock distributor respectively and byte clock distributes Bit clock signal and byte clock signal are distributed the bit clock signal of 32 outputs and the byte clock letter of 32 output by device Number, and the byte clock signal of bit clock signal and 32 outputs that 32 export is sent to 32 conversions corresponding thereto In device;
(3) 32 converters are converted into 32 output signals after receiving total 64 output signals, and will 32 output signals are sent in 32 main channel sensors corresponding thereto, are passed signal by each main channel sensor It send into corresponding accessory channel sensor, to complete the bit clock signal and byte clock signal of acoustic sensor unit It is synchronous;
(4) acoustic sensor array after clock signal excitation is started to work, and acquires the voice signal of sound source, sound is believed It number is sent in digital sound signal processing module, processing is carried out to the voice signal and is converted to digital signal, intercepts acoustics sensor 20 acoustic datas in device unit in collected voice signal;
(5) by treated, digital signal is sent to main control unit to digital acoustics signal processing module, and main control unit uses Time division multiplexing and space division multiplexing technology, intercept 20 data in acoustic sensor unit in collected voice signal, in sound The position 0-15 in 20 data is intercepted when source is most weak, and the position 1-16 in 20 data is intercepted when sound source is slightly strong, and so on, according to The actual conditions of sound source, acoustic sensor unit can all be intercepted to obtain 16 valid data per output signal all the way;
(6) optical imagery locating for the camera shooting sound source in image sensor array, is sent to master for optical imagery Control unit;
(7) main control unit receives digital signal and optical imagery, and according to digital signal and optical image security at acoustics Data frame and image data frame.
Main control unit is that the same clock source issues clock signal, motivates all acoustics sensors on acoustic sensor array Device carries out clock signal synchronization, does not need multiple clock sources and issues signal to motivate the different acoustics on acoustic sensor array to pass Sensor reduces the nonsynchronous phenomenon of signal, it is contemplated that the spatial characteristics of sonic transmissions channel, in order to guarantee subsequent wave beam shape At the convergence that scheduling algorithm is handled, excitation clock synchronous error is 100 times lower than sample frequency, under 48kHz sample frequency, swashs Clock synchronous error is encouraged lower than 200ns, ensure that the high synchronism and high reliability of sound source data sampling.
Embodiment 2
On the basis of embodiment 1, image sensor array is placed on the center of acoustic sensor array, it is seen that light image The pixel of sensor reaches 500W, realizes that auto-focusing, auto-exposure control and automatic white balance, image sensor array can connect The excitation clock of main control unit sending is received, main control unit can be image sensor array configuration work mode, in excitation clock Under the action of, image sensor array starts Image Acquisition, and sample frequency is set as 30 frames/second, refreshes figure under the frequency As display can eliminate scintillation effect.
To match with acoustic data, the image data frame length and acoustic data frame phase of imaging sensor acquisition are adjusted Together, as every row length is 1024Byte, and the data uniformity for transmitting it externally is high.
Embodiment 3
As shown in figure 3, power supply unit includes voltage transformation module, for converting alternating current to direct current and supplying electricity to lead Control unit;
Standby power supply module, for supplying electricity to main control unit under power blackout situation;
Control switch, for controlling the opening and closing of main control unit.
It wherein, include rechargeable lithium battary in standby power supply module.
In the case where acoustics and picture signal hybrid terminal encounter power-off or fortuitous event, by standby power supply module to master control list Member power supply, will not be interrupted or stop the normal use of acoustics Yu picture signal hybrid terminal.
One embodiment of the present invention has been described in detail above, but the content is only preferable implementation of the invention Example, should not be considered as limiting the scope of the invention.It is all according to equivalent variations made by the present patent application range and improve Deng should still be within the scope of the patent of the present invention.

Claims (10)

1. a kind of acoustics and picture signal hybrid terminal characterized by comprising
Acoustic sensor array, the voice signal for inductive pick-up sound source;
Digital sound signal processing module is handled for receiving the voice signal and is converted to digital signal;
Image sensor array, positioned at the center of the acoustic sensor array, for shooting the optical imagery of the sound source;
Main control unit, for receiving the digital signal and optical imagery, and according to the digital signal and optical image security Obtain acoustic data frame and image data frame;
The acoustic sensor array is equipped with 8 branches, and 8 acoustic sensor units are equipped on each branch road, And 8 acoustic sensor units include 4 main channel sensors and 4 accessory channel sensors, each main channel passes The accessory channel sensor electrical connection of sensor corresponding thereto, the acoustic sensor unit uniformly divide on curved surface or plane Cloth;
Wherein, include: in the main control unit
Crystal oscillator, for issuing bit clock signal and byte clock signal;
Bit clock phaselocked loop, for the bit clock signal to be sent in bit clock allocation unit;
Byte phaselocked loop, for the byte clock signal to be sent in byte clock allocation unit;
Bit clock allocation unit, for receiving the bit clock signal and distributing the bit clock of output corresponding with converter Signal;
Byte clock allocation unit, for receiving the bit clock signal and distributing the byte of output corresponding with converter Clock signal;
Converter, for receiving the bit clock signal and byte clock signal and by the conversion output of two output signals of the output To in the main channel sensor.
2. acoustics according to claim 1 and picture signal hybrid terminal, it is characterised in that: the acoustics and picture signal Hybrid terminal further includes the power supply unit for powering to the main control unit.
3. acoustics according to claim 2 and picture signal hybrid terminal, it is characterised in that: said supply unit includes:
Voltage transformation module, for converting alternating current to direct current and supplying electricity to the main control unit;
Standby power supply module, for supplying electricity to the main control unit under power blackout situation;
Control switch, for controlling the opening and closing of the main control unit.
4. acoustics according to claim 3 and picture signal hybrid terminal, it is characterised in that: each main channel sensing Device one converter of corresponding electrical connection, and the quantity of the converter is 32.
5. acoustics according to claim 4 and picture signal hybrid terminal, it is characterised in that: institute's bit clock allocation unit In include 8 bit clock distributors, institute's bit clock distributor use one point of four clock distributor.
6. acoustics according to claim 4 and picture signal hybrid terminal, it is characterised in that: the byte clock distribution is single It include 8 byte clock distributors in member, the byte clock distributor uses one point of four clock distributor.
7. acoustics described in any one of -6 and picture signal hybrid terminal according to claim 1, it is characterised in that: the master It controls unit and uses fpga chip.
8. acoustics according to claim 7 and picture signal hybrid terminal, it is characterised in that: described image sensor array Using face formation visible light image sensor.
9. acoustics according to claim 8 and picture signal hybrid terminal, it is characterised in that: the acoustic sensor unit The helically gradually open form circle battle array distribution on curved surface or plane.
10. acoustics according to claim 9 and picture signal hybrid terminal, it is characterised in that: the acoustic sensor battle array Column use microphone array.
CN201821844488.6U 2018-11-09 2018-11-09 A kind of acoustics and picture signal hybrid terminal Active CN209132419U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201821844488.6U CN209132419U (en) 2018-11-09 2018-11-09 A kind of acoustics and picture signal hybrid terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201821844488.6U CN209132419U (en) 2018-11-09 2018-11-09 A kind of acoustics and picture signal hybrid terminal

Publications (1)

Publication Number Publication Date
CN209132419U true CN209132419U (en) 2019-07-19

Family

ID=67244561

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201821844488.6U Active CN209132419U (en) 2018-11-09 2018-11-09 A kind of acoustics and picture signal hybrid terminal

Country Status (1)

Country Link
CN (1) CN209132419U (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109683132A (en) * 2018-11-09 2019-04-26 天津师范大学 A kind of acoustics and picture signal hybrid terminal and its processing method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109683132A (en) * 2018-11-09 2019-04-26 天津师范大学 A kind of acoustics and picture signal hybrid terminal and its processing method
CN109683132B (en) * 2018-11-09 2024-06-28 天津芯盟微电子技术有限公司 Acoustic and image signal hybrid terminal and processing method thereof

Similar Documents

Publication Publication Date Title
CN109683132A (en) A kind of acoustics and picture signal hybrid terminal and its processing method
RU2012108664A (en) DATA COLLECTION CARD, ALSO THE SYSTEM AND METHOD OF EXPANSION MANAGEMENT FOR DATA COLLECTION
CN102652288B (en) System and method for synchronizing video and sensor signals
CN102006420B (en) Design method capable of using external synchronous cameral with various data output formats
CN106611600A (en) Audio processing device and system for far-field pickup and mobile charging
CN103812593B (en) High precision distribution type fiber-optic clock synchronization system
CN209132419U (en) A kind of acoustics and picture signal hybrid terminal
JP2015520590A (en) Data transmission method, apparatus, and system
CN101237533B (en) Imaging apparatus and image signal generating apparatus
CN104506888A (en) Clock synchronizing device, method and system
CN113037458A (en) High-precision synchronous time service system
US20220179446A1 (en) Heterogeneous Computing Systems and Methods for Clock Synchronization
CN108206683B (en) Dynamic compensation pulse circuit
CN101752901B (en) Method, system, equipment and device for synchronizing data sampling at different places
CN109739136A (en) Implementation method based on the synchronous data collection of ocean platform wireless multi-channel and transmission
CN104243858B (en) A kind of circuit system of optical sensor
CN101726708A (en) Battery voltage data acquisition system
CN206741432U (en) A kind of system for human action extraction
CN104935803A (en) Image acquisition method and electronic equipment
CN102201851B (en) Remote clock system, equipment and information transmission method
CN211128157U (en) Sound pickup system
CN101516041B (en) Control method and control system for three-dimensional video acquisition
CN107608036B (en) A kind of jointing
CN112995938A (en) Synchronous acquisition method for sensors in field of power Internet of things
CN207218701U (en) Suitable for the smart mobile phone image receiving system of visible light communication

Legal Events

Date Code Title Description
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20210927

Address after: No. 2005, unit 3, building 1, No. 555, north section of Yizhou Avenue, high tech Zone, Wuhou District, Chengdu, Sichuan 610095

Patentee after: Sichuan Tianyuan hongchuang Technology Co.,Ltd.

Address before: 300387 Tianjin city Xiqing District West Binshui Road No. 393

Patentee before: TIANJIN NORMAL University

TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20231112

Address after: No. 1-1-701, Huixue Road, Xuefu Industrial Zone, Xiqing District, Tianjin, 300000

Patentee after: Tianjin Xinmeng Microelectronics Technology Co.,Ltd.

Address before: No. 2005, unit 3, building 1, No. 555, north section of Yizhou Avenue, high tech Zone, Wuhou District, Chengdu, Sichuan 610095

Patentee before: Sichuan Tianyuan hongchuang Technology Co.,Ltd.