CN204517964U - A kind of sound localization device be applied in Smart Home - Google Patents
A kind of sound localization device be applied in Smart Home Download PDFInfo
- Publication number
- CN204517964U CN204517964U CN201520108123.7U CN201520108123U CN204517964U CN 204517964 U CN204517964 U CN 204517964U CN 201520108123 U CN201520108123 U CN 201520108123U CN 204517964 U CN204517964 U CN 204517964U
- Authority
- CN
- China
- Prior art keywords
- localization device
- sound localization
- sound
- adc
- smart home
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
Abstract
The utility model provides a kind of with sound localization function, simultaneously can the novel monitoring equipment of intellectual analysis.It comprises monopod video camera, multiple sound gathers array, sound localization device, home intelligent main frame and power supply; Described monopod video camera and multiple sound gather array and are all electrically connected with sound localization device; Described sound localization device and monopod video camera are all electrically connected with home intelligent main frame; Described power supply is respectively above-mentioned each consuming parts and powers; Described sound localization device is one piece of hardware circuit board, and described hardware circuit board comprises analog signal conditioner circuit, analog to digital conversion circuit, FPGA pretreatment module and DSP core algorithm module.
Description
Technical field
The utility model relates to a kind of sound localization device be applied in Smart Home, it is characterized in that utilizing multiple sound to gather position and the attribute of array estimation sound source object, control the rotation of cradle head camera, video-audio frequency data is also supplied to backstage and carries out intellectual analysis simultaneously.
Background technology
Localization of sound, tracking and sound source analysis have become the important research field of multimedia human-computer interaction and Low Altitude Target Detection, general employing realizes based on the method for the delay inequality (TDOA) of many collectors, can be widely used in video conferencing system, video monitoring system, intelligent robot, radar auxiliary system and intelligent domestic system.
Smart Home is the brand-new typical apply of technology of Internet of things in mankind's family life.Various equipment (as audio & video equipment, illuminator, safety-protection system, Digital Theater System, video server, network home appliance etc.) in family are connected together by technology of Internet of things by Smart Home, provide several functions and the means such as home wiring control, Lighting control, remote control using telephone, indoor and outdoor remote control, burglar alarm, intelligence nurse, environmental monitoring, HVAC control.
In Modern Family, watch-dog is very common, but the intelligent monitoring and controlling device with sound localization function is little.Tradition watch-dog only has video and does not have sound, or just record merely and do not carry out auditory localization and analysis, the accident with abnormal sound of movement that can not occur in complete documentation home environment, therefore with sound localization function, the novel monitoring equipment of intellectual analysis can seem and be even more important simultaneously.
In view of there is no intelligentized sound localization device in traditional watch-dog, be therefore badly in need of at present wanting a kind of with sound localization function, simultaneously can the novel monitoring equipment of intellectual analysis.
Utility model content
The technical problems to be solved in the utility model is, provides a kind of with sound localization function, simultaneously can the novel monitoring equipment of intellectual analysis.
For solving the problems of the technologies described above, the technical scheme that the utility model provides is: a kind of sound localization device be applied in Smart Home, and it comprises monopod video camera, multiple sound gathers array, sound localization device, home intelligent main frame and power supply; Described monopod video camera and multiple sound gather array and are all electrically connected with sound localization device; Described sound localization device and monopod video camera are all electrically connected with home intelligent main frame; Described power supply is respectively above-mentioned each consuming parts and powers; Described sound localization device is one piece of hardware circuit board, and described hardware circuit board comprises analog signal conditioner circuit, analog to digital conversion circuit, FPGA pretreatment module and DSP core algorithm module.
As preferably, described analog signal conditioner circuit is two panels OP747AR chip, the analog signal that six road sound collection arrays export is ADC_CH0, ADC_CH1, ADC_CH2, ADC_CH3, ADC_CH4, ADC_CH5, described analog signal is connected with the amplifier input of OP747, amplifier exports as SIG1_OUT, SIG2_OUT, SIG3_OUT, SIG4_OUT, SIG5_OUT, SIG6_OUT, completes the amplification to input small-signal and conditioning.
As preferably, described analog to digital conversion circuit is a slice ADS8365 chip, and described modulus conversion chip is independent 16, six tunnel ADCs, has lower power consumption and higher dynamic range.ADS8365 is input as six road amplifier output signal SIG1_OUT, SIG2_OUT, SIG3_OUT, SIG4_OUT, SIG5_OUT, SIG6_OUT.The output of ADS8365 is 16 bit data bus ADS_D [0 ~ 15], identifies which analog signal current be by address bus ADS_A0, ADS_A1, ADS_A2 and chip selection signal ADS_CS, and sends in FPGA and carry out preliminary treatment.
As preferably, described FPGA pretreatment module adopts the Sparton3XC3S200 of xilinx company, there is abundant IO resource and parallel processing capability, sampling and the synchronization process of six road voice signals can be carried out simultaneously, in addition, higher to the wavelet transformation computation complexity of voice signal, processing load is comparatively large in dsp, first can carry out preliminary treatment in FPGA.The output being input as ADS8365 of described FPGA, the output of described FPGA is 16 EMIF parallel buss and SPI universal serial bus, is connected respectively with core processing unit C6747.
As preferably, described DSP core processing unit is the TMS320C6747 of Texas Instrument, it is the floating-point signal processor of a Low Power High Performance, mainly carry out the DOA estimation of multiple sound array signal, noise reduction process, target identification, and result is sent to home intelligent terminal, export the rotation that angle information controls monopod video camera simultaneously; Described DSP unit be input as 16 EMIF parallel buss and SPI universal serial bus, the output of described DSP unit is Ethernet interface and RS485 bus.
After adopting said structure, the utility model has following beneficial effect: by sound localization device, monopod video camera, multiple sound gather the combination of array, sound localization device, home intelligent main frame and power supply, when there is abnormal sound of movement at home, sound localization device can collected sound signal rapidly, monopod video camera is controlled, video-audio frequency data by location algorithm.
The utility model provides a kind of with sound localization function in sum, simultaneously can the novel monitoring equipment of intellectual analysis.
Accompanying drawing explanation
Fig. 1 is the main structure block diagram of the sound localization device be applied in the utility model in Smart Home.
Fig. 2 is the part signal modulate circuit figure that the utility model is applied in the sound localization device in Smart Home.
Fig. 3 is the AD sample circuit figure that the utility model is applied in the sound localization device in Smart Home.
Fig. 4 is the FPGA pretreatment module schematic diagram that the utility model is applied in the sound localization device in Smart Home.
Fig. 5 is the DSP core processing unit schematic diagram one that the utility model is applied in the sound localization device in Smart Home.
Fig. 6 is the DSP core processing unit schematic diagram two that the utility model is applied in the sound localization device in Smart Home.
Fig. 7 is the DSP core processing unit schematic diagram three that the utility model is applied in the sound localization device in Smart Home.
Fig. 8 is the DSP core processing unit schematic diagram four that the utility model is applied in the sound localization device in Smart Home.
Fig. 9 is the sound localization algorithm flow chart that the utility model is applied in the sound localization device in Smart Home.
Embodiment
Below in conjunction with accompanying drawing, the utility model is described in further detail.
1 to accompanying drawing 8 by reference to the accompanying drawings, a kind of sound localization device be applied in Smart Home, and it comprises monopod video camera, multiple sound gathers array, sound localization device, home intelligent main frame and power supply; Described monopod video camera and multiple sound gather array and are all electrically connected with sound localization device; Described sound localization device and monopod video camera are all electrically connected with home intelligent main frame; Described power supply is respectively above-mentioned each consuming parts and powers; Described sound localization device is one piece of hardware circuit board, and described hardware circuit board comprises analog signal conditioner circuit, analog to digital conversion circuit, FPGA pretreatment module and DSP core algorithm module etc.
Described analog signal conditioner circuit is two panels OP747AR chip, the analog signal that six road sound collection arrays export is ADC_CH0, ADC_CH1, ADC_CH2, ADC_CH3, ADC_CH4, ADC_CH5, described analog signal is connected with the amplifier input of OP747, amplifier exports as SIG1_OUT, SIG2_OUT, SIG3_OUT, SIG4_OUT, SIG5_OUT, SIG6_OUT, completes the amplification to input small-signal and conditioning.
Described analog to digital conversion circuit is a slice ADS8365 chip, and described modulus conversion chip is independent 16, six tunnel ADCs, has lower power consumption and higher dynamic range.ADS8365 is input as six road amplifier output signal SIG1_OUT, SIG2_OUT, SIG3_OUT, SIG4_OUT, SIG5_OUT, SIG6_OUT.The output of ADS8365 is 16 bit data bus ADS_D [0 ~ 15], identifies which analog signal current be by address bus ADS_A0, ADS_A1, ADS_A2 and chip selection signal ADS_CS, and sends in FPGA and carry out preliminary treatment.
Described FPGA pretreatment module adopts the Sparton3XC3S200 of xilinx company, there is abundant IO resource and parallel processing capability, sampling and the synchronization process of six road voice signals can be carried out simultaneously, in addition, higher to the wavelet transformation computation complexity of voice signal, processing load is comparatively large in dsp, first can carry out preliminary treatment in FPGA.The output being input as ADS8365 of described FPGA, the output of described FPGA is 16 EMIF parallel buss and SPI universal serial bus, is connected respectively with core processing unit C6747.
Described DSP core processing unit is the TMS320C6747 of Texas Instrument, it is the floating-point signal processor of a Low Power High Performance, mainly carry out the DOA estimation, noise reduction process, target identification etc. of multiple sound array signal, and result is sent to home intelligent terminal, export the rotation that angle information controls monopod video camera simultaneously.Described DSP unit be input as 16 EMIF parallel buss and SPI universal serial bus, the output of described DSP unit is Ethernet interface and RS485 bus.
Further combined with accompanying drawing 9, sound localization algorithm is the software algorithm performed in circuit board programming device, described sound localization algorithm realization flow process is as follows, first initialization is carried out to the sound array matrix of system, by intensity of sound, the sound difference between transducer makes zero, and then receives unitary sampling data value, there is N number of sound transducer just to have N number of data value, and upgrade sound array matrix.Whole system is divided in coordinate four regions in advance, according to the Distance geometry field intensity of sound source from transducer, show that sound source is in a certain region, namely 1/4 sound area is calculated, retain 2 transducers in this region and central point sensor values, and calculate the time difference of 2 transducers to central sensor, can obtain by time difference the displacement that sound source offsets two transducer axis, determine the coordinate of this sound source according to hyperbolic fix principle.Then deflection system coordinates being converted into cradle head camera is also needed.Simultaneously, the intensity of sound information that the multiple transducer of systematic collection gathers, maximum signal to noise ratio Measurement Algorithm is utilized to merge multiple sensing data, and set up equation calculating superimposed noise, the impact of filtering noise, adopts fast fourier transform to obtain the frequency information of sound, preserves field intensity and the frequency information of signal, binding pattern recognizer is classified to sound source, or carries out identification to speech waveform.Finally, give home intelligent main frame by the rough result of pattern recognition and do further process, give monopod video camera by deflection information and make it turn to Sounnd source direction.
Be described the utility model and execution mode thereof above, this description does not have restricted, and shown in accompanying drawing is also one of execution mode of the present utility model, and actual structure is not limited thereto.If generally speaking those of ordinary skill in the art enlightens by it, when not departing from the utility model and creating aim, design the frame mode similar to this technical scheme and embodiment without creationary, protection range of the present utility model all should be belonged to.
Claims (5)
1. be applied in the sound localization device in Smart Home, it is characterized in that: it comprises monopod video camera, multiple sound gathers array, sound localization device, home intelligent main frame and power supply; Described monopod video camera and multiple sound gather array and are all electrically connected with sound localization device; Described sound localization device and monopod video camera are all electrically connected with home intelligent main frame; Described power supply is respectively above-mentioned each consuming parts and powers; Described sound localization device is one piece of hardware circuit board, and described hardware circuit board comprises analog signal conditioner circuit, analog to digital conversion circuit, FPGA pretreatment module and DSP core algorithm module.
2. the sound localization device be applied in Smart Home according to claim 1, it is characterized in that: described analog signal conditioner circuit is two panels OP747AR chip, the analog signal that six road sound collection arrays export is ADC_CH0, ADC_CH1, ADC_CH2, ADC_CH3, ADC_CH4, ADC_CH5, described analog signal is connected with the amplifier input of OP747, amplifier exports as SIG1_OUT, SIG2_OUT, SIG3_OUT, SIG4_OUT, SIG5_OUT, SIG6_OUT, completes the amplification to input small-signal and conditioning.
3. the sound localization device be applied in Smart Home according to claim 1, is characterized in that: described analog to digital conversion circuit is a slice ADS8365 chip, and described modulus conversion chip is independent 16, six tunnel ADCs; ADS8365 is input as six road amplifier output signal SIG1_OUT, SIG2_OUT, SIG3_OUT, SIG4_OUT, SIG5_OUT, SIG6_OUT, the output of ADS8365 is 16 bit data bus ADS_D [0 ~ 15], identify which analog signal current be by address bus ADS_A0, ADS_A1, ADS_A2 and chip selection signal ADS_CS, and send in FPGA and carry out preliminary treatment.
4. the sound localization device be applied in Smart Home according to claim 1, it is characterized in that: described FPGA pretreatment module adopts the Sparton3XC3S200 of xilinx company, the output being input as ADS8365 of described FPGA, the output of described FPGA is 16 EMIF parallel buss and SPI universal serial bus, is connected respectively with core processing unit C6747.
5. the sound localization device be applied in Smart Home according to claim 1, is characterized in that: described DSP core processing unit is the TMS320C6747 of Texas Instrument; Described DSP unit be input as 16 EMIF parallel buss and SPI universal serial bus, the output of described DSP unit is Ethernet interface and RS485 bus.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201520108123.7U CN204517964U (en) | 2015-02-13 | 2015-02-13 | A kind of sound localization device be applied in Smart Home |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201520108123.7U CN204517964U (en) | 2015-02-13 | 2015-02-13 | A kind of sound localization device be applied in Smart Home |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN204517964U true CN204517964U (en) | 2015-07-29 |
Family
ID=53715889
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201520108123.7U Expired - Fee Related CN204517964U (en) | 2015-02-13 | 2015-02-13 | A kind of sound localization device be applied in Smart Home |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN204517964U (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105866741A (en) * | 2016-06-23 | 2016-08-17 | 合肥联宝信息技术有限公司 | Home control device and home control method on basis of sound source localization |
| WO2017096625A1 (en) * | 2015-12-11 | 2017-06-15 | 深圳市轻生活科技有限公司 | Video interaction control method and device |
| CN107450390A (en) * | 2017-07-31 | 2017-12-08 | 绵阳美菱软件技术有限公司 | A kind of intelligent electrical appliance control device, control method and control system |
| CN109709989A (en) * | 2019-01-09 | 2019-05-03 | 中德（珠海）人工智能研究院有限公司 | A kind of positioning system, localization method and augmented reality system |
| WO2021168620A1 (en) * | 2020-02-24 | 2021-09-02 | 京东方科技集团股份有限公司 | Sound source tracking control method and control apparatus, and sound source tracking system |
-
2015
- 2015-02-13 CN CN201520108123.7U patent/CN204517964U/en not_active Expired - Fee Related
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017096625A1 (en) * | 2015-12-11 | 2017-06-15 | 深圳市轻生活科技有限公司 | Video interaction control method and device |
| CN105866741A (en) * | 2016-06-23 | 2016-08-17 | 合肥联宝信息技术有限公司 | Home control device and home control method on basis of sound source localization |
| CN107450390A (en) * | 2017-07-31 | 2017-12-08 | 绵阳美菱软件技术有限公司 | A kind of intelligent electrical appliance control device, control method and control system |
| CN109709989A (en) * | 2019-01-09 | 2019-05-03 | 中德（珠海）人工智能研究院有限公司 | A kind of positioning system, localization method and augmented reality system |
| WO2021168620A1 (en) * | 2020-02-24 | 2021-09-02 | 京东方科技集团股份有限公司 | Sound source tracking control method and control apparatus, and sound source tracking system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN204517964U (en) | A kind of sound localization device be applied in Smart Home | |
| CN204442410U (en) | The intelligent home device that a kind of sound is auxiliary | |
| CN108231079B (en) | Method, apparatus, device and computer-readable storage medium for controlling electronic device | |
| US11295760B2 (en) | Method, apparatus, system and storage medium for implementing a far-field speech function | |
| CN101957442A (en) | Sound source positioning device | |
| CN103948398B (en) | Be applicable to the heart sound location segmentation method of android system | |
| WO2020048431A1 (en) | Voice processing method, electronic device and display device | |
| CN110146764A (en) | A kind of power equipment method for detecting abnormality based on acoustic array edge calculations | |
| US20170287480A1 (en) | Voice wake-up method and device | |
| CN108986833A (en) | Sound pick-up method, system, electronic equipment and storage medium based on microphone array | |
| CN205754811U (en) | Mobile terminal and audio frequency processing system thereof | |
| CN108447483A (en) | Speech recognition system | |
| CN103576126A (en) | Four-channel array sound source positioning system based on neural network | |
| CN102819021A (en) | Multifunctional ultrasonic ranging data acquisition system and method thereof | |
| CN109040905A (en) | A kind of low-power consumption speaker and its working method | |
| CN203416751U (en) | Bird repelling device for electric power tower | |
| CN204215209U (en) | For the signal conditioning circuit of data collector in drawout cubicle | |
| CN208444161U (en) | Robot auditory localization and identification device | |
| CN104655111B (en) | Method and device for simulating laser detector | |
| CN208671125U (en) | A kind of refrigerator and its control device of speech recognition | |
| CN208520985U (en) | A kind of sonic location system based on multi-microphone array | |
| CN112799016B (en) | Sound source positioning method, sound source positioning device, computer readable storage medium and electronic equipment | |
| CN110633066B (en) | Voice acquisition method, system, mobile terminal and storage medium | |
| CN208284231U (en) | Voice enhancer based on voice awakening technology | |
| CN202940964U (en) | Vehicle speaker durability testing device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20161223 Address after: Jiading District new area, 201800 Ring Road Shanghai City No. 2222 Building 1 room J343 Patentee after: Shanghai win things Technology Co., Ltd. Address before: The town of Shanghai city Jinshan District Huagong Road 201516 corridor corridor 95 Lane 68, room 122 Patentee before: SHANGHAI YINGYI ELECTRONIC EQUIPMENT CO., LTD. |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20150729 Termination date: 20210213 |