CN109886071A - A kind of human body localization method and system based on auditory localization and Face datection - Google Patents
A kind of human body localization method and system based on auditory localization and Face datection Download PDFInfo
- Publication number
- CN109886071A CN109886071A CN201811591840.4A CN201811591840A CN109886071A CN 109886071 A CN109886071 A CN 109886071A CN 201811591840 A CN201811591840 A CN 201811591840A CN 109886071 A CN109886071 A CN 109886071A
- Authority
- CN
- China
- Prior art keywords
- face
- sound
- auditory localization
- human body
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000004807 localization Effects 0.000 title claims abstract description 28
- 238000000034 method Methods 0.000 title claims description 10
- 230000001815 facial effect Effects 0.000 claims abstract description 6
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 claims description 3
- 238000003491 array Methods 0.000 claims description 3
- 238000005286 illumination Methods 0.000 claims description 3
- 230000000644 propagated effect Effects 0.000 claims description 3
- 238000001514 detection method Methods 0.000 abstract description 3
- 238000005516 engineering process Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000004378 air conditioning Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Abstract
The human body positioning system based on auditory localization and Face datection that the invention discloses a kind of, including interchanger, interchanger is connected with face camera and single-chip microcontroller, single-chip microcontroller is connected with signal-adjusting module by input interface, signal-adjusting module is connected with microphone array, interchanger is connected with recognition of face server, master control management server, pooled storage and monitoring center, itself the following steps are included: sound-source signal acquisition, auditory localization cooperates Face datection, the modeling and identification of face, the present invention forms array structure by the way that multiple microphones are arranged inside of the house, carry out auditory localization detection, it quickly determines sound source position and facial image is carried out by face camera and take, to obtain the face information of sound source position, smart home is facilitated to determine user position, to carry out the quick adjusting of smart home, in conjunction with auditory localization With Face datection, smart home system is improved to the location efficiency of position of human body, is worthy to be popularized.
Description
Technical field
It is specially a kind of to be positioned based on the human body of auditory localization and Face datection the present invention relates to location systems art field
Method and system.
Background technique
Smart home be using house as platform, using comprehensive wiring technology, network communication technology, security precautions technology, from
Dynamic control technology, audio and video technology integrate the related facility of home life, construct efficient housing facilities and family's schedule thing
The management system of business promotes house security, convenience, comfort, artistry, and realizes the living environment of environmental protection and energy saving.
Smart home is the embodiment of the instrumentation under the influence of internet.Smart home will be in family by technology of Internet of things
Various equipment (such as audio & video equipment, lighting system, curtain control, airconditioning control, security system, Digital Theater Systems, audio-visual clothes
Business device, shadow cabinet system, network home appliance etc.) it connects together, home wiring control, Lighting control, remote control using telephone, indoor and outdoor are provided
The multiple functions such as remote control, burglar alarm, environmental monitoring, HVAC control, infrared forwarding and programmable Timer control and means.With
Common household is compared, and smart home not only has traditional inhabitation function, has both building, network communication, information household appliances, equipment certainly
Dynamicization provides comprehensive information exchange function, and even various energy expenditures save fund.
From the point of view of the classification of broad sense, Internet appliance product actually contains network home appliance product, but if from narrow sense
Definition is to define, we can do so a simple classification: information household appliances more refer to the small-sized family with embeded processor
With (individual uses) information equipment, its essential characteristic is to be connected with network (referring mainly to internet) and have some concrete functions, can
To be complete sets of products, it is also possible to an auxiliary accessories.And network home appliance then refers to the household appliances with network operation feature
Product, this household electrical appliances are appreciated that the upgrading of our original ordinary electrical home appliance products.
Smart homes many at present requires to determine whether that the talent opens, and is easy to appear using sound source to position merely
Mistake, therefore devise a kind of human body localization method and system based on auditory localization and Face datection.
Summary of the invention
In order to overcome the shortcomings of that prior art, the present invention provide a kind of people based on auditory localization and Face datection
Body localization method and system can effectively solve the problem of background technique proposes.
The technical solution adopted by the present invention to solve the technical problems is:
A kind of human body positioning system based on auditory localization and Face datection, including interchanger, the interchanger are connected with face
Camera and single-chip microcontroller, the single-chip microcontroller are connected with signal-adjusting module by input interface, and the signal-adjusting module is connected with
Microphone array, the interchanger are connected in recognition of face server, master control management server, pooled storage and monitoring
The heart.
Further comprising following steps:
S1. the acquisition of sound-source signal: 3 microphone arrays are separately fixed at three vertex of 60cm*60cm square area,
When sound source generates in this region, sound can to all the winds be spread, and 3 microphones can once receive the letter of sound source
Number, interchanger is sent to by single-chip microcontroller after signal-adjusting module is handled；
S2. auditory localization cooperate Face datection: mainly used this physical quantity of sound amplitude, due to sound wave in air with
Certain speed is propagated, and is reached the phase difference for being set to the microphone of different location, is recorded according to these microphones to same sound
The phase differential of system can calculate the time difference that same sound reaches each pair of microphone, and the sound that some sound source issues arrives
Up to the time difference of a pair of of microphone, the suitable position for arranging microphone, can make bi-curved intersection point is sound source position, from
And the position of face camera is adjusted, alignment sound source position acquires image；
S3. the modeling and identification of face: positioning feature point algorithm finds out the position of each characteristic point of face, and algorithm is according to spy
Face size is normalized in the position of sign point, is stored in pooled storage, i.e., all people's face is carried out affine transformation,
It is handled according to the position of characteristic point and a preset template alignment, identification is compared by recognition of face server.
Further, it is characterised in that: include amplifier, filter and reshaper inside the signal-adjusting module.
Further, it is characterised in that: in the step S2, facial image is taken pictures acquisition by face camera, face phase
Realize that the actual conditions to disengaging personnel records in real time and detected automatically to face in machine, simultaneous camera have ultra-wide dynamically,
Ultra-low illumination function guarantees full color video acquisition in 24 hours.
Compared with prior art, the beneficial effects of the present invention are:
The present invention forms array structure by the way that multiple microphones are arranged inside of the house, carries out auditory localization detection, quickly determines
Sound source position is simultaneously taken by face camera progress facial image, to obtain the face information of sound source position, avoids mixed and disorderly
Sound source interference, can be convenient smart home and determines user position, so that the quick adjusting of smart home is carried out, it is fixed in conjunction with sound source
Position and Face datection, improve smart home system to the location efficiency of position of human body, are worthy to be popularized.
Detailed description of the invention
Fig. 1 is system structure diagram of the invention；
Fig. 2 is work flow diagram of the invention.
Figure label:
1- interchanger, 2- face camera, 3- single-chip microcontroller, 4- input interface, 5- signal-adjusting module, 6- microphone array, 7- people
Face identifies server, 8- master control management server, 9- pooled storage, 10- monitoring center.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
As shown in Figures 1 and 2, the human body positioning system based on auditory localization and Face datection that the present invention provides a kind of,
Including interchanger 1, the interchanger 1 is connected with face camera 2 and single-chip microcontroller 3, and the single-chip microcontroller 3 is connected by input interface 4
There is signal-adjusting module 5, the signal-adjusting module 5 is connected with microphone array 6, and the interchanger 1 is connected with recognition of face
Server 7, master control management server 8, pooled storage 9 and monitoring center 10.
It should be added that a kind of human body localization method based on auditory localization and Face datection comprising following
Step:
S1. the acquisition of sound-source signal: 3 microphone arrays 6 are separately fixed at three tops of 60cm*60cm square area
Point, when sound source generates in this region, sound can to all the winds be spread, and 3 microphones can once receive sound source
Signal is sent to interchanger 1 by single-chip microcontroller 3 after the processing of signal-adjusting module 5；
S2. auditory localization cooperate Face datection: mainly used this physical quantity of sound amplitude, due to sound wave in air with
Certain speed is propagated, and is reached the phase difference for being set to the microphone of different location, is recorded according to these microphones to same sound
The phase differential of system can calculate the time difference that same sound reaches each pair of microphone, and the sound that some sound source issues arrives
Up to the time difference of a pair of of microphone, the suitable position for arranging microphone, can make bi-curved intersection point is sound source position, from
And the position of face camera 2 is adjusted, alignment sound source position acquires image；
S3. the modeling and identification of face: positioning feature point algorithm finds out the position of each characteristic point of face, and algorithm is according to spy
Face size is normalized in the position of sign point, is stored in pooled storage 9, i.e., all people's face is carried out affine change
It changes, is handled according to the position of characteristic point and a preset template alignment, identification is compared by recognition of face server 7.
It include amplifier, filter and reshaper inside the signal-adjusting module 5 as preferred embodiment.
As preferred embodiment, in the step S2, facial image is taken pictures acquisition by face camera 2, face phase
Realize that the actual conditions to disengaging personnel records in real time and detected automatically to face in machine 2, simultaneous camera have ultra-wide dynamically,
Ultra-low illumination function guarantees full color video acquisition in 24 hours.
In conclusion the main characteristic of the invention lies in that:
The present invention forms array structure by the way that multiple microphones are arranged inside of the house, carries out auditory localization detection, quickly determines
Sound source position is simultaneously taken by face camera progress facial image, to obtain the face information of sound source position, avoids mixed and disorderly
Sound source interference, can be convenient smart home and determines user position, so that the quick adjusting of smart home is carried out, it is fixed in conjunction with sound source
Position and Face datection, improve smart home system to the location efficiency of position of human body, are worthy to be popularized.
It is obvious to a person skilled in the art that invention is not limited to the details of the above exemplary embodiments, Er Qie
In the case where without departing substantially from spirit or essential attributes of the invention, the present invention can be realized in other specific forms.Therefore, no matter
From the point of view of which point, the present embodiments are to be considered as illustrative and not restrictive, and the scope of the present invention is by appended power
Benefit requires rather than above description limits, it is intended that all by what is fallen within the meaning and scope of the equivalent elements of the claims
Variation is included within the present invention.Any reference signs in the claims should not be construed as limiting the involved claims.
Claims (4)
1. a kind of human body positioning system based on auditory localization and Face datection, including interchanger (1), it is characterised in that: described
Interchanger (1) is connected with face camera (2) and single-chip microcontroller (3), and the single-chip microcontroller (3) is connected with signal by input interface (4)
Adjustment module (5), the signal-adjusting module (5) are connected with microphone array (6), and the interchanger (1) is connected with face knowledge
Other server (7), master control management server (8), pooled storage (9) and monitoring center (10).
2. a kind of human body localization method based on auditory localization and Face datection according to claim 1 comprising following
Step:
S1. the acquisition of sound-source signal: 3 microphone arrays (6) are separately fixed at three tops of 60cm*60cm square area
Point, when sound source generates in this region, sound can to all the winds be spread, and 3 microphones can once receive sound source
Signal is sent to interchanger (1) by single-chip microcontroller (3) after signal-adjusting module (5) processing；
S2. auditory localization cooperate Face datection: mainly used this physical quantity of sound amplitude, due to sound wave in air with
Certain speed is propagated, and is reached the phase difference for being set to the microphone of different location, is recorded according to these microphones to same sound
The phase differential of system can calculate the time difference that same sound reaches each pair of microphone, and the sound that some sound source issues arrives
Up to the time difference of a pair of of microphone, the suitable position for arranging microphone, can make bi-curved intersection point is sound source position, from
And the position of face camera (2) is adjusted, alignment sound source position acquires image；
S3. the modeling and identification of face: positioning feature point algorithm finds out the position of each characteristic point of face, and algorithm is according to spy
Face size is normalized in the position of sign point, is stored in pooled storage (9), i.e., all people's face is carried out affine change
It changes, is handled according to the position of characteristic point and a preset template alignment, knowledge is compared by recognition of face server (7)
Not.
3. a kind of human body positioning system based on auditory localization and Face datection according to claim 1, it is characterised in that:
It include amplifier, filter and reshaper inside the signal-adjusting module (5).
4. a kind of human body localization method based on auditory localization and Face datection according to claim 2, it is characterised in that:
In the step S2, facial image is taken pictures acquisition by face camera (2), and the reality to the personnel of disengaging is realized in face camera (2)
Border situation is recorded in real time and is detected automatically to face, and simultaneous camera has ultra-wide dynamic, ultra-low illumination function, is guaranteed 24 hours
Full color video acquisition.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811591840.4A CN109886071A (en) | 2018-12-25 | 2018-12-25 | A kind of human body localization method and system based on auditory localization and Face datection |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811591840.4A CN109886071A (en) | 2018-12-25 | 2018-12-25 | A kind of human body localization method and system based on auditory localization and Face datection |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109886071A true CN109886071A (en) | 2019-06-14 |
Family
ID=66925176
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811591840.4A Pending CN109886071A (en) | 2018-12-25 | 2018-12-25 | A kind of human body localization method and system based on auditory localization and Face datection |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109886071A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110275138A (en) * | 2019-07-16 | 2019-09-24 | 北京工业大学 | A kind of more sound localization methods removed using advantage sound source ingredient |
| CN110443371A (en) * | 2019-06-25 | 2019-11-12 | 深圳欧克曼技术有限公司 | A kind of artificial intelligence device and method |
| CN110503045A (en) * | 2019-08-26 | 2019-11-26 | 北京华捷艾米科技有限公司 | A kind of Face detection method and device |
| CN111722537A (en) * | 2020-06-22 | 2020-09-29 | 合肥优恩物联网科技有限公司 | Intelligent interaction system and method based on autonomous face recognition |
| CN112578338A (en) * | 2019-09-27 | 2021-03-30 | 阿里巴巴集团控股有限公司 | Sound source positioning method, device, equipment and storage medium |
| CN112578338B (en) * | 2019-09-27 | 2024-05-14 | 阿里巴巴集团控股有限公司 | Sound source positioning method, device, equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103841357A (en) * | 2012-11-21 | 2014-06-04 | 中兴通讯股份有限公司 | Microphone array sound source positioning method, device and system based on video tracking |
| CN105184214A (en) * | 2015-07-20 | 2015-12-23 | 北京进化者机器人科技有限公司 | Sound source positioning and human face detection-based human body positioning method and system |
| CN106292732A (en) * | 2015-06-10 | 2017-01-04 | 上海元趣信息技术有限公司 | Intelligent robot rotating method based on sound localization and Face datection |
-
2018
- 2018-12-25 CN CN201811591840.4A patent/CN109886071A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103841357A (en) * | 2012-11-21 | 2014-06-04 | 中兴通讯股份有限公司 | Microphone array sound source positioning method, device and system based on video tracking |
| CN106292732A (en) * | 2015-06-10 | 2017-01-04 | 上海元趣信息技术有限公司 | Intelligent robot rotating method based on sound localization and Face datection |
| CN105184214A (en) * | 2015-07-20 | 2015-12-23 | 北京进化者机器人科技有限公司 | Sound source positioning and human face detection-based human body positioning method and system |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110443371A (en) * | 2019-06-25 | 2019-11-12 | 深圳欧克曼技术有限公司 | A kind of artificial intelligence device and method |
| CN110443371B (en) * | 2019-06-25 | 2023-07-25 | 深圳欧克曼技术有限公司 | Artificial intelligence device and method |
| CN110275138A (en) * | 2019-07-16 | 2019-09-24 | 北京工业大学 | A kind of more sound localization methods removed using advantage sound source ingredient |
| CN110275138B (en) * | 2019-07-16 | 2021-03-23 | 北京工业大学 | Multi-sound-source positioning method using dominant sound source component removal |
| CN110503045A (en) * | 2019-08-26 | 2019-11-26 | 北京华捷艾米科技有限公司 | A kind of Face detection method and device |
| CN112578338A (en) * | 2019-09-27 | 2021-03-30 | 阿里巴巴集团控股有限公司 | Sound source positioning method, device, equipment and storage medium |
| CN112578338B (en) * | 2019-09-27 | 2024-05-14 | 阿里巴巴集团控股有限公司 | Sound source positioning method, device, equipment and storage medium |
| CN111722537A (en) * | 2020-06-22 | 2020-09-29 | 合肥优恩物联网科技有限公司 | Intelligent interaction system and method based on autonomous face recognition |
| CN111722537B (en) * | 2020-06-22 | 2023-08-22 | 合肥优恩物联网科技有限公司 | Intelligent interaction system and method based on autonomous face recognition |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109886071A (en) | A kind of human body localization method and system based on auditory localization and Face datection | |
| CN108390859B (en) | Intelligent robot device for intercom extension | |
| CN107240319B (en) | A kind of interaction Scene Teaching system for the K12 stage | |
| CN108989162B (en) | Household intelligent robot management system | |
| CN105116859A (en) | UAV-based smart home system and method | |
| JP6958360B2 (en) | Information processing equipment, information processing methods, and programs | |
| CN204903983U (en) | Smart home systems and unmanned vehicles , intelligent maincenter equipment thereof | |
| CN106997695A (en) | A kind of new cloud education intelligence system | |
| WO2019140697A1 (en) | Interphone extension intelligent robot device | |
| CN107369203A (en) | The adaptive construction method of indoor three-dimensional scenic and device | |
| CN107065588A (en) | A kind of intelligent domestic system | |
| CN110535737A (en) | A kind of intelligent home control system | |
| CN105068722A (en) | Intelligent home environment-oriented man-machine interaction control method | |
| CN105975079A (en) | Air conditioner information processing method and device | |
| WO2015078299A1 (en) | Smart home monitoring method, apparatus, and smart home system | |
| CN106710490A (en) | Show window system and practice method thereof | |
| CN110597083A (en) | Intelligent household control method and system based on user weight | |
| CN204347461U (en) | Smart Home central control system | |
| CN204631844U (en) | Family's thin cloud storage system | |
| CN205457679U (en) | Furniture intelligence mirror | |
| CN217982414U (en) | Conference management system | |
| CN213934918U (en) | AI face recognition canteen consumption terminal | |
| CN106094942A (en) | Smart meeting room control method | |
| CN205487178U (en) | Interactive media end system of visual big data | |
| CN205726095U (en) | A kind of intelligent meeting system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190614 |
|
| RJ01 | Rejection of invention patent application after publication |