CN107368720A - Intuitive interactive device and its interactive approach - Google Patents
Intuitive interactive device and its interactive approach Download PDFInfo
- Publication number
- CN107368720A CN107368720A CN201610307570.4A CN201610307570A CN107368720A CN 107368720 A CN107368720 A CN 107368720A CN 201610307570 A CN201610307570 A CN 201610307570A CN 107368720 A CN107368720 A CN 107368720A
- Authority
- CN
- China
- Prior art keywords
- user
- interactive
- face feature
- module
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
- G10L15/10—Speech classification or search using distance or distortion measures between unknown speech and reference templates
Abstract
The present invention provides a kind of intuitive interactive device and interactive approach.Intuitive interactive device includes management module, detection module, identity identification module, sound identification module and interactive module.Management module is registered to user and stores the user characteristics and authority of registered user.Detection module obtains image and sound, and if having image of face, storage image and sound in detection image and starting identity identification module.Identity identification module obtains the face feature of interactive user.Management module compares the face feature of interactive user and the user characteristics of registered user to judge whether interactive user is registered.After judging interactive user to be registered, sound identification module is actuated to obtain the order of interactive user.After judging mentioned order to be effective, interactive module is activated and reacts on mentioned order to carry out interaction with interactive user.The present invention can reduce power consumption, hardware cost and the probability when machine of intuitive interactive device.
Description
Technical field
The present invention relates to a kind of electronic installation, more particularly to a kind of intuitive interactive device and its interactive approach.
Background technology
With making rapid progress for science and technology, existing human-computer interaction device (such as robot) can pass through diversification
Input (such as image or phonetic entry etc.) and the interaction of diversification is produced with user.But in order to improve
Interactive between human-computer interaction device and user, human-computer interaction device must be continual to image or language
Sound input is recognized to carry out interaction.Consequently, it is possible to it not only can largely consume the electricity of human-computer interaction device
Power, increase the hardware cost of human-computer interaction device, more likely lift the probability that human-computer interaction device works as machine.
If human-computer interaction device need to carry out signal transmission to carry out image or speech recognition by network, largely
The problem of image or voice signal more likely cause network latency.In addition, in the noisy environment of sound
Under, existing human-computer interaction device also may be because the interference of noise and can not identify the life of user
Order, so as to which corresponding interaction can not be produced.
In addition, existing human-computer interaction device once can only carry out interaction with a user mostly, work as people
When machine interactive device carries out interactive with multidigit user simultaneously, it can not generally be directed to other user and produce phase
Corresponding interaction.Moreover, under the noisy environment of sound, existing human-computer interaction device may also be because
For noise interference and the order of user can not be identified, so that corresponding interaction can not be produced.Separately
Outside, if human-computer interaction device can be controlled by the people of lack of competence easily, it will cause for security ask
Topic.
The content of the invention
In view of this, the present invention provides a kind of intuitive interactive device and its interactive approach, uses solution first
The problem of described in preceding technology.
The intuitive interactive device of the present invention includes management module, detection module, identity identification module, language
Sound identification module and interactive module.Management module to an at least user being registered using as at least
One registered user, and store this at least user characteristics of a registered user and corresponding authority.Detection module
Whether to obtain image and sound, detecting in image has an at least image of face, and if detection knot
Fruit is yes, stores above-mentioned image and tut using as the first signal of video signal and the first voice signal.
Identity identification module after detecting that above-mentioned image has an at least image of face to be activated, to the
One signal of video signal carries out face recognition to obtain the face feature of interactive user, and judges whether to provide interaction
The face feature of user is to management module.Management module more to obtain interactive user face feature after,
The face feature of interactive user is compared with the user characteristics of an above-mentioned at least registered user, to judge
Whether interactive user is registered.Sound identification module is to after judging above-mentioned interactive user to be registered
It is activated.The user characteristics carry out sound that sound identification module is registered the first voice signal and interactive user
Voice messaging is converted to order to obtain the voice messaging of interactive user by signal to noise ratio.Management module is more
To judge whether mentioned order is effective.Interactive module to judging mentioned order for effectively after opened
It is dynamic, and it is correspondingly interactive to be carried out with above-mentioned interactive user to react on this order.
In one embodiment of this invention, above-mentioned identity identification module to the first signal of video signal more entering
Row image analysing computer is to judge whether above-mentioned interactive user opens one's mouth, and if the determination result is YES, there is provided above-mentioned
The face feature of interactive user is to management module.
In one embodiment of this invention, above-mentioned identity identification module is more retrieving the first signal of video signal
In image background information, and judge whether image background information is consistent with background scene information, Yi Jiruo
Judged result is to be to provide the face feature of above-mentioned interactive user to management module.
In one embodiment of this invention, above-mentioned management module according to above-mentioned interactive user more being noted
The authority of volume, to judge whether interactive user has the authority using mentioned order, if the determination result is YES,
Then determine that mentioned order is effective.
In one embodiment of this invention, above-mentioned identity identification module to the first signal of video signal more entering
Row face recognition is used with obtaining the face feature of multiple candidate users according to setting order in this little candidate
One is selected in the face feature at family, so that the face feature of each in this little candidate user is in order
Face feature as interactive user.
In one embodiment of this invention, above-mentioned identity identification module is more to according to this little candidate user
Face feature judge the distance between each candidate user and intuitive interactive device, and according to by
One is closely selected in the face feature of this little candidate user to remote distance order, so that this little candidate uses
The face feature of each in the family face feature as interactive user in order.
The interactive approach of the present invention can be used for intuitive interactive device.Interactive approach comprises the following steps.It is logical
The management module for crossing intuitive interactive device is registered to an at least user to be used as at least one registration
Family, and store this at least user characteristics of a registered user and corresponding authority.Filled by the way that intuitive is interactive
The detection module put obtains image and sound, and whether detect in the image has an at least image of face, with
And if testing result is yes, above-mentioned image and tut are stored using as the first signal of video signal and the
One voice signal.Start the interactive dress of intuitive after detecting that above-mentioned image has an at least image of face
The identity identification module put, face recognition is carried out to obtain to the first signal of video signal by identity identification module
The face feature of interactive user, and judge whether to provide the face feature of this interactive user to management module.
After management module obtains the face feature of this interactive user, by management module by the face of this interactive user
Portion's feature is compared with the user characteristics of an above-mentioned at least registered user, whether to judge this interactive user
It is registered.Start the speech recognition mould of intuitive interactive device after judging this interactive user to be registered
Block, the user characteristics for being registered the first voice signal and this interactive user by sound identification module are carried out
Sound is compared to obtain the voice messaging of this interactive user, and voice messaging is converted into order.Pass through pipe
Reason module judges whether mentioned order is effective.Judging mentioned order for effectively afterwards by the interactive dress of intuitive
The interactive module put starts, and reacts on mentioned order by interactive module to carry out phase with this interactive user
Should ground interaction.
Based on above-mentioned, in the intuitive interactive device that the embodiment of the present invention is proposed with method, detecting mould
Block, identity identification module, sound identification module and interactive module are only just activated when needing running,
Therefore intuitive interactive device can be avoided ceaselessly to be recognized to image or sound input, so as to reduce intuition
Change power consumption, hardware cost and the probability when machine of interactive device.Moreover, sound identification module can
The first voice signal is carried out into sound with the vocal print feature that user is registered to compare, therefore decreasing environmental noise function
Interference to intuitive interactive device.In addition, other people can be also avoided by stealing the image and sound of user
And carried out with intuitive interactive device it is interactive, the problem of so as to produce security.Finally, the present invention is implemented
The intuitive interactive device that example is proposed can reach the effect of multi-person interactive with method.
For features described above of the invention and advantage can be become apparent, special embodiment below, and coordinate
Accompanying drawing is described in detail below.
Brief description of the drawings
Fig. 1 is the circuitry block signal according to the intuitive interactive device shown by one embodiment of the invention
Figure；
Fig. 2 is that Fig. 1 intuitive interactive device and multidigit user carry out interactive situation schematic diagram；
Fig. 3 is the step schematic flow sheet of the interactive approach of Fig. 1 intuitive interactive device.
Reference：
100：Intuitive interactive device
105：Storage module
110：Management module
130：Detection module
150：Identity identification module
170：Sound identification module
190：Interactive module
CHR1、CHR3：Face feature
CHR2：Vocal print feature
CHR4：Voice messaging
CMD：Order
IMG：First signal of video signal
SUD：First voice signal
S200、S210、S220、S230、S235、S240、S250、S260、S270：Step
USR、USR1、USR2、USR3：User
Embodiment
With detailed reference to the one exemplary embodiment of the present invention, illustrate the one exemplary embodiment in the accompanying drawings
Example.In addition, all possible parts, use element/component of identical label in drawings and the embodiments
Represent same or like part.
Fig. 1 is refer to below, and Fig. 1 is according to the intuitive interactive device shown by one embodiment of the invention
100 circuitry block schematic diagram.In one embodiment of this invention, intuitive interactive device 100 can example
Emotion class robot in this way, but the present invention is not limited thereto.In other embodiments of the invention, directly
Feelization interactive device 100 also can be used as input equipment of contact panel or display etc..Intuitive
Interactive device 100 may include management module 110, detection module 130, identity identification module 150, voice
Identification module 170 and interactive module 190.
In one embodiment of this invention, management module 110, detection module 130, identity identification module
150th, sound identification module 170 and interactive module 190 can be hardware, firmware respectively or be stored in
Internal memory and by the soft of microprocessor (micro processor) or digital signal processor (DSP) institute load and execution
Part or machine-executable program code.If employing hardware to realize, then management module 110, detection mould
Block 130, identity identification module 150, sound identification module 170 and interactive module 190 can be by more
Individual circuit chip is completed, and can also be reached by single integrated circuit chip, but the present invention is not with this
For limitation.Above-mentioned multiple circuit chips or single integrated circuit chip can use specific function integrated circuit
(ASIC) or programmable logic gate array (FPGA) is realized.
In other embodiments of the invention, intuitive interactive device 100 may also include storage module 105.
Storage module 105 can be such as random access memory, flash memory, Winchester disk drive etc., but the present invention is unlimited
In this.
Management module 110 can be used to register an at least user using as an at least registered user, and
Store the user characteristics of each registered user and its corresponding authority.For example, user is using straight
Before feelization interactive device 100, management module 110 can be first passed through and registered and turn into registered user,
To ensure that intuitive interactive device 100 is using upper security.And the content registered may include user's
User characteristics and the authority of user, wherein user characteristics may include face (the i.e. face feature of user
CHR1) and sound (i.e. vocal print feature CHR2), and authority to be, for example, user can be assigned to intuitive interaction
Device 100 with it to carry out the command authority of interaction, but the invention is not restricted to this.One in the present invention is real
Apply in example, management module 110 can be not arranged in the inside of intuitive interactive device 100, but settable
In long-range (such as high in the clouds) and intuitive interactive device 100 is managed by way of wired or wireless network,
But the invention is not restricted to this.
Detection module 130 can be used to obtain the image and sound of the place environment of intuitive interactive device 100,
Wherein detection module 130 may include camera and microphone etc., but not limited to this.In addition, detection
Module 130 can detect in above-mentioned image whether have image of face.If detection module 130 detects above-mentioned
There is image of face in image, whether detect one or multiple image of face, detection module 130
Above-mentioned image and tut can be stored in storage module 105 using as the first signal of video signal IMG
With the first voice signal SUD, and start identity identification module 150 to carry out face recognition.Relatively,
If detection module 130 does not detect any image of face in above-mentioned image, the interactive dress of intuitive is represented
Put environment where 100 not someone, therefore the action that detection module 130 will be detected persistently, and body
Part identification module 150, sound identification module 170 and interactive module 190 then will be maintained at standby mode (or
Claim battery saving mode) to save the electric power of intuitive interactive device 100.
After identity identification module 150 is activated, detection module 130, sound identification module 170 and
Interactive module 190 then by operation in standby mode to save the electric power of intuitive interactive device 100.In detail
For, identity identification module 150 can carry out face recognition after being activated to the first signal of video signal IMG
To obtain interactive user (such as user USR shown in Fig. 1) face feature CHR3, and judge whether
User USR face feature CHR3 is provided to management module 110.
For example, in one embodiment of this invention, identity identification module 150 can be believed the first image
Number IMG carries out image analysing computer to judge whether user USR mouth has action (open one's mouth and speak), if sentencing
Disconnected result is yes, then the face feature CHR3 for providing user USR is follow-up to carry out to management module 110
Identity compare.If judged result is no, represent that user USR does not lift up one's voice, therefore intuitive is mutual
Dynamic device 100 will not carry out interaction with user USR, and now, identity identification module 150, which will enter, to be treated
Machine pattern, and detection operation of the detection module 130 by progress next time.
In another embodiment of the invention, identity identification module 150 also can be used to retrieve the first image letter
Image background information in number IMG, and judge whether this image background information is consistent with background scene information.
If the determination result is YES, user USR is represented really in the environment where intuitive interactive device 100,
Therefore identity identification module 150 will provide user USR face feature CHR3 to management module 110 with
Follow-up identity is carried out to compare.If judged result is no, represents user USR and be not located at intuitive interaction
In environment where device 100, therefore intuitive interactive device 100 can't be carried out mutually with user USR
Dynamic, now, identity identification module 150 will enter standby mode, and detection module 130 will carry out it is next
Secondary detection operation.It can so avoid other people from stealing user USR image and sound, then pass through and stolen
User USR image and sound and intuitive interactive device 100 carry out interaction, so as to produce security
The problem of.In one embodiment of this invention, above-mentioned background scene information can be interactive by offer intuitive
The manufacturer of device 100 is set, and either, above-mentioned background scene information can also be filled by intuitive is interactive
Put 100 pairs of site environments to be taken pictures and stored, but the present invention is not limited thereto.
In another embodiment of the present invention, identity identification module 150 can judge user USR mouth
There is an action and the image background information for judging in the first signal of video signal IMG is consistent with background scene information
In the case of, user USR face feature CHR3 is just provided to management module 110 to carry out follow-up body
Part compares, but the invention is not restricted to this.
After management module 110 obtains user USR face feature CHR3, management module 110 can incite somebody to action
User USR face feature CHR3 and stored registered user user characteristics (i.e. face feature
CHR1) it is compared, to judge whether user USR is registered.If management module 110 judges user
USR has not yet registered, and represents that user USR has no the authority using intuitive interactive device 100, therefore directly
Feelization interactive device 100 can't carry out interactive with user USR.Now, identity identification module 150 will
Into standby mode, and detection module 130 will carry out detection operation next time.Relatively, if management
Module 110 judges that user USR is registered, represents that user USR has and uses intuitive interactive device 100
Authority, then sound identification module 170 can be activated.
After sound identification module 170 is activated, detection module 130, identity identification module 150 and
Interactive module 190 is then operated in standby mode to save the electric power of intuitive interactive device 100.Come in detail
Say, sound identification module 170, can be by the first voice signal SUD and user USR after being activated
The user characteristics (such as vocal print feature CHR2) of registration carries out sound and compared to obtain user USR voice
Information CHR4, and voice messaging CHR4 can be converted to order CMD.Then, management module 110
It can determine whether order CMD is effective.
For example, in one embodiment of this invention, if user USR is registered, management module 110
The authority that can be registered according to user USR, come judge user USR whether have using order CMD with
The authority of interaction is carried out with intuitive interactive device 100.If the determination result is YES, then order CMD is determined
To be effective.If judged result is no, represent that user USR does not have the authority using order CMD, because
This intuitive interactive device 100 will not carry out interactive with user USR.
In another embodiment of the invention, management module 110 can determine whether order CMD is intuition
Changing interactive device 100 can perform, and if the determination result is YES, then determine that order CMD is effective.If
Judged result is no, represents that intuitive interactive device 100 does not support the function corresponding to order CMD,
Therefore intuitive interactive device 100 will not be carried out interactive with user USR.
If sum it up, management module 110 judge order CMD it is invalid, intuitive interactive device 100
It will not be carried out with user USR interactive.Now, sound identification module 170 will enter standby mode, and
Detection module 130 will be actuated to carry out detection operation next time.Relatively, if management module 110
Judge that order CMD is effective, represent that user USR has and allow intuitive interactive device 100 to perform order
CMD is to carry out the authority of interaction, then interactive module 190 can be activated.
After interactive module 190 is activated, detection module 130, identity identification module 150 and voice
Identification module 170 then by operation in standby mode to save the electric power of intuitive interactive device 100.In detail
For, after interactive module 190 is activated, intuitive interactive device 100 can pass through interactive module 190
It is correspondingly interactive to be carried out with user USR to react on order CMD.In one embodiment of this invention,
Intuitive interactive device 100 can export sound to carry out voice interface with user USR by loudspeaker.
In another embodiment of the present invention, intuitive interactive device 100 can also control it according to order CMD
His electrical equipment, such as television set, air conditioner etc. are opened/are opened and closed, but the invention is not restricted to this.
Due to detection module 130, identity identification module 150, sound identification module 170 and interactive module
190 are only just activated when needing running, therefore intuitive interactive device 100 can be avoided continual to shadow
As or sound input is recognized, therefore can reduce the power consumption of intuitive interactive device 100, hardware into
Sheet and the probability when machine.In addition, even if the sound of the place environment of intuitive interactive device 100 it is noisy and
Cause that there is noise in the first voice signal SUD, sound identification module 170 can be by the first voice signal
Vocal print feature that SUD and user USR is registered carries out sound and compared, you can filtering environmental noise and obtain
User USR voice messaging CHR4, so as to reduce environmental noise to the dry of intuitive interactive device 100
Disturb.
In one embodiment of this invention, intuitive interactive device 100 can be carried out interactive with multidigit user.
Below referring to Fig. 1 and Fig. 2, Fig. 2 is Fig. 1 intuitive interactive device 100 and multidigit user
Carry out interactive situation schematic diagram.As shown in Fig. 2 it is assumed herein that there are three user user USR1, users
USR2, user USR3 (i.e. candidate user) will carry out interaction, therefore body with intuitive interactive device 100
Part identification module 150 can carry out face recognition to obtain user USR1, use to the first signal of video signal IMG
Family USR2, user USR3 face feature.Identity identification module 150 can be according to setting order and at this
Three user user USR1, user USR2, user USR3 face feature in selection one using as
The face feature of interactive user to carry out follow-up processing, and follow-up face recognition, sound compare and
The running of interactive processing refers to above-mentioned Fig. 1 related description, will not be repeated here.
For example, identity identification module 150 can according to this three user user USR1, user USR2,
User USR3 face feature judges this three user user USR1, user USR2, user USR3
The distance between intuitive interactive device 100.It is understood that due to user USR1 near
Intuitive interactive device 100, therefore face's human relations of the user USR1 acquired by identity identification module 150 are wide
Area it is maximum.User USR3 and intuitive interactive device 100 distance are farthest, therefore identity identification
The area that face's human relations of user USR3 acquired by module 150 are wide is minimum.And identity identification module 150
The wide area of acquired user USR2 face human relations be then between user USR1 and user USR3 it
Between.Consequently, it is possible to identity identification module 150 can be according to by closely using to remote distance order in three users
Family USR1, user USR2, user USR3 face feature in selection one to be used as interactive user
Face feature, and carry out the running of follow-up face recognition, sound comparison and interaction.That is,
Intuitive interactive device 100 can be carried out according to user USR1, user USR2, user USR3 order
Handle and reach the effect of multi-person interactive.But the present invention is not limited thereto.
Below referring to Fig. 1 and Fig. 3, Fig. 3 is the interaction of Fig. 1 intuitive interactive device 100
The step schematic flow sheet of method.First, in step s 200, can be by management module 110 at least
One user is registered using as an at least registered user, and the user for storing this at least registered user is special
Levy (including face feature CHR1 and vocal print feature CHR2) and corresponding authority.Then, in step S210
In, image and sound can be obtained by detection module 130, and detect in above-mentioned image whether there is face
Image.If step S210 testing result is no, step S210 is rested on to be continued for face
The detection of image.If step S210 testing result is yes, above-mentioned image is stored with tut to divide
Not Zuo Wei the first signal of video signal IMG and the first voice signal SUD, as shown in step S220.
After step S220, in step S230, identity identification module 150 can be started, pass through body
Part identification module 150 carries out face recognition to obtain interactive user (i.e. user to the first signal of video signal IMG
USR face feature CHR3).Then, in step S235, judged by identity identification module 150
Whether the face feature CHR3 of interactive user (user USR) is provided to management module 110.If step S235
Judged result be no, then return to step S210.If step S235 judged result is yes, perform
Step S240.
, can be by management module 110 by interactive user (user USR) face feature in step S240
CHR3 is compared with the user characteristics (i.e. face feature CHR1) of an at least registered user, mutual to judge
Whether registered employ family (user USR).If (i.e. user USR is not to be no for step S240 judged result
Registration), then return to step S210.If it is (i.e. user USR is registered) that step S240 judged result, which is,
Then start sound identification module 170, by sound identification module 170 by the first voice signal SUD and mutually
Employ the user characteristics (such as vocal print feature CHR2) registered at family (user USR) and carry out sound comparison to take
The voice messaging CHR4 of interactive user (user USR) is obtained, and voice messaging CHR4 is converted into order
CMD, as shown in step S250.
Afterwards, in step S260, can judge to order CMD whether effective by management module 110.
If step S260 judged result is no (i.e. order CMD is invalid), step S210 is returned to.If step
S260 judged result then starts interactive module 190, and pass through to be (i.e. order CMD is effective)
It is correspondingly interactive to be carried out with interactive user (user USR) that interactive module 190 reacts on order CMD, such as
Shown in step S270.
In addition, the step details of the interactive approach on the embodiment of the present invention, earlier figures 1 and Fig. 2's
It has been discussed in detail in embodiment, has seldom repeated below.
In summary, in the intuitive interactive device that the embodiment of the present invention is proposed with method, detecting mould
Block, identity identification module, sound identification module and interactive module are only just activated when needing running,
Therefore intuitive interactive device can be avoided ceaselessly to be recognized to image or sound input, so as to reduce intuition
Change power consumption, hardware cost and the probability when machine of interactive device.Moreover, sound identification module can
The first voice signal is carried out into sound with the vocal print feature that user is registered to compare, therefore decreasing environmental noise function
Interference to intuitive interactive device.In addition, other people can be also avoided by stealing the image and sound of user
And carried out with intuitive interactive device it is interactive, the problem of so as to produce security.Finally, the present invention is implemented
The intuitive interactive device that example is proposed can reach the effect of multi-person interactive with method.
Although the present invention is disclosed as above with embodiment, so it is not limited to the present invention, any affiliated
Those of ordinary skill in technical field, it is without departing from the spirit and scope of the present invention, a little when that can make
Change and retouching, therefore protection scope of the present invention ought be defined depending on appended claims confining spectrum.
Claims (12)
- A kind of 1. intuitive interactive device, it is characterised in that including：Management module, to be registered an at least user to be used as an at least registered user, and storing At least user characteristics of a registered user and corresponding authority；Detection module, whether to obtain image and sound, detecting in the image has an at least face Image, and if testing result is yes, store the image and the sound using as the first image Signal and the first voice signal；Identity identification module, to the quilt after detecting that the image has an at least image of face Start, face recognition is carried out to first signal of video signal to obtain the face feature of interactive user, and sentence The disconnected face feature for whether providing the interactive user is to the management module, wherein the management mould Block is more to after the face feature of the interactive user is obtained, by the face of the interactive user Portion's feature is compared with the user characteristics of an at least registered user, to judge described mutually to employ Whether family is registered；Sound identification module, to be activated after judging the interactive user to be registered, by described in First voice signal carries out sound with the user characteristics that the interactive user is registered and compared to obtain The voice messaging of interactive user is stated, and the voice messaging is converted into order, wherein the management module More to judge it is described order it is whether effective；AndInteractive module, to judge the order to be effectively activated afterwards, and react on the order It is correspondingly interactive to be carried out with the interactive user.
- 2. intuitive interactive device according to claim 1, it is characterised in that the identity identification Module to first signal of video signal more carrying out image analysing computer to judge whether the interactive user moves Mouthful, and if the determination result is YES, there is provided the face feature of the interactive user to the management mould Block.
- 3. intuitive interactive device according to claim 1, it is characterised in that the identity identification Module judges the image background more to retrieve the image background information in first signal of video signal Whether information is consistent with background scene information, and if the determination result is YES, there is provided the interactive user The face feature is to the management module.
- 4. intuitive interactive device according to claim 1, it is characterised in that the management module More to the authority registered according to the interactive user, to judge whether the interactive user has Using the authority of the order, if the determination result is YES, then determine that the order is effective.
- 5. intuitive interactive device according to claim 1, it is characterised in that the identity identification Module is more special to obtain the face of multiple candidate users to carry out face recognition to first signal of video signal Sign, and one is selected in the face feature of the multiple candidate user according to setting order, so that described more The face of the face feature of each in order as the interactive user in individual candidate user is special Sign.
- 6. intuitive interactive device according to claim 5, it is characterised in that the identity identification Module more to the face feature according to the multiple candidate user come judge each the multiple candidate user with The distance between described intuitive interactive device, and according to by closely to remote distance order in the multiple time From selecting one in the face feature at family, so that the face of each in the multiple candidate user is special Levy the face feature as the interactive user in order.
- A kind of 7. interactive approach, for intuitive interactive device, it is characterised in that the interactive approach bag Include：An at least user is registered using as at least by the management module of the intuitive interactive device One registered user, and at least user characteristics of a registered user and corresponding authority described in storage；Image and sound are obtained by the detection module of the intuitive interactive device, detected in the image Whether there is an at least image of face, and if testing result is yes, store the image and the sound Using as the first signal of video signal and the first voice signal；Start the interactive dress of the intuitive after detecting that the image has an at least image of face The identity identification module put, face is carried out to first signal of video signal by the identity identification module and distinguished Know to obtain the face feature of interactive user, and judge whether that the face for providing the interactive user is special Levy to the management module；After the face feature that the management module obtains the interactive user, pass through the management mould Block enters the face feature of the interactive user and the user characteristics of an at least registered user Row compares, to judge whether the interactive user is registered；Start the speech recognition of the intuitive interactive device after judging the interactive user to be registered Module, first voice signal and the interactive user are registered by the sound identification module The user characteristics carries out sound and compared to obtain the voice messaging of the interactive user, and by the voice Information is converted to order；Judge whether the order is effective by the management module；AndThe order is being judged effectively afterwards to start the interactive module of the intuitive interactive device, and It is correspondingly interactive to be carried out with the interactive user that the order is reacted on by the interactive module.
- 8. interactive approach according to claim 7, it is characterised in that pass through the identity identification mould Block judges whether that the face feature to the step of management module for providing the interactive user includes：It is described mutual to judge that image analysing computer is carried out to first signal of video signal by the identity identification module Employ whether family opens one's mouth, and if the determination result is YES, there is provided the face feature of the interactive user To the management module.
- 9. interactive approach according to claim 7, it is characterised in that pass through the identity identification mould Block judges whether that the face feature to the step of management module for providing the interactive user includes：Image background information in first signal of video signal is retrieved by the identity identification module, and sentenced Whether the image background information of breaking is consistent with background scene information, and if the determination result is YES, there is provided The face feature of the interactive user is to the management module.
- 10. interactive approach according to claim 7, it is characterised in that sentenced by the management module Whether effective step includes for the disconnected order：The authority registered by the management module according to the interactive user, it is described mutual to judge Employ whether family has the authority for using the order, if the determination result is YES, then determine that the order is Effectively.
- 11. interactive approach according to claim 7, it is characterised in that pass through the identity identification mould Block carries out face recognition to obtain the face feature of the interactive user to first signal of video signal Step includes：Face recognition is carried out to obtain multiple times to first signal of video signal by the identity identification module Selected from the face feature at family, and according to setting order in the face feature of the multiple candidate user One, so that the face feature of each in the multiple candidate user is mutually employed as described in order The face feature at family.
- 12. interactive approach according to claim 11, it is characterised in that according to setting order One is selected in the face feature of the multiple candidate user, so that every in the multiple candidate user The face feature of one in order the face feature as the interactive user the step of include：Judged by the identity identification module according to the face feature of the multiple candidate user it is each described in The distance between multiple candidate users and the intuitive interactive device, and according to by suitable closely to remote distance Sequence selects one in the face feature of the multiple candidate user, so that in the multiple candidate user The face feature of each face feature as the interactive user in order.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610307570.4A CN107368720A (en) | 2016-05-11 | 2016-05-11 | Intuitive interactive device and its interactive approach |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610307570.4A CN107368720A (en) | 2016-05-11 | 2016-05-11 | Intuitive interactive device and its interactive approach |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107368720A true CN107368720A (en) | 2017-11-21 |
Family
ID=60303640
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610307570.4A Pending CN107368720A (en) | 2016-05-11 | 2016-05-11 | Intuitive interactive device and its interactive approach |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107368720A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110009639A (en) * | 2018-08-02 | 2019-07-12 | 永康市柴迪贸易有限公司 | Books automatic push platform |
| US11158314B2 (en) | 2018-06-04 | 2021-10-26 | Pegatron Corporation | Voice control device and method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101472066A (en) * | 2007-12-27 | 2009-07-01 | 华晶科技股份有限公司 | Near-end control method of image viewfinding device and image viewfinding device applying the method |
| CN104298909A (en) * | 2013-07-19 | 2015-01-21 | 富泰华工业（深圳）有限公司 | Electronic device and identity verifying system and method |
| CN105425970A (en) * | 2015-12-29 | 2016-03-23 | 深圳羚羊微服机器人科技有限公司 | Human-machine interaction method and device, and robot |
-
2016
- 2016-05-11 CN CN201610307570.4A patent/CN107368720A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101472066A (en) * | 2007-12-27 | 2009-07-01 | 华晶科技股份有限公司 | Near-end control method of image viewfinding device and image viewfinding device applying the method |
| CN104298909A (en) * | 2013-07-19 | 2015-01-21 | 富泰华工业（深圳）有限公司 | Electronic device and identity verifying system and method |
| CN105425970A (en) * | 2015-12-29 | 2016-03-23 | 深圳羚羊微服机器人科技有限公司 | Human-machine interaction method and device, and robot |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11158314B2 (en) | 2018-06-04 | 2021-10-26 | Pegatron Corporation | Voice control device and method |
| CN110009639A (en) * | 2018-08-02 | 2019-07-12 | 永康市柴迪贸易有限公司 | Books automatic push platform |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9659212B2 (en) | Methods, systems, and products for gesture-activation | |
| CN104503691B (en) | Apparatus control method, device and intelligent terminal | |
| CN103632165B (en) | A kind of method of image procossing, device and terminal device | |
| CN110009052A (en) | A kind of method of image recognition, the method and device of image recognition model training | |
| WO2019210796A1 (en) | Speech recognition method and apparatus, storage medium, and electronic device | |
| CN109903773B (en) | Audio processing method, device and storage medium | |
| CN108352168A (en) | The low-resource key phrase detection waken up for voice | |
| CN108604447A (en) | Information processing unit, information processing method and program | |
| CN107085488A (en) | The quick application method and device of a kind of application program common function | |
| CN109997185A (en) | Method and apparatus for the biometric authentication in electronic equipment | |
| CN104966086B (en) | Live body discrimination method and device | |
| CN108682414A (en) | Sound control method, voice system, equipment and storage medium | |
| CN110544468B (en) | Application awakening method and device, storage medium and electronic equipment | |
| CN105429969A (en) | User identity verification method and equipment | |
| CN108877793B (en) | Application control method and device, storage medium and electronic equipment | |
| CN108469772A (en) | A kind of control method and device of smart machine | |
| CN109446961A (en) | Pose detection method, device, equipment and storage medium | |
| CN109644218A (en) | The method, apparatus and manufacture in the orientation of display are controlled using biometric sensor | |
| CN101673329A (en) | Establishment method of biometric data, electronic device and computer program product thereof | |
| CN107368720A (en) | Intuitive interactive device and its interactive approach | |
| CN109727342A (en) | Recognition methods, device, access control system and the storage medium of access control system | |
| CN108762712B (en) | Electronic device control method, electronic device control device, storage medium and electronic device | |
| CN116566760B (en) | Smart home equipment control method and device, storage medium and electronic equipment | |
| CN105391873A (en) | Method for realizing local voice recognition in mobile device | |
| WO2020119810A1 (en) | Electronic device control system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20171121 |
|
| WD01 | Invention patent application deemed withdrawn after publication |