CN105425970A - Human-machine interaction method and device, and robot - Google Patents
Human-machine interaction method and device, and robot Download PDFInfo
- Publication number
- CN105425970A CN105425970A CN201511016826.8A CN201511016826A CN105425970A CN 105425970 A CN105425970 A CN 105425970A CN 201511016826 A CN201511016826 A CN 201511016826A CN 105425970 A CN105425970 A CN 105425970A
- Authority
- CN
- China
- Prior art keywords
- user
- interaction
- identity
- multimedia messages
- human
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/60—Information retrieval; Database structures therefor; File system structures therefor of audio data
- G06F16/68—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/686—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title or artist information, time, location or usage information, user ratings
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Library & Information Science (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention provides a human-machine interaction method and device, and a robot. The human-machine interaction method comprises the following steps: collecting multimedia information of a user, wherein the multimedia information comprises user image information and/or user voice information; determining the identity of the user and an interactive mode according to multimedia information stored in a preset database and the collected multimedia information, wherein the interactive mode comprises a voice interaction mode and/or an action interaction mode; obtaining an interactive content corresponding to the identity of the user to realize interaction with the user according to the determined interactive mode. According to the method provided by the embodiment of the invention, the interactive content corresponding to the identified identity of the user is obtained for interaction with the user, so that the diversity of human-computer interaction is realized, and the targeted man-machine interaction mode is realized.
Description
Technical field
The present invention relates to robotics, in particular to a kind of method of human-computer interaction, device and robot.
Background technology
Along with the development of the develop rapidly of infotech, particularly internet, deepening continuously of data message.Increasing affairs, can be come by intelligent robot, current intelligent robot plays various rolls in daily life, therefore, Intelligent Service class robot must become main flow in the future, be used for replacing manual service, thus for company, utilizing intelligent robot to play the part of foreground role also will be following development trend.
At present, in correlation technique, provide various types of robot, such as: guest-meeting robot is mainly when having identified guests through out-of-date, and guest-meeting robot can initiatively be greeted, and " you are good! You is welcome to come ", when having identified guests and having left, guest-meeting robot can have been said " you are good, welcome presence next time ", and the Method compare of greeting is single; And for example: humanoid robot of accompanying and attending to mainly performs corresponding action according to the language message of user, as " held up me to get up when user said before getting up! ", humanoid robot of accompanying and attending to will with the hands be propped up people from the bed to come, and help old man to sit on wheelchair to get on.
But realizing in process of the present invention, inventor finds at least there is following problem in correlation technique: current most of robot mainly realizes saying hello or guiding function, and its function ratio is more single, and degree of intelligence is not high.
Summary of the invention
In view of this, the object of the embodiment of the present invention is to provide a kind of method of human-computer interaction, device and robot, to solve the problem.
First aspect, embodiments provides a kind of method of human-computer interaction, comprising:
Gather the multimedia messages of user, wherein, described multimedia messages comprises: user images information and/or user speech information;
Identity and the interactive mode of described user is determined according to the multimedia messages stored in the database preset and the described multimedia messages collected; Wherein, described interactive mode comprises: interactive voice and/or action mutual;
The interaction content corresponding with the identity of described user is transferred and described user carries out interaction according to the interactive mode determined.
In conjunction with first aspect, embodiments provide the first possible embodiment of first aspect, wherein, the multimedia messages of above-mentioned collection user comprises:
When monitoring user and entering in image acquisition region, automatically gather the multimedia messages of described user;
Or, when monitoring user's triggering collection option, gather the multimedia messages of described user.
In conjunction with first aspect, embodiments provide the embodiment that the second of first aspect is possible, wherein, the multimedia messages of above-mentioned collection user comprises: when having identified telephone bell, automatic call answering, and gathers the voice messaging of user in call;
The multimedia messages stored in the database that described basis is preset and the described multimedia messages collected determine that the identity of described user and interactive mode comprise: according to the voice messaging identification voice keyword of user in the described call collected; Voice recognition information according to storing in described voice keyword and default database determines that the identity of described user and current interactive mode are that action is mutual, wherein, described voice keyword comprises personnel's name that the name of described user and/or described user need to connect electricity;
The described interactive mode according to determining is transferred the interaction content corresponding with the identity of described user and described user and is carried out interaction and comprise: transfer the call forwarding number corresponding with the identity of described user, described call is forwarded to terminal corresponding to described call forwarding number.
In conjunction with in first aspect to the possible embodiment of the second of first aspect arbitrary middle may, embodiments provide the third possible embodiment of first aspect, wherein, the above-mentioned interactive mode according to determining is transferred the interaction content corresponding with the identity of described user and described user and is carried out interaction and comprise:
According to the language form corresponding to the voice messaging identification voice of user, transfer the interaction content corresponding with the identity of described user according to the interactive mode determined and the language form that identifies and described user carries out interaction.
In conjunction with first aspect, embodiments provide the 4th kind of possible embodiment of first aspect, wherein, the method for above-mentioned human-computer interaction also comprises: when having identified doorbell sound, starts automatically-controlled door and opens.
In conjunction with first aspect, embodiments provide the 5th kind of possible embodiment of first aspect, wherein, the above-mentioned interactive mode according to determining is transferred the interaction content corresponding with the identity of described user and described user and is carried out interaction and comprise:
From the database preset, the interaction content corresponding with the identity of described user is searched according to the interactive mode determined, wherein, be previously stored with in described database following in one or more: the visiting information of client and the interaction content of correspondence, the pre-prompting information of employee and the hint instructions of correspondence, the identity of the stranger identified and the image information of correspondence;
Transfer the described interaction content found, and carry out interaction with described user.
In conjunction with first aspect, embodiments provide the 6th kind of possible embodiment of first aspect, wherein, the method for above-mentioned human-computer interaction also comprises:
When gathering the multimedia messages of patrolling and examining in process, unusual condition judgement is carried out to the described multimedia messages collected;
When identifying described multimedia messages for burst or abnormal conditions, report to the police, wherein, described warning at least comprises one of following: field speech or light warning, sends a telegraph client service center or related personnel reports to the police.
Second aspect, the embodiment of the present invention additionally provides a kind of square law device of human-computer interaction, and this device comprises:
Information acquisition module, for gathering the multimedia messages of user, wherein, described multimedia messages comprises: user images information and/or user speech information;
Identity and mutual determination module, for determining identity and the interactive mode of described user according to the multimedia messages stored in the database preset and the described multimedia messages collected; Wherein, described interactive mode comprises: interactive voice and/or action mutual;
Interaction content transfers module, for transferring the interaction content corresponding with the identity of described user according to the interactive mode determined and described user carries out interaction.
In conjunction with second aspect, embodiments provide the first possible embodiment of second aspect, wherein, above-mentioned information acquisition module comprises:
First collecting unit, for when monitoring user and entering in image acquisition region, gathers the multimedia messages of described user automatically; Or,
Second collecting unit, for when monitoring user's triggering collection option, gathers the multimedia messages of described user.
In conjunction with second aspect, embodiments provide the embodiment that the second of second aspect is possible, wherein, above-mentioned information acquisition module comprises:
Call voice collecting unit, for when having identified telephone bell, automatic call answering, and the voice messaging gathering user in call;
Described identity and mutual determination module comprise:
Keyword recognition unit, for the voice messaging identification voice keyword according to user in the described call collected;
The identity determination unit of user, for determining that the identity of described user and current interactive mode are that action is mutual according to the voice recognition information stored in described voice keyword and default database, wherein, described voice keyword comprises personnel's name that the name of described user and/or described user need to connect electricity;
Described interaction content is transferred module and is comprised:
Switching number transfers unit, for transferring the call forwarding number corresponding with the identity of described user, described call is forwarded to terminal corresponding to described call forwarding number.
In conjunction with in second aspect to the possible embodiment of the second of second aspect arbitrary middle may, embodiments provide the third possible embodiment of second aspect, wherein, above-mentioned interaction content is transferred module and is comprised:
Language form recognition unit, for the language form corresponding to the voice messaging identification voice of user;
First interaction content transfers unit, for transferring the interaction content corresponding with the identity of described user according to the interactive mode determined and the language form that identifies and described user carries out interaction.
In conjunction with second aspect, embodiments provide the 4th kind of possible embodiment of second aspect, wherein, the device of above-mentioned human-computer interaction also comprises:
Automatically-controlled door starts module, for when having identified doorbell sound, having started automatically-controlled door and opening.
In conjunction with second aspect, embodiments provide the 5th kind of possible embodiment of second aspect, wherein, above-mentioned interaction content is transferred module and is comprised:
Interaction content searches unit, for searching the interaction content corresponding with the identity of described user according to the interactive mode determined from the database preset, wherein, be previously stored with in described database following in one or more: the visiting information of client and the interaction content of correspondence, the pre-prompting information of employee and the hint instructions of correspondence, the identity of the stranger identified and the image information of correspondence;
Second interaction content transfers unit, for transferring the described interaction content found, and carries out interaction with described user.
In conjunction with second aspect, embodiments provide the 6th kind of possible embodiment of second aspect, wherein, the device of above-mentioned human-computer interaction also comprises:
Unusual condition judge module, during for gathering the multimedia messages in the process of patrolling and examining, carries out unusual condition judgement to the described multimedia messages collected;
Alarm module, for when identifying described multimedia messages for burst or abnormal conditions, reports to the police, and wherein, described warning at least comprises one of following: field speech or light warning, sends a telegraph client service center or related personnel reports to the police.
The third aspect, the embodiment of the present invention additionally provides a kind of robot, and this robot comprises: the device of above-mentioned human-computer interaction.
In the method for the human-computer interaction provided in the embodiment of the present invention and device, first, gather the multimedia messages of user, wherein, multimedia messages comprises: user images information and/or user speech information; Then, identity and the interactive mode of user is determined according to the multimedia messages stored in the database preset and the multimedia messages collected; Wherein, interactive mode comprises: interactive voice and/or action mutual; Finally, the interaction content corresponding with the identity of user is transferred and user carries out interaction according to the interactive mode determined, by transferring according to the user identity identified the interaction content matched with it, and then carry out interaction with user, achieve the diversity of human-computer interaction, and achieve the mode of carrying out human-computer interaction targetedly.
For making above-mentioned purpose of the present invention, feature and advantage become apparent, preferred embodiment cited below particularly, and coordinate appended accompanying drawing, be described in detail below.
Accompanying drawing explanation
In order to be illustrated more clearly in the technical scheme of the embodiment of the present invention, be briefly described to the accompanying drawing used required in embodiment below, be to be understood that, the following drawings illustrate only some embodiment of the present invention, therefore the restriction to scope should be counted as, for those of ordinary skill in the art, under the prerequisite not paying creative work, other relevant accompanying drawings can also be obtained according to these accompanying drawings.
Fig. 1 shows the process flow diagram of the man-machine interaction method that the embodiment of the present invention provides;
Fig. 2 shows the process flow diagram of the another kind of man-machine interaction method that the embodiment of the present invention provides;
Fig. 3 shows the structural representation of a kind of human-computer interaction device that the embodiment of the present invention provides;
Fig. 4 shows the structural representation of the another kind of human-computer interaction device that the embodiment of the present invention provides;
Fig. 5 shows the structural representation of another human-computer interaction device that the embodiment of the present invention provides.
Embodiment
For making the object of the embodiment of the present invention, technical scheme and advantage clearly, below in conjunction with accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.The assembly of the embodiment of the present invention describing and illustrate in usual accompanying drawing herein can be arranged with various different configuration and design.Therefore, below to the detailed description of the embodiments of the invention provided in the accompanying drawings and the claimed scope of the present invention of not intended to be limiting, but selected embodiment of the present invention is only represented.Based on embodiments of the invention, the every other embodiment that those skilled in the art obtain under the prerequisite not making creative work, all belongs to the scope of protection of the invention.
Consider that current most of robot mainly realizes saying hello or guiding function, its function ratio is more single, and degree of intelligence is not high, thus causes human-computer interaction poor effect.Based on this, embodiments provide a kind of method of human-computer interaction, device and robot, be described below by embodiment.
As shown in Figure 1, embodiments provide a kind of method of human-computer interaction, the method comprising the steps of S102-S106, specific as follows:
Step S102: the multimedia messages gathering user, wherein, above-mentioned multimedia messages can be user images information, also can be user speech information, can also be that user images information and user speech information gather simultaneously;
Wherein, the multimedia messages of user can be gathered in the following way, be specially:
Mode monitors the multimedia messages that active acquisition enters the user of image acquisition areas in real time, namely when monitoring user and entering in image acquisition region, automatically gathers the multimedia messages of above-mentioned user;
Another kind of mode is the multimedia messages that passive collection enters the user of image acquisition areas, namely when monitoring user's triggering collection option, gather the multimedia messages of above-mentioned user, as detected user press gather button or point touching screen upper check box time, start to perform and gather action.
Step S104: identity and the interactive mode of determining above-mentioned user according to the multimedia messages stored in the database preset and the above-mentioned multimedia messages collected; Wherein, above-mentioned interactive mode comprises: interactive voice and/or action mutual;
Concrete, the image information stored in the user images information collected in step S102 and the database preset is compared, and then judges the identity of user; Simultaneously, according to the user speech information identification keyword collected, according to the keyword determination interactive mode recognized, as when identifying user and being visiting guest and needing to look for company XXX employee, now interactive mode is the mutual and interactive voice of action, then transfer corresponding interaction content by following step S106 and carry out interaction: first saying hello in the mode taken in guests, then this user is guided on the station of arrival company XXX employee.
Step S106: transfer the interaction content corresponding with the identity of above-mentioned user according to the interactive mode determined and above-mentioned user carries out interaction.
After the identity determining user by step S104 and interactive mode, perform step S106 transfer corresponding interaction content according to the identity of user and interactive mode and carry out interaction, namely according to identity and the interactive mode determined of the user identified, in the database preset, transfer the interaction content corresponding with this user identity exchange, as: if judge, user is company personnel, then carry out saying hello " good morning for XXX/and Good noon "; If unidentified go out identity, then can think that it is visiting guest, then carry out saying hello " welcome XXX company, may I ask you have anything to want help "; Then, voice messaging according to user identifies keyword, and relevant answer is retrieved from the database preset, carry out with user exchanging, interactive, in addition, when not retrieving the answer of coupling, client service center will be gone to, continue as the personnel service in visiting guest's service or phone by manual service, realize aspectant interchange, interaction by the mode of video calling simultaneously.
In the method for the human-computer interaction provided in the embodiment of the present invention, first, gather the multimedia messages of user, wherein, multimedia messages comprises: user images information and/or user speech information, then, identity and the interactive mode of user is determined according to the multimedia messages stored in the database preset and the multimedia messages collected, wherein, interactive mode comprises: interactive voice and/or action mutual, finally, the interaction content corresponding with the identity of user is transferred and user carries out interaction according to the interactive mode determined, identity in embodiments of the present invention by utilizing face recognition technology to identify user, and the interaction content matched with it is transferred according to the user identity identified, simultaneously by utilizing voiced keyword recognition technology to identify key word, and according to keyword and user identity determination interaction content, and then carry out interaction with user, achieve the diversity of human-computer interaction, improve the dirigibility of human-computer interaction, and transfer different interaction contents for different users, achieve the mode of carrying out human-computer interaction targetedly.
Further, consider that work hours or quitting time may have guest to throw the phone of company at any time, based on this, the another kind of process flow diagram of man-machine interaction method as shown in Figure 2, specific as follows:
Step S202: when having identified telephone bell, automatic call answering, and the voice messaging gathering user in call;
Step S204: according to the voice messaging identification voice keyword of user in the above-mentioned call collected;
Step S206: the voice recognition information according to storing in above-mentioned voice keyword and default database determines that the identity of above-mentioned user and current interactive mode are that action is mutual, wherein, above-mentioned voice keyword comprises personnel's name that the name of above-mentioned user and/or above-mentioned user need to connect electricity;
Step S208: transfer the call forwarding number corresponding with the identity of above-mentioned user, is forwarded to terminal corresponding to above-mentioned call forwarding number by above-mentioned call.
Wherein, the above-mentioned call forwarding number corresponding with the identity of user can comprise called cell-phone number, also extension number can be comprised, client service center's number can also be comprised, if the identity of above-mentioned user opens XX for needs associated company employee, then will open XX phone as call forwarding number, if do not inquire company personnel in presetting database to open XX phone, then transfer client service center's number as call forwarding number.
In addition, the process of receiving calls can also carry out interaction with user in call, directly answers the counseling problem of user, concrete, when having identified phone, can automatic call answering, and go out keyword according to the speech recognition of user in call, then from the database preset, relevant answer is retrieved, carry out exchanging with user in call, interactive, in addition, when not retrieving the answer of coupling, to client service center be gone to, continue as personnel service in phone by manual service.
In embodiments of the present invention, by arranging the function of automatic call answering, and in conjunction with voiced keyword recognition technology, namely the interaction content corresponding with user identity can be exported, on the call forwarding number that can automatically user in call forwarding to call be needed again, furthermore achieved that the diversity of human-computer interaction, improve the dirigibility of human-computer interaction.
Further, owing to considering that the language form of the user collected may have multiple, in order to better improve user experience, based on this, transferring the interaction content corresponding with the identity of above-mentioned user and above-mentioned user according to the interactive mode determined and carrying out interaction and comprise:
According to the language form corresponding to the voice messaging identification voice of user, transfer the interaction content corresponding with the identity of above-mentioned user according to the interactive mode determined and the language form that identifies and above-mentioned user carries out interaction.
Wherein, also can be the macroscopic features of the image information identification user according to user, the interaction content corresponding with the identity of above-mentioned user is transferred and above-mentioned user carries out interaction according to the language form corresponding to the interactive mode determined and the macroscopic features that identifies, above two kinds of modes can both determine language form, if and adopt this two kinds of modes simultaneously, the language form determined then can be made more accurate, no matter the language form corresponding to the voice messaging identification voice of user, or according to the macroscopic features of the image information identification user of user, again according to macroscopic features determination language form, above-mentioned two kinds of multimedia messages determination language forms according to user, to realize the mode of multi-language environment interchange all in protection scope of the present invention.
In embodiments of the present invention, identify the language form corresponding to voice according to the language message of the user collected or identify the macroscopic features of user according to the image information of the user collected, again according to macroscopic features determination language form, adopt corresponding language form and visiting guest to carry out exchanging, interactive, by adopting the exchange way of multi-language environment, the dirigibility of further increase human-computer interaction, improves the Experience Degree of visiting guest.
Further, said method also comprises: when having identified doorbell sound, starts automatically-controlled door and opens.
In embodiments of the present invention, can realize automatically opening automatically-controlled door, specifically comprise: when having identified doorbell sound, automatically open automatically-controlled door and the image information of the user collected is carried out record and and adopt interaction mode targetedly, be convenient to real-time monitoring and follow-up tracking.
In order to increase the dirigibility of human-computer interaction further, the above-mentioned interactive mode according to determining is transferred the interaction content corresponding with the identity of above-mentioned user and above-mentioned user and is carried out interaction and comprise:
From the database preset, the interaction content corresponding with the identity of above-mentioned user is searched according to the interactive mode determined, wherein, be previously stored with in above-mentioned database following in one or more: the visiting information of client and the interaction content of correspondence, the pre-prompting information of employee and the hint instructions of correspondence, the identity of the stranger identified and the image information of correspondence;
Transfer the above-mentioned interaction content found, and carry out interaction with above-mentioned user.
Concrete, the information of visiting client and the interaction content of correspondence can be prestored in the database preset, such as: when certain leader may be had in the recent period to inspect, then can add the identification data (facial image and/or acoustic information) of this leader temporarily, and add corresponding identification mode (recognition of face/or voice recognition) in robot, and add corresponding human-computer interaction mode (as and the welcome mode that arranges specially); If judge, user is the expert/professor of the present guidance prestored, then carry out saying hello " warm welcome XXX expert/professor come the guiding work of XXX company "; Thus, some special interaction modes can be carried out by control, increase dirigibility and the practicality of human-computer interaction further;
The pre-prompting information of employee and the hint instructions of correspondence can also be prestored in the database preset, such as, for interior employee, interactive service needed for oneself can be set in robot, after identifying the identity of this employee, some corresponding interaction modes can be provided for the employee of this identity, as interior employee had a meeting second day needs XX time, then meeting reminding service can be set in robot in advance, robot saves after this arranges, after can identifying this employee at second day, perform the human-computer interaction operation for reminding of setting; Whether and for example, prompting operation can also be remind whether to be with work board, or be late according to current time prompting, by identification and setting human-computer interaction mode being combined, can strengthen dirigibility and the practicality of man-machine interaction further;
Also can in the database preset the identity of stranger that identified of real-time storage and the image information of correspondence, specifically comprise: image record is carried out to the personnel entering company first and preserves its identity, these personnel enter company again can automatically identify its identity, according to the identity determination output AC statement of the described personnel stored, and carry out the interchange corresponding with this personnel identity, interaction, such as: exchanged by first time and identify personnel identity for courier, this courier's second time is come company and initiatively said hello by the mode of saying hello with courier.
In embodiments of the present invention, by pre-setting the interaction content of user profile and correspondence in the database preset, adopting this mode that human-computer interaction is set flexibly, increasing face identity memory function simultaneously, further increase the dirigibility of human-computer interaction, improve the Experience Degree of user.
In addition, said method also comprises: when gathering the multimedia messages of patrolling and examining in process, carry out unusual condition judgement to the above-mentioned multimedia messages collected;
When identifying above-mentioned multimedia messages for burst or abnormal conditions, report to the police, wherein, above-mentioned warning at least comprises one of following: field speech or light warning, sends a telegraph client service center or related personnel reports to the police.
Concrete, when identifying existence burst or abnormal conditions, report to the police by alarm module, wherein type of alarm can be field speech alarm, also can report to the police by light flash, can also be transferred to client service center, or be transferred on default mobile phone, thus monitored in real time by the shooting harvester in robot, achieve 24 hours to monitor round the clock, can triggering alarm system in time as there being people to swarm into outside the work hours, can push on company's foreground system and APP, timely notice mansion property security personnel, avoid company's property and suffer a loss; Meanwhile, by supervising data storage on Cloud Server, this Cloud Server carries out communication by wireless communication mode and client, and the user in relative client can obtain required information from Cloud Server at any time.
In sum, in the method for the human-computer interaction provided in the embodiment of the present invention, first, gather the multimedia messages of user, wherein, this multimedia messages comprises: user images information and/or user speech information, then, identity and the interactive mode of user is determined according to the multimedia messages stored in the database preset and the multimedia messages collected, wherein, this interactive mode comprises: interactive voice and/or action mutual, finally, the interaction content corresponding with the identity of user is transferred and user carries out interaction according to the interactive mode determined, the identity of the embodiment of the present invention by utilizing face recognition technology to identify user, and the interaction content matched with it is transferred according to the user identity identified, simultaneously by utilizing voiced keyword recognition technology to identify key word, and according to keyword and user identity determination interaction content, and then carry out interaction with user, achieve the diversity of human-computer interaction, improve the dirigibility of human-computer interaction, and transfer different interaction contents for different users, achieve the mode of carrying out human-computer interaction targetedly, further, by arranging the function of automatic call answering, and in conjunction with voiced keyword recognition technology, namely the interaction content corresponding with user identity can be exported, on the call forwarding number that can automatically user in call forwarding to call be needed again, furthermore achieved that the diversity of human-computer interaction, improve the dirigibility of human-computer interaction, further again, identify the language form corresponding to voice according to the language message of the user collected or identify the macroscopic features of user according to the image information of the user collected, again according to macroscopic features determination language form, adopt corresponding language form and visiting guest to carry out exchanging, interactive, by adopting the exchange way of multi-language environment, the dirigibility of further increase human-computer interaction, improves the Experience Degree of visiting guest, further, by pre-setting the interaction content of user profile and correspondence in the database preset, adopting this mode that human-computer interaction is set flexibly, increasing face identity memory function simultaneously, further increase the dirigibility of human-computer interaction, improve the Experience Degree of user.
As shown in Figure 3, embodiments provide a kind of device of human-computer interaction, this device comprises:
Information acquisition module 402, for gathering the multimedia messages of user, wherein, above-mentioned multimedia messages comprises: user images information and/or user speech information;
Identity and mutual determination module 404, for determining identity and the interactive mode of above-mentioned user according to the multimedia messages stored in the database preset and the above-mentioned multimedia messages collected; Wherein, above-mentioned interactive mode comprises: interactive voice and/or action mutual;
Interaction content transfers module 406, for transferring the interaction content corresponding with the identity of above-mentioned user according to the interactive mode determined and above-mentioned user carries out interaction.
Further, above-mentioned information acquisition module 402 comprises:
First collecting unit, for when monitoring user and entering in image acquisition region, gathers the multimedia messages of above-mentioned user automatically; Or,
Second collecting unit, for when monitoring user's triggering collection option, gathers the multimedia messages of above-mentioned user.
Further, as shown in Figure 4, above-mentioned information acquisition module 402 comprises:
Call voice collecting unit 4021, for when having identified telephone bell, automatic call answering, and the voice messaging gathering user in call;
Above-mentioned identity and mutual determination module 404 comprise:
Keyword recognition unit 4041, for the voice messaging identification voice keyword according to user in the above-mentioned call collected;
The identity determination unit 4042 of user, for determining that the identity of above-mentioned user and current interactive mode are that action is mutual according to the voice recognition information stored in above-mentioned voice keyword and default database, wherein, above-mentioned voice keyword comprises personnel's name that the name of above-mentioned user and/or above-mentioned user need to connect electricity;
Above-mentioned interaction content is transferred module 406 and is comprised:
Switching number transfers unit 4061, for transferring the call forwarding number corresponding with the identity of above-mentioned user, above-mentioned call is forwarded to terminal corresponding to above-mentioned call forwarding number.
Further, as shown in Figure 5, above-mentioned interaction content is transferred module 406 and is comprised:
Language form recognition unit 4062, for the language form corresponding to the voice messaging identification voice of user;
First interaction content transfers unit 4063, for transferring the interaction content corresponding with the identity of above-mentioned user according to the interactive mode determined and the language form that identifies and above-mentioned user carries out interaction.
Further, above-mentioned human-computer interaction device also comprises:
Automatically-controlled door starts module, for when having identified doorbell sound, having started automatically-controlled door and opening.
Further, above-mentioned interaction content is transferred module 406 and is comprised:
Interaction content searches unit, for searching the interaction content corresponding with the identity of above-mentioned user according to the interactive mode determined from the database preset, wherein, be previously stored with in above-mentioned database following in one or more: the visiting information of client and the interaction content of correspondence, the pre-prompting information of employee and the hint instructions of correspondence, the identity of the stranger identified and the image information of correspondence;
Second interaction content transfers unit, for transferring the above-mentioned interaction content found, and carries out interaction with above-mentioned user.
Further, above-mentioned human-computer interaction device also comprises:
Unusual condition judge module, during for gathering the multimedia messages in the process of patrolling and examining, carries out unusual condition judgement to the above-mentioned multimedia messages collected;
Alarm module, for when identifying above-mentioned multimedia messages for burst or abnormal conditions, reports to the police, and wherein, above-mentioned warning at least comprises one of following: field speech or light warning, sends a telegraph client service center or related personnel reports to the police.
Also provide a kind of robot in the embodiment of the present invention, this robot comprises: the device of above-mentioned human-computer interaction.
Owing to considering that current most of robot mainly realizes saying hello or guiding function, its function ratio is more single, and degree of intelligence is not high, insufficiency of function achieved by existing robot is to meet the demand of foreground supervision, the related work that foreground personnel complete foreground cannot be substituted, face identification functions is embedded in the robot that the embodiment of the present invention provides, by gathering the image information entering the personnel of company, then compare with the image information prestored in a database, and then judge the identity of these personnel, default exchange way is used to exchange, embed voiced keyword recognition function simultaneously, by gathering the voice messaging entering the personnel of company, then key word is identified, interaction content is transferred according to key word and personnel identity, the robot that the embodiment of the present invention provides can be used for alternative foreground personnel and exchange accurately with visiting guest, interactive, can better meet the actual demand being applied to foreground robot, the scene that other require human-computer interaction diversity, dirigibility can also be applied.
Further, punch card system can also be embedded in above-mentioned robot, and automatically generate attendance record, specifically comprise: by identifying turnover personnel image, company's time passes in and out to employee and carries out record, and generating attendance record list, this record entry comprises date, work hours, quitting time, and the work hours, company of coming in and going out also can carry out record.
Further, predetermined module can also be embedded in above-mentioned robot: as predetermined in meeting room etc.
Further, can also sound source positioning function be embedded in above-mentioned robot, can adjust in time according to sound source position and turn to, all the time just to face.
Known based on above-mentioned analysis, compared with the robot in correlation technique, first the device of the human-computer interaction provided in the embodiment of the present invention and robot, gather the multimedia messages of user, wherein, this multimedia messages comprises: user images information and/or user speech information, then, identity and the interactive mode of user is determined according to the multimedia messages stored in the database preset and the multimedia messages collected, wherein, this interactive mode comprises: interactive voice and/or action mutual, finally, the interaction content corresponding with the identity of user is transferred and user carries out interaction according to the interactive mode determined, the identity of the embodiment of the present invention by utilizing face recognition technology to identify user, and the interaction content matched with it is transferred according to the user identity identified, simultaneously by utilizing voiced keyword recognition technology to identify key word, and according to keyword and user identity determination interaction content, and then carry out interaction with user, achieve the diversity of human-computer interaction, improve the dirigibility of human-computer interaction, and transfer different interaction contents for different users, achieve the mode of carrying out human-computer interaction targetedly, further, by arranging the function of automatic call answering, and in conjunction with voiced keyword recognition technology, namely the interaction content corresponding with user identity can be exported, on the call forwarding number that can automatically user in call forwarding to call be needed again, furthermore achieved that the diversity of human-computer interaction, improve the dirigibility of human-computer interaction, further again, identify the language form corresponding to voice according to the language message of the user collected or identify the macroscopic features of user according to the image information of the user collected, again according to macroscopic features determination language form, adopt corresponding language form and visiting guest to carry out exchanging, interactive, by adopting the exchange way of multi-language environment, the dirigibility of further increase human-computer interaction, improves the Experience Degree of visiting guest, further, by pre-setting the interaction content of user profile and correspondence in the database preset, adopting this mode that human-computer interaction is set flexibly, increasing face identity memory function simultaneously, further increase the dirigibility of human-computer interaction, improve the Experience Degree of user.
The device of the human-computer interaction that the embodiment of the present invention provides can be the specific hardware on equipment or the software be installed on equipment or firmware etc.The device that the embodiment of the present invention provides, its technique effect realizing principle and generation is identical with preceding method embodiment, is concise and to the point description, and the not mentioned part of device embodiment part can with reference to corresponding contents in preceding method embodiment.Those skilled in the art can be well understood to, and for convenience and simplicity of description, the specific works process of the system of aforementioned description, device and unit, all with reference to the corresponding process in said method embodiment, can not repeat them here.
In embodiment provided by the present invention, should be understood that disclosed apparatus and method can realize by another way.Device embodiment described above is only schematic, such as, the division of described unit, be only a kind of logic function to divide, actual can have other dividing mode when realizing, again such as, multiple unit or assembly can in conjunction with or another system can be integrated into, or some features can be ignored, or do not perform.Another point, shown or discussed coupling each other or direct-coupling or communication connection can be by some communication interfaces, and the indirect coupling of device or unit or communication connection can be electrical, machinery or other form.
The described unit illustrated as separating component or can may not be and physically separates, and the parts as unit display can be or may not be physical location, namely can be positioned at a place, or also can be distributed in multiple network element.Some or all of unit wherein can be selected according to the actual needs to realize the object of the present embodiment scheme.
In addition, each functional unit in embodiment provided by the invention can be integrated in a processing unit, also can be that the independent physics of unit exists, also can two or more unit in a unit integrated.
If described function using the form of SFU software functional unit realize and as independently production marketing or use time, can be stored in a computer read/write memory medium.Based on such understanding, the part of the part that technical scheme of the present invention contributes to prior art in essence in other words or this technical scheme can embody with the form of software product, this computer software product is stored in a storage medium, comprising some instructions in order to make a computer equipment (can be personal computer, server, or the network equipment etc.) perform all or part of step of method described in each embodiment of the present invention.And aforesaid storage medium comprises: USB flash disk, portable hard drive, ROM (read-only memory) (ROM, Read-OnlyMemory), random access memory (RAM, RandomAccessMemory), magnetic disc or CD etc. various can be program code stored medium.
It should be noted that: in similar label and letter accompanying drawing below, represent similar terms, therefore, once be defined in an a certain Xiang Yi accompanying drawing, then do not need to define further it and explain in accompanying drawing subsequently, in addition, term " first ", " second ", " the 3rd " etc. only for distinguishing description, and can not be interpreted as instruction or hint relative importance.
Last it is noted that the above embodiment, be only the specific embodiment of the present invention, in order to technical scheme of the present invention to be described, be not intended to limit, protection scope of the present invention is not limited thereto, although with reference to previous embodiment to invention has been detailed description, those of ordinary skill in the art is to be understood that: be anyly familiar with those skilled in the art in the technical scope that the present invention discloses, it still can be modified to the technical scheme described in previous embodiment or can expect change easily, or equivalent replacement is carried out to wherein portion of techniques feature, and these amendments, change or replacement, do not make the essence of appropriate technical solution depart from the spirit and scope of embodiment of the present invention technical scheme.All should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should described be as the criterion with the protection domain of claim.
Claims (15)
1. a method for human-computer interaction, is characterized in that, comprising:
Gather the multimedia messages of user, wherein, described multimedia messages comprises: user images information and/or user speech information;
Identity and the interactive mode of described user is determined according to the multimedia messages stored in the database preset and the described multimedia messages collected; Wherein, described interactive mode comprises: interactive voice and/or action mutual;
The interaction content corresponding with the identity of described user is transferred and described user carries out interaction according to the interactive mode determined.
2. the method for human-computer interaction according to claim 1, is characterized in that, the multimedia messages of described collection user comprises:
When monitoring user and entering in image acquisition region, automatically gather the multimedia messages of described user;
Or, when monitoring user's triggering collection option, gather the multimedia messages of described user.
3. the method for human-computer interaction according to claim 1, is characterized in that, the multimedia messages of described collection user comprises: when having identified telephone bell, automatic call answering, and the voice messaging gathering user in call;
The multimedia messages stored in the database that described basis is preset and the described multimedia messages collected determine that the identity of described user and interactive mode comprise: according to the voice messaging identification voice keyword of user in the described call collected; Voice recognition information according to storing in described voice keyword and default database determines that the identity of described user and current interactive mode are that action is mutual, wherein, described voice keyword comprises personnel's name that the name of described user and/or described user need to connect electricity;
The described interactive mode according to determining is transferred the interaction content corresponding with the identity of described user and described user and is carried out interaction and comprise: transfer the call forwarding number corresponding with the identity of described user, described call is forwarded to terminal corresponding to described call forwarding number.
4. the method for the human-computer interaction according to any one of claim 1-3, is characterized in that, the described interactive mode according to determining is transferred the interaction content corresponding with the identity of described user and described user and carried out interaction and comprise:
According to the language form corresponding to the voice messaging identification voice of user, transfer the interaction content corresponding with the identity of described user according to the interactive mode determined and the language form that identifies and described user carries out interaction.
5. the method for human-computer interaction according to claim 1, is characterized in that, also comprises: when having identified doorbell sound, starts automatically-controlled door and opens.
6. the method for human-computer interaction according to claim 1, is characterized in that, the described interactive mode according to determining is transferred the interaction content corresponding with the identity of described user and described user and carried out interaction and comprise:
From the database preset, the interaction content corresponding with the identity of described user is searched according to the interactive mode determined, wherein, be previously stored with in described database following in one or more: the visiting information of client and the interaction content of correspondence, the pre-prompting information of employee and the hint instructions of correspondence, the identity of the stranger identified and the image information of correspondence;
Transfer the described interaction content found, and carry out interaction with described user.
7. the method for human-computer interaction according to claim 1, is characterized in that, also comprises:
When gathering the multimedia messages of patrolling and examining in process, unusual condition judgement is carried out to the described multimedia messages collected;
When identifying described multimedia messages for burst or abnormal conditions, report to the police, wherein, described warning at least comprises one of following: field speech or light warning, sends a telegraph client service center or related personnel reports to the police.
8. a device for human-computer interaction, is characterized in that, comprising:
Information acquisition module, for gathering the multimedia messages of user, wherein, described multimedia messages comprises: user images information and/or user speech information;
Identity and mutual determination module, for determining identity and the interactive mode of described user according to the multimedia messages stored in the database preset and the described multimedia messages collected; Wherein, described interactive mode comprises: interactive voice and/or action mutual;
Interaction content transfers module, for transferring the interaction content corresponding with the identity of described user according to the interactive mode determined and described user carries out interaction.
9. the device of human-computer interaction according to claim 8, is characterized in that, described information acquisition module comprises:
First collecting unit, for when monitoring user and entering in image acquisition region, gathers the multimedia messages of described user automatically; Or,
Second collecting unit, for when monitoring user's triggering collection option, gathers the multimedia messages of described user.
10. the device of human-computer interaction according to claim 8, is characterized in that, described information acquisition module comprises:
Call voice collecting unit, for when having identified telephone bell, automatic call answering, and the voice messaging gathering user in call;
Described identity and mutual determination module comprise:
Keyword recognition unit, for the voice messaging identification voice keyword according to user in the described call collected;
The identity determination unit of user, for determining that the identity of described user and current interactive mode are that action is mutual according to the voice recognition information stored in described voice keyword and default database, wherein, described voice keyword comprises personnel's name that the name of described user and/or described user need to connect electricity;
Described interaction content is transferred module and is comprised:
Switching number transfers unit, for transferring the call forwarding number corresponding with the identity of described user, described call is forwarded to terminal corresponding to described call forwarding number.
The device of 11. human-computer interactions according to Claim 8 described in-10 any one, it is characterized in that, described interaction content is transferred module and is comprised:
Language form recognition unit, for the language form corresponding to the voice messaging identification voice of user;
First interaction content transfers unit, for transferring the interaction content corresponding with the identity of described user according to the interactive mode determined and the language form that identifies and described user carries out interaction.
The device of 12. human-computer interactions according to claim 8, is characterized in that, also comprise:
Automatically-controlled door starts module, for when having identified doorbell sound, having started automatically-controlled door and opening.
The device of 13. human-computer interactions according to claim 8, is characterized in that, described interaction content is transferred module and comprised:
Interaction content searches unit, for searching the interaction content corresponding with the identity of described user according to the interactive mode determined from the database preset, wherein, be previously stored with in described database following in one or more: the visiting information of client and the interaction content of correspondence, the pre-prompting information of employee and the hint instructions of correspondence, the identity of the stranger identified and the image information of correspondence;
Second interaction content transfers unit, for transferring the described interaction content found, and carries out interaction with described user.
The device of 14. human-computer interactions according to claim 8, is characterized in that, also comprise:
Unusual condition judge module, during for gathering the multimedia messages in the process of patrolling and examining, carries out unusual condition judgement to the described multimedia messages collected;
Alarm module, for when identifying described multimedia messages for burst or abnormal conditions, reports to the police, and wherein, described warning at least comprises one of following: field speech or light warning, sends a telegraph client service center or related personnel reports to the police.
15. 1 kinds of robots, is characterized in that, comprising: the device of the human-computer interaction as described in any one of claim 8-14.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201511016826.8A CN105425970B (en) | 2015-12-29 | 2015-12-29 | A kind of method, apparatus and robot of human-computer interaction |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201511016826.8A CN105425970B (en) | 2015-12-29 | 2015-12-29 | A kind of method, apparatus and robot of human-computer interaction |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105425970A true CN105425970A (en) | 2016-03-23 |
| CN105425970B CN105425970B (en) | 2019-02-26 |
Family
ID=55504226
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201511016826.8A Active CN105425970B (en) | 2015-12-29 | 2015-12-29 | A kind of method, apparatus and robot of human-computer interaction |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105425970B (en) |
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106161155A (en) * | 2016-06-30 | 2016-11-23 | 联想(北京)有限公司 | A kind of information processing method and master terminal |
| CN106294813A (en) * | 2016-08-15 | 2017-01-04 | 歌尔股份有限公司 | A kind of method and apparatus of smart machine person recognition |
| CN106328139A (en) * | 2016-09-14 | 2017-01-11 | 努比亚技术有限公司 | Voice interaction method and voice interaction system |
| CN106462384A (en) * | 2016-06-29 | 2017-02-22 | 深圳狗尾草智能科技有限公司 | Multi-modal based intelligent robot interaction method and intelligent robot |
| CN106782606A (en) * | 2017-01-17 | 2017-05-31 | 山东南工机器人科技有限公司 | For the communication and interaction systems and its method of work of Dao Jiang robots |
| CN107220532A (en) * | 2017-04-08 | 2017-09-29 | 网易（杭州）网络有限公司 | For the method and apparatus by voice recognition user identity |
| CN107340859A (en) * | 2017-06-14 | 2017-11-10 | 北京光年无限科技有限公司 | The multi-modal exchange method and system of multi-modal virtual robot |
| CN107368720A (en) * | 2016-05-11 | 2017-11-21 | 中华映管股份有限公司 | Intuitive interactive device and its interactive approach |
| CN107423398A (en) * | 2017-07-26 | 2017-12-01 | 腾讯科技（上海）有限公司 | Exchange method, device, storage medium and computer equipment |
| CN107846508A (en) * | 2017-10-28 | 2018-03-27 | 上海爱优威软件开发有限公司 | For the assisted memory method and system of forgetful crowd |
| CN107977072A (en) * | 2017-07-28 | 2018-05-01 | 北京物灵智能科技有限公司 | What a kind of robot used form method, forms expert system and electronic equipment |
| CN108038937A (en) * | 2017-11-22 | 2018-05-15 | 同观科技（深圳）有限公司 | A kind of methods of exhibiting, device, terminal device and the storage medium of welcome's information |
| CN108197963A (en) * | 2018-03-28 | 2018-06-22 | 广州市菲玛尔咨询服务有限公司 | A kind of intelligent customer service manages system |
| CN109343706A (en) * | 2018-09-18 | 2019-02-15 | 周文 | A kind of interactive system and its implementation |
| CN109644303A (en) * | 2016-08-29 | 2019-04-16 | Groove X 株式会社 | Identify the autonomous humanoid robot of behavior of Sounnd source direction |
| CN109756532A (en) * | 2017-11-02 | 2019-05-14 | 阿里巴巴集团控股有限公司 | For the response processing method and device of external staff |
| CN110177660A (en) * | 2017-01-19 | 2019-08-27 | 夏普株式会社 | Words and deeds control device, robot, the control method for controlling program and words and deeds control device |
| CN110324797A (en) * | 2018-03-28 | 2019-10-11 | 上海博泰悦臻电子设备制造有限公司 | Telephony intelligence forwarding method, system, vehicle device and storage medium |
| US10474947B2 (en) | 2016-05-26 | 2019-11-12 | Asustek Computer Inc. | Control method, electronic device and non-transitory computer readable storage medium |
| CN110722568A (en) * | 2019-11-01 | 2020-01-24 | 北京云迹科技有限公司 | Robot control method, device, service robot and storage medium |
| CN111191074A (en) * | 2019-12-10 | 2020-05-22 | 秒针信息技术有限公司 | Member information query method and system based on voiceprint recognition |
| CN111988474A (en) * | 2020-08-21 | 2020-11-24 | 国网山东省电力公司莱芜供电公司 | Electric power intelligent scheduling system based on voice recognition function |
| CN112259076A (en) * | 2020-10-12 | 2021-01-22 | 北京声智科技有限公司 | Voice interaction method and device, electronic equipment and computer readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102300008A (en) * | 2010-06-23 | 2011-12-28 | 上海博路信息技术有限公司 | Automatic master station based on voice identification |
| CN103945351A (en) * | 2013-01-17 | 2014-07-23 | 上海博路信息技术有限公司 | Automatic switching system based on voice identification |
| US20140277735A1 (en) * | 2013-03-15 | 2014-09-18 | JIBO, Inc. | Apparatus and methods for providing a persistent companion device |
| CN104951077A (en) * | 2015-06-24 | 2015-09-30 | 百度在线网络技术（北京）有限公司 | Man-machine interaction method and device based on artificial intelligence and terminal equipment |
| CN105058393A (en) * | 2015-08-17 | 2015-11-18 | 李泉生 | Guest greeting robot |
-
2015
- 2015-12-29 CN CN201511016826.8A patent/CN105425970B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102300008A (en) * | 2010-06-23 | 2011-12-28 | 上海博路信息技术有限公司 | Automatic master station based on voice identification |
| CN103945351A (en) * | 2013-01-17 | 2014-07-23 | 上海博路信息技术有限公司 | Automatic switching system based on voice identification |
| US20140277735A1 (en) * | 2013-03-15 | 2014-09-18 | JIBO, Inc. | Apparatus and methods for providing a persistent companion device |
| CN104951077A (en) * | 2015-06-24 | 2015-09-30 | 百度在线网络技术（北京）有限公司 | Man-machine interaction method and device based on artificial intelligence and terminal equipment |
| CN105058393A (en) * | 2015-08-17 | 2015-11-18 | 李泉生 | Guest greeting robot |
Cited By (40)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107368720A (en) * | 2016-05-11 | 2017-11-21 | 中华映管股份有限公司 | Intuitive interactive device and its interactive approach |
| US10474947B2 (en) | 2016-05-26 | 2019-11-12 | Asustek Computer Inc. | Control method, electronic device and non-transitory computer readable storage medium |
| WO2018000280A1 (en) * | 2016-06-29 | 2018-01-04 | 深圳狗尾草智能科技有限公司 | Multi-mode based intelligent robot interaction method and intelligent robot |
| CN106462384A (en) * | 2016-06-29 | 2017-02-22 | 深圳狗尾草智能科技有限公司 | Multi-modal based intelligent robot interaction method and intelligent robot |
| CN106462384B (en) * | 2016-06-29 | 2019-05-31 | 深圳狗尾草智能科技有限公司 | Based on multi-modal intelligent robot exchange method and intelligent robot |
| CN106161155A (en) * | 2016-06-30 | 2016-11-23 | 联想(北京)有限公司 | A kind of information processing method and master terminal |
| US10963550B2 (en) | 2016-08-15 | 2021-03-30 | Goertek Inc. | Method and apparatus for person identification by a smart device |
| WO2018032931A1 (en) * | 2016-08-15 | 2018-02-22 | 歌尔股份有限公司 | Person recognition method and apparatus of intelligent device |
| CN106294813A (en) * | 2016-08-15 | 2017-01-04 | 歌尔股份有限公司 | A kind of method and apparatus of smart machine person recognition |
| US11376740B2 (en) | 2016-08-29 | 2022-07-05 | Groove X, Inc. | Autonomously acting robot that recognizes direction of sound source |
| CN109644303B (en) * | 2016-08-29 | 2021-07-23 | Groove X 株式会社 | Robot for operating sounding body |
| CN109644303A (en) * | 2016-08-29 | 2019-04-16 | Groove X 株式会社 | Identify the autonomous humanoid robot of behavior of Sounnd source direction |
| CN106328139A (en) * | 2016-09-14 | 2017-01-11 | 努比亚技术有限公司 | Voice interaction method and voice interaction system |
| CN106782606A (en) * | 2017-01-17 | 2017-05-31 | 山东南工机器人科技有限公司 | For the communication and interaction systems and its method of work of Dao Jiang robots |
| CN110177660A (en) * | 2017-01-19 | 2019-08-27 | 夏普株式会社 | Words and deeds control device, robot, the control method for controlling program and words and deeds control device |
| US11400601B2 (en) | 2017-01-19 | 2022-08-02 | Sharp Kabushiki Kaisha | Speech and behavior control device, robot, storage medium storing control program, and control method for speech and behavior control device |
| CN110177660B (en) * | 2017-01-19 | 2022-06-14 | 夏普株式会社 | Language control device, robot, storage medium, and control method |
| CN107220532A (en) * | 2017-04-08 | 2017-09-29 | 网易（杭州）网络有限公司 | For the method and apparatus by voice recognition user identity |
| CN107340859B (en) * | 2017-06-14 | 2021-04-06 | 北京光年无限科技有限公司 | Multi-modal interaction method and system of multi-modal virtual robot |
| CN107340859A (en) * | 2017-06-14 | 2017-11-10 | 北京光年无限科技有限公司 | The multi-modal exchange method and system of multi-modal virtual robot |
| WO2019019935A1 (en) * | 2017-07-26 | 2019-01-31 | 腾讯科技（深圳）有限公司 | Interaction method, interaction terminal, storage medium, and computer device |
| US11069338B2 (en) | 2017-07-26 | 2021-07-20 | Tencent Technology (Shenzhen) Company Limited | Interactive method, interactive terminal, storage medium, and computer device |
| CN107423398A (en) * | 2017-07-26 | 2017-12-01 | 腾讯科技（上海）有限公司 | Exchange method, device, storage medium and computer equipment |
| CN107423398B (en) * | 2017-07-26 | 2023-04-18 | 腾讯科技（上海）有限公司 | Interaction method, interaction device, storage medium and computer equipment |
| CN107977072B (en) * | 2017-07-28 | 2021-06-08 | 北京物灵智能科技有限公司 | Formation method for robot, formation expert system and electronic equipment |
| CN107977072A (en) * | 2017-07-28 | 2018-05-01 | 北京物灵智能科技有限公司 | What a kind of robot used form method, forms expert system and electronic equipment |
| CN107846508A (en) * | 2017-10-28 | 2018-03-27 | 上海爱优威软件开发有限公司 | For the assisted memory method and system of forgetful crowd |
| CN109756532A (en) * | 2017-11-02 | 2019-05-14 | 阿里巴巴集团控股有限公司 | For the response processing method and device of external staff |
| CN108038937A (en) * | 2017-11-22 | 2018-05-15 | 同观科技（深圳）有限公司 | A kind of methods of exhibiting, device, terminal device and the storage medium of welcome's information |
| CN110324797A (en) * | 2018-03-28 | 2019-10-11 | 上海博泰悦臻电子设备制造有限公司 | Telephony intelligence forwarding method, system, vehicle device and storage medium |
| CN110324797B (en) * | 2018-03-28 | 2022-04-15 | 博泰车联网科技(上海)股份有限公司 | Intelligent telephone switching method, system, vehicle machine and storage medium |
| CN108197963A (en) * | 2018-03-28 | 2018-06-22 | 广州市菲玛尔咨询服务有限公司 | A kind of intelligent customer service manages system |
| CN109343706B (en) * | 2018-09-18 | 2022-03-11 | 周文 | Interactive system and implementation method thereof |
| CN109343706A (en) * | 2018-09-18 | 2019-02-15 | 周文 | A kind of interactive system and its implementation |
| CN110722568A (en) * | 2019-11-01 | 2020-01-24 | 北京云迹科技有限公司 | Robot control method, device, service robot and storage medium |
| CN111191074A (en) * | 2019-12-10 | 2020-05-22 | 秒针信息技术有限公司 | Member information query method and system based on voiceprint recognition |
| CN111988474A (en) * | 2020-08-21 | 2020-11-24 | 国网山东省电力公司莱芜供电公司 | Electric power intelligent scheduling system based on voice recognition function |
| CN111988474B (en) * | 2020-08-21 | 2021-10-01 | 国网山东省电力公司莱芜供电公司 | Electric power intelligent scheduling system based on voice recognition function |
| CN112259076A (en) * | 2020-10-12 | 2021-01-22 | 北京声智科技有限公司 | Voice interaction method and device, electronic equipment and computer readable storage medium |
| CN112259076B (en) * | 2020-10-12 | 2024-03-01 | 北京声智科技有限公司 | Voice interaction method, voice interaction device, electronic equipment and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105425970B (en) | 2019-02-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105425970A (en) | Human-machine interaction method and device, and robot | |
| KR101827320B1 (en) | Server for call center using artificial intelligence | |
| WO2017117879A1 (en) | Personal identification processing method, apparatus and system | |
| CN105446146A (en) | Intelligent terminal control method based on semantic analysis, system and intelligent terminal | |
| CN104823411A (en) | Voice-controlled configuration of an automation system | |
| KR20190031167A (en) | Electronic Device and method for controlling the electronic device | |
| CN103729476A (en) | Method and system for correlating contents according to environmental state | |
| CN111416914B (en) | Artificial intelligence voice interaction service system | |
| CN111970409A (en) | Voice processing method, device, equipment and storage medium based on man-machine interaction | |
| CN110116414A (en) | A kind of shop 4S intelligent comprehensive service robot and its system | |
| CN109541948A (en) | A kind of smart home intelligence control system and application method | |
| US11521626B2 (en) | Device, system and method for identifying a scene based on an ordered sequence of sounds captured in an environment | |
| KR20190009201A (en) | Mobile terminal and method for controlling the same | |
| CN208225272U (en) | An a kind of key alarm system based on wisdom street lamp | |
| CN105232051B (en) | A kind of children's self monitor system based on abnormal speech identification technology | |
| CN113840040B (en) | Man-machine cooperation outbound method, device, equipment and storage medium | |
| CN105847746A (en) | Monitoring method and device | |
| CN102447786A (en) | Personal life special-purpose assisting device and method thereof | |
| CN104954429A (en) | Method of automatic help seeking system in danger | |
| CN107357859A (en) | A kind of intelligent terminal for realizing that knowledge base shows automatically by voice collecting | |
| CN209359307U (en) | A kind of pet monitoring system | |
| EP3977328A1 (en) | Determining observations about topics in meetings | |
| CN111489276B (en) | Personnel management method and related device | |
| CN105282714A (en) | Life care and rescue system | |
| CN108769587A (en) | A kind of calculator room equipment safety monitoring system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 518000 Guangdong city of Shenzhen province Nanshan District Guangdong streets Houhai Road No. 2388 Yi financial science and technology building 12 room 06 Applicant after: SHENZHEN WEIFU ROBOT TECHNOLOGY Co.,Ltd. Address before: 518000 Guangdong city of Shenzhen province Nanshan District Guangdong streets Houhai Road No. 2388 Yi financial science and technology building 12 room 06 Applicant before: SHENZHEN LINGYANG MICRO SERVER ROBOT TECHNOLOGY Co.,Ltd. |
|
| COR | Change of bibliographic data | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220704 Address after: 518000 418a, building 3, sangtai Science Park, Xinwei community, Xili street, Nanshan District, Shenzhen City, Guangdong Province Patentee after: Shenzhen hande Intelligent Technology Co.,Ltd. Address before: 518000 room 06, 12 / F, Yihua financial technology building, 2388 Houhai Avenue, Yuehai street, Nanshan District, Shenzhen, Guangdong Province Patentee before: SHENZHEN WEIFU ROBOT TECHNOLOGY Co.,Ltd. |