CN108009490A - A kind of determination methods of chat robots system based on identification mood and the system - Google Patents
A kind of determination methods of chat robots system based on identification mood and the system Download PDFInfo
- Publication number
- CN108009490A CN108009490A CN201711227422.2A CN201711227422A CN108009490A CN 108009490 A CN108009490 A CN 108009490A CN 201711227422 A CN201711227422 A CN 201711227422A CN 108009490 A CN108009490 A CN 108009490A
- Authority
- CN
- China
- Prior art keywords
- chat
- person
- expression
- system based
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
- G06V40/175—Static expression
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/332—Query formulation
- G06F16/3329—Natural language query formulation or dialogue systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Mathematical Physics (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Artificial Intelligence (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Manipulator (AREA)
Abstract
The present invention relates to technical field of electronic communication, and in particular to the determination methods of a kind of chat robots system based on identification mood and the system.The determination methods of this chat robots system based on identification mood of the present invention and the system fully use the mature face recognition technology of current industry, psychology general knowledge etc., by the real meaning for constantly judging chat person, by vision Expression analysis, Speech processing, the coordination integrated fusion of expression robot, the kernel of Expression analysis is used as using visual information, the fusion method of assistant voice intonation intensive analysis, make full use of various methods each advantage, both the result of vision Expression analysis had been reacted, also the state of speech emotional is embodied, there is this method higher intelligent, so as to adjust chat content, experience so that chat person obtains close to real chat, so as to which the sense of reality of chat robots be greatly improved, accuracy.
Description
Technical field
The present invention relates to technical field of electronic communication, and in particular to it is a kind of based on identification mood chat robots system and
The determination methods of the system.
Background technology
Facial expression robot reduces the emotion distance between the mankind and robot, tool for realizing natural human-machine interaction
There is positive promotion meaning.Substantial amounts of research work is unfolded to this research direction in domestic and foreign scholars：Representative expression machine
The Kismet of Qi Renyou Massachusetts Institute Technologies Artificial Intelligence Laboratory, SAYA robots, U.S. of the exploitation of Tokyo Polytechnics
Nao, the Osaka, Japan that the K-bot and " Einstein " of Hansen robot technology company of state, Hertford, England university design are big
Learn ReplieeQ1, ReplieeQ2 and GeminoidTMF of research, the H＆F Series machine people that domestic Harbin Institute of Technology is studied etc..With biography
The industrial robot of the fixed station of system, fixed work order and fixed operation scene is different, facial expression robot for interactivity,
The intelligent and requirement higher of independence, it, which is studied, is related to Machine Design, automatically controls, computer intelligence, psychology and cognition
The multi-field knowledge such as science, has typical multi-crossed disciplines feature.
Chat robots are a kind of by the artificial intelligence technology identification word meaning of one's words, and reasonably select answer, are reached in mould
Intend the robot of true man's chat purpose.At present, the exploitation of chat robots all concentrates on the meaning of one's words for improving identification other side, and selection is closed
In the stage of the answer of reason, relevant research is very much, it is also only limitted to the communication text of both sides.But actual language communication,
Language is by no means limited to, further includes expression, limb action etc..Identical language, is equipped with different expression and the tone, its possible table
Up to antipodal implication.For example someone says that " you ask me to have a meal", an expression scorned to take even a glance at is equipped with, what can be can be shown that is
Refusal, and pleasantly surprised expression is equipped with, this is clearly to receive.The development trend of chat robots should be it is comprehensive these mutually inside the Pass
Hold, reach as a true as possible, believable communication process so that " illusion " that chat person produces and true man chat.
The content of the invention
It is an object of the invention to fully use the mature face recognition technology of current industry, psychology general knowledge etc., pass through
Constantly the real meaning of chat person being judged, so as to adjust chat content so that chat person obtains to be experienced close to real chat, from
And the sense of reality of chat robots, accuracy is greatly improved, there is provided a kind of chat robots system based on identification mood is sentenced
Disconnected method, solves above technical problem；
A kind of determination methods of the chat robots system based on identification mood, comprise the following steps：
Step A, establishes Facial expression database, facial characteristics of the storage face under different expressions；
Step B, the digital picture of chat person is periodically collected by image collecting device；
Step C, identifies the face of chat person from digital picture, counts chat person's facial characteristics；
Step D, according to chat person's facial characteristics, obtains table corresponding with above-mentioned position relationship from Facial expression database
Feelings, the expression as chat person.
The determination methods of the above-mentioned chat robots system based on identification mood, by following field storage people in step A
Facial characteristics in face difference expression：Ethnic group, gender, age.
The determination methods of the above-mentioned chat robots system based on identification mood, store the following expression of face in step A
In facial characteristics：Amimia, happy, sad, anxiety, indignation, sorrow, detest, surprised, contempt.
The determination methods of the above-mentioned chat robots system based on identification mood, facial characteristics include：Eyebrow direction, two
The distance between a eyebrow, eyes size, pupil size, two corners of the mouth angles, face size, upper and lower lip shape, naris diameter.
The determination methods of the above-mentioned chat robots system based on identification mood, in step C, further include from digital picture
Middle identification obtains chat person's headwork, both shoulders action and hand motion.
The determination methods of the above-mentioned chat robots system based on identification mood, step D include before：
Step D1, speech reception module constantly detect sound source, and whether detecting has voice signal；
Step D2, extracts the keyword in the voice signal of detecting；
Step D3, keyword is matched with the unlatching word preserved in memory module；
Step D4, if successful match, sends and wakes up instruction, chat robots enter opening.
The determination methods of the above-mentioned chat robots system based on identification mood, it is further comprising the steps of：Step E, root
Chat theme is obtained according to chat content, and using the language of current chat person and expression as foundation, judges chat person to current chat
The true attitude of theme；
Step F, according to the strategy of true attitude adjustment chat of the obtained chat person to current chat theme：Change chat
Theme, correct robot to the viewpoint for theme of chatting, the diction of adjustment robot.
The present invention also aims to adjust chat content so that and chat person obtains to be experienced close to real chat, so that
The sense of reality, the accuracy of chat robots is greatly improved, there is provided it is a kind of based on identification mood chat robots system, solve with
Upper technical problem.
Technical problem solved by the invention can be realized using following technical scheme：A kind of chatting based on identification mood
Its robot system, including：
Control module, the information sent for receiving other modules, and received information is given to other moulds as needed
Block processing；
Image capture module, is electrically connected with the input terminal of the control module, and the face for periodically collecting chat person is special
Sign, and facial characteristics is converted into digital picture, it is stored in database；
Photographing module, is electrically connected with the input terminal of control module, for identify facial characteristics in face difference expression and
Chat person's headwork, both shoulders action and hand motion；
Voice output module, is electrically connected with the output terminal of control module, for playing corresponding voice；
Display module, is electrically connected with the output terminal of control module, corresponding for being shown according to chat person's facial characteristics
Expression.
The above-mentioned chat robots system based on identification mood, further includes：
Memory module, is connected with control module, for storing the unlatching word of chat robots unlatching；
Speech reception module, is connected with memory module and control module, for detecting voice signal；
Judgment module, is connected with control module, the unlatching word in the keyword and memory module that are obtained for judging detecting
Whether match.
Beneficial effect：Due to using above technical scheme, this chat robots system based on identification mood of the present invention
And the determination methods of the system fully use the mature face recognition technology of current industry, psychology general knowledge etc., by constantly sentencing
The real meaning of disconnected chat person, by vision Expression analysis, Speech processing, expression robot coordination integrated fusion,
Using visual information as the kernel of Expression analysis, the fusion method of assistant voice intonation intensive analysis, makes full use of various methods
Respective advantage, both reacted vision Expression analysis as a result, or embody the state of speech emotional, there is this method higher
It is intelligent, so as to adjust chat content so that chat person obtains to be experienced close to real chat, so that chat machine be greatly improved
The sense of reality, the accuracy of people.
Brief description of the drawings
Fig. 1 is a kind of work of the determination methods of chat robots system based on identification mood in the embodiment of the present invention
Make flow chart；
Fig. 2 is a kind of structure diagram of chat robots system based on identification mood in the embodiment of the present invention.
Embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art obtained on the premise of creative work is not made it is all its
His embodiment, belongs to the scope of protection of the invention.
It should be noted that in the case where there is no conflict, the feature in embodiment and embodiment in the present invention can phase
Mutually combination.
The invention will be further described with specific embodiment below in conjunction with the accompanying drawings, but not as limiting to the invention.
With reference to Fig. 1, a kind of determination methods of the chat robots system based on identification mood, comprise the following steps：
Step A, establishes Facial expression database, facial characteristics of the storage face under different expressions；
Step B, the digital picture of chat person is periodically collected by image collecting device；
Step C, identifies the face of chat person from digital picture, counts chat person's facial characteristics；
Step D, according to chat person's facial characteristics, obtains table corresponding with above-mentioned position relationship from Facial expression database
Feelings, the expression as chat person.
For different application demands, recognition training sample storehouse of the selection for Expression analysis.There are two schemes for choosing
Select, one kind is the existing expression storehouse of selection, such as considers that the present invention is directed to Chinese's face feature, may be selected by Japanese ART matchmaker
The JAFFE storehouses that body information science laboratory provides, the storehouse provide 7 kinds of basic facial expressions of 10 Japanese young woman, are well suited to
Women operator Expression analysis identifies.Another kind can be according to particular demands, and the operator for selecting to specify is in same operation scenario
Under, the self-built expression storehouse as special-purpose.Expression storehouse is stored under the catalogue specified after selecting according to expression category classification, from
In expression storehouse feature vector is extracted in the facial expression image of known expression classification.In the present invention, the expression in expression storehouse is classified into
For some different classes of expression groups, feature vector is extracted to the facial expression image in each expression group, as training sample；With spy
Sign vector, which is formed, obtains expressive features space, and facial image to be identified is identified based on expressive features space.
Speech signal analysis, which is divided into, outputs and inputs two parts.During phonetic entry, by phonetic entry and input language
Sound reference model carries out DTW analyses, according to phonetic entry and intonation intensity, makes different tone strength quantifies indexs, identifies
Sound emoticon.In the present embodiment, excited-pleasant-passive three kinds of tone strength quantifies are made to speaker's state.Assisted in multitask
In mode transfer block, the basic emotion that tone strength quantifies index and visual analysis obtain is done into linear fusion, by emotional facial expressions and sound
Sound expression carries out linear fusion, and the quantity of the compound expression instruction of acquisition is the quantity of sound emoticon and adding for emotional facial expressions quantity
Power summation.The present embodiment can obtain 21 kinds of combination speech output orders.According to combination speech output order, according to predefined defeated
Go out phonetic reference model, corresponding voice stream data selected from voice output storehouse, in this way, to user feedback voice output both
Reacted the analysis of visual emotional facial expressions as a result, also embodying the state of sound emoticon acoustically.
Further, a kind of the preferable of determination methods of the chat robots system based on identification mood of the present invention is implemented
In example, by the facial characteristics in following field storage face difference expression in step A：Ethnic group, gender, age.
Further, a kind of the preferable of determination methods of the chat robots system based on identification mood of the present invention is implemented
The facial characteristics in the following expression of face is stored in example, in step A：Amimia, happy, sad, anxiety, indignation, sorrow, detest
Dislike, is surprised, contempt.
Further, a kind of the preferable of determination methods of the chat robots system based on identification mood of the present invention is implemented
In example, facial characteristics includes：The distance between eyebrow direction, two eyebrows, eyes size, pupil size, two corners of the mouth angles, mouth
Ba great little, upper and lower lip shape, naris diameter.
Facial characteristics under different expressions mainly includes：It is amimia, happy, sad, anxiety, indignation, sorrow, detest, frightened
The common expression such as it is surprised, scorns.Various expressions can all have corresponding facial characteristics, such as：It is sad.Facial characteristics includes narrowing eye, eyebrow
Hair tightening, corners of the mouth drop-down, chin are lifted or tightened.Fear.When fearing, face and eyes open, and eyebrow raises up, and nostril is magnified.
Indignation.At this moment eyebrow is sagging, and forehead is knitted tightly, and eyelid and lip are nervous.Detest.The expression of detest includes sneering nose, is lifted on upper lip,
Eyebrow is sagging, narrows eye.It is surprised.When surprised, lower jaw is sagging, and lip and face loosen, and eyes magnify, eyelid and the micro- lift of eyebrow.Gently
Slight.The famous feature of contempt is exactly that corners of the mouth side is lifted, and ridicules or proud laughs at shape.As long as capture these facial characteristics of chat person
Change, you can judge the current mood of chat person.And according to：Ethnic group, gender, age classify, because, different people
Kind, gender and the people at age, facial characteristics when expressing expression are certainly different.For example, many white people are in expression phase feeling of sympathy
When, facial expression will be exaggerated more than yellow, and movement range is big.Further, it is also possible to carry out expressiveness and not abundant progress
Distinguish, someone's expressiveness, just as it has often been said that " glad unhappy all hangs on the face ", and somebody is then with respect to expression list
One, it is only capable of by local trickle change, can just flutters and grasp his real psychology.According to the history chat record of chat person, machine
Device people can give chat person to carry out certain classification：Expressiveness or expression are not enriched.So as to use different determination strategies, with
Improve the accuracy judged.
Further, a kind of the preferable of determination methods of the chat robots system based on identification mood of the present invention is implemented
In example, in step C, further include the identification from digital picture and obtain chat person's headwork, both shoulders action and hand motion.Shoulder
Action includes the common action such as shrug；Headwork includes the common action such as nod, shake the head；Hand motion include wave, wave,
Push, lift the common actions such as hand.
Further, a kind of the preferable of determination methods of the chat robots system based on identification mood of the present invention is implemented
In example, include before step D：
Step D1, speech reception module constantly detect sound source, and whether detecting has voice signal；
Step D2, extracts the keyword in the voice signal of detecting；
Step D3, keyword is matched with the unlatching word preserved in memory module；
Step D4, if successful match, sends and wakes up instruction, chat robots enter opening.
, it is necessary to be initialized to the robot before input speech signal, user can say the robot user：
" data storage ", smart machine, which enters, establishes voice recognition storage interface, prompts user to start phonetic entry and opens word.
The judgment module of chat robots is connected by serial ports with control module.User is inputted by speech reception module
Voice signal；Keyword in voice signal should be matched with the unlatching word preserved in memory module, if there are the key
Word, then chat robots enter armed state.
Further, a kind of the preferable of determination methods of the chat robots system based on identification mood of the present invention is implemented
It is further comprising the steps of in example：
Step E, chat theme is obtained according to chat content, and using the language of current chat person and expression as foundation, is judged
Chat person is to the true attitude of current chat theme, for example, chat robots, when stating that certain part is true, chat person replys " no
May", chat robots can then be proved by its expression, and chat person's expression is surprised, show that it may connect
By the fact that；If chat person's expression is scorned, the fact that he does not approve is shown；
Step F, according to the strategy of true attitude adjustment chat of the obtained chat person to current chat theme：Change chat
Theme, correct robot to the viewpoint for theme of chatting, the diction of adjustment robot.After all, chat robots are one
The instrument for accompanying people to chat, rather than real people, it is not necessary that and chat person carries out the chat content such as arguing, one is relatively prone to
The viewpoint and opinion of chat person, it is easier to allow chat person to obtain pleasant chat impression.
With reference to Fig. 2, a kind of chat robots system based on identification mood, including：
Control module 1, the information sent for receiving other modules, and received information is given to other moulds as needed
Block processing；
Image capture module 8, is electrically connected with the input terminal of the control module 1, for periodically collecting the face of chat person
Feature, and facial characteristics is converted into digital picture, it is stored in database；
Photographing module 2, is electrically connected with the input terminal of control module 1, for identifying the facial characteristics in face difference expression
And chat person's headwork, both shoulders action and hand motion；
Voice output module 3, is electrically connected with the output terminal of control module 1, for playing corresponding voice；
Display module 4, is electrically connected with the output terminal of control module 1, corresponding for being shown according to chat person's facial characteristics
Expression.
Further, in a kind of preferred embodiment of the chat robots system based on identification mood of the present invention, also wrap
Include：
Memory module 5, is connected with control module 1, for storing the unlatching word of chat robots unlatching；
Speech reception module 6, is connected with memory module 5 and control module 1, for detecting voice signal；
Judgment module 7, is connected with control module 1, the unlatching in the keyword and memory module 5 that are obtained for judging detecting
Whether word matches.
The determination methods of this chat robots system based on identification mood of the present invention and the system are fully with current
The mature face recognition technology of industry, psychology general knowledge etc., by constantly judging the real meaning of chat person, by vision expression point
Analysis, Speech processing, the coordination integrated fusion of expression robot, it is auxiliary using visual information as the kernel of Expression analysis
The fusion method of speech intonation intensive analysis is helped, various methods each advantage is made full use of, had both reacted vision Expression analysis
As a result, also embody the state of speech emotional, there is this method higher intelligent, so as to adjust chat content so that chat
Its person obtains to be experienced close to real chat, so that the sense of reality of chat robots, accuracy be greatly improved.
The foregoing is merely preferred embodiments of the present invention, not thereby limit embodiments of the present invention and protection model
Enclose, to those skilled in the art, should can appreciate that all with made by description of the invention and diagramatic content
Equivalent substitution and obviously change obtained scheme, should be included in protection scope of the present invention.
Claims (9)
1. a kind of determination methods of the chat robots system based on identification mood, it is characterised in that comprise the following steps：
Step A, establishes Facial expression database, facial characteristics of the storage face under different expressions；
Step B, the digital picture of chat person is periodically collected by image collecting device；
Step C, identifies the face of chat person from the digital picture, counts chat person's facial characteristics；
Step D, according to chat person's facial characteristics, obtains table corresponding with above-mentioned position relationship from the Facial expression database
Feelings, the expression as chat person.
2. a kind of determination methods of chat robots system based on identification mood according to claim 1, its feature exist
In by the facial characteristics in following field storage face difference expression in the step A：Ethnic group, gender, age.
3. a kind of determination methods of chat robots system based on identification mood according to claim 1, its feature exist
In the facial characteristics in the step A in the storage following expression of face：Amimia, happy, sad, anxiety, indignation, sorrow, detest
Dislike, is surprised, contempt.
4. a kind of determination methods of chat robots system based on identification mood according to claim 3, its feature exist
In the facial characteristics includes：The distance between eyebrow direction, two eyebrows, eyes size, pupil size, two corners of the mouth angles,
Face size, upper and lower lip shape, naris diameter.
5. a kind of determination methods of chat robots system based on identification mood according to claim 1, its feature exist
In in the step C, further including from the digital picture identification and obtain chat person's headwork, both shoulders action and hand and move
Make.
6. a kind of determination methods of chat robots system based on identification mood according to claim 1, its feature exist
In the step D includes before：
Step D1, speech reception module constantly detect sound source, and whether detecting has voice signal；
Step D2, extracts the keyword in the voice signal of detecting；
Step D3, the keyword is matched with the unlatching word preserved in memory module；
Step D4, if successful match, sends and wakes up instruction, chat robots enter opening.
7. a kind of determination methods of chat robots system based on identification mood according to claim 1, its feature exist
In further comprising the steps of：
Step E, chat theme is obtained according to chat content, and using the language of current chat person and expression as foundation, judges to chat
True attitude of the person to current chat theme；
Step F, according to the strategy of true attitude adjustment chat of the obtained chat person to current chat theme：Change chat master
Topic, correct robot to the viewpoint for theme of chatting, the diction of adjustment robot.
A kind of 8. chat robots system based on identification mood, it is characterised in that including：
Control module (1), the information sent for receiving other modules, and received described information is given to other as needed
Resume module；
Image capture module (8), is electrically connected with the input terminal of the control module (1), for periodically collecting the face of chat person
Feature, and facial characteristics is converted into digital picture, it is stored in database；
Photographing module (2), is electrically connected with the input terminal of the control module (1), for identifying the face in face difference expression
Feature and chat person's headwork, both shoulders action and hand motion；
Voice output module (3), is electrically connected with the output terminal of the control module (1), for playing corresponding voice；
Display module (4), is electrically connected with the output terminal of the control module (1), for showing phase according to chat person's facial characteristics
Corresponding expression.
9. a kind of chat robots system based on identification mood according to claim 8, it is characterised in that further include：
Memory module (5), is connected with the control module (1), for storing the unlatching word of chat robots unlatching；
Speech reception module (6), is connected with the memory module (5) and the control module (1), for detecting voice signal；
Judgment module (7), is connected with the control module (1), for judging to detect obtained keyword and the memory module
(5) whether the unlatching word in matches.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711227422.2A CN108009490A (en) | 2017-11-29 | 2017-11-29 | A kind of determination methods of chat robots system based on identification mood and the system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711227422.2A CN108009490A (en) | 2017-11-29 | 2017-11-29 | A kind of determination methods of chat robots system based on identification mood and the system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108009490A true CN108009490A (en) | 2018-05-08 |
Family
ID=62054886
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711227422.2A Pending CN108009490A (en) | 2017-11-29 | 2017-11-29 | A kind of determination methods of chat robots system based on identification mood and the system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108009490A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109119077A (en) * | 2018-08-20 | 2019-01-01 | 深圳市三宝创新智能有限公司 | A kind of robot voice interactive system |
| CN109376621A (en) * | 2018-09-30 | 2019-02-22 | 北京七鑫易维信息技术有限公司 | A kind of sample data generation method, device and robot |
| CN109446907A (en) * | 2018-09-26 | 2019-03-08 | 百度在线网络技术（北京）有限公司 | A kind of method, apparatus of Video chat, equipment and computer storage medium |
| CN109979462A (en) * | 2019-03-21 | 2019-07-05 | 广东小天才科技有限公司 | A kind of combination context of co-text obtains the method and system of intention |
| CN110224919A (en) * | 2018-03-02 | 2019-09-10 | 汪俊霞 | A kind of quasi- true man's chat robots |
| CN110308669A (en) * | 2019-07-27 | 2019-10-08 | 南京市晨枭软件技术有限公司 | A kind of modular robot selfreparing analogue system and method |
| CN110370275A (en) * | 2019-07-01 | 2019-10-25 | 夏博洋 | Mood chat robots based on Expression Recognition |
| CN110502609A (en) * | 2019-07-11 | 2019-11-26 | 江苏心涧康科技有限公司 | A kind of method, apparatus and company robot of adjusting mood |
| CN110910297A (en) * | 2019-10-14 | 2020-03-24 | 梁剑 | Information acquisition system based on behavior simulation robot |
| CN110935182A (en) * | 2019-12-06 | 2020-03-31 | 赤峰学院 | Toy for disabled child education |
| CN110991238A (en) * | 2019-10-30 | 2020-04-10 | 中国科学院自动化研究所南京人工智能芯片创新研究院 | Speech auxiliary system based on speech emotion analysis and micro-expression recognition |
| CN114360417A (en) * | 2021-12-28 | 2022-04-15 | 苏州金螳螂文化发展股份有限公司 | Interactive exhibition hall message real-time display system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104091153A (en) * | 2014-07-03 | 2014-10-08 | 苏州工业职业技术学院 | Emotion judgment method applied to chatting robot |
| CN105046238A (en) * | 2015-08-17 | 2015-11-11 | 华侨大学 | Facial expression robot multi-channel information emotion expression mapping method |
| CN105700682A (en) * | 2016-01-08 | 2016-06-22 | 北京乐驾科技有限公司 | Intelligent gender and emotion recognition detection system and method based on vision and voice |
| CN106409306A (en) * | 2016-09-19 | 2017-02-15 | 宁波高新区敦和科技有限公司 | Intelligent system obtaining human voice and obtaining method based on the system |
-
2017
- 2017-11-29 CN CN201711227422.2A patent/CN108009490A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104091153A (en) * | 2014-07-03 | 2014-10-08 | 苏州工业职业技术学院 | Emotion judgment method applied to chatting robot |
| CN105046238A (en) * | 2015-08-17 | 2015-11-11 | 华侨大学 | Facial expression robot multi-channel information emotion expression mapping method |
| CN105700682A (en) * | 2016-01-08 | 2016-06-22 | 北京乐驾科技有限公司 | Intelligent gender and emotion recognition detection system and method based on vision and voice |
| CN106409306A (en) * | 2016-09-19 | 2017-02-15 | 宁波高新区敦和科技有限公司 | Intelligent system obtaining human voice and obtaining method based on the system |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110224919A (en) * | 2018-03-02 | 2019-09-10 | 汪俊霞 | A kind of quasi- true man's chat robots |
| CN109119077A (en) * | 2018-08-20 | 2019-01-01 | 深圳市三宝创新智能有限公司 | A kind of robot voice interactive system |
| CN109446907A (en) * | 2018-09-26 | 2019-03-08 | 百度在线网络技术（北京）有限公司 | A kind of method, apparatus of Video chat, equipment and computer storage medium |
| CN109376621A (en) * | 2018-09-30 | 2019-02-22 | 北京七鑫易维信息技术有限公司 | A kind of sample data generation method, device and robot |
| CN109979462A (en) * | 2019-03-21 | 2019-07-05 | 广东小天才科技有限公司 | A kind of combination context of co-text obtains the method and system of intention |
| CN110370275A (en) * | 2019-07-01 | 2019-10-25 | 夏博洋 | Mood chat robots based on Expression Recognition |
| CN110502609A (en) * | 2019-07-11 | 2019-11-26 | 江苏心涧康科技有限公司 | A kind of method, apparatus and company robot of adjusting mood |
| CN110502609B (en) * | 2019-07-11 | 2022-03-08 | 江苏心涧康科技有限公司 | Method and device for adjusting emotion and accompanying robot |
| CN110308669A (en) * | 2019-07-27 | 2019-10-08 | 南京市晨枭软件技术有限公司 | A kind of modular robot selfreparing analogue system and method |
| CN110308669B (en) * | 2019-07-27 | 2021-07-30 | 南京市晨枭软件技术有限公司 | Modular robot self-repairing simulation system and method |
| CN110910297A (en) * | 2019-10-14 | 2020-03-24 | 梁剑 | Information acquisition system based on behavior simulation robot |
| CN110991238A (en) * | 2019-10-30 | 2020-04-10 | 中国科学院自动化研究所南京人工智能芯片创新研究院 | Speech auxiliary system based on speech emotion analysis and micro-expression recognition |
| CN110935182A (en) * | 2019-12-06 | 2020-03-31 | 赤峰学院 | Toy for disabled child education |
| CN114360417A (en) * | 2021-12-28 | 2022-04-15 | 苏州金螳螂文化发展股份有限公司 | Interactive exhibition hall message real-time display system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108009490A (en) | A kind of determination methods of chat robots system based on identification mood and the system | |
| Wu et al. | Multimodal large language models: A survey | |
| CN107301168A (en) | Intelligent robot and its mood exchange method, system | |
| CN104091153A (en) | Emotion judgment method applied to chatting robot | |
| CN103218842B (en) | A kind of voice synchronous drives the method for the three-dimensional face shape of the mouth as one speaks and facial pose animation | |
| CN107368572A (en) | Multifunctional intellectual man-machine interaction method and system | |
| CN105046238A (en) | Facial expression robot multi-channel information emotion expression mapping method | |
| CN108000526A (en) | Dialogue exchange method and system for intelligent robot | |
| CN106294774A (en) | User individual data processing method based on dialogue service and device | |
| CN111368053B (en) | Mood pacifying system based on legal consultation robot | |
| CN106985137A (en) | Multi-modal exchange method and system for intelligent robot | |
| CN106933807A (en) | Memorandum event-prompting method and system | |
| CN110309254A (en) | Intelligent robot and man-machine interaction method | |
| CN109117952B (en) | Robot emotion cognition method based on deep learning | |
| CN102298694A (en) | Man-machine interaction identification system applied to remote information service | |
| CN106782606A (en) | For the communication and interaction systems and its method of work of Dao Jiang robots | |
| CN106372604A (en) | Intelligent robot negative emotion detection method and system | |
| CN107016046A (en) | The intelligent robot dialogue method and system of view-based access control model displaying | |
| Yuan et al. | Large scale sign language interpretation | |
| CN108510988A (en) | A kind of speech recognition system and method for deaf-mute | |
| Krishnaraj et al. | A Glove based approach to recognize Indian Sign Languages | |
| Zhang et al. | Intelligent Facial Action and emotion recognition for humanoid robots | |
| CN112329593A (en) | Gesture generation method and gesture generation system based on stylization | |
| Singh et al. | A Review For Different Sign Language Recognition Systems | |
| Xu et al. | Rethinking auditory affective descriptors through zero-shot emotion recognition in speech |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180508 |
|
| RJ01 | Rejection of invention patent application after publication |