CN107363862B - Social intercourse system based on robot - Google Patents
Social intercourse system based on robot Download PDFInfo
- Publication number
- CN107363862B CN107363862B CN201710510188.8A CN201710510188A CN107363862B CN 107363862 B CN107363862 B CN 107363862B CN 201710510188 A CN201710510188 A CN 201710510188A CN 107363862 B CN107363862 B CN 107363862B
- Authority
- CN
- China
- Prior art keywords
- social
- match
- processor
- signal
- old man
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000033001 locomotion Effects 0.000 claims abstract description 32
- 238000013480 data collection Methods 0.000 claims abstract description 11
- 230000001133 acceleration Effects 0.000 claims description 32
- 230000009471 action Effects 0.000 claims description 19
- 230000003068 static effect Effects 0.000 claims description 19
- 230000014509 gene expression Effects 0.000 claims description 16
- 230000006399 behavior Effects 0.000 claims description 13
- 239000013598 vector Substances 0.000 claims description 12
- 230000008859 change Effects 0.000 claims description 11
- 239000000284 extract Substances 0.000 claims description 8
- 230000005236 sound signal Effects 0.000 claims description 6
- 230000001815 facial effect Effects 0.000 claims description 5
- 238000005259 measurement Methods 0.000 claims description 5
- 230000005540 biological transmission Effects 0.000 claims description 4
- 238000012545 processing Methods 0.000 claims description 3
- 238000000605 extraction Methods 0.000 description 8
- 230000003542 behavioural effect Effects 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 235000012054 meals Nutrition 0.000 description 3
- 238000000034 method Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 208000030251 communication disease Diseases 0.000 description 2
- 241000208340 Araliaceae Species 0.000 description 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 1
- 235000003140 Panax quinquefolius Nutrition 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000009429 distress Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 235000008434 ginseng Nutrition 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000035479 physiological effects, processes and functions Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000000284 resting effect Effects 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J19/00—Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/01—Social networking
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Strategic Management (AREA)
- Mechanical Engineering (AREA)
- Health & Medical Sciences (AREA)
- Economics (AREA)
- General Health & Medical Sciences (AREA)
- Robotics (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Computing Systems (AREA)
- Tourism & Hospitality (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Medical Treatment And Welfare Office Work (AREA)
- Telephonic Communication Services (AREA)
Abstract
The present patent application discloses the social intercourse system based on robot, Social Match device including being set to server and the social data collection device in robot, Social Match device is used to receive the Social Match parameter value sent in network, Data Matching is stored and carried out, Social Match information is sent；The daily behavior that social data collection device is used to collect old man forms Social Match parameter value, analysis and sends social demand, and the social data collection device includes motion capture module, voice acquisition module, processor, voice cue module.This programme provides a Social Match platform for the elderly, realizes the friend for finding similar personality according to feature tag, meets the social demand of old man.
Description
Technical field
The present invention relates to robot communication technical field more particularly to a kind of social intercourse systems based on robot.
Background technique
In real life, many old men lack necessary social activity.
American Psychologist's Maslow's theory thinks that, in addition to possessing basic physiology and demand for security, people also possesses social essence
Refreshing demand.As young man, old man also has normal social demand.In some cities, university for the aged why one it is hard to find,
Also in that herein, the old men can establish the social circle for being suitble to oneself, their social demand has obtained release and has met,
It is not important instead that is learned.
And the old man for newly moving in home for destitute, original known social circle is had left, a strange environment is entered,
It is less with surrounding people's communication because not known about to the old man in home for destitute, feel lonely；And for moving in time longer old man,
Because of the difference with old man's life style of surrounding, experience etc., common topic cannot be generated to each other, social demand obtains not
To release and meet, can also feel that heart is lonely over time.
Summary of the invention
The invention is intended to provide a kind of social intercourse system based on robot, a Social Match platform is provided for the elderly,
It realizes the friend for finding similar personality according to feature tag, meets the social demand of old man.
The present invention provides base case: the social intercourse system based on robot, and the Social Match including being set to server fills
It sets and the social data collection device in robot, in which:
Social Match device is used to receive the Social Match parameter value sent in network, by social of social demand old man
Social Match parameter value with other old men stored in parameter value and numerical data base carries out Data Matching:
When matching value is more than or equal to preset threshold, then Social Match information is sent to by successful match, Social Match device
Processor；
When matching value is less than preset threshold, then it fails to match, and Social Match failure signal is sent to by Social Match device
Processor；
Social data collection device includes:
Motion capture module, motion capture module are used to collect the action state of the elderly, the motion capture module packet
Include acceleration transducer and gyroscope, wherein acceleration transducer is used to detect the acceleration signal of human motion, and gyroscope is used
In the detection inclined angle signal of human body；
Voice acquisition module, voice acquisition module are used to acquire the voice signal of the elderly and the audio letter of ambient enviroment
Number；
Processor, processor is for receiving acceleration signal, angle signal, voice signal and audio signal, extracting and knowing
Other characteristic signal carries out social analysis, forms Social Match parameter value；
Wherein processor receive after acceleration signal and angle signal with acceleration rate threshold preset in memory and angle
Degree threshold value compares, so that it is determined that the action state that old man is current；
Wherein processor extracts the keyword in voice signal and audio signal, keyword frequency of occurrence is counted, after identification
Classify to keyword, so that it is determined that the experience of life and hobby of the elderly；
Wherein processor passes through the action state identified and chat content analyzes the living habit and interest love of old man
It is good；
Processor is also used to the push Social Match parameter value of the Social Match device into server and transmission is invited；
Processor is also used to receive the Social Match information of Social Match device push and receives other the elderlys and invites；
Voice cue module, to the elderly when voice cue module receives Social Match information and invite for processor
Carry out voice prompting.
The working principle of base case: the movement of the elderly's daily behavior is acquired by motion capture module, wherein accelerating
Degree sensor can measure the acceleration of human motion, and then judge the distance of human motion；Gyroscope can detecte out
Human body rotation, deflection angle judge human body current motion state by measuring itself rotation status, be forward, backward,
Upwards, downwards, to the left still to the right, be to accelerate (angular speed) or slow down (angular speed), the two is in conjunction with forming inertia measurement list
Member can accurately judge the action state of human body.
Detailed process, acceleration transducer and gyroscope acquire the actual act of the elderly in real time and are sent to processor,
Processor receives after acceleration signal and angle signal to carry out pair with acceleration rate threshold preset in processor and angle threshold
Than:
When acceleration signal is greater than predetermined acceleration threshold value, angle signal is also greater than predetermined angle threshold value, such situation
It may then be judged as that human body is squatted down；
When acceleration signal is greater than predetermined acceleration threshold value, angle signal is less than or equal to predetermined angle threshold value, such feelings
Condition may then be judged as that human body is being run；
When acceleration signal is less than or equal to predetermined acceleration threshold value, angle signal is more than or equal to predetermined angle threshold value, this
Kind situation may then be judged as that human body is being bent over；
When acceleration signal is less than or equal to predetermined acceleration threshold value, angle signal is less than or equal to predetermined angle threshold value, this
Kind situation may then judge not move for people, may be in reading of resting or be seated.
Voice signal of the voice acquisition module acquisition simultaneously under current daily behavior, is extracted and is identified by processor
The feature of voice signal so that the two binding analysis goes out the state that the elderly is presently in, such as has a meal, chats, plays card, and unite
The behavior state in special time period is counted, so that it is determined that living habit and the hobby of nursed old man；Processor can also mention
The keyword in voice signal is taken, keyword frequency of occurrence is counted, classifies after identification to keyword, so that it is determined that the elderly
The experience of life and hobby.
Processor passes through the action state identified and chat content analysis, the living habit for counting the elderly, life
Experience and hobby form Social Match parameter value, and Social Match parameter value is pushed to the Social Match in server
Device, Social Match device store Social Match parameter value.
Processor also carries out social analysis to the voice signal of extraction, judges whether old man has social demand, if so, then
Social desired signal is sent to Social Match device, after Social Match device receives desired signal, by social demand old man's
The Social Match parameter value of other old men stored in Social Match parameter value and numerical data base carries out Data Matching:
When matching value is more than or equal to preset threshold, then Social Match information is sent to by successful match, Social Match device
Processor, after processor receives Social Match information, control voice cue module issues voice prompting, such as " XX is fond of fishing,
Whether invite " etc., processor confirms whether old man invites by speech recognition and/or motion capture, as old man agrees to invite
About, processor send to the successful human hair of Social Match information and invites signal.
When matching value is less than preset threshold, then it fails to match, and Social Match failure signal is sent to by Social Match device
Processor, after processor receives Social Match failure signal, control voice cue module issues voice prompting, and such as " social
With failure " etc..
Voice cue module can also simply be exchanged with old man other than above-mentioned voice prompting, work as motion capture
When module and voice acquisition module do not acquire behavioural characteristic signal and voice signal, voice cue module can be opened, to old
People inquires, to ensure to obtain accurate Social Match parameter value, reduces error, while also can handle some emergencies
Situation.
The beneficial effect of base case is: living habit, the experience of life and the hobby that this programme passes through collection old man
Equal characteristic informations obtain Social Match parameter value, so that Auto-matching, which goes out personality, likes similar friend, to meet the society of old man
Friendship demand.
Voice cue module is in addition to receiving Social Match information and inviting information to old man's progress voice prompting simultaneously
Outside, old man can also be inquired when can't detect behavioural characteristic signal and voice signal, to ensure to obtain accurate society
Match parameter value is handed over, reduces error, while when some emergency situations occur for old man, inquiry can also be carried out to old man and is sent to ask
Signal is rescued, guarantees that old man is timely helped.
Preferred embodiment one: further including still image acquisition module, still image acquisition module as the preferred of basic scheme
The static human image being under daily behavior state for collecting the elderly, processor are adopted for receiving static human image
Feature vector is generated with Sift algorithm, chooses key point feature vector, it is quiet by being stored in key point feature vector and database
State human body image sample carries out similarity determination measurement apart from 2 close key feature vectors: in the two key points,
If secondary short distance is less than default threshold divided by minimum distance, it is determined as match point.The utility model has the advantages that passing through acquisition static human
Image, processor carry out feature extraction and identification to static human image, and with the static human image sample that is stored in database
This is matched, and judges action state locating for current old man, to be identified through acceleration signal, angle signal and voice signal
Whether the action state in conjunction with acquisition is correct, to obtain accurate Social Match parameter value, reduces error.
Preferred embodiment two: preferably one it is preferred, still image acquisition module can also be used in acquire facial image,
Processor extracts the expression shape change of identification face, and judges whether the elderly has social demand according to expression shape change.The utility model has the advantages that
By the expression shape change of extraction face, the happiness, anger, grief and joy of old man are judged, and then judge whether the elderly has social demand:
When the expression for identifying old man is more sad, illustrate that old man has something on one's mind, need to exchange with people and mediate, handles
Social Match parameter value is pushed to the Social Match device in server automatically by device, is carried out Data Matching, is lifted social demand.
Preferred embodiment three: further including touch screen, touch screen is for showing Social Match information as the preferred of basic scheme
And receive the touch signal of old man.The utility model has the advantages that for can not be with speech exchange be passed through there are communication disorder or special old man when,
The idea of touch screen ways of writing expression heart can be used.
Preferred embodiment four: social as the preferred of basic scheme, preferred embodiment one, preferred embodiment two and preferred embodiment three
Transacter further includes positioning system, and positioning system is used to position the position of the elderly and sends out as Social Match parameter value
Give server.The utility model has the advantages that positioning system can position old man position, after inviting successfully, old man can be made to find faster
To object is invited, also prevent that the elderly is lost to wander away.
Preferred embodiment five: preferably four it is preferred, processor is to the successful the elderly's information of Social Match information
It is stored.The utility model has the advantages that processor stores the successful the elderly's information of Social Match information, social group is established, when
When old man has social demand, processor selects from social group, reserves good friend, convenient and efficient.
Detailed description of the invention
Fig. 1 is that the present invention is based on the functional block diagrams of the social intercourse system embodiment of robot.
Specific embodiment
Below by specific embodiment, the present invention is described in further detail:
Appended drawing reference in Figure of description includes: social data collection device 1, motion capture module 11, voice collecting
Module 12, voice cue module 13, still image acquisition module 14, touch screen 15, positioning system 16, processor 17, social
With device 2.
Social intercourse system embodiment based on robot is substantially as shown in Fig. 1: including the social data being set in robot
Collection device 1 and Social Match device 2 set on server, in which:
Social Match device 2 is used to receive the Social Match parameter value sent in network, by the social activity of social demand old man
The Social Match parameter value of other old men stored in match parameter value and numerical data base carries out Data Matching:
When matching value is more than or equal to preset threshold, then Social Match information is sent to by successful match, Social Match device 2
Processor 17；
When matching value is less than preset threshold, then it fails to match, and Social Match failure signal is sent to by Social Match device 2
Processor 17；
Social data collection device 1 includes:
Motion capture module 11, motion capture module 11 are used to collect the action state of the elderly, the motion capture mould
Block 11 includes acceleration transducer and gyroscope, wherein acceleration transducer is used to detect the acceleration signal of human motion, top
Spiral shell instrument is for detecting the inclined angle signal of human body；
Acceleration transducer uses three axis accelerometer, can measure the acceleration of human motion, and then judge people
The mobile distance of body；Gyroscope uses three-axis gyroscope, by measuring itself rotation status, judges human body current kinetic shape
State is forward, back, up, downwards, to the left or to the right, is to accelerate (angular speed) or slow down (angular speed), and the two combines
6 axis Inertial Measurement Units are formed, can accurately judge the action state of human body.
Voice acquisition module 12, voice acquisition module 12 are used to acquire the voice signal of the elderly and the audio of ambient enviroment
Signal；Wherein voice acquisition module 12 includes the speech recognition module of microphone and Iflytek company, reaches speech recognition effect.
Processor 17, processor 17 are added using the progress data processing of domestic Godson CPU and control, processor 17 for receiving
Speed signal, angle signal and voice signal, are extracted and identification feature signal, the social analysis of progress form Social Match parameter
Value；
Wherein processor 17 receive after acceleration signal and angle signal with acceleration rate threshold preset in memory and
Angle threshold compares, so that it is determined that the action state that old man is current；
Wherein processor 17 extracts the keyword in voice signal and audio signal, counts keyword frequency of occurrence, identification
Classify afterwards to keyword, so that it is determined that the experience of life and hobby of the elderly；
Wherein processor 17 passes through the action state identified and chat content analyzes the living habit and interest of old man
Hobby；
Processor 17 is also used to the push Social Match parameter value of the Social Match device 2 into server and transmission is invited；
Processor 17 is also used to receive the Social Match information of the push of Social Match device 2 and receives other the elderlys and invites
About；
Voice cue module 13, voice cue module 13 for processor 17 receive Social Match information and when inviting pair
The elderly carries out voice prompting.Voice cue module 13 uses loudspeaker and carries the audio output module of model E702T, reaches
To the effect of output voice signal.
It further include still image acquisition module 14, still image acquisition module 14 is in daily behavior for collecting the elderly
Static human image under state, processor 17 generate feature vector, choosing for receiving static human image, using Sift algorithm
Key point feature vector is taken, by the static human image pattern stored in key point feature vector and database apart from close 2
A key feature vector carries out similarity determination measurement: in the two key points, if secondary short distance is divided by minimum distance
Less than default threshold, then it is determined as match point, by acquiring static human image, processor 17 carries out static human image special
Sign is extracted and identification, and is matched with the static human image pattern stored in database, judges to move locating for current old man
Make state, combines the action state obtained whether correct to be identified through acceleration signal, angle signal and voice signal, thus
Accurate Social Match parameter value is obtained, error is reduced.
Still image acquisition module 14 can also be used to acquire facial image, and the expression that processor 17 extracts identification face becomes
Change, and judges whether the elderly has social demand, still image acquisition module 14CCD (charge-coupled device) according to expression shape change
Camera acquires static human and facial image by CCD (charge-coupled device) camera.
Touch screen 15, touch screen 15 are used to show Social Match information and receive the touch signal of old man.In view of old man
The characteristics of, touch screen 1524 uses NOVA screen, increases manipulation sense and improves screen intensity and contrast, is convenient for old man's book
It writes and checks.
Positioning system 16, positioning system 16 are used to position the position of the elderly and are sent to clothes as Social Match parameter value
Business device, positioning are positioned using GPS positioning system 16.
The movement that the elderly's daily behavior is acquired by motion capture module 11, is extracted and is identified acquisition by processor 17
Behavioural characteristic signal, while voice signal of the acquisition of voice acquisition module 12 under the current daily behavior pass through processor
17 extractions and recognition of speech signals, so that the two combines the state for determining that the elderly is presently in, such as have a meal, chat, play card,
And the behavior state in special time period is counted, so that it is determined that living habit and the hobby of nursed old man；Processor 17
The keyword in voice signal can be also extracted, keyword frequency of occurrence is counted, classifies after identification to keyword, so that it is determined that
The experience of life and hobby of the elderly.
Processor 17 counts living habit, the experience of life and the hobby of the elderly, forms Social Match parameter value, and
Social Match parameter value is pushed to the Social Match device 2 in server, Social Match device 2 to Social Match parameter value into
Row storage.
Processor 17 also carries out social analysis to the voice signal of extraction, judges whether old man has social demand, if so,
Social desired signal then is sent to Social Match device 2, it is after Social Match device 2 receives desired signal, social demand is old
The Social Match parameter value of other old men stored in the Social Match parameter value and numerical data base of people carries out Data Matching:
When matching value is more than or equal to preset threshold, then Social Match information is sent to by successful match, Social Match device 2
Processor 17, after processor 17 receives Social Match information, control voice cue module 13 issues voice prompting, such as " XX happiness
Joyous fishing, if invite " etc., processor 17 confirms whether old man invites by speech recognition and/or motion capture, such as
Old man agrees to invite, and processor 17 send to the successful human hair of Social Match information and invites signal.
When matching value is less than preset threshold, then it fails to match, and Social Match failure signal is sent to by Social Match device 2
Processor 17, after processor 17 receives Social Match failure signal, control voice cue module 13 issues voice prompting, such as
" Social Match failure " etc..
Voice cue module 13 can also simply be exchanged, when movement is caught other than above-mentioned voice prompting with old man
It catches module 11 and when voice acquisition module 12 does not acquire behavioural characteristic signal and voice signal, voice cue module can be opened
13, old man is inquired, to ensure to obtain accurate Social Match parameter value, reduces error, while also can handle
Emergency situation.
Still image acquisition module 14 is handled for collecting the static human image that the elderly is under daily behavior state
Device 17 is for receiving static human image, extraction and identification feature signal, and by acquiring static human image, processor 17 is to quiet
State human body image carries out feature extraction and identification, and is matched with the static human image pattern stored in database, judges
Behavior state locating for current old man, to be identified through whether just characteristic signal and voice signal combine the behavior state obtained
Really, to obtain accurate Social Match parameter value, error is reduced.Still image acquisition module 14 can also be used to acquire face figure
Picture, processor 17 extract the expression shape change of identification face, and judge whether the elderly has social demand according to expression shape change, pass through
The expression shape change for extracting face, judges the happiness, anger, grief and joy of old man, and then judge whether the elderly has social demand: old when identifying
When the expression of people is more sad, illustrate that old man has something on one's mind, need to exchange with people and mediate, processor 1717 is automatically by social
It is pushed to the Social Match device 2 in server with parameter value, Data Matching is carried out, lifts social demand.
Touch screen 15 is used to show Social Match information and receives the touch signal of old man, for there are communication disorder or spies
When different old man can not be with speech exchange be passed through, the idea of 15 ways of writing of touch screen expression heart can be used.Positioning system 16 can
To position old man position, after inviting successfully, old man can be made to search out faster and invite object, it is lost to also prevent the elderly.
Processor 17 stores the successful the elderly's information of Social Match information, establishes social group.Processor 17 is right
The successful the elderly's information of Social Match information stores, and establishes social group, when old man has social demand, processor 17 from
It selected in social group, reserve good friend.
In use, social data collection device 1 collects the behavioural habits in a period of time in such as one week, caught by movement
The movement that module 11 collects the elderly's daily behavior is caught, acquires voice signal in conjunction with voice acquisition module 12 so that it is determined that old man
Living habit, hobby, when having a meal such as old man, sleep, move, read a book, motion capture module 11 can capture old man's
Action state confirms the current state of old man by acquisition voice signal, and marks storage, obtains accurate old man's life and practises
It is used, and speak middle extraction keyword from daily chat, count keyword frequency of occurrence, so that it is determined that the experience of life of the elderly and
Hobby, such as: when count the keywords such as " Sino-US relations ", " Sino-Japanese relations ", " world structure ", " Syria " appearance
Number is more, illustrates that old man likes the merely political situation of the time and the world affairs；When counting " fishing ", " fishing ", " river bank ", " fishing rod " etc.,
Illustrate that old man is accustomed to fishing, so that it is determined that the hobby of old man.
It ponders a problem when old man stands on window side, can't detect action signal and voice signal, can also be adopted by still image
Collect module 14 acquire picture analyzing old man action state, can also be issued by voice cue module 13 " you why " language
Sound carries out inquiry to messenger, so that it is determined that the action state that old man is current.
After the statistics of processor 17 completes living habit, the experience of life and the hobby of the elderly, Social Match ginseng is formed
Numerical value, and Social Match parameter value is pushed to the Social Match device 2 in server, Social Match device 2 is to Social Match
Parameter value is stored.
When processor 17 analyzes in voice signal with social wish, for example detect that old man says " I wants social " or language
In sentence comprising " lonely " or when having detected " sighing sound ", then judge that old man has social demand；Processor 17 can be with
By analyze still image acquisition module 14 acquire expression shape change in facial image judges whether old man has social demand,
When detecting the expressions such as old man's " frowning ", then judge that old man has social demand.
At this point, processor 17 then sends social desired signal to Social Match device 22, Social Match device 2 receives society
After handing over desired signal, by the Social Match parameter value of other old men stored in the Social Match parameter value of old man and database into
Row Data Matching:
Work as successful match, Social Match information is sent to processor 17 by Social Match device 2, and processor 17 receives society
After handing over match information, control voice cue module 13 issues voice prompting, and such as " XX is fond of fishing, if invites ", " XX is being beaten
Board, if invite and go to " etc., old man feed back by language or with movement, when detect old man say " going ", " can with ",
It indicates that old man agrees to when the movement such as when words such as " good " or detect old man's " nodding ", is then invited to the transmission of successful match object
About；When detect old man say " letting it pass ", " not going " word or collect old man's " shaking the head ", " waving " movement when, illustrate always
People disagrees.After processor 17 receives the reply agreed to by the side of inviting, then gone to according to the position that positioning system 16 positions
Other side position.
It is interacted for there is the elderly of aphasis that can write by touch screen 15 with system, for example hears voice
Prompt, such as " XX is fond of fishing, if invites ", " XX is playing card, if invites and goes to " etc., old man can be on touch screen 15
The words such as " not going " or " going " are directly entered, to express the idea of heart.
For the social object of successful match, processor 17 can be automatically stored in the database, establish social group, later old
People has social demand, selecting object can directly invite from social group.
This programme obtains Social Match by characteristic informations such as living habit, the experience of life and the hobbies of collection old man
Parameter value, so that Auto-matching, which goes out personality, likes similar friend, to meet the social demand of old man.
Simultaneously voice cue module 13 in addition to receive Social Match information and invite information to old man carry out voice mention
Outside showing, old man can also be inquired when can't detect behavioural characteristic signal and voice signal, it is accurate to ensure to obtain
Social Match parameter value reduces error, while when some emergency situations occur for old man, and inquiry can also be carried out to old man and is sent
Distress signal guarantees that old man is timely helped.
What has been described above is only an embodiment of the present invention, and the common sense such as well known specific structure and characteristic are not made herein in scheme
Excessive description, technical field that the present invention belongs to is all before one skilled in the art know the applying date or priority date
Ordinary technical knowledge can know the prior art all in the field, and have using routine experiment hand before the date
The ability of section, one skilled in the art can improve and be implemented in conjunction with self-ability under the enlightenment that the application provides
This programme, some typical known features or known method should not become one skilled in the art and implement the application
Obstacle.It should be pointed out that for those skilled in the art, without departing from the structure of the invention, can also make
Several modifications and improvements out, these also should be considered as protection scope of the present invention, these all will not influence the effect that the present invention is implemented
Fruit and patent practicability.The scope of protection required by this application should be based on the content of the claims, the tool in specification
The records such as body embodiment can be used for explaining the content of claim.
Claims (6)
1. the social intercourse system based on robot, which is characterized in that including being set to the Social Match device of server and being set to machine
Social data collection device on people, in which:
Social Match device is used to receive the Social Match parameter value sent in network, and the Social Match of social demand old man is joined
The Social Match parameter value of other old men stored in numerical value and numerical data base carries out Data Matching:
When matching value is more than or equal to preset threshold, then Social Match information is sent to processing by successful match, Social Match device
Device；
When matching value is less than preset threshold, then it fails to match, and Social Match failure signal is sent to processing by Social Match device
Device；
Social data collection device includes:
Motion capture module, motion capture module are used to collect the action state of the elderly, and the motion capture module includes adding
Velocity sensor and gyroscope, wherein acceleration transducer is used to detect the acceleration signal of human motion, and gyroscope is for examining
Survey the inclined angle signal of human body；
Voice acquisition module, voice acquisition module are used to acquire the voice signal of the elderly and the audio signal of ambient enviroment；
Processor, processor extract for receiving acceleration signal, angle signal, voice signal and audio signal and identification are special
Reference number carries out social analysis, forms Social Match parameter value；
Wherein processor receive after acceleration signal and angle signal with acceleration rate threshold preset in memory and angle threshold
Value compares, so that it is determined that the action state that old man is current；
Wherein processor extracts the keyword in voice signal and audio signal, keyword frequency of occurrence is counted, to pass after identification
Keyword is classified, so that it is determined that the experience of life and hobby of the elderly；
Wherein processor passes through the action state identified and chat content analyzes living habit and the hobby of old man；
Processor is also used to the push Social Match parameter value of the Social Match device into server and transmission is invited；
Processor is also used to receive the Social Match information of Social Match device push and receives other the elderlys and invites；
Voice cue module carries out the elderly when voice cue module receives Social Match information and invite for processor
Voice prompting.
2. the social intercourse system according to claim 1 based on robot, it is characterised in that: further include still image acquisition mould
Block, for collecting the static human image that the elderly is under daily behavior state, processor is used for still image acquisition module
Static human image is received, feature vector is generated using Sift algorithm, key point feature vector is chosen, by key point feature vector
Similarity determination measurement is carried out apart from 2 close key feature vectors with the static human image pattern stored in database:
In the two key points, if secondary short distance is less than default threshold divided by minimum distance, it is determined as match point.
3. the social intercourse system according to claim 2 based on robot, it is characterised in that: the still image acquisition module
It can also be used to acquire facial image, processor extracts the expression shape change of identification face, and judges that the elderly is according to expression shape change
It is no to have social demand.
4. the social intercourse system according to claim 1 based on robot, it is characterised in that: further include touch screen, touch screen
For showing Social Match information and receiving the touch signal of old man.
5. according to claim 1 to described in 4 any claims based on the social intercourse system of robot, it is characterised in that: it is described
Social data collection device further includes positioning system, and positioning system is for positioning the position of the elderly and as Social Match parameter
Value is sent to server.
6. the social intercourse system according to claim 5 based on robot, it is characterised in that: the processor is to Social Match
The successful the elderly's information of information stores.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710510188.8A CN107363862B (en) | 2017-06-28 | 2017-06-28 | Social intercourse system based on robot |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710510188.8A CN107363862B (en) | 2017-06-28 | 2017-06-28 | Social intercourse system based on robot |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107363862A CN107363862A (en) | 2017-11-21 |
| CN107363862B true CN107363862B (en) | 2019-08-09 |
Family
ID=60306572
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710510188.8A Active CN107363862B (en) | 2017-06-28 | 2017-06-28 | Social intercourse system based on robot |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107363862B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108234619A (en) * | 2017-12-28 | 2018-06-29 | 重庆柚瓣家科技有限公司 | Old man's social intercourse system based on robot self-learning capability |
| CN109129508A (en) * | 2018-09-17 | 2019-01-04 | 广州惠创信息科技有限公司 | A kind of intelligent robot interactive system |
| CN112967781A (en) * | 2021-02-01 | 2021-06-15 | 苏州工业职业技术学院 | NFC-based sports social system and method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102223393A (en) * | 2010-04-16 | 2011-10-19 | 英特尔公司 | Methods and systems for relationship characterization and utilization from a user's social networks |
| CN103763179A (en) * | 2014-01-07 | 2014-04-30 | 深圳市中科睿成智能科技有限公司 | Micro-interaction device, micro-interaction system and micro-interaction method |
| CN103914794A (en) * | 2014-04-04 | 2014-07-09 | 田进婷 | One-stop type intelligent comprehensive knowledge service system for the elderly based on cloud computing |
| CN105407038A (en) * | 2015-10-30 | 2016-03-16 | 努比亚技术有限公司 | Social matching device, method and server |
| CN106407346A (en) * | 2016-09-06 | 2017-02-15 | 百度在线网络技术（北京）有限公司 | Retrieval processing method and apparatus based on artificial intelligence |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150314454A1 (en) * | 2013-03-15 | 2015-11-05 | JIBO, Inc. | Apparatus and methods for providing a persistent companion device |
-
2017
- 2017-06-28 CN CN201710510188.8A patent/CN107363862B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102223393A (en) * | 2010-04-16 | 2011-10-19 | 英特尔公司 | Methods and systems for relationship characterization and utilization from a user's social networks |
| CN103763179A (en) * | 2014-01-07 | 2014-04-30 | 深圳市中科睿成智能科技有限公司 | Micro-interaction device, micro-interaction system and micro-interaction method |
| CN103914794A (en) * | 2014-04-04 | 2014-07-09 | 田进婷 | One-stop type intelligent comprehensive knowledge service system for the elderly based on cloud computing |
| CN105407038A (en) * | 2015-10-30 | 2016-03-16 | 努比亚技术有限公司 | Social matching device, method and server |
| CN106407346A (en) * | 2016-09-06 | 2017-02-15 | 百度在线网络技术（北京）有限公司 | Retrieval processing method and apparatus based on artificial intelligence |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107363862A (en) | 2017-11-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106057205B (en) | Automatic voice interaction method for intelligent robot | |
| CN106682090B (en) | Active interaction implementation device and method and intelligent voice interaction equipment | |
| Bousmalis et al. | Towards the automatic detection of spontaneous agreement and disagreement based on nonverbal behaviour: A survey of related cues, databases, and tools | |
| CN107423398B (en) | Interaction method, interaction device, storage medium and computer equipment | |
| CN110780707B (en) | Information processing apparatus, information processing method, and computer readable medium | |
| Junker et al. | Gesture spotting with body-worn inertial sensors to detect user activities | |
| CN110427462A (en) | With method, apparatus, storage medium and the service robot of user interaction | |
| Varghese et al. | Overview on emotion recognition system | |
| CN108305615A (en) | A kind of object identifying method and its equipment, storage medium, terminal | |
| CN109815795A (en) | Classroom student's state analysis method and device based on face monitoring | |
| CN112088315A (en) | Multi-mode speech positioning | |
| CN107363862B (en) | Social intercourse system based on robot | |
| CN110853646A (en) | Method, device and equipment for distinguishing conference speaking roles and readable storage medium | |
| Lin et al. | Activity recognition using a combination of category components and local models for video surveillance | |
| CN111985348B (en) | Face recognition method and system | |
| JP6397250B2 (en) | Concentration estimation apparatus, method and program | |
| Gelman et al. | Gaydar and the fallacy of decontextualized measurement | |
| WO2012020591A1 (en) | System for identifying individuals, feature value specification device, feature specification method, and recording medium | |
| Hung et al. | Detecting conversing groups with a single worn accelerometer | |
| CN109829691B (en) | C/S card punching method and device based on position and deep learning multiple biological features | |
| Zhang et al. | Multimodal Deception Detection Using Automatically Extracted Acoustic, Visual, and Lexical Features. | |
| Hedayati et al. | Reform: Recognizing f-formations for social robots | |
| CN102509548B (en) | Audio indexing method based on multi-distance sound sensor | |
| CN108810625A (en) | A kind of control method for playing back of multi-medium data, device and terminal | |
| KR20170036927A (en) | System for building social emotion network and method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |