CN107363862A - Social intercourse system based on robot - Google Patents
Social intercourse system based on robot Download PDFInfo
- Publication number
- CN107363862A CN107363862A CN201710510188.8A CN201710510188A CN107363862A CN 107363862 A CN107363862 A CN 107363862A CN 201710510188 A CN201710510188 A CN 201710510188A CN 107363862 A CN107363862 A CN 107363862A
- Authority
- CN
- China
- Prior art keywords
- social
- match
- processor
- signal
- old man
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000013480 data collection Methods 0.000 claims abstract description 11
- 230000001133 acceleration Effects 0.000 claims description 31
- 230000003068 static effect Effects 0.000 claims description 17
- 238000000605 extraction Methods 0.000 claims description 16
- 230000014509 gene expression Effects 0.000 claims description 16
- 230000006399 behavior Effects 0.000 claims description 14
- 230000008859 change Effects 0.000 claims description 11
- 238000012545 processing Methods 0.000 claims description 9
- 230000001815 facial effect Effects 0.000 claims description 5
- 238000005259 measurement Methods 0.000 claims description 5
- 230000005236 sound signal Effects 0.000 claims description 5
- 230000005540 biological transmission Effects 0.000 claims description 3
- 230000009471 action Effects 0.000 description 10
- 230000003542 behavioural effect Effects 0.000 description 6
- 230000009286 beneficial effect Effects 0.000 description 6
- 230000000694 effects Effects 0.000 description 6
- 235000012054 meals Nutrition 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 208000030251 communication disease Diseases 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 235000013399 edible fruits Nutrition 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 230000001404 mediated effect Effects 0.000 description 2
- 238000000034 method Methods 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 241000208340 Araliaceae Species 0.000 description 1
- 206010003694 Atrophy Diseases 0.000 description 1
- 206010048909 Boredom Diseases 0.000 description 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 1
- 235000003140 Panax quinquefolius Nutrition 0.000 description 1
- 230000037444 atrophy Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000009429 distress Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 235000008434 ginseng Nutrition 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000035479 physiological effects, processes and functions Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000000284 resting effect Effects 0.000 description 1
- 208000024891 symptom Diseases 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J19/00—Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/01—Social networking
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Strategic Management (AREA)
- Mechanical Engineering (AREA)
- Health & Medical Sciences (AREA)
- Economics (AREA)
- General Health & Medical Sciences (AREA)
- Robotics (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Computing Systems (AREA)
- Tourism & Hospitality (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Medical Treatment And Welfare Office Work (AREA)
- Telephonic Communication Services (AREA)
Abstract
The present patent application discloses the social intercourse system based on robot, including the Social Match device located at server and the social data collection device in robot, Social Match device is used to receive the Social Match parameter value sent in network, store and carry out Data Matching, send Social Match information；The daily behavior that social data collection device is used to collect old man forms Social Match parameter value, analysis and sends social demand, and the social data collection device includes motion capture module, voice acquisition module, processor, voice cue module.This programme provides a Social Match platform for the elderly, realizes the friend that similar personality is found according to feature tag, meets the social demand of old man.
Description
Technical field
The present invention relates to robot communication technical field, more particularly to a kind of social intercourse system based on robot.
Background technology
In actual life, many old men lack necessary social activity.By the issue of national development research institute of Peking University
China's Healthy in 2015 shows that, in rural area, 45.61% more than 60 years old old man does not join with endowment follow-up study project research report
Add social activities, in city, this ratio is 23.98%.More than 60 years old in interviewed old man, 33.1% has more serious depression
Symptom.
There is news report to claim within 2017, a civic mother carrys out Luoyang life from other places, because no one speaks here,
Just often go out alone to relieve boredom, a night has been sat alone in Luoyang railway station waiting hall unexpectedly in a whole night.From the point of view of surface, old man is alone
It is outgoing, do not go home all night, because of lonely, and it is profound the reason for be then two lifes of people ground after old man comes Luoyang, social circle's atrophy, always
The social demand of people cannot effectively meet some psychological problems easily occur, or even make the behavior of " strange ".
American Psychologist's Maslow's theory thinks that, except possessing basic physiology and demand for security, people also possesses the essence of social activity
Refreshing demand.As young man, old man also has normal social demand.In some cities, university for the aged why one it is hard to find,
Also in that herein, the old men can establish the suitable social circle of oneself, their social demand has obtained release and met,
It is unimportant on the contrary that what is learned.
And for newly moving in the old man in home for destitute, original known social circle is have left, enters a strange environment,
It is less with surrounding people's communication because not known about to the old man in home for destitute, feel lonely；And for moving in time longer old man,
Because of the difference of old man's life style with surrounding, experience etc., common topic can not be produced to each other, social demand obtains not
To release and meet, can also feel that heart is lonely in the course of time.
The content of the invention
The invention is intended to provide a kind of social intercourse system based on robot, a Social Match platform is provided for the elderly,
The friend that similar personality is found according to feature tag is realized, meets the social demand of old man.
The present invention provides base case：Social intercourse system based on robot, including filled located at the Social Match of server
Put and the social data collection device in robot, wherein：
Social Match device is used to receive the Social Match parameter value sent in network, and the Social Match of social demand old man is joined
The Social Match parameter value of other old men of the numerical value with being stored in numerical data base carries out Data Matching：
When matching value is more than or equal to predetermined threshold value, then the match is successful, and Social Match information is sent to processing by Social Match device
Device；
When matching value is less than predetermined threshold value, then it fails to match, and Social Match failure signal is sent to processing by Social Match device
Device；
Social data collection device includes：
Motion capture module, motion capture module are used for the operating state for collecting the elderly, and the motion capture module includes adding
Velocity sensor and gyroscope, wherein, acceleration transducer is used for the acceleration signal for detecting human motion, and gyroscope is used to examine
Survey the inclined angle signal of human body；
Voice acquisition module, voice acquisition module are used to gather the voice signal of the elderly and the audio signal of surrounding environment；
Processor, processor are used to receive acceleration signal, angle signal and voice signal, extraction and identification feature signal, entered
The social analysis of row, forms Social Match parameter value；
Wherein processor receive after acceleration signal and angle signal with default acceleration rate threshold in memory and angle threshold
Value is contrasted, so that it is determined that the operating state that old man is current；
Keyword wherein in processor extraction voice signal and audio signal, counts keyword occurrence number, to closing after identification
Keyword is classified, so that it is determined that the experience of life and hobby of the elderly；
Wherein processor analyzes habits and customs and the hobby of old man by the operating state and chat content that identify；
The Social Match device that processor is additionally operable into server pushes Social Match parameter value and transmission is invited；
Processor is additionally operable to receive the Social Match information of Social Match device push and receive other the elderlys to invite；
Voice cue module, the elderly is carried out when voice cue module receives Social Match information and invited for processor
Voice message.
The operation principle of base case：The action of the elderly's daily behavior is gathered by motion capture module, wherein accelerating
Degree sensor can measure the acceleration of human motion, and then judge the distance of human motion；Gyroscope can detect
Human body rotate, deflection angle, by measuring the rotation status of itself, judge human body current motion state, be forward, backward,
Upwards, downwards, to the left still to the right, be accelerate（Angular speed）Or slow down（Angular speed）, both combine to form inertia measurement list
Member, it can accurately judge the operating state of human body.
Detailed process, acceleration transducer and gyroscope gather the actual act of the elderly and are sent to processor in real time,
Processor receives after acceleration signal and angle signal to be carried out pair with default acceleration rate threshold in processor and angle threshold
Than：
When acceleration signal is more than predetermined acceleration threshold value, angle signal may also greater than predetermined angle threshold value, such a situation
Then it is judged as that human body is squatted down；
When acceleration signal is more than predetermined acceleration threshold value, angle signal is less than or equal to predetermined angle threshold value, and such a situation can
It can then be judged as that human body is being run；
When acceleration signal is less than or equal to predetermined acceleration threshold value, angle signal is more than or equal to predetermined angle threshold value, such a feelings
Condition may then be judged as that human body is being bent over；
When acceleration signal is less than or equal to predetermined acceleration threshold value, angle signal is less than or equal to predetermined angle threshold value, such a feelings
Condition may then judge not move for people, may be in reading of resting or be seated.
The voice signal that voice acquisition module collection simultaneously is under current daily behavior, is extracted and identified by processor
The feature of voice signal, so as to which both binding analysis go out the state that the elderly is presently in, such as have a meal, chat, play card, and unite
The behavior state in special time period is counted, so that it is determined that habits and customs and the hobby of nursed old man；Processor can also carry
The keyword in voice signal is taken, keyword occurrence number is counted, keyword is classified after identification, so that it is determined that the elderly
The experience of life and hobby.
Processor passes through operating state and the chat content analysis identified, the habits and customs for counting the elderly, life
Experience and hobby, Social Match parameter value is formed, and Social Match parameter value is pushed to the Social Match in server
Device, Social Match device store to Social Match parameter value.
Processor also carries out social analysis to the voice signal of extraction, judges whether old man has social demand, if so, then
Social desired signal is sent to Social Match device, after Social Match device receives desired signal, by social demand old man's
The Social Match parameter value of other old men of the Social Match parameter value with being stored in numerical data base carries out Data Matching：
When matching value is more than or equal to predetermined threshold value, then the match is successful, and Social Match information is sent to processing by Social Match device
Device, after processor receives Social Match information, control voice reminding module sends voice message, such as " XX is fond of fishing, if
Invite " etc., processor confirms whether old man is invited by speech recognition and/or motion capture, as old man agree to invite,
Processor sends to the successful people of Social Match information and invites signal.
When matching value is less than predetermined threshold value, then it fails to match, and Social Match failure signal is sent to by Social Match device
Processor, after processor receives Social Match failure signal, control voice reminding module sends voice message, such as " social
With failure " etc..
Voice cue module can also simply be exchanged with old man in addition to above-mentioned voice message, work as motion capture
When module and voice acquisition module do not collect behavioural characteristic signal and voice signal, voice cue module can be opened, to old
People is inquired, to ensure to obtain accurate Social Match parameter value, reduces error, while can also handle some emergencies
Situation.
The beneficial effect of base case is：This programme is by collecting habits and customs, the experience of life and the hobby of old man
Social Match parameter value is obtained Deng characteristic information, similar friend is liked so as to which Auto-matching goes out personality, to meet the society of old man
Friendship demand.
Voice cue module is except receiving Social Match information and inviting information to old man's progress voice message simultaneously
Outside, old man can also be inquired when can't detect behavioural characteristic signal and voice signal, to ensure to obtain accurate society
Match parameter value is handed over, reduces error, while when some emergency situations occur for old man, inquiry can be also carried out to old man and is sent to ask
Signal is rescued, ensures that old man is timely helped.
Preferred scheme one：Based on scheme preferred, in addition to still image acquisition module, still image acquisition module
The still image being in for collecting the elderly under daily behavior state, processor are used to receive static human image, used
Sift algorithms generate characteristic vector, choose key point characteristic vector, the static state that will be stored in key point characteristic vector and database
Human body image sample carries out similarity determination measurement apart from close 2 key features vector：When in the two key points, such as
Fruit time is closely divided by minimum distance is less than default threshold, then is determined as match point.Beneficial effect：By gathering static human figure
Picture, processor carry out feature extraction and identification, and the static human image pattern with being stored in database to static human image
Matched, judge the operating state residing for current old man, to be identified through acceleration signal, angle signal and voice signal knot
Whether correct close the operating state obtained, so as to obtain accurate Social Match parameter value, reduce error.
Preferred scheme two：Preferably one it is preferred, still image acquisition module can be additionally used in gather facial image,
The expression shape change of processor extraction identification face, and judge whether the elderly has social demand according to expression shape change.Beneficial effect：
By extracting the expression shape change of face, the happiness, anger, grief and joy of old man are judged, and then judge whether the elderly has social demand：
When the expression for identifying old man is more sad, illustrates that old man has something on one's mind and mediated, it is necessary to be exchanged with people, processor is certainly
The dynamic Social Match device being pushed to Social Match parameter value in server, carries out Data Matching, lifts social demand.
Preferred scheme three：Based on scheme preferred, in addition to touch-screen, touch-screen is used to show Social Match information
And receive the touch signal of old man.Beneficial effect：For exist communication disorder or special old man can not be with passing through speech exchange when,
The idea of touch-screen ways of writing expression heart can be used.
Preferred scheme four：Based on scheme, preferred scheme one, preferred scheme two and preferred scheme three it is preferred, it is social
Transacter also includes alignment system, and alignment system is used for the position for positioning the elderly and as Social Match parameter value hair
Give server.Beneficial effect：Alignment system can position old man position, after inviting successfully, old man can be made to find faster
To object is invited, it also prevent that the elderly is lost to wander away.
Preferred scheme five：Preferably four it is preferred, processor is to the successful the elderly's information of Social Match information
Stored.Beneficial effect：Processor stores to the successful the elderly's information of Social Match information, establishes social group, when
When old man has social demand, processor selects from social group, preengages good friend, convenient and swift.
Brief description of the drawings
Fig. 1 is the theory diagram of the social intercourse system embodiment of the invention based on robot.
Embodiment
Below by embodiment, the present invention is further detailed explanation：
Reference in Figure of description includes：Social data collection device 1, motion capture module 11, voice acquisition module
12nd, voice cue module 13, still image acquisition module 14, touch-screen 15, alignment system 16, processor 17, Social Match dress
Put 2.
Social intercourse system embodiment based on robot is substantially as shown in Figure 1：Including the social data in robot
Collection device 1 and the Social Match device 2 located at server, wherein：
Social Match device 2 is used to receive the Social Match parameter value sent in network, by the Social Match of social demand old man
The Social Match parameter value of other old men of the parameter value with being stored in numerical data base carries out Data Matching：
When matching value is more than or equal to predetermined threshold value, then the match is successful, and Social Match information is sent to processing by Social Match device 2
Device 17；
When matching value is less than predetermined threshold value, then it fails to match, and Social Match failure signal is sent to processing by Social Match device 2
Device 17；
Social data collection device 1 includes：
Motion capture module 11, motion capture module 11 are used for the operating state for collecting the elderly, the motion capture module 11
Including acceleration transducer and gyroscope, wherein, acceleration transducer is used for the acceleration signal for detecting human motion, gyroscope
For detecting the inclined angle signal of human body；
Acceleration transducer uses three axis accelerometer, can measure the acceleration of human motion, and then judges that human body moves
Dynamic distance；Gyroscope uses three-axis gyroscope, by measuring the rotation status of itself, judges human body current motion state,
It is forward, back, up, downwards, to the left or to the right, is to accelerate（Angular speed）Or slow down（Angular speed）, both combine shape
Into 6 axle Inertial Measurement Units, the operating state of human body can be accurately judged.
Voice acquisition module 12, voice acquisition module 12 are used to gather the voice signal of the elderly and the audio of surrounding environment
Signal；Wherein voice acquisition module 12 includes microphone and the sound identification module of Xun Fei companies of University of Science and Technology, reaches speech recognition effect.
Processor 17, using the progress data processing of domestic Godson CPU and control, processor 17 is used to receive and added processor 17
Rate signal, angle signal and voice signal, extraction and identification feature signal, carry out social analysis, form Social Match parameter
Value；
Wherein processor 17 receive after acceleration signal and angle signal with default acceleration rate threshold and angle in memory
Threshold value is contrasted, so that it is determined that the operating state that old man is current；
Wherein processor 17 extracts the keyword in voice signal and audio signal, counts keyword occurrence number, right after identification
Keyword is classified, so that it is determined that the experience of life and hobby of the elderly；
Wherein processor 17 analyzes habits and customs and the hobby of old man by the operating state and chat content that identify；
The Social Match device 2 that processor 17 is additionally operable into server pushes Social Match parameter value and transmission is invited；
Processor 17 is additionally operable to receive the Social Match information of the push of Social Match device 2 and receive other the elderlys to invite；
Voice cue module 13, to old age when voice cue module 13 receives Social Match information and invited for processor 17
People carries out voice message.Voice cue module 13 is using loudspeaker and carries model E702T dio Output Modules, reaches defeated
Go out the effect of voice signal.
Also include still image acquisition module 14, still image acquisition module 14 is in daily behavior for collecting the elderly
Still image under state, processor 17 are used to receive static human image, generate characteristic vector using Sift algorithms, choose and close
Key point feature vector, by the static human image pattern stored in key point characteristic vector and database apart from 2 close passes
Key characteristic vector carries out similarity determination measurement：When in the two key points, if it is secondary closely divided by minimum distance is less than
Default threshold, then be determined as match point, and by gathering static human image, processor 17 carries out feature to static human image and carried
Take and identify, and matched with the static human image pattern stored in database, judge the action shape residing for current old man
State, it is whether correct to be identified through the operating state of acceleration signal, angle signal and voice signal combination acquisition, so as to obtain
Accurate Social Match parameter value, reduces error.
Still image acquisition module 14 can also be used to gather facial image, and the expression of the extraction identification face of processor 17 becomes
Change, and judge whether the elderly has social demand, still image acquisition module 14CCD according to expression shape change（Charge coupling device）
Camera, pass through CCD（Charge coupling device）Camera gathers static human and facial image.
Touch-screen 15, touch-screen 15 are used to show Social Match information and receive the touch signal of old man.In view of old man
The characteristics of, touch-screen 1524 uses NOVA screens, and increase manipulation is felt and improves screen intensity and contrast, is easy to old man's book
Write and check.
Alignment system 16, alignment system 16 are used for the position for positioning the elderly and are sent to clothes as Social Match parameter value
Business device, positioning are positioned using GPS positioning system 16.
The action of the elderly's daily behavior is gathered by motion capture module 11, extracts and identify collection by processor 17
Behavioural characteristic signal, while voice acquisition module 12 collection be in current daily behavior under voice signal, pass through processor
17 extractions and recognition of speech signals, so as to which both combine the state for determining that the elderly is presently in, such as have a meal, chat, play card,
And the behavior state in special time period is counted, so that it is determined that habits and customs and the hobby of nursed old man；Processor 17
The keyword in voice signal can be also extracted, keyword occurrence number is counted, keyword is classified after identification, so that it is determined that
The experience of life and hobby of the elderly.
Processor 17 counts habits and customs, the experience of life and the hobby of the elderly, forms Social Match parameter value, and
The Social Match device 2 Social Match parameter value being pushed in server, Social Match device 2 enter to Social Match parameter value
Row storage.
Processor 17 also carries out social analysis to the voice signal of extraction, judges whether old man has social demand, if so,
Social desired signal then is sent to Social Match device 2, it is after Social Match device 2 receives desired signal, social demand is old
The Social Match parameter value of other old men of the Social Match parameter value of people with being stored in numerical data base carries out Data Matching：
When matching value is more than or equal to predetermined threshold value, then the match is successful, and Social Match information is sent to processing by Social Match device 2
Device 17, after processor 17 receives Social Match information, control voice reminding module 13 sends voice message, and such as " XX likes fishing
Fish, if invite " etc., processor 17 confirms whether old man is invited by speech recognition and/or motion capture, such as old man
Agreement is invited, and processor 17 sends to the successful people of Social Match information and invites signal.
When matching value is less than predetermined threshold value, then it fails to match, and Social Match failure signal is sent to by Social Match device 2
Processor 17, after processor 17 receives Social Match failure signal, control voice reminding module 13 sends voice message, such as
" Social Match failure " etc..
Voice cue module 13 can also simply be exchanged in addition to above-mentioned voice message with old man, when action is caught
Catch module 11 and when voice acquisition module 12 does not collect behavioural characteristic signal and voice signal, voice cue module can be opened
13, old man is inquired, to ensure to obtain accurate Social Match parameter value, reduces error, while can also handle
Emergency situation.
Still image acquisition module 14 is used to collect the static human image that the elderly is under daily behavior state, handles
Device 17 is used to receive static human image, extraction and identification feature signal, and by gathering static human image, processor 17 is to quiet
State human body image carries out feature extraction and identification, and is matched with the static human image pattern stored in database, judges
Behavior state residing for current old man, to be identified through whether just characteristic signal and voice signal combine the behavior state obtained
Really, so as to obtain accurate Social Match parameter value, error is reduced.Still image acquisition module 14 can also be used to gather face figure
Picture, the expression shape change of the extraction identification face of processor 17, and judge whether the elderly has social demand according to expression shape change, pass through
The expression shape change of face is extracted, judges the happiness, anger, grief and joy of old man, and then judge whether the elderly has social demand：It is old when identifying
When the expression of people is more sad, illustrates that old man has something on one's mind and mediated, it is necessary to be exchanged with people, processor 1717 is automatically by social
The Social Match device 2 being pushed to parameter value in server, Data Matching is carried out, lifts social demand.
Touch-screen 15 is used to show Social Match information and receives the touch signal of old man, for communication disorder or spy be present
When different old man can not be with passing through speech exchange, the idea of the ways of writing of touch-screen 15 expression heart can be used.Alignment system 16 can
To position old man position, after inviting successfully, old man can be made to search out faster and invite object, the elderly is also prevent and get lost.
Processor 17 stores to the successful the elderly's information of Social Match information, establishes social group.Processor 17 is right
The successful the elderly's information of Social Match information is stored, and establishes social group, when old man has social demand, processor 17 from
Selected in social group, preengage good friend.
In use, social data collection device 1 collects the behavioural habits in such as one week in a period of time, caught by action
The action that module 11 collects the elderly's daily behavior is caught, gathers voice signal with reference to voice acquisition module 12 so that it is determined that old man
Habits and customs, hobby, as old man has a meal, sleep, move, read a book when, motion capture module 11 can capture old man's
Operating state, confirm the current state of old man by gathering voice signal, and mark storage, obtain accurate old man's life and practise
It is used, and spoken middle extraction keyword from daily chat, count keyword occurrence number, so that it is determined that the experience of life of the elderly and
Hobby, such as：When count the keyword such as " Sino-US relations ", " Sino-Japanese relations ", " world structure ", " Syria " appearance
Number is more, illustrates that old man likes the merely political situation of the time and the world affairs；When counting " fishing ", " fishing ", " river bank ", " fishing rod " etc.,
Illustrate that old man is accustomed to fishing, so that it is determined that the hobby of old man.
Pondered a problem when old man stands on window side, can't detect action signal and voice signal, can also be adopted by still image
Collect the operating state for the picture analyzing old man that module 14 gathers, the language of " you why " can be also sent by voice cue module 13
Sound carries out inquiry to messenger, so that it is determined that the operating state that old man is current.
After the statistics of processor 17 completes habits and customs, the experience of life and the hobby of the elderly, Social Match ginseng is formed
Numerical value, and Social Match parameter value is pushed to the Social Match device 2 in server, Social Match device 2 is to Social Match
Parameter value is stored.
When processor 17 is analyzed in voice signal with social wish, for example detect that old man says " I am social " or language
When " lonely " is included in sentence or has detected " sighing sound ", then judge that old man has social demand；Processor 17 can be with
By analyze still image acquisition module 14 gather expression shape change in facial image judges whether old man has social demand,
When detecting the expressions such as old man's " frowning ", then judge that old man has social demand.
Now, processor 17 then sends social desired signal to Social Match device 22, and Social Match device 2 receives society
After handing over desired signal, the Social Match parameter value of other old men of the Social Match parameter value of old man with being stored in database is entered
Row Data Matching：
When the match is successful, Social Match information is sent to processor 17 by Social Match device 2, and processor 17 receives social
After information, control voice reminding module 13 sends voice message, such as " XX is fond of fishing, if invites ", " XX plays card,
Whether invite and go to " etc., old man is fed back by language or with action, when detecting that old man says " going ", " can with ", " good
" etc. word when or represent that old man agrees to when detecting the action such as old man's " nodding ", then send and invite to the match is successful object；When
Detect that old man says " letting it pass ", the word of " not going " or when collecting old man's " shaking the head ", " waving " action, illustrate that old man is different
Meaning.After processor 17 receives the reply agreed to by the side of inviting, then other side institute is gone in the position positioned according to alignment system 16
In position.
Interacted for there is the elderly of aphasis to be write by touch-screen 15 with system, for example hear voice
Prompting, such as " XX is fond of fishing, if invites ", " XX plays card, if invites and goes to " etc., old man can be on touch-screen 15
The words such as " not going " or " going " are directly entered, to express the idea of heart.
For the social object that the match is successful, processor 17 can be stored automatically in database, establish social group, later old
People has social demand, selecting object can directly be invited from social group.
The characteristic informations such as habits and customs, the experience of life and hobby of this programme by collecting old man obtain Social Match
Parameter value, similar friend is liked so as to which Auto-matching goes out personality, to meet the social demand of old man.
Simultaneously voice cue module 13 except receive Social Match information and invite information to old man carry out voice carry
Outside showing, old man can also be inquired when can't detect behavioural characteristic signal and voice signal, it is accurate to ensure to obtain
Social Match parameter value, error is reduced, while when some emergency situations occur for old man, inquiry can be also carried out to old man and is sent
Distress signal, ensure that old man is timely helped.
Above-described is only embodiments of the invention, and the general knowledge such as known concrete structure and characteristic is not made herein in scheme
Excessive description, technical field that the present invention belongs to is all before one skilled in the art know the applying date or priority date
Ordinary technical knowledge, prior art all in the field can be known, and with using normal experiment hand before the date
The ability of section, one skilled in the art can improve and implement under the enlightenment that the application provides with reference to self-ability
This programme, some typical known features or known method should not implement the application as one skilled in the art
Obstacle.It should be pointed out that for those skilled in the art, without departing from the structure of the invention, it can also make
Go out several modifications and improvements, these should also be considered as protection scope of the present invention, these effects implemented all without the influence present invention
Fruit and practical applicability.The scope of protection required by this application should be based on the content of the claims, the tool in specification
The records such as body embodiment can be used for the content for explaining claim.
Claims (6)
1. the social intercourse system based on robot, it is characterised in that including the Social Match device located at server and located at machine
Social data collection device on people, wherein：
Social Match device is used to receive the Social Match parameter value sent in network, and the Social Match of social demand old man is joined
The Social Match parameter value of other old men of the numerical value with being stored in numerical data base carries out Data Matching：
When matching value is more than or equal to predetermined threshold value, then the match is successful, and Social Match information is sent to processing by Social Match device
Device；
When matching value is less than predetermined threshold value, then it fails to match, and Social Match failure signal is sent to processing by Social Match device
Device；
Social data collection device includes：
Motion capture module, motion capture module are used for the operating state for collecting the elderly, and the motion capture module includes adding
Velocity sensor and gyroscope, wherein, acceleration transducer is used for the acceleration signal for detecting human motion, and gyroscope is used to examine
Survey the inclined angle signal of human body；
Voice acquisition module, voice acquisition module are used to gather the voice signal of the elderly and the audio signal of surrounding environment；
Processor, processor are used to receive acceleration signal, angle signal and voice signal, extraction and identification feature signal, entered
The social analysis of row, forms Social Match parameter value；
Wherein processor receive after acceleration signal and angle signal with default acceleration rate threshold in memory and angle threshold
Value is contrasted, so that it is determined that the operating state that old man is current；
Keyword wherein in processor extraction voice signal and audio signal, counts keyword occurrence number, to closing after identification
Keyword is classified, so that it is determined that the experience of life and hobby of the elderly；
Wherein processor analyzes habits and customs and the hobby of old man by the operating state and chat content that identify；
The Social Match device that processor is additionally operable into server pushes Social Match parameter value and transmission is invited；
Processor is additionally operable to receive the Social Match information of Social Match device push and receive other the elderlys to invite；
Voice cue module, the elderly is carried out when voice cue module receives Social Match information and invited for processor
Voice message.
2. the social intercourse system according to claim 1 based on robot, it is characterised in that：Also include still image collection mould
Block, still image acquisition module are used to collect the still image that the elderly is under daily behavior state, and processor is used to receive
Static human image, characteristic vector is generated using Sift algorithms, key point characteristic vector is chosen, by key point characteristic vector and number
According to the static human image pattern stored in storehouse similarity determination measurement is carried out apart from close 2 key features vector：When
In the two key points, if it is secondary closely divided by minimum distance is less than default threshold, be determined as match point.
3. the social intercourse system according to claim 2 based on robot, it is characterised in that：The still image acquisition module
It can also be used to gather facial image, the expression shape change of processor extraction identification face, and judge that the elderly is according to expression shape change
It is no to have social demand.
4. the social intercourse system according to claim 1 based on robot, it is characterised in that：Also include touch-screen, touch-screen
For showing Social Match information and receiving the touch signal of old man.
5. the social intercourse system based on robot according to Claims 1-4 any claim, it is characterised in that：It is described
Social data collection device also includes alignment system, and alignment system is used for the position for positioning the elderly and is used as Social Match parameter
Value is sent to server.
6. the social intercourse system according to claim 5 based on robot, it is characterised in that：The processor is to Social Match
The successful the elderly's information of information is stored.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710510188.8A CN107363862B (en) | 2017-06-28 | 2017-06-28 | Social intercourse system based on robot |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710510188.8A CN107363862B (en) | 2017-06-28 | 2017-06-28 | Social intercourse system based on robot |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107363862A true CN107363862A (en) | 2017-11-21 |
| CN107363862B CN107363862B (en) | 2019-08-09 |
Family
ID=60306572
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710510188.8A Active CN107363862B (en) | 2017-06-28 | 2017-06-28 | Social intercourse system based on robot |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107363862B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108234619A (en) * | 2017-12-28 | 2018-06-29 | 重庆柚瓣家科技有限公司 | Old man's social intercourse system based on robot self-learning capability |
| CN109129508A (en) * | 2018-09-17 | 2019-01-04 | 广州惠创信息科技有限公司 | A kind of intelligent robot interactive system |
| CN112967781A (en) * | 2021-02-01 | 2021-06-15 | 苏州工业职业技术学院 | NFC-based sports social system and method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102223393A (en) * | 2010-04-16 | 2011-10-19 | 英特尔公司 | Methods and systems for relationship characterization and utilization from a user's social networks |
| CN103763179A (en) * | 2014-01-07 | 2014-04-30 | 深圳市中科睿成智能科技有限公司 | Micro-interaction device, micro-interaction system and micro-interaction method |
| CN103914794A (en) * | 2014-04-04 | 2014-07-09 | 田进婷 | One-stop type intelligent comprehensive knowledge service system for the elderly based on cloud computing |
| CN105407038A (en) * | 2015-10-30 | 2016-03-16 | 努比亚技术有限公司 | Social matching device, method and server |
| US20160171979A1 (en) * | 2013-03-15 | 2016-06-16 | JIBO, Inc. | Tiled grammar for phrase spotting with a persistent companion device |
| CN106407346A (en) * | 2016-09-06 | 2017-02-15 | 百度在线网络技术（北京）有限公司 | Retrieval processing method and apparatus based on artificial intelligence |
-
2017
- 2017-06-28 CN CN201710510188.8A patent/CN107363862B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102223393A (en) * | 2010-04-16 | 2011-10-19 | 英特尔公司 | Methods and systems for relationship characterization and utilization from a user's social networks |
| US20160171979A1 (en) * | 2013-03-15 | 2016-06-16 | JIBO, Inc. | Tiled grammar for phrase spotting with a persistent companion device |
| CN103763179A (en) * | 2014-01-07 | 2014-04-30 | 深圳市中科睿成智能科技有限公司 | Micro-interaction device, micro-interaction system and micro-interaction method |
| CN103914794A (en) * | 2014-04-04 | 2014-07-09 | 田进婷 | One-stop type intelligent comprehensive knowledge service system for the elderly based on cloud computing |
| CN105407038A (en) * | 2015-10-30 | 2016-03-16 | 努比亚技术有限公司 | Social matching device, method and server |
| CN106407346A (en) * | 2016-09-06 | 2017-02-15 | 百度在线网络技术（北京）有限公司 | Retrieval processing method and apparatus based on artificial intelligence |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108234619A (en) * | 2017-12-28 | 2018-06-29 | 重庆柚瓣家科技有限公司 | Old man's social intercourse system based on robot self-learning capability |
| CN109129508A (en) * | 2018-09-17 | 2019-01-04 | 广州惠创信息科技有限公司 | A kind of intelligent robot interactive system |
| CN112967781A (en) * | 2021-02-01 | 2021-06-15 | 苏州工业职业技术学院 | NFC-based sports social system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107363862B (en) | 2019-08-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230041117A1 (en) | Monitoring and analyzing body language with machine learning, using artificial intelligence systems for improving interaction between humans, and humans and robots | |
| Cabrera-Quiros et al. | The MatchNMingle dataset: a novel multi-sensor resource for the analysis of social interactions and group dynamics in-the-wild during free-standing conversations and speed dates | |
| CN110780707B (en) | Information processing apparatus, information processing method, and computer readable medium | |
| CN104850846B (en) | A kind of Human bodys' response method and identifying system based on deep neural network | |
| Felski | Latour and literary studies | |
| CN110427462A (en) | With method, apparatus, storage medium and the service robot of user interaction | |
| CN109271832A (en) | Stream of people's analysis method, stream of people's analytical equipment and stream of people's analysis system | |
| WO2016158267A1 (en) | Information processing device, information processing method, and program | |
| KR101194186B1 (en) | A lifelog system by using intelligent context-aware | |
| JP2015510636A (en) | System and method for identifying and analyzing a user's personal context | |
| Chen et al. | A framework for group activity detection and recognition using smartphone sensors and beacons | |
| Hung et al. | Detecting conversing groups with a single worn accelerometer | |
| CN109176535A (en) | Exchange method and system based on intelligent robot | |
| CN107363862A (en) | Social intercourse system based on robot | |
| CN109447232A (en) | Robot active inquiry method, apparatus, electronic equipment and storage medium | |
| Gelman et al. | Gaydar and the fallacy of decontextualized measurement | |
| EP3726453A1 (en) | Information processing device, information processing method, and program | |
| CN111144359A (en) | Exhibit evaluation device and method and exhibit pushing method | |
| Saunders et al. | Following or forging a way through the world: Audio walks and the making of place | |
| US20220335275A1 (en) | Multimodal, dynamic, privacy preserving age and attribute estimation and learning methods and systems | |
| Kim et al. | Activity recognition for a smartphone and web-based human mobility sensing system | |
| CN112286758A (en) | Information processing method, information processing device, electronic equipment and computer readable storage medium | |
| Kim et al. | Activity recognition for a smartphone and web based travel survey | |
| Rosatelli et al. | Detecting f-formations & roles in crowded social scenes with wearables: Combining proxemics & dynamics using lstms | |
| CN114242235A (en) | Autism patient portrait method based on multi-level key characteristic behaviors |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |