CN112297023A - Intelligent accompanying robot system - Google Patents
Intelligent accompanying robot system Download PDFInfo
- Publication number
- CN112297023A CN112297023A CN202011140302.0A CN202011140302A CN112297023A CN 112297023 A CN112297023 A CN 112297023A CN 202011140302 A CN202011140302 A CN 202011140302A CN 112297023 A CN112297023 A CN 112297023A
- Authority
- CN
- China
- Prior art keywords
- information
- emotional
- user
- management system
- state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J11/00—Manipulators not otherwise provided for
- B25J11/0005—Manipulators having means for high-level communication with users, e.g. speech generator, face recognition means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J11/00—Manipulators not otherwise provided for
- B25J11/008—Manipulators for service tasks
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J19/00—Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
- B25J19/02—Sensing devices
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/80—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for detecting, monitoring or modelling epidemics or pandemics, e.g. flu
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H80/00—ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
Abstract
The application provides an intelligence robot system of accompanying and attending to includes: the wearable device acquires physiological state data through a built-in sensor and uploads the physiological state data to the intelligent management system; the entity robot is deployed in an application site and used for carrying out emotional communication with a guided object through a configured human-computer interaction system, acquiring emotional state information of the guided object, uploading the emotional state information to the intelligent management system, receiving emotional guidance recommendation information sent by the intelligent management system, and displaying the emotional state information to the guided object so as to guide the emotional state of the guided object; the intelligent management system is used for receiving the emotional state information and the physiological state data of the guided object, carrying out artificial intelligent analysis on the emotional state information and the physiological state data based on a pre-deployed emotional algorithm model trained by big data, identifying the emotional state of the user, generating corresponding emotional guidance recommendation information and issuing the information to the entity robot; the scheme improves the accuracy and the use effect of the emotional state guidance.
Description
Technical Field
The application relates to the technical field of artificial intelligence data processing, in particular to an intelligent accompanying robot system.
Background
At present, public health safety is extremely important for national and social influences, for example, the prevention, control and treatment of novel pneumonia epidemic situations increasingly concern the treatment effect of national governments and social stability, and reflect the importance of mental health professional services under new situations.
After the epidemic situation generally occurs, the epidemic situation is resisted through a long-term, continuous, deep and special adjusting and guiding process. The rescue object has huge scale and difficulty far exceeding the daily treatment capability of the existing medical care and treatment mechanism, so that the advanced scientific technology is utilized, and the emotional state guidance is extremely necessary by means of the deep intervention of multiple subjects such as artificial intelligence, informatics, sensors, communication and the like and multiple industries such as media and the like.
With the development of artificial intelligence and emotion calculating technology, the intelligent emotion accompanying robot gradually enters the daily life field of people. Some entity robots have appeared on the market, which provide emotional guidance information to users instead of people, and replace medical staff to communicate with users in daily life, so that appropriate emotional state guidance and guidance are performed. However, the range of data sources of the technologies is narrow, model training is simple, accuracy is low when emotional state guidance is performed on the user, and the effect is poor.
Disclosure of Invention
The purpose of this application aims at providing an intelligence robot system of accompanying and attending to the above-mentioned accuracy when carrying out emotional state guide to the user on the low side, the relatively poor technical defect of effect.
An intelligent accompanying robot system, comprising: the system comprises at least one entity robot, wearable equipment worn by a user and an intelligent management system connected with the entity robot;
the wearable device collects physiological state data of the user through a built-in sensor and uploads the physiological state data to an intelligent management system;
the entity robot is deployed in an application site and used for carrying out emotional communication with the user through a configured human-computer interaction system, acquiring emotional state information of the user, uploading the emotional state information to the intelligent management system, receiving emotional guide recommendation information issued by the intelligent management system and displaying the emotional guide recommendation information to the user so as to guide the emotional state of the user;
the intelligent management system is used for receiving the emotional state information and the physiological state data of the user, carrying out artificial intelligent analysis on the emotional state information and the physiological state data based on a pre-deployed emotional algorithm model trained by big data, identifying the emotional state of the user, generating corresponding emotional guidance recommendation information according to the emotional state, and issuing the information to the entity robot.
In one embodiment, the intelligent management system is further configured to construct a user profile for each user, and select the emotional guidance recommendation information based on the user profile.
In one embodiment, the emotional guidance recommendation information includes audiovisual content that adjusts emotional states and relieves psychological stress.
In one embodiment, the intelligent management system is further provided with an anxiety algorithm model and a fatigue algorithm model, and is used for performing artificial intelligence analysis on the emotional state information to obtain the anxiety state and the fatigue state of the user; and generating corresponding emotion guidance audio and video content according to the anxiety state and the fatigue state.
In one embodiment, the physical robot is provided with a positioning system for positioning a user to obtain positioning information;
the intelligent management system is also used for generating a passing route and contact environment data of the user according to the positioning information; and sending out epidemic situation danger alarm when the path route is overlapped with the designated path or area.
In one embodiment, the system further comprises a body temperature tester for acquiring the body temperature of the crowd and uploading the body temperature to the intelligent management system;
and the intelligent management system performs multi-dimensional fusion analysis according to the body temperature, the position information, the physiological state information and the emotional state information of the crowd to obtain the real-time situation of the epidemic situation, and monitors, predicts and warns the real-time situation of the epidemic situation.
In one embodiment, the intelligent management system receives epidemic situation monitoring data transmitted by an epidemic situation monitoring system of a third party, generates a full-data real-time hotspot graph of an epidemic situation according to the epidemic situation monitoring data, transmits the hotspot graph to an entity robot for displaying, and optimizes and configures online and offline psychological guidance resources according to the epidemic situation monitoring data.
In one embodiment, the emotional algorithm model is obtained by:
acquiring skin electric signals of a tested object in a set emotional state, and acquiring evaluation information of the tested object on the set emotional state;
dividing the grade range under the set emotional state, and determining the grade range of the tested object according to the measured information and the evaluation information of the tested object;
utilizing a machine learning model to establish mapping from skin electric signals to all grade ranges, and obtaining a quantitative prediction result of a set emotional state output by the machine learning model;
and obtaining an emotion algorithm model according to the quantitative prediction result.
In one embodiment, the set emotional state comprises an agitation, stress, and/or anxiety state;
the intelligent management system utilizes wearable equipment to collect skin electric signals of a tested object in a set emotional state; wherein the emotional state comprises an agitation, stress, and/or anxiety state.
In one embodiment, the process of obtaining an emotional algorithm model according to the quantitative prediction result includes:
feeding back the quantitative prediction result to a tested object, performing secondary evaluation on the quantitative prediction result according to the actual measurement information and the evaluation information of the tested object, performing quantitative refinement and correction on the quantitative prediction result output by the machine learning model, and executing a secondary evaluation process in a circulating manner until the quantitative prediction result output by the machine learning model is consistent with the actual measurement information and the evaluation information of the tested object, thereby obtaining an emotion algorithm model.
The application provides an intelligence robot system of accompanying and attending to's technical scheme has following advantage:
(1) each entity robot is deployed in an application site, interacts with a user through a configured human-computer interaction system, can provide emotion guidance service for a large number of users at the same time, wearable equipment collects physiological state data of the users, an intelligent management system can receive emotion state information and the physiological state data of the users, carries out artificial intelligent analysis on the emotion state information and the physiological state data based on a pre-deployed emotion algorithm model trained by big data, identifies the emotion state of the users, and generates corresponding emotion guidance recommendation information to be issued to the entity robots; therefore, the accuracy of emotion state guidance of the user is improved, and the using effect of the intelligent accompanying robot is improved.
(2) By constructing the user portrait of each user, tagging the user information and selecting the emotion guidance recommendation information according to the user portrait, the accuracy of the recommended emotion guidance recommendation information can be improved.
(3) Performing artificial intelligence analysis by combining an anxiety algorithm model and a fatigue algorithm model deployed by an intelligent management system to obtain the anxiety state and the fatigue state of the user; and corresponding emotion guide audio and video content is generated according to the anxiety state and the fatigue state, the emotion state and the relieving psychological pressure of the user are adjusted, and the user can be effectively assisted to face life more actively.
(4) The positioning system is arranged on the entity robot to acquire the positioning information of the user, so that the route and the contact environment data of the user can be generated according to the positioning information, when the route of the user is overlapped with the route or the area where the epidemic situation occurs, the epidemic situation danger alarm is timely sent out, and a real-time early warning function can be provided for epidemic situation prevention and control.
Meanwhile, the entity robot acquires the body temperature of the crowd through a body temperature tester; the intelligent management system performs multi-dimensional fusion analysis according to the body temperature, the position information, the physiological state information and the emotional state information of the crowd to obtain the real-time situation of the epidemic situation, so that the real-time situation of the epidemic situation is monitored, predicted and early warned; thereby providing full data monitoring and emotion management functions.
(5) The intelligent management system generates a full-data real-time heat point diagram of the epidemic through the epidemic monitoring data of the epidemic monitoring system of the third party and sends the full-data real-time heat point diagram to the entity robot for displaying, so that a user can know the current development condition of the epidemic in real time, and meanwhile, the online and offline psychological guidance resources of the medical health system can be fully allocated according to the on-line and offline psychological guidance resources optimized and configured according to the epidemic monitoring data, and scientific reference basis is provided for medical resource allocation.
(6) The intelligent emotion algorithm model is obtained through the machine learning model and artificial intelligence learning, accurate emotion monitoring and analysis are achieved, the emotion change trend of the user is rapidly and accurately obtained, prediction and early warning are conducted, and then the most appropriate emotion communication information is recommended to guide the emotion of the user.
Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a framework diagram of an intelligent accompanying robot system of an embodiment;
fig. 2 is a frame diagram of an intelligent accompanying robot system of another embodiment;
FIG. 3 is a flow chart of a method of obtaining an emotional algorithm model.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combinations of one or more of the associated listed items.
It will be understood by those within the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
Referring to fig. 1, fig. 1 is a frame diagram of an intelligent accompanying robot system according to an embodiment, including: the system comprises at least more than one entity robot, wearable equipment worn by a user (namely the user), and an intelligent management system connected with the entity robots; as shown in FIG. 1, users 1-n correspond to wearable devices 1-n and physical robots 1-n, respectively, where n ≧ 2.
The wearable device collects physiological state data through a built-in sensor and uploads the physiological state data to an intelligent management system;
the entity robot is deployed in an application site and used for carrying out emotion communication with a user through a configured human-computer interaction system, acquiring emotion state information of the user, uploading the emotion state information to the intelligent management system, receiving emotion guide recommendation information issued by the intelligent management system and displaying the emotion guide recommendation information to the user so as to guide the emotion state of the user;
the intelligent management system is used for receiving the emotional state information and the physiological state data of the user, carrying out artificial intelligent analysis on the emotional state information and the physiological state data based on a pre-deployed emotional algorithm model trained by big data, identifying the emotional state of the user, generating corresponding emotional guidance recommendation information according to the emotional state, and issuing the information to the entity robot.
Specifically, as shown in fig. 1, the wearable device may be a smart band/smart ring, and the wearable device may detect a user to acquire physiological status data, such as detecting a skin electrical signal, through a sensor built in the wearable device, and upload the data to the smart management system through a network.
The entity robots are respectively deployed at each application site, one entity robot can be allocated for each user, the entity robots can acquire voice or image information of the users and send the voice or image information to the intelligent management system, meanwhile, the entity robots receive emotion guidance recommendation information issued by the intelligent management system and display the emotion guidance information, for example, emotion guidance information can be displayed in a voice mode, an action mode, an image mode and the like, audio and video can be played, specific actions can be output, physical therapy and the like, and therefore the artificial intelligence function is achieved.
The intelligent management system can provide information processing services for a plurality of wearable devices and the entity robot, artificial intelligent analysis is carried out on physiological state data and emotional state information by receiving the physiological state data uploaded by the wearable devices and the emotional state information uploaded by the entity robot in combination with a pre-deployed emotion algorithm model, and the emotional state of a user can be identified and corresponding emotion guide recommendation information can be generated by combining the physiological state data with voice semantic analysis and expression analysis of a current picture; for example, the anxiety state of the user is judged, the emotion trend is accurately predicted, then an audio and video file corresponding to the anxiety state and the emotion trend is selected as emotion guide recommendation information and sent to the entity robot to be played to the user, and the user is guided to relax emotions.
According to the technical scheme of the embodiment, each entity robot is deployed in an application site, and interacts with users through a configured human-computer interaction system, so that emotion guide services can be provided for a large number of users at the same time, an intelligent management system can receive emotion state information of the users, artificial intelligent analysis is carried out on the emotion state information and physiological state data based on an emotion algorithm model which is deployed in advance and trained by big data, the anxiety state and emotion trend of the users are identified, and corresponding emotion guide recommendation information is generated and issued to the entity robots; accuracy when can promote to carry out emotion state guide to the user has promoted intelligent service effect of accompanying and attending to robot.
The following proceeds to illustrate detailed embodiments of the present application.
In one embodiment, the intelligent management system is further used for constructing a user representation of each user, and selecting the emotion guidance recommendation information according to the user representation; and forming a user portrait consisting of intelligent hardware, software and content, and realizing a content recommending and distributing function based on the user portrait.
According to the scheme of the embodiment, the accuracy of the recommended emotion guidance recommendation information can be improved by constructing the user portrait of each user, labeling the user information, and selecting the emotion guidance recommendation information according to the user portrait.
In one embodiment, the emotional guidance recommendation information includes audiovisual content that adjusts emotional states and relieves psychological stress. Furthermore, an anxiety algorithm model and a fatigue algorithm model are deployed in the intelligent management system and used for carrying out artificial intelligent analysis on the emotional state information to obtain the anxiety state and the fatigue state of the user; and generating corresponding emotion guidance audio and video content according to the anxiety state and the fatigue state.
Specifically, guiding audios and videos corresponding to different anxiety state indexes and fatigue state indexes can be stored in advance, after the actual anxiety state indexes and fatigue state indexes of the user are determined through artificial intelligence analysis, appropriate emotion guiding audio and video contents are selected.
According to the scheme of the embodiment, the anxiety algorithm model and the fatigue algorithm model deployed by the intelligent management system are combined to perform artificial intelligence analysis to obtain the anxiety state and the fatigue state of the user; and corresponding emotion guide audio and video content is generated according to the anxiety state and the fatigue state, the emotion state and the relieving psychological pressure of the user are adjusted, and the user can be effectively assisted to face life more actively.
In one embodiment, the physical robot is provided with a positioning system for positioning a user to obtain positioning information; the intelligent management system is also used for generating a passing route and contact environment data of the user according to the positioning information; and sending out epidemic situation danger alarm when the path route is overlapped with the designated path or area. Further, the system also comprises a body temperature tester (wearable intelligent body temperature equipment) for acquiring the body temperature of the crowd and uploading the body temperature to the intelligent management system; and the intelligent management system performs multi-dimensional fusion analysis according to the body temperature, the position information, the physiological state information and the emotional state information of the crowd to obtain the real-time situation of the epidemic situation, and monitors, predicts and warns the real-time situation of the epidemic situation.
According to the scheme of the embodiment, the positioning system is arranged on the entity robot to acquire the positioning information of the user, so that the route and the contact environment data of the user can be generated according to the positioning information, when the route of the user coincides with the route or the area where the epidemic situation occurs, the epidemic situation danger alarm is timely sent out, and a real-time early warning function can be provided for epidemic situation prevention and control. Meanwhile, the entity robot acquires the body temperature of the crowd through a body temperature tester; the intelligent management system performs multi-dimensional fusion analysis according to the body temperature, the position information, the physiological state information and the emotional state information of the crowd to obtain the real-time situation of the epidemic situation, so that the real-time situation of the epidemic situation is monitored, predicted and early warned; thereby providing full data monitoring and emotion management functions.
In one embodiment, the intelligent management system receives epidemic situation monitoring data transmitted by an epidemic situation monitoring system of a third party, sends a full-data real-time hotspot graph of an epidemic situation generated according to the epidemic situation monitoring data to an entity robot for displaying, and optimizes and configures online and offline psychological guidance resources according to the epidemic situation monitoring data. Specifically, with the help of an epidemic situation monitoring system of a third party, such as a crystal ball epidemic situation monitoring and inquiring system, a government, a medical institution, a service provider, an individual and a family can be connected to form an internet of things system service platform facing the old, the community and the institution at home. By accessing the third-party service, the third-party can push the service accurately; has good business model expansion prospect.
According to the scheme of the embodiment, the intelligent management system generates the full-data real-time heat point diagram of the epidemic situation through the epidemic situation monitoring data of the epidemic situation monitoring system of the third party and sends the full-data real-time heat point diagram to the entity robot for displaying, so that a user can know the current development situation of the epidemic situation in real time, and meanwhile, the online and offline psychological guidance resources of the medical health system can be fully allocated according to the epidemic situation monitoring data, so that the scientific reference basis is provided for medical resource allocation.
In one embodiment, the present application provides the following preferred embodiments with respect to the emotional algorithm model provided herein.
Referring to fig. 3, fig. 3 is a flowchart of a method for obtaining an emotional algorithm model, and specific processes may refer to the following:
s101, acquiring skin electric signals of a tested object in a set emotional state, and acquiring evaluation information of the tested object on the set emotional state.
Specifically, the intelligent management system can utilize the wearable device to collect skin electric signals of the tested object in a set emotional state; wherein the emotional state comprises an agitation, stress, and/or anxiety state. The physiological sensor can be used for acquiring skin electric signals of a tested object in an exciting state, a stress state and/or an anxiety state, and the tested object is allowed to evaluate information on aspects of exciting state, stress state and anxiety state in the form of a questionnaire.
And S102, dividing the grade range under the set emotional state, and determining the grade range of the tested object according to the actual measurement information and the evaluation information of the tested object.
Specifically, first, the activation, stress and/or anxiety are classified into 5 classes, for example, the classes are classified into 100 classes, and the 5 classes are respectively classified into 0 to 20, 21 to 40, 41 to 60, 61 to 80 and 81 to 100, and the range of the activation state of the subject is determined by combining the observation condition (actually measured information) and the evaluation information of the subject.
S103, mapping between the skin electric signals to all grade ranges is established by using a machine learning model, and a quantitative prediction result of the set emotional state output by the machine learning model is obtained.
And S104, obtaining an emotion algorithm model according to the quantitative prediction result.
Specifically, in the process, the quantitative prediction result may be fed back to the object to be tested, secondary evaluation may be performed on the quantitative prediction result according to the actual measurement information and the evaluation information of the object to be tested, quantitative refinement and correction may be performed on the quantitative prediction result output by the machine learning model, and the secondary evaluation process may be executed in a loop until the quantitative prediction result output by the machine learning model is consistent with the actual measurement information and the evaluation information of the object to be tested, so as to obtain the emotion algorithm model.
The intelligent emotion algorithm model is obtained by the machine learning model and artificial intelligence learning, accurate monitoring and analysis are achieved, the emotion state of the user is rapidly and accurately obtained, and early warning reminding is carried out.
For example, by using the above model, the skin electrical signal of the user can be collected and input into the activation state monitoring model, and the activation index, the stress index and/or the anxiety index (0-100 points) of the user can be output.
According to the scheme of the embodiment, the machine learning model is used for carrying out artificial intelligence learning to obtain the intelligent emotion algorithm model, accurate emotion monitoring and analysis are achieved, the emotion change trend of the user is rapidly and accurately obtained, prediction and early warning are carried out, and then the most appropriate emotion communication information is recommended to guide the emotion of the guided object.
The application provides an intelligence robot system of accompanying and attending to has adopted artificial intelligence and emotion computing technology, can alleviate the serious not enough condition of professional psychologist in the emergent nature application of epidemic situation treatment period, cooperates psychotherapist to develop work. Meanwhile, during and after the occurrence of an emergent public health event, the emotional state of a specific group is monitored in real time, guidance and early warning are carried out when an abnormal condition occurs, audio and video content which can help the user to adjust the emotional state is recommended to the user, rich recommended content can be designed, high-quality audio content resources are generated through technical means, the problem that existing psychological guidance personnel are insufficient is effectively relieved, and the user is helped to relieve psychological pressure.
The system can provide dynamic, instant, accurate and personalized emotion decompression content service, and specific groups facing public health emergencies comprise: (1) a patient or a survivor; (2) isolating the crowd; (3) medical staff and rescue staff; (4) the general public.
This application is based on biological label research and development, core emotion algorithm research and development, software and hardware combines system design and development, possesses intelligent hardware, recommendation algorithm, mood decompression physiotherapy APP, the intelligent propelling movement of audio content, high in the clouds management system that can detect user's physiology emotion and change, forms the user portrait and the content recommendation distribution system that constitute by intelligent hardware, software, content.
In addition, this system can also insert little letter, map, country and province and city health and welfare commission data to can insert big dipper, "magpie" remote sensing data, and the analysis report and the experimental data of relevant unit, except providing the data service with some as the unit, can also provide route and contact environment data, wherein entity robot can provide the situation perception towards places such as district, hospital, asylum for the aged, business surpass, station, real-time information and psychological counseling, include: policy publicity, epidemic prevention knowledge publicity, epidemic prevention and control, remote inquiry and public psychological dispersion of epidemic situation.
Furthermore, the emotion calculation technology applying multiple modes can be combined with internet of things and music therapy, physiological state data accessed into a smart ring (wearable device) can monitor physiological and emotional abnormal conditions of the user in real time, such as anxiety, fatigue and the like, and psychological decompression and relaxation can be performed on specific groups of people through specific physical therapy modes, such as emotional voice interaction, music decompression and the like.
Furthermore, an epidemic situation monitoring, predicting and early warning system is comprehensively constructed by combining the body temperature, the positioning information, the physiological state data and the emotional state information of the crowd, and more intelligent monitoring and emotion management work is realized.
Furthermore, a third-party service management system (such as a crystal ball epidemic situation monitoring system) is utilized, online psychological guidance resources are combined, online and offline data are communicated, online and offline psychological guidance resources are optimized and configured, and meanwhile, an epidemic situation sensing and monitoring system is combined to present a full-data real-time hotspot graph of the epidemic situation, so that timely and effective auxiliary management can be provided for real-time management of the epidemic situation and the emotion of the government or the enterprise and public institution.
It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least a portion of the steps in the flow chart of the figure may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed alternately or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
The foregoing is only a partial embodiment of the present application, and it should be noted that, for those skilled in the art, several modifications and decorations can be made without departing from the principle of the present application, and these modifications and decorations should also be regarded as the protection scope of the present application.
Claims (10)
1. An intelligent accompanying robot system, comprising: the system comprises at least one entity robot, wearable equipment worn by a user and an intelligent management system connected with the entity robot;
the wearable device collects physiological state data of the user through a built-in sensor and uploads the physiological state data to an intelligent management system;
the entity robot is deployed in an application site and used for carrying out emotional communication with the user through a configured human-computer interaction system, acquiring emotional state information of the user, uploading the emotional state information to the intelligent management system, receiving emotional guide recommendation information issued by the intelligent management system and displaying the emotional guide recommendation information to the user so as to guide the emotional state of the user;
the intelligent management system is used for receiving the emotional state information and the physiological state data of the user, carrying out artificial intelligent analysis on the emotional state information and the physiological state data based on a pre-deployed emotional algorithm model trained by big data, identifying the emotional state of the user, generating corresponding emotional guidance recommendation information according to the emotional state, and issuing the information to the entity robot.
2. The intelligent accompanying robot system as claimed in claim 1, wherein the intelligent management system is further configured to construct a user profile for each user, the emotional guidance recommendation information being selected based on the user profile.
3. The intelligent accompanying robot system as claimed in claim 1, wherein the emotion guidance recommendation information includes audio-visual contents for adjusting emotional state and relieving psychological stress.
4. The intelligent accompanying robot system as claimed in claim 3, wherein the intelligent management system is further deployed with an anxiety algorithm model and a fatigue algorithm model for performing artificial intelligence analysis on the emotional state information to obtain the anxiety state and the fatigue state of the user; and generating corresponding emotion guidance audio and video content according to the anxiety state and the fatigue state.
5. The intelligent accompanying robot system as claimed in claim 1, wherein a positioning system is installed on the physical robot for positioning a user to obtain positioning information;
the intelligent management system is also used for generating a passing route and contact environment data of the user according to the positioning information; and sending out epidemic situation danger alarm when the path route is overlapped with the designated path or area.
6. The intelligent accompanying robot system as claimed in claim 1, wherein the system further comprises a body temperature tester for obtaining body temperature of the crowd and uploading the body temperature to the intelligent management system;
and the intelligent management system performs multi-dimensional fusion analysis according to the body temperature, the position information, the physiological state information and the emotional state information of the crowd to obtain the real-time situation of the epidemic situation, and monitors, predicts and warns the real-time situation of the epidemic situation.
7. The intelligent accompanying robot system as claimed in claim 1, wherein the intelligent management system receives epidemic situation monitoring data transmitted by an epidemic situation monitoring system of a third party, generates a full data real-time hotspot graph of an epidemic situation according to the epidemic situation monitoring data, transmits the full data real-time hotspot graph to the entity robot for displaying, and optimizes and configures online and offline psychological guidance resources according to the epidemic situation monitoring data.
8. The intelligent accompanying robot system according to any one of claims 2 to 7, wherein the emotion algorithm model is obtained by:
acquiring skin electric signals of a tested object in a set emotional state, and acquiring evaluation information of the tested object on the set emotional state;
dividing the grade range under the set emotional state, and determining the grade range of the tested object according to the measured information and the evaluation information of the tested object;
utilizing a machine learning model to establish mapping from skin electric signals to all grade ranges, and obtaining a quantitative prediction result of a set emotional state output by the machine learning model;
and obtaining an emotion algorithm model according to the quantitative prediction result.
9. The intelligent accompanying robot system as claimed in claim 8, wherein the set emotional states include states of excitement, stress, and/or anxiety;
the intelligent management system utilizes wearable equipment to collect skin electric signals of a tested object in a set emotional state; wherein the emotional state comprises an agitation, stress, and/or anxiety state.
10. The intelligent accompanying robot system as claimed in claim 9, wherein the process of obtaining an emotional algorithm model from the quantitative prediction result comprises:
feeding back the quantitative prediction result to a tested object, performing secondary evaluation on the quantitative prediction result according to the actual measurement information and the evaluation information of the tested object, performing quantitative refinement and correction on the quantitative prediction result output by the machine learning model, and executing a secondary evaluation process in a circulating manner until the quantitative prediction result output by the machine learning model is consistent with the actual measurement information and the evaluation information of the tested object, thereby obtaining an emotion algorithm model.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011140302.0A CN112297023B (en) | 2020-10-22 | 2020-10-22 | Intelligent accompanying robot system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011140302.0A CN112297023B (en) | 2020-10-22 | 2020-10-22 | Intelligent accompanying robot system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112297023A true CN112297023A (en) | 2021-02-02 |
| CN112297023B CN112297023B (en) | 2022-04-05 |
Family
ID=74327106
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011140302.0A Active CN112297023B (en) | 2020-10-22 | 2020-10-22 | Intelligent accompanying robot system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112297023B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112863661A (en) * | 2021-02-07 | 2021-05-28 | 深圳市今视通数码科技有限公司 | High potential physiotherapy method, system, terminal and storage medium based on robot |
| CN113290567A (en) * | 2021-04-19 | 2021-08-24 | 山东师范大学 | Crowd evacuation guiding robot based on crowd emotion recognition |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105082150A (en) * | 2015-08-25 | 2015-11-25 | 国家康复辅具研究中心 | Robot man-machine interaction method based on user mood and intension recognition |
| CN106264571A (en) * | 2016-08-29 | 2017-01-04 | 无锡卓信信息科技股份有限公司 | A kind of inmate's emotion adjustment method and system |
| CN106725473A (en) * | 2016-12-29 | 2017-05-31 | 杭州联络互动信息科技股份有限公司 | A kind of method and device that emotional state is adjusted based on intelligent wearable device |
| CN107139184A (en) * | 2017-06-10 | 2017-09-08 | 唐建芳 | A kind of intelligent robot of accompanying and attending to |
| TWI654600B (en) * | 2017-11-29 | 2019-03-21 | 隆宸星股份有限公司 | Speech emotion recognition system and method and intelligent robot using same |
| CN110881987A (en) * | 2019-08-26 | 2020-03-17 | 首都医科大学 | Old person emotion monitoring system based on wearable equipment |
| WO2020119245A1 (en) * | 2018-12-12 | 2020-06-18 | 华南理工大学 | Wearable bracelet-based emotion recognition system and method |
| CN111347439A (en) * | 2020-03-20 | 2020-06-30 | 山东西部智能科技有限公司 | Epidemic prevention robot and control system thereof |
| CN111368609A (en) * | 2018-12-26 | 2020-07-03 | 深圳Tcl新技术有限公司 | Voice interaction method based on emotion engine technology, intelligent terminal and storage medium |
| CN111413874A (en) * | 2019-01-08 | 2020-07-14 | 北京京东尚科信息技术有限公司 | Method, device and system for controlling intelligent equipment |
| CN111568444A (en) * | 2020-05-13 | 2020-08-25 | 武汉艾瓦客机器人有限公司 | Vehicle-mounted emotion communication interaction system |
| US20200294670A1 (en) * | 2019-03-13 | 2020-09-17 | Monsoon Design Studios LLC | System and method for real-time estimation of emotional state of user |
| CN111735541A (en) * | 2020-06-19 | 2020-10-02 | 北京天骥空间科技有限公司 | Mobile body temperature monitoring robot |
-
2020
- 2020-10-22 CN CN202011140302.0A patent/CN112297023B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105082150A (en) * | 2015-08-25 | 2015-11-25 | 国家康复辅具研究中心 | Robot man-machine interaction method based on user mood and intension recognition |
| CN106264571A (en) * | 2016-08-29 | 2017-01-04 | 无锡卓信信息科技股份有限公司 | A kind of inmate's emotion adjustment method and system |
| CN106725473A (en) * | 2016-12-29 | 2017-05-31 | 杭州联络互动信息科技股份有限公司 | A kind of method and device that emotional state is adjusted based on intelligent wearable device |
| CN107139184A (en) * | 2017-06-10 | 2017-09-08 | 唐建芳 | A kind of intelligent robot of accompanying and attending to |
| TWI654600B (en) * | 2017-11-29 | 2019-03-21 | 隆宸星股份有限公司 | Speech emotion recognition system and method and intelligent robot using same |
| WO2020119245A1 (en) * | 2018-12-12 | 2020-06-18 | 华南理工大学 | Wearable bracelet-based emotion recognition system and method |
| CN111368609A (en) * | 2018-12-26 | 2020-07-03 | 深圳Tcl新技术有限公司 | Voice interaction method based on emotion engine technology, intelligent terminal and storage medium |
| CN111413874A (en) * | 2019-01-08 | 2020-07-14 | 北京京东尚科信息技术有限公司 | Method, device and system for controlling intelligent equipment |
| US20200294670A1 (en) * | 2019-03-13 | 2020-09-17 | Monsoon Design Studios LLC | System and method for real-time estimation of emotional state of user |
| CN110881987A (en) * | 2019-08-26 | 2020-03-17 | 首都医科大学 | Old person emotion monitoring system based on wearable equipment |
| CN111347439A (en) * | 2020-03-20 | 2020-06-30 | 山东西部智能科技有限公司 | Epidemic prevention robot and control system thereof |
| CN111568444A (en) * | 2020-05-13 | 2020-08-25 | 武汉艾瓦客机器人有限公司 | Vehicle-mounted emotion communication interaction system |
| CN111735541A (en) * | 2020-06-19 | 2020-10-02 | 北京天骥空间科技有限公司 | Mobile body temperature monitoring robot |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112863661A (en) * | 2021-02-07 | 2021-05-28 | 深圳市今视通数码科技有限公司 | High potential physiotherapy method, system, terminal and storage medium based on robot |
| CN112863661B (en) * | 2021-02-07 | 2023-11-28 | 深圳市今视通数码科技有限公司 | High-potential physiotherapy method, system, terminal and storage medium based on robot |
| CN113290567A (en) * | 2021-04-19 | 2021-08-24 | 山东师范大学 | Crowd evacuation guiding robot based on crowd emotion recognition |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112297023B (en) | 2022-04-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20190239791A1 (en) | System and method to evaluate and predict mental condition | |
| CN112297023B (en) | Intelligent accompanying robot system | |
| Hosseini et al. | A multimodal sensor dataset for continuous stress detection of nurses in a hospital | |
| Doryab et al. | Impact factor analysis: combining prediction with parameter ranking to reveal the impact of behavior on health outcome | |
| Alharthi et al. | CASP: context-aware stress prediction system | |
| CN113520395A (en) | Real-time mental state assessment system and method | |
| Rajawat et al. | Depression detection for elderly people using AI robotic systems leveraging the Nelder–Mead Method | |
| US20220280085A1 (en) | System and Method for Patient Monitoring | |
| L'Hommedieu et al. | Lessons learned: recommendations for implementing a longitudinal study using wearable and environmental sensors in a health care organization | |
| US20230039882A1 (en) | Artificial intelligence-based platform to optimize skill training and performance | |
| Lüscher et al. | Social support and common dyadic coping in couples' dyadic management of type II diabetes: protocol for an ambulatory assessment application | |
| Fedor et al. | Wearable technology in clinical practice for depressive disorder | |
| KR20190061826A (en) | System and method for detecting complex biometric data cure of posttraumatic stress disorder and panic disorder | |
| Dimitrov et al. | Social activity modelling and multimodal coaching for active aging | |
| Subetha et al. | An Early Prediction and Detection of Alzheimer's Disease: A Comparative Analysis on Various Assistive Technologies | |
| Levine et al. | Anxiety detection leveraging mobile passive sensing | |
| Diederich et al. | Mental health informatics: current approaches | |
| Deng et al. | A machine Learning-Based monitoring system for attention and stress detection for children with autism spectrum disorders | |
| CN114758767A (en) | Method and device for remotely monitoring body health state in real time and giving regulation and control guidance | |
| De Boer et al. | A Call to Expand the Scope of Digital Phenotyping | |
| Silva et al. | Tracking context-aware well-being through intelligent environments | |
| Niermann et al. | Predicting Vehicle Passenger Stress Based on Sensory Measurements | |
| Jyotsna et al. | PredictEYE: Personalized Time Series Model for Mental State Prediction Using Eye Tracking | |
| Suciu et al. | ENVIRONMENTAL SENSING AND LEARNING HUMAN BEHAVIOR USING CLOUD COMPUTING AND BIG DATA TO ACT FOR A BETTER QUALITY OF LIFE AND SMART HEALTH. | |
| Jia et al. | Research and Application of Fatigue Management of Apron Control in Beijing Daxing International Airport |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |