CN113316041B - Remote health detection system, method, device and equipment - Google Patents
Remote health detection system, method, device and equipment Download PDFInfo
- Publication number
- CN113316041B CN113316041B CN202010126085.3A CN202010126085A CN113316041B CN 113316041 B CN113316041 B CN 113316041B CN 202010126085 A CN202010126085 A CN 202010126085A CN 113316041 B CN113316041 B CN 113316041B
- Authority
- CN
- China
- Prior art keywords
- user
- health
- data
- detection
- health detection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000036541 health Effects 0.000 title claims abstract description 657
- 238000001514 detection method Methods 0.000 title claims abstract description 427
- 238000000034 method Methods 0.000 title claims description 90
- 230000008451 emotion Effects 0.000 claims description 65
- 230000017531 blood circulation Effects 0.000 claims description 34
- 230000001815 facial effect Effects 0.000 claims description 29
- 230000006854 communication Effects 0.000 claims description 16
- 238000004891 communication Methods 0.000 claims description 15
- 230000008859 change Effects 0.000 claims description 9
- 238000013075 data extraction Methods 0.000 claims description 8
- 239000000523 sample Substances 0.000 claims 1
- 238000012545 processing Methods 0.000 abstract description 15
- 239000000284 extract Substances 0.000 abstract description 5
- 238000010586 diagram Methods 0.000 description 11
- 238000005516 engineering process Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 5
- 230000014509 gene expression Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 5
- 238000001228 spectrum Methods 0.000 description 5
- 239000008280 blood Substances 0.000 description 3
- 210000004369 blood Anatomy 0.000 description 3
- 238000004590 computer program Methods 0.000 description 3
- 230000008921 facial expression Effects 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000008909 emotion recognition Effects 0.000 description 2
- 238000010438 heat treatment Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- WQZGKKKJIJFFOK-GASJEMHNSA-N Glucose Natural products OC[C@H]1OC(O)[C@H](O)[C@@H](O)[C@@H]1O WQZGKKKJIJFFOK-GASJEMHNSA-N 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 description 1
- 230000036772 blood pressure Effects 0.000 description 1
- 230000036996 cardiovascular health Effects 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 239000008103 glucose Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000036651 mood Effects 0.000 description 1
- 238000012634 optical imaging Methods 0.000 description 1
- 229910052760 oxygen Inorganic materials 0.000 description 1
- 239000001301 oxygen Substances 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/02—Casings; Cabinets ; Supports therefor; Mountings therein
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/026—Measuring blood flow
- A61B5/0261—Measuring blood flow using optical means, e.g. infrared light
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
- A61B5/6898—Portable consumer electronic devices, e.g. music players, telephones, tablet computers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Molecular Biology (AREA)
- General Health & Medical Sciences (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- Animal Behavior & Ethology (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Surgery (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Child & Adolescent Psychology (AREA)
- Hematology (AREA)
- Physiology (AREA)
- Acoustics & Sound (AREA)
- Cardiology (AREA)
- Developmental Disabilities (AREA)
- Educational Technology (AREA)
- Hospice & Palliative Care (AREA)
- Psychiatry (AREA)
- Psychology (AREA)
- Social Psychology (AREA)
- Medical Treatment And Welfare Office Work (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
The application discloses a remote health detection system, a remote health detection method, a remote health detection device and remote health detection equipment. The remote health detection system collects the data of the called user from the call data flow between the remote health detection system and other terminal equipment through the intelligent sound box, extracts health related data from the data of the called user, and sends a health detection request for the called user to the server; and the server determines the health information of the called user at least according to the health related data carried by the detection request, and the intelligent sound box receives the health information returned by the server. By adopting the processing mode, the health detection is combined with the voice box call application, so that the intelligent voice box end can carry out remote health detection on other people; therefore, the timeliness of user health detection can be effectively improved, and user experience is improved.
Description
Technical Field
The application relates to the technical field of intelligent sound boxes, in particular to a remote health detection system, a remote health detection method and a remote health detection device, a health detection system, a health detection method and a health detection device, an intelligent sound box and electronic equipment.
Background
The intelligent sound box is a product of upgrading the sound box, is a tool for home consumers to surf the internet by voice, such as requesting songs, surfing the internet and shopping, or knowing weather forecast, and can also control intelligent household equipment, such as opening curtains, setting the temperature of a refrigerator, heating a water heater in advance, and the like.
At present, intelligent audio amplifier mainly realizes following function through the camera: video call, home monitoring, transcript identification, etc. However, there is a lack of health class function output and interaction locally at the loudspeaker. For the health detection requirement of users, at present, devices such as smart phones are required to be combined, and some skin detection functions are accessed by embedding some small programs in mobile phone apps. In addition, the intelligent sound box is not relied on, and skin detection can be directly carried out through the mobile phone.
In summary, how to perform health detection locally in the intelligent sound box is a problem that needs to be solved urgently by those skilled in the art.
Disclosure of Invention
The application provides a remote health detection system to solve the problem that the unable remote health detection to other people locally at intelligent audio amplifier that prior art exists. The application additionally provides a remote health detection method and device, a health detection system, a health detection method and device, an intelligent sound box and electronic equipment.
The present application provides a remote health detection system, comprising:
the intelligent sound box is used for collecting called user data from call data streams with other terminal equipment, extracting health related data from the called user data and sending a health detection request for the called user to the server; and receiving health information of the called user returned by the server;
The server is used for receiving the detection request; and determining the health information of the called user at least according to the health related data carried by the detection request, and sending back the health information to the intelligent sound box.
The application also provides a remote health detection method, comprising the following steps:
the first intelligent sound box collects called user data from a call data stream between the first intelligent sound box and the second terminal equipment;
extracting health related data from the called user data;
and sending a health detection request for the called user to the server, so that the server determines health information of the called user at least according to the health related data carried by the detection request.
Optionally, the collecting, by the first intelligent speaker, the called user data from the call data stream between the first intelligent speaker and the second terminal device includes:
collecting at least one frame of image data of a called user from a video call data stream;
the extracting health related data from the called user data comprises the following steps:
and determining the face blood flow data of the called user as the health related data according to the at least one frame of image data.
Optionally, the facial blood flow data is determined by:
Extracting a face image of the called user from the image data through a face detection algorithm;
performing a face scan on the face image;
and extracting the facial blood flow data according to the facial scanning result.
Optionally, the method further comprises:
according to the image data, determining first emotion data of the called user;
the health detection request further comprises the first emotion data, so that the server side determines health information of the called user at least according to the health related data and the first emotion data.
Optionally, the collecting, by the first intelligent speaker, the called user data from the call data stream between the first intelligent speaker and the second terminal device includes:
collecting at least one frame of voice data of a called user from a voice call data stream;
the extracting health related data from the called user data comprises the following steps:
the health related data is extracted from the at least one frame of speech data.
Optionally, the method further comprises:
determining second emotion data of the called user according to the at least one frame of voice data;
the health detection request further comprises the second emotion data, so that the server side determines health information of the called user at least according to the health related data and the second emotion data.
Optionally, the method further comprises:
receiving the health information returned by the server;
and displaying the health information.
Optionally, the call data flow includes: video call data stream;
the displaying the health information includes:
and displaying the health information in a video call interface.
Optionally, the method further comprises:
determining health change information of the called user according to the multiple health information of the called user determined by the multiple health detection;
and sending the health change information to the second terminal equipment.
Optionally, if the remote health detection starting condition is met, the method is executed.
Optionally, the method further comprises:
displaying an operation option for starting remote health detection;
and if the operation option is selected, judging that the condition is met.
Optionally, one of the following ways is adopted to determine whether the condition is satisfied:
if the called user is a remote health detection user and the call time length is greater than a first time length threshold, judging that the condition is met;
if the called user is a remote health detection user and the time length from the last health detection is longer than a second time length threshold value, judging that the condition is satisfied;
and if the call time length is greater than the first time length threshold value, judging that the condition is met.
Optionally, the method further comprises:
and setting the called user as a remote health detection user.
Optionally, the setting the called user as a remote health detection user adopts at least one of the following modes:
if the called user is a lifetime, setting the called user as a remote health detection user;
if the called user is an ancestor, setting the called user as a remote health detection user;
if the called user is a friend, setting the called user as a remote health detection user;
and if the called user is a client, setting the remote health detection user.
Optionally, the method further comprises:
setting the user type of the called user; the user types include: ancestor, friend, client.
Optionally, the method further comprises:
the second terminal device includes: the second intelligent sound box;
before collecting the called user data, the method further comprises:
the method comprises the steps that a friend relation is established between a first intelligent sound box and a second intelligent sound box;
and the first intelligent sound box and the second intelligent sound box are communicated through a communication application.
The application also provides a health detection method, comprising the following steps:
receiving a health detection request sent by an intelligent sound box and aiming at a target user;
determining health information of the target user at least according to the health related data of the target user carried by the detection request; the health related data are extracted from target user data, and the target user data are acquired from call data streams between the intelligent sound box and other terminal equipment;
And sending the health information back to the intelligent sound box.
Optionally, determining feature data for determining a health condition at least according to the health related data;
and determining the health information according to the characteristic data through a health detection model.
Optionally, the health related data comprises facial blood flow data of the target user, the facial blood flow data being determined from at least one frame of image data of the target user.
Optionally, the target user includes a called user, and the at least one frame of image data is acquired from a video call data stream.
Optionally, the detection request further carries first emotion data of the target user, where the first emotion data is determined according to image data of the target user;
and determining the health information of the target user according to the health related data and the first emotion data.
Optionally, the detection request further carries second emotion data of the target user, where the second emotion data is determined according to at least one frame of voice data of the target user;
and determining the health information of the target user according to the health related data and the second emotion data.
Optionally, the target user includes: calling and/or called subscribers.
The present application also provides a health detection system comprising:
the intelligent sound box is used for collecting calling user data if a local health detection starting condition is met after call connection is established with other terminal equipment, extracting health related data from the calling user data and sending a health detection request for the calling user to the server; and receiving health information of the calling user returned by the server;
the server is used for receiving the detection request; and determining the health information of the calling user at least according to the health related data carried by the detection request, and returning the health information to the intelligent sound box.
The application also provides a health detection method, comprising the following steps:
after the first intelligent sound box establishes communication connection with other terminal equipment, if the local health detection starting condition is met, collecting calling user data;
extracting health related data from the caller data;
and sending a health detection request for the calling user to the server side, so that the server side determines the health information of the calling user at least according to the health related data carried by the detection request.
Optionally, the method further comprises:
After the first intelligent sound box and other terminal equipment are connected in a communication way, displaying operation options for starting local health detection; and if the operation option is selected, judging that the condition is met.
Optionally, the other terminal device includes a second smart speaker.
The present application also provides a health detection system comprising:
the intelligent sound box is used for starting a health detection application, collecting user data, extracting health related data from the user data and sending a health detection request to the server; receiving user health information returned by the server;
the server is used for receiving the detection request; and determining health information of the user at least according to the health related data carried by the detection request, and returning the health information to the intelligent sound box.
The application also provides a health detection method, comprising the following steps:
after the health detection application is started, collecting user data;
extracting health related data from the user data;
and sending a health detection request to the server side so that the server side can determine the health information of the user at least according to the health related data carried by the detection request.
The application also provides a health detection device, including:
The user data acquisition unit is used for acquiring called user data from a call data stream between the first intelligent sound box and the second terminal equipment;
a health data extraction unit for extracting health related data from the called user data;
the request sending unit is used for sending a health detection request aiming at the called user to the server side so that the server side can determine the health information of the called user at least according to the health related data carried by the detection request.
The application also provides an intelligent sound box, include:
a processor; and
a memory for storing a program for implementing a remote health detection method, the apparatus being powered on and executing the program of the method by the processor, and performing the steps of: the first intelligent sound box collects called user data from a call data stream between the first intelligent sound box and the second terminal equipment; extracting health related data from the called user data; and sending a health detection request for the called user to the server, so that the server determines health information of the called user at least according to the health related data carried by the detection request.
The application also provides a health detection device, including:
the request receiving unit is used for receiving a health detection request for a target user, which is sent by the intelligent sound box;
The health information determining unit is used for determining the health information of the target user at least according to the health related data of the target user carried by the detection request; the health related data are extracted from target user data, and the target user data are acquired from call data streams between the intelligent sound box and other terminal equipment;
and the health information sending unit is used for sending the health information back to the intelligent sound box.
The application also provides an electronic device comprising:
a processor; and
a memory for storing a program for realizing the health detection method, the apparatus being powered on and executing the program of the method by the processor, and performing the steps of: receiving a health detection request sent by an intelligent sound box and aiming at a target user; determining health information of the target user at least according to the health related data of the target user carried by the detection request; the health related data are extracted from target user data, and the target user data are acquired from call data streams between the intelligent sound box and other terminal equipment; and sending the health information back to the intelligent sound box.
The application also provides a health detection device, including:
The user data acquisition unit is used for acquiring calling user data if the local health detection starting condition is met after the first intelligent sound box establishes call connection with other terminal equipment;
a health data extraction unit for extracting health related data from the caller data;
and the request sending unit is used for sending a health detection request aiming at the calling user to the server side so that the server side can determine the health information of the calling user at least according to the health related data carried by the detection request.
The application also provides an intelligent sound box, include:
a processor; and
a memory for storing a program for realizing the health detection method, the apparatus being powered on and executing the program of the method by the processor, and performing the steps of: after the first intelligent sound box establishes communication connection with other terminal equipment, if the local health detection starting condition is met, collecting calling user data; extracting health related data from the caller data; and sending a health detection request for the calling user to the server side, so that the server side determines the health information of the calling user at least according to the health related data carried by the detection request.
The application also provides a health detection device, including:
the user data acquisition unit is used for acquiring user data after the health detection application is started;
a health data extraction unit for extracting health related data from the user data;
the request sending unit is used for sending a health detection request to the server side so that the server side can determine the health information of the user at least according to the health related data carried by the detection request.
The application also provides an electronic device comprising:
a processor; and
a memory for storing a program for realizing the health detection method, the apparatus being powered on and executing the program of the method by the processor, and performing the steps of: after the health detection application is started, collecting user data; extracting health related data from the user data; and sending a health detection request to the server side so that the server side can determine the health information of the user at least according to the health related data carried by the detection request.
The application also provides an electronic device comprising:
a processor; and
a memory for storing a program for implementing a remote health detection method, the apparatus being powered on and executing the program of the method by the processor, and performing the steps of: the device collects the called user data from the call data flow between other devices; extracting health related data from the called user data; and sending a health detection request for the called user to the server, so that the server determines health information of the called user at least according to the health related data carried by the detection request.
Optionally, the apparatus includes: smart phones, tablet computers, personal computers.
The application also provides an electronic device comprising:
a processor; and
a memory for storing a program for realizing the health detection method, the apparatus being powered on and executing the program of the method by the processor, and performing the steps of: after the equipment establishes call connection with other equipment, if the health detection starting condition is met, collecting calling user data; extracting health related data from the caller data; and sending a health detection request for the calling user to the server side, so that the server side determines the health information of the calling user at least according to the health related data carried by the detection request.
Optionally, the apparatus includes: smart phones, tablet computers, personal computers.
The present application also provides a computer-readable storage medium having instructions stored therein that, when executed on a computer, cause the computer to perform the various methods described above.
The present application also provides a computer program product comprising instructions which, when run on a computer, cause the computer to perform the various methods described above.
Compared with the prior art, the application has the following advantages:
according to the remote health detection system provided by the embodiment of the application, the called user data is collected from the call data flow between the intelligent sound box and other terminal equipment, the health related data is extracted from the called user data, and a health detection request for the called user is sent to the server side; the server determines the health information of the called user at least according to the health related data carried by the detection request, and the intelligent sound box receives the health information returned by the server; the processing mode combines the health detection with the voice box call application, so that the intelligent voice box end can carry out remote health detection on other people; therefore, the timeliness of user health detection can be effectively improved, user experience is improved, and the utilization rate of the intelligent sound box is improved. In addition, the cost of the intelligent sound box is much lower than that of other health detection instruments, so that the cost of health detection hardware can be effectively reduced.
After call connection is established between the intelligent sound box and other terminal equipment, if a health detection starting condition is met, collecting calling user data, extracting health related data from the calling user data, and sending a health detection request for the calling user to a server side; the server determines the health information of the calling user at least according to the health related data carried by the request, and the intelligent sound box receives the health information returned by the server; the processing mode combines the health detection with the sound box call application, realizes the health detection of the intelligent sound box end to the host, takes the sound box call as an entrance of the health detection, and reminds the sound box host of the health detection in time; therefore, the timeliness of user health detection can be effectively improved, and user experience is improved.
According to the health detection system provided by the embodiment of the application, the health detection application is started through the intelligent sound box, the user data are collected, the health related data are extracted from the user data, and the health detection request is sent to the server side; the server determines health information of the user at least according to the health related data carried by the request, and the intelligent sound box receives the health information returned by the server; the processing mode combines the health detection with the voice box call application, so that the intelligent voice box end can carry out remote health detection on other people; therefore, the timeliness of user health detection can be effectively improved, and user experience is improved.
Drawings
FIG. 1A block diagram of an embodiment of a remote health detection system is provided herein;
fig. 2 is a schematic application scenario diagram of an embodiment of a remote health detection system provided in the present application;
FIG. 3 is a schematic diagram of device interactions of an embodiment of a remote health detection system provided herein;
FIG. 4 is a schematic illustration of specific device interactions of an embodiment of a remote health detection system provided herein;
FIG. 5 is a schematic diagram of device interactions of an embodiment of a health detection system provided herein;
Fig. 6 is a schematic diagram illustrating interaction of devices with an embodiment of a health detection system provided herein.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. This application is, however, susceptible of embodiment in many other ways than those herein described and similar generalizations can be made by those skilled in the art without departing from the spirit of the application and the application is therefore not limited to the specific embodiments disclosed below.
In the application, a remote health detection system, a method and a device, a smart sound box and an electronic device are provided. The various schemes are described in detail one by one in the examples below.
First embodiment
Referring to fig. 1, a block diagram of an embodiment of a remote health detection system of the present application is shown. The system comprises: the server 1 and the intelligent sound box 2.
The server 1 may be a server deployed on a cloud server, or may be a server dedicated to implementing remote health detection, and may be deployed in a data center. The server may be a cluster server or a single server.
The intelligent sound box 2 can be a tool for home consumers to surf the internet by voice, such as song requesting, shopping on the internet, or weather forecast knowing, and can also control intelligent home equipment, such as opening a curtain, setting the temperature of a refrigerator, heating a water heater in advance, and the like.
Please refer to fig. 2, which is a schematic diagram of a scenario of the remote health detection system of the present application. The server side and the intelligent sound box A and the intelligent sound box B can be connected through a network, for example, the intelligent sound box A and the intelligent sound box B can be networked through WIFI and the like. The calling user can communicate in a voice mode or a video mode through the intelligent sound box A and the called user can communicate in a video mode through the intelligent sound box B. In the communication process, a calling user can start remote health detection on a called user by clicking a 'do health detection bar for the opposite party' displayed on a screen of the sound box A; correspondingly, the intelligent sound box A collects multi-frame image data of the called user from the video stream according to the opening instruction, extracts face blood flow data of the called user from the image data, uploads the face blood flow data to the server, carries out health detection according to the face blood flow data through the server, and the detection result can be displayed in the video call image in real time.
Please refer to fig. 3, which is a schematic diagram illustrating device interaction of an embodiment of the remote health detection system of the present application. In the embodiment, the intelligent sound box collects the data of the called user from the call data flow between the intelligent sound box and other terminal equipment, extracts the health related data from the data of the called user, and sends a health detection request for the called user to the server; and the server determines the health information of the called user at least according to the health related data carried by the detection request, and returns the health information to the intelligent sound box.
The other terminal devices include, but are not limited to: smart speakers, smart phones, tablet computers, etc. In this embodiment, the other terminal device is an intelligent speaker. For clarity, the intelligent sound box of the calling user is called a first intelligent sound box A, and the intelligent sound box of the called user is called a second intelligent sound box B.
In the specific implementation, the first intelligent sound box A and the second intelligent sound box B communicate through the communication application of the intelligent sound boxes, and before communication, a friend relationship between the two sound boxes can be constructed. Because the friend relation between the two sound boxes and the conversation technology between the intelligent sound boxes are established, the method belongs to the mature prior art, and therefore the description is omitted here.
The health related data includes user sign data from which the user's health condition can be analyzed, such as facial blood flow data of the user, and the like.
The call data stream can be a video call stream, namely, a video call mode is adopted between devices; the call data stream may also be a voice call stream, that is, a voice call mode is adopted between devices.
Please refer to fig. 4, which is a schematic diagram illustrating device interaction of an embodiment of the remote health detection system of the present application. In one example, a video call mode is adopted between devices; the first intelligent sound box A collects at least one frame of image data of a called user from a video call data stream, such as 30 continuous frames of image data; and determining the face blood flow data of the called user as the health related data according to the at least one frame of image data.
The first intelligent sound box A can acquire N frames of continuous images by utilizing the existing cameras, such as CMOS/CCD cameras, and extract facial photoblood flow data; the service end can perform analysis light spectrum detection according to the detection data (facial light blood flow data).
In particular, the facial blood flow data may be determined by: 1) Extracting a face image of the called user from the image data through a face detection algorithm; 2) Performing a face scan on the face image; 3) And extracting the facial blood flow data according to the facial scanning result. In this embodiment, a blood spectrum optical imaging (TOI) technique is used to extract facial blood flow data, and the TOI is a mature prior art, so that details are not repeated here.
In one example, the intelligent sound box is further used for determining expression data of the called user as first emotion data according to the at least one frame of image data; the health detection request further comprises the first emotion data, so that the server side determines health information of the called user at least according to the health related data and the first emotion data.
The first emotion data may be happy, sad, angry, etc. In specific implementation, the facial expression information of the user can be determined according to the facial image by a facial expression recognition technology. Because facial expression recognition technology belongs to the mature prior art, the description is omitted here.
According to the system provided by the embodiment of the application, the expression data of the called user is determined through the intelligent sound box according to the at least one frame of image data; the health detection request also comprises the expression data, so that the server side determines health information of the called user at least according to the health related data and the expression data; by the processing mode, for the same health related information, if the user expressions are different, different health information can be determined, so that the user health information is determined according to multi-mode data; therefore, the accuracy of health detection can be effectively improved.
In this embodiment, the server is specifically configured to determine, according to at least the health related data, feature data for determining a health condition; and determining the health information according to the characteristic data through a health detection model. The health detection model may be an artificial intelligence model, and the network structure may include a common neural network structure such as DNN, CNN, RNN, etc. Because the extraction of the feature data and the health detection model are all of the more mature prior art, the description is omitted here.
The health information, i.e. the detection result, includes but is not limited to: heartbeat, blood pressure, psychological stress, cardiovascular health, BMI, skin age, blood glucose, blood oxygen, and the like.
The system provided by the application enables the existing camera of the intelligent sound box to be utilized through the equipment interaction mode shown in fig. 4, and combines an optical spectrum health detection scheme to realize real-time health detection of a remote user.
In another example, a voice call is used between devices; the first intelligent sound box A collects at least one frame of voice data of a called user from a voice call data stream; the health related data is extracted from the at least one frame of speech data.
In one example, the intelligent sound box is further used for determining emotion data of the called user as second emotion data according to the at least one frame of voice data; the health detection request further comprises the second emotion data, so that the server side determines health information of the called user at least according to the health related data and the second emotion data.
The second mood data may be happy, low, angry, etc. In particular, the user emotion information can be determined according to the voice data by a voice emotion recognition technology. Since speech emotion recognition technology is a relatively mature prior art, it is not described in detail here.
In specific implementation, feature data for determining a health condition may be determined according to the health related data, the first emotion data and the second emotion data; the processing mode enables more accurate characteristic data to be extracted; therefore, the accuracy of the health information can be effectively improved.
According to the system provided by the embodiment of the application, the emotion data of the called user is determined through the intelligent sound box according to the at least one frame of voice data; the health detection request also comprises the emotion data, so that the server side determines health information of the called user at least according to the health related data and the emotion data; the processing mode ensures that for the same health related information, if the emotion of the user is different, different health information can be determined, so that the health information of the user is determined according to multi-mode data; therefore, the accuracy of health detection can be effectively improved. In this embodiment, the first smart speaker a is specifically configured to execute remote health detection processing for the called user if the remote health detection start condition is satisfied. The remote health detection on condition includes, but is not limited to: the caller selects an operational option for turning on remote health detection, as well as other conditions.
In one example, the first intelligent speaker a may be further configured to display an operation option for starting remote health detection, such as "do a health detection bar for the opposite party" displayed on the screen of the speaker a in the call process in fig. 2, and the calling user may start remote health detection on the called user by clicking the option, that is: and judging that the remote health detection starting condition is met.
In another example, if the call time period is greater than the first time period threshold, it is determined that the remote health detection on condition is satisfied. In the implementation, if the call time is longer than the first time threshold and the called user is a specified remote health detection user, it may be determined that the remote health detection start condition is satisfied.
In yet another example, if the called user is a designated remote health detection user and the duration from the last health detection reaches a second duration threshold, it is determined that the remote health detection on condition is satisfied.
The specified remote health detection user may be an elderly person, a child, a customer, or the like. In this embodiment, the first smart speaker a is further configured to set the called user as a remote health detection user. In specific implementation, at least one of the following modes may be adopted, where the called user is set as a remote health detection user: if the called user is a lifetime, setting the called user as a remote health detection user; if the called user is an ancestor, setting the called user as a remote health detection user; if the called user is a friend, setting the called user as a remote health detection user; and if the called user is a client, setting the remote health detection user. The user type, such as lifetime, evening, friends, clients, etc., may be set in advance for the called user. By adopting the processing mode, health detection data can be directly output in video call, health indexes of crowds such as old people, children, clients and the like are output, care for the aged is completed, and remote monitoring and detection are performed.
In an example, after the first intelligent speaker a receives the health detection result sent by the server, the health information of the called user may be displayed on the screen. In the implementation, if the users communicate with each other in a video mode, the health information of the called user can be displayed in the video communication interface in real time, so that the two users can communicate the health information.
In another example, the first smart speaker a stores the multiple health detection results of the called user, and may determine the health change information of the called user according to the multiple health information of the called user determined by the multiple health detection, so as to facilitate communication with the called user when the call is subsequently made, or send the health change information of the called user to the called user, which may be a mobile phone short message or the like, so as to facilitate the called user to know.
It should be noted that, in the system provided in this embodiment, the processing of extracting the health related data from the called user data (such as the user face image) is performed on the intelligent speaker side, so that the user information corresponding to the health related data is prevented from being uploaded to the server, and thus leakage of personal privacy information of the user can be prevented; therefore, the user experience can be effectively improved.
As can be seen from the above embodiments, in the remote health detection system provided in the embodiments of the present application, called user data is collected from a call data stream with other terminal devices through an intelligent sound box, health related data is extracted from the called user data, and a health detection request for the called user is sent to a server; the server determines the health information of the called user at least according to the health related data carried by the detection request, and the intelligent sound box receives the health information returned by the server; the processing mode combines the health detection with the voice box call application, so that the intelligent voice box end can carry out remote health detection on other people; therefore, the timeliness of user health detection can be effectively improved, user experience is improved, and the utilization rate of the intelligent sound box is improved. In addition, the cost of the intelligent sound box is much lower than that of other health detection instruments, so that the cost of health detection hardware can be effectively reduced.
Second embodiment
Corresponding to the remote health detection system, the application also provides a remote health detection method, and an execution subject of the method comprises, but is not limited to, a smart sound box and other terminal equipment. The same parts of the present embodiment as those of the first embodiment will not be described again, please refer to the corresponding parts in the first embodiment.
In this embodiment, the method includes the steps of:
step 1: the first intelligent sound box collects called user data from a call data stream between the first intelligent sound box and the second terminal equipment;
step 2: extracting health related data from the called user data;
step 3: and sending a health detection request for the called user to the server, so that the server determines health information of the called user at least according to the health related data carried by the detection request.
In one example, step 1 may be implemented as follows: collecting at least one frame of image data of a called user from a video call data stream; step 2 may be implemented as follows: and determining the face blood flow data of the called user as the health related data according to the at least one frame of image data.
In one example, the facial blood flow data is determined using the steps of: extracting a face image of the called user from the image data through a face detection algorithm; performing a face scan on the face image; and extracting the facial blood flow data according to the facial scanning result.
In one example, the method may further comprise the steps of: determining first emotion data of the called user according to the at least one frame of image data; the health detection request further comprises the first emotion data, so that the server side determines health information of the called user at least according to the health related data and the first emotion data.
In another example, step 1 may be implemented as follows: collecting at least one frame of voice data of a called user from a voice call data stream; step 2 may be implemented as follows: the health related data is extracted from the at least one frame of speech data.
In one example, the method may further comprise the steps of: determining second emotion data of the called user according to the at least one frame of voice data; the health detection request further comprises the second emotion data, so that the server side determines health information of the called user at least according to the health related data and the second emotion data.
In one example, the method may further comprise the steps of:
step 4: receiving the health information returned by the server;
step 5: and displaying the health information.
In one example, the call data flow includes: video call data stream; step 5 may be implemented as follows: and displaying the health information in a video call interface.
In one example, the method may further comprise the steps of:
step 6: determining health change information of the called user according to the multiple health information of the called user determined by the multiple health detection;
Step 7: and sending the health change information to the second terminal equipment.
In one example, the method is performed if a remote health detection on condition is met.
In one example, the method may further comprise the steps of: displaying an operation option for starting remote health detection; and if the operation option is selected, judging that the condition is met.
In one example, one of the following ways is used to determine whether the condition is met: if the called user is a remote health detection user and the call time length is greater than a first time length threshold, judging that the condition is met; if the called user is a remote health detection user and the time length from the last health detection is longer than a second time length threshold value, judging that the condition is satisfied; and if the call time length is greater than the first time length threshold value, judging that the condition is met.
In one example, the method may further comprise the steps of: and setting the called user as a remote health detection user.
In one example, the setting the called user to be a remote health detection user may adopt at least one of the following manners: if the called user is a lifetime, setting the called user as a remote health detection user; if the called user is an ancestor, setting the called user as a remote health detection user; if the called user is a friend, setting the called user as a remote health detection user; and if the called user is a client, setting the remote health detection user.
In one example, the method may further comprise the steps of: setting the user type of the called user; the user types include, but are not limited to: ancestor, friend, client.
In one example, the method may further comprise the steps of: the second terminal device includes: the second intelligent sound box; before collecting the called user data, the method may further comprise the steps of: the method comprises the steps that a friend relation is established between a first intelligent sound box and a second intelligent sound box; and the first intelligent sound box and the second intelligent sound box are communicated through a communication application.
As can be seen from the foregoing embodiments, in the remote health detection method provided by the embodiments of the present application, data of a called user is collected from a call data stream between the first intelligent sound box and the second terminal device; extracting health related data from the called user data; sending a health detection request for a called user to a server, so that the server determines health information of the called user at least according to health related data carried by the detection request; the processing mode combines the health detection with the voice box call application, so that the intelligent voice box end can carry out remote health detection on other people; therefore, the timeliness of user health detection can be effectively improved, user experience is improved, and the utilization rate of the intelligent sound box is improved. In addition, the cost of the intelligent sound box is much lower than that of other health detection instruments, so that the cost of health detection hardware can be effectively reduced.
Third embodiment
In the above embodiment, a remote health detection method is provided, and correspondingly, the application also provides a remote health detection device. The device corresponds to the embodiment of the method described above.
The same parts of the present embodiment as those of the first embodiment will not be described again, please refer to the corresponding parts in the first embodiment. The application provides a long-range health detection device includes:
the user data acquisition unit is used for acquiring called user data from a call data stream between the first intelligent sound box and the second terminal equipment;
a health data extraction unit for extracting health related data from the called user data;
the request sending unit is used for sending a health detection request aiming at the called user to the server side so that the server side can determine the health information of the called user at least according to the health related data carried by the detection request.
Fourth embodiment
The application also provides an intelligent sound box. Since the apparatus embodiments are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points. The device embodiments described below are merely illustrative.
An intelligent sound box of this embodiment, this intelligent sound box includes: a processor and a memory; a memory for storing a program for implementing a remote health detection method, the apparatus being powered on and executing the program of the method by the processor, and performing the steps of: the first intelligent sound box collects called user data from a call data stream between the first intelligent sound box and the second terminal equipment; extracting health related data from the called user data; and sending a health detection request for the called user to the server, so that the server determines health information of the called user at least according to the health related data carried by the detection request.
Fifth embodiment
Corresponding to the remote health detection system, the application also provides a health detection method, and an execution subject of the method comprises, but is not limited to, a server side, and any device capable of realizing the method. The same parts of the present embodiment as those of the first embodiment will not be described again, please refer to the corresponding parts in the first embodiment.
In this embodiment, the method includes the steps of:
step 1: receiving a health detection request sent by an intelligent sound box and aiming at a target user; the target user can be a calling user, a called user and health related data of two users simultaneously included in the request.
Step 2: determining health information of the target user at least according to the health related data of the target user carried by the detection request; the health related data are extracted from target user data, and the target user data are acquired from call data streams between the intelligent sound box and other terminal equipment;
step 3: and sending the health information back to the intelligent sound box.
In one example, step 2 may comprise the following sub-steps: 2.1 determining characteristic data for determining a health condition based at least on the health related data; 2.2, determining the health information according to the characteristic data through a health detection model.
In one example, the health-related data includes facial blood flow data of the target user, the facial blood flow data determined from at least one frame of image data of the target user.
In one example, the target user includes a called user, and the at least one frame of image data is acquired from a video call data stream.
In one example, the detection request further carries first emotion data of the target user, the first emotion data being determined according to at least one frame of image data of the target user; and determining the health information of the target user according to the health related data and the first emotion data.
In one example, the detection request also carries second emotion data of the target user, the second emotion data being determined according to at least one frame of speech data of the target user; and determining the health information of the target user according to the health related data and the second emotion data.
As can be seen from the above embodiments, in the remote health detection method provided by the embodiments of the present application, a health detection request for a target user sent by an intelligent sound box is received; determining health information of the target user at least according to the health related data of the target user carried by the detection request; the health related data are extracted from target user data, and the target user data are acquired from call data streams between the intelligent sound box and other terminal equipment; the health information is sent back to the intelligent sound box; the processing mode combines the health detection with the voice box call application, so that the intelligent voice box end can carry out remote health detection on other people; therefore, the timeliness of user health detection can be effectively improved, user experience is improved, and the utilization rate of the intelligent sound box is improved. In addition, the cost of the intelligent sound box is much lower than that of other health detection instruments, so that the cost of health detection hardware can be effectively reduced.
Sixth embodiment
In the above embodiment, a health detection method is provided, and corresponding thereto, the present application also provides a health detection device. The device corresponds to the embodiment of the method described above.
The same parts of the present embodiment as those of the first embodiment will not be described again, please refer to the corresponding parts in the first embodiment. The utility model provides a health detection device includes:
the request receiving unit is used for receiving a health detection request for a target user, which is sent by the intelligent sound box;
the health information determining unit is used for determining the health information of the target user at least according to the health related data of the target user carried by the detection request; the health related data are extracted from target user data, and the target user data are acquired from call data streams between the intelligent sound box and other terminal equipment;
and the health information sending unit is used for sending the health information back to the intelligent sound box.
Seventh embodiment
The application also provides an electronic device embodiment. Since the apparatus embodiments are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points. The device embodiments described below are merely illustrative.
An electronic device of the present embodiment includes: a processor and a memory; a memory for storing a program for realizing the health detection method, the apparatus being powered on and executing the program of the method by the processor, and performing the steps of: receiving a health detection request sent by an intelligent sound box and aiming at a target user; determining health information of the target user at least according to the health related data of the target user carried by the detection request; the health related data are extracted from target user data, and the target user data are acquired from call data streams between the intelligent sound box and other terminal equipment; and sending the health information back to the intelligent sound box.
Eighth embodiment
In the foregoing embodiments, a remote health detection system is provided, and in response thereto, the present application also provides a health detection system. The system corresponds to the embodiment of the system described above. The same parts of the present embodiment as those of the first embodiment will not be described again, please refer to the corresponding parts in the first embodiment.
As shown in fig. 1, a health detection system provided in the present application includes: a server 1 and an intelligent sound box 2.
Please refer to fig. 5, which is a schematic diagram illustrating device interaction of an embodiment of the health detection system of the present application. After the intelligent sound box establishes communication connection with other terminal equipment, if a local health detection starting condition is met, collecting calling user data, extracting health related data from the calling user data, and sending a health detection request for the calling user to a server; and receiving health information of the calling user returned by the server; the server receives the detection request; and determining the health information of the calling user at least according to the health related data carried by the detection request, and returning the health information to the intelligent sound box.
The system provided in this embodiment is different from the system provided in the first embodiment in that it includes: different health detection objects are obtained, in the first embodiment, remote health detection is performed on the called user, and in the second embodiment, local health detection is performed on the calling user. The system provided by the embodiment utilizes the camera of the first intelligent sound box A and combines the health detection of the optical spectrum to realize the local health detection function of the sound box A.
As shown in fig. 2, after the first intelligent sound box and other terminal equipment construct a call connection, an operation option for starting local health detection is displayed, namely, a health detection bar is made for the user; and if the operation option is selected, judging that the condition is met. In specific implementation, other opening conditions may be used, for example, the time length from the last detection is greater than a time length threshold, and the details are not repeated here.
As can be seen from the above embodiments, in the health detection system provided in the embodiments of the present application, after a call connection is established between an intelligent sound box and other terminal devices, if a health detection start condition is met, caller data is collected, health related data is extracted from the caller data, and a health detection request for a caller is sent to a server; the server determines the health information of the calling user at least according to the health related data carried by the request, and the intelligent sound box receives the health information returned by the server; the processing mode combines the health detection with the sound box call application, realizes the health detection of the intelligent sound box end to the host, takes the sound box call as an entrance of the health detection, and reminds the sound box host of the health detection in time; therefore, the timeliness of user health detection can be effectively improved, and user experience is improved.
Ninth embodiment
Corresponding to the above health detection system, the application further provides a health detection method, and the execution subject of the method includes, but is not limited to, a smart speaker, and may also be other terminal devices, such as a smart phone, a tablet computer, and so on. The parts of this embodiment, which have the same content as the eighth embodiment, will not be described again, and please refer to the corresponding parts in the eighth embodiment.
The health detection method provided by the application can comprise the following steps:
step 1: after the first intelligent sound box establishes communication connection with other terminal equipment, if the local health detection starting condition is met, collecting calling user data; the other terminal devices include, but are not limited to, a second smart speaker, a smart phone, a tablet computer, and the like.
Step 2: extracting health related data from the caller data;
step 3: and sending a health detection request for the calling user to the server side, so that the server side determines the health information of the calling user at least according to the health related data carried by the detection request.
In one example, the method may further comprise the steps of: after the first intelligent sound box and other terminal equipment are connected in a communication way, displaying operation options for starting local health detection; and if the operation option is selected, judging that the condition is met.
Tenth embodiment
In the above embodiment, a health detection method is provided, and corresponding thereto, the present application also provides a health detection device. The device corresponds to the embodiment of the method described above. The same parts of the present embodiment as those of the first embodiment will not be described again, please refer to the corresponding parts in the first embodiment.
The utility model provides a health detection device includes:
the user data acquisition unit is used for acquiring calling user data if the local health detection starting condition is met after the first intelligent sound box establishes call connection with other terminal equipment;
a health data extraction unit for extracting health related data from the caller data;
and the request sending unit is used for sending a health detection request aiming at the calling user to the server side so that the server side can determine the health information of the calling user at least according to the health related data carried by the detection request.
Eleventh embodiment
The application also provides an intelligent sound box. Since the apparatus embodiments are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points. The device embodiments described below are merely illustrative.
An intelligent sound box of this embodiment, this intelligent sound box includes: a processor and a memory; a memory for storing a program for realizing the health detection method, the apparatus being powered on and executing the program of the method by the processor, and performing the steps of: after the first intelligent sound box establishes communication connection with other terminal equipment, if the local health detection starting condition is met, collecting calling user data; extracting health related data from the caller data; and sending a health detection request for the calling user to the server side, so that the server side determines the health information of the calling user at least according to the health related data carried by the detection request.
Twelfth embodiment
In the foregoing embodiments, a remote health detection system is provided, and in response thereto, the present application also provides a health detection system. The system corresponds to the embodiment of the system described above. The same parts of the present embodiment as those of the first embodiment will not be described again, please refer to the corresponding parts in the first embodiment.
As shown in fig. 1, a health detection system provided in the present application includes: a server 1 and an intelligent sound box 2.
Please refer to fig. 6, which is a schematic diagram illustrating device interaction of an embodiment of the health detection system of the present application. The intelligent sound box starts a health detection application installed locally, collects user data, extracts health related data from the user data and sends a health detection request to a server; and receiving the detection request; and determining health information of the user at least according to the health related data carried by the detection request, and returning the health information to the intelligent sound box.
The system provided in this embodiment is different from the system provided in the first embodiment in that it includes: 1) The health detection objects are different, and in the first embodiment, remote health detection is performed on the called user, local health detection is performed on the loudspeaker box owner, and the system provided by the embodiment utilizes the camera of the intelligent loudspeaker box and combines the health detection of an optical spectrum to realize the local health detection function of the loudspeaker box; 2) The intelligent sound box of the embodiment does not need to communicate with other equipment, and user data is directly collected after a local health detection application is started, such as collecting N frames of user image data through a camera, collecting user voice data for a period of time through a microphone, and the like.
As can be seen from the above embodiments, in the health detection system provided in the embodiments of the present application, a health detection application is started through an intelligent sound box, user data is collected, health related data is extracted from the user data, and a health detection request is sent to a server; the server determines health information of the user at least according to the health related data carried by the request, and the intelligent sound box receives the health information returned by the server; the processing mode combines the health detection with the voice box call application, so that the intelligent voice box end can carry out remote health detection on other people; therefore, the timeliness of user health detection can be effectively improved, and user experience is improved.
Thirteenth embodiment
Corresponding to the health detection system, the application also provides a health detection method, and an execution subject of the method comprises, but is not limited to, an intelligent sound box and can also be other terminal equipment. The parts of this embodiment, which have the same content as the eighth embodiment, will not be described again, and please refer to the corresponding parts in the eighth embodiment.
The remote health detection method provided by the application can comprise the following steps:
step 1: after the health detection application is started, collecting user data;
Step 2: extracting health related data from the user data;
step 3: and sending a health detection request to the server side so that the server side can determine the health information of the user at least according to the health related data carried by the detection request.
Fourteenth embodiment
In the above embodiment, a health detection method is provided, and corresponding thereto, the present application also provides a health detection device. The device corresponds to the embodiment of the method described above. The same parts of the present embodiment as those of the first embodiment will not be described again, please refer to the corresponding parts in the first embodiment.
The utility model provides a health detection device includes:
the user data acquisition unit is used for acquiring user data after the health detection application is started;
a health data extraction unit for extracting health related data from the user data;
the request sending unit is used for sending a health detection request to the server side so that the server side can determine the health information of the user at least according to the health related data carried by the detection request.
Fifteenth embodiment
The application also provides electronic equipment. Since the apparatus embodiments are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points. The device embodiments described below are merely illustrative.
An electronic device of the present embodiment includes: a processor and a memory; a memory for storing a program for realizing the health detection method, the apparatus being powered on and executing the program of the method by the processor, and performing the steps of: after the health detection application is started, collecting user data; extracting health related data from the user data; and sending a health detection request to the server side so that the server side can determine the health information of the user at least according to the health related data carried by the detection request.
Sixteenth embodiment
The application also provides electronic equipment. Since the apparatus embodiments are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points. The device embodiments described below are merely illustrative.
An electronic device of the present embodiment includes: a processor and a memory; a memory for storing a program for realizing the health detection method, the apparatus being powered on and executing the program of the method by the processor, and performing the steps of: the device collects the called user data from the call data flow between other devices; extracting health related data from the called user data; and sending a health detection request for the called user to the server, so that the server determines health information of the called user at least according to the health related data carried by the detection request.
The apparatus comprises: smart phones, tablet computers, personal computers.
Seventeenth embodiment
The application also provides electronic equipment. Since the apparatus embodiments are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points. The device embodiments described below are merely illustrative.
An electronic device of the present embodiment includes: a processor and a memory; a memory for storing a program for realizing the health detection method, the apparatus being powered on and executing the program of the method by the processor, and performing the steps of: after the equipment establishes call connection with other equipment, if the health detection starting condition is met, collecting calling user data; extracting health related data from the caller data; and sending a health detection request for the calling user to the server side, so that the server side determines the health information of the calling user at least according to the health related data carried by the detection request.
The apparatus comprises: smart phones, tablet computers, personal computers.
While the preferred embodiment has been described, it is not intended to limit the invention thereto, and any person skilled in the art may make variations and modifications without departing from the spirit and scope of the present invention, so that the scope of the present invention shall be defined by the claims of the present application.
In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of computer-readable media.
1. Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer readable media, as defined herein, does not include non-transitory computer readable media (transmission media), such as modulated data signals and carrier waves.
2. It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Claims (25)
1. A remote health detection system, comprising:
the intelligent sound box is used for setting a remote health detection user according to the user type, wherein the user type comprises at least one of ancestors, friends and clients; if the called user is a remote health detection user and the remote health detection starting condition is met, collecting at least one frame of image data of the called user from a video call data stream between the called user and other terminal equipment; determining face blood flow data of the called user as health related data according to the at least one frame of image data; according to the image data, determining first emotion data of the called user; sending a health detection request for a called user to a server; and receiving health information of the called user returned by the server;
The server is used for receiving the detection request; and determining the health information of the called user at least according to the health related data carried by the detection request and the first emotion data, and sending back the health information to the intelligent sound box.
2. A method of remote health detection comprising:
the method comprises the steps that a first intelligent sound box sets a remote health detection user according to a user type, wherein the user type comprises at least one of ancestors, friends and clients;
if the called user is a remote health detection user and the remote health detection starting condition is met, the first intelligent sound box collects at least one frame of image data of the called user from a video call data stream between the first intelligent sound box and the second terminal equipment;
determining face blood flow data of the called user as health related data according to the at least one frame of image data;
according to the image data, determining first emotion data of the called user;
and sending a health detection request for the called user to the server, so that the server determines health information of the called user at least according to the health related data carried by the detection request and the first emotion data.
3. The method of claim 2, wherein the facial blood flow data is determined by:
Extracting a face image of the called user from the image data through a face detection algorithm;
performing a face scan on the face image;
and extracting the facial blood flow data according to the facial scanning result.
4. The method as recited in claim 2, further comprising:
receiving the health information returned by the server;
and displaying the health information.
5. The method of claim 4, wherein the step of determining the position of the first electrode is performed,
the displaying the health information includes:
and displaying the health information in a video call interface.
6. The method as recited in claim 2, further comprising:
determining health change information of the called user according to the multiple health information of the called user determined by the multiple health detection;
and sending the health change information to the second terminal equipment.
7. The method as recited in claim 2, further comprising:
displaying an operation option for starting remote health detection;
and if the operation option is selected, judging that the condition is met.
8. The method of claim 2, wherein determining whether the condition is met is one of:
If the time length from the last health detection is greater than a second time length threshold value, judging that the condition is met;
and if the call time length is greater than the first time length threshold value, judging that the condition is met.
9. The method as recited in claim 2, further comprising:
the second terminal device includes: the second intelligent sound box;
before collecting the called user data, the method further comprises:
the method comprises the steps that a friend relation is established between a first intelligent sound box and a second intelligent sound box;
and the first intelligent sound box and the second intelligent sound box are communicated through a communication application.
10. A method of health detection comprising:
receiving a health detection request sent by an intelligent sound box and aiming at a target user, wherein the target user is a called user, the request is initiated when the called user is a remote health detection user and a remote health detection starting condition is met, the remote health detection user is set according to a user type, and the user type comprises at least one of ancestors, friends and clients;
determining health information of the target user at least according to the health related data and the first emotion data of the target user carried by the detection request; the health related data and the first emotion data are extracted from at least one frame of image data of a target user, the image data are acquired from video call data streams between the intelligent sound box and other terminal equipment, and the health related data comprise facial blood flow data;
And sending the health information back to the intelligent sound box.
11. The method of claim 10, wherein the step of determining the position of the first electrode is performed,
determining characteristic data for determining a health condition based at least on the health related data;
and determining the health information according to the characteristic data through a health detection model.
12. A health detection system, comprising:
the intelligent sound box is used for setting health detection users according to user types, wherein the user types comprise at least one of ancestors, friends and clients; after video call connection is established with other terminal equipment, if the calling user is the health detection user and the local health detection starting condition is met, collecting at least one frame of image data of the calling user; determining facial blood flow data of the calling user as health related data according to the at least one frame of image data; determining first emotion data of the calling user according to the image data; sending a health detection request for a calling user to a server; and receiving health information of the calling user returned by the server;
the server is used for receiving the detection request; and determining the health information of the calling user at least according to the health related data carried by the detection request and the first emotion data, and sending back the health information to the intelligent sound box.
13. A method of health detection comprising:
the first intelligent sound box sets a health detection user according to a user type, wherein the user type comprises at least one of ancestors, friends and clients;
after the first intelligent sound box and other terminal equipment are connected in a video call mode, if a calling user is the health detection user and a local health detection starting condition is met, at least one frame of image data of the calling user is collected;
determining facial blood flow data of the calling user as health related data according to the at least one frame of image data;
determining first emotion data of the calling user according to the image data;
and sending a health detection request for the calling user to the server side, so that the server side determines the health information of the calling user at least according to the health related data carried by the detection request and the first emotion data.
14. The method as recited in claim 13, further comprising:
after the first intelligent sound box and other terminal equipment are connected in a communication way, displaying operation options for starting local health detection; and if the operation option is selected, judging that the condition is met.
15. The method of claim 13, wherein the step of determining the position of the probe is performed,
the other terminal equipment comprises a second intelligent sound box.
16. A remote health detection device, comprising:
the user data acquisition unit is used for setting a remote health detection user according to a user type of the first intelligent sound box, wherein the user type comprises at least one of ancestors, friends and clients; if the called user is a remote health detection user and the remote health detection starting condition is met, the first intelligent sound box collects at least one frame of image data of the called user from a video call data stream between the first intelligent sound box and the second terminal equipment;
the health data extraction unit is used for determining the face blood flow data of the called user as health related data according to the at least one frame of image data; according to the image data, determining first emotion data of the called user;
the request sending unit is used for sending a health detection request for the called user to the server side, so that the server side at least determines health information of the called user according to the health related data carried by the detection request and the first emotion data.
17. An intelligent sound box, which is characterized by comprising:
A processor; and
the storage is used for storing a program for realizing a remote health detection method, and after the intelligent sound box is electrified and the program of the method is run through the processor, the following steps are executed: the first intelligent sound box sets a remote health detection user according to a user type, wherein the user type comprises at least one of ancestors, evening, friends and clients; if the called user is a remote health detection user and the remote health detection starting condition is met, the first intelligent sound box collects at least one frame of image data of the called user from a video call data stream between the first intelligent sound box and the second terminal equipment; determining face blood flow data of the called user as health related data according to the at least one frame of image data; according to the image data, determining first emotion data of the called user; and sending a health detection request for the called user to the server, so that the server determines health information of the called user at least according to the health related data carried by the detection request and the first emotion data.
18. A health detection device, comprising:
the system comprises a request receiving unit, a target user and a remote health detection starting unit, wherein the request receiving unit is used for receiving a health detection request sent by an intelligent sound box and aiming at a target user, the target user is a called user, the request is initiated when the called user is a remote health detection user, and a remote health detection starting condition is met, the remote health detection user is set according to a user type, and the user type comprises at least one of ancestors, friends and clients;
The health information determining unit is used for determining the health information of the target user at least according to the health related data and the first emotion data of the target user carried by the detection request; the health related data and the first emotion data are extracted from at least one frame of image data of a target user, the image data are acquired from video call data streams between the intelligent sound box and other terminal equipment, and the health related data comprise facial blood flow data;
and the health information sending unit is used for sending the health information back to the intelligent sound box.
19. An electronic device, comprising:
a processor; and
a memory for storing a program for realizing the health detection method, the apparatus being powered on and executing the program of the method by the processor, and performing the steps of: receiving a health detection request sent by an intelligent sound box and aiming at a target user, wherein the target user is a called user, the request is initiated when the called user is a remote health detection user and a remote health detection starting condition is met, the remote health detection user is set according to a user type, and the user type comprises at least one of ancestors, friends and clients; determining health information of the target user at least according to the health related data and the first emotion data of the target user carried by the detection request; the health related data and the first emotion data are extracted from at least one frame of image data of a target user, the image data are acquired from video call data streams between the intelligent sound box and other terminal equipment, and the health related data comprise facial blood flow data; and sending the health information back to the intelligent sound box.
20. A health detection device, comprising:
the user data acquisition unit is used for setting a health detection user according to a user type of the first intelligent sound box, wherein the user type comprises at least one of ancestors, friends and clients; after the first intelligent sound box and other terminal equipment are connected in a video call mode, if a calling user is the health detection user and a local health detection starting condition is met, at least one frame of image data of the calling user is collected;
the health data extraction unit is used for determining facial blood flow data of the calling user as health related data according to the at least one frame of image data; determining first emotion data of the calling user according to the image data;
and the request sending unit is used for sending a health detection request for the calling user to the server side so that the server side can determine the health information of the calling user at least according to the health related data carried by the detection request and the first emotion data.
21. An intelligent sound box, which is characterized by comprising:
a processor; and
the storage is used for storing a program for realizing the health detection method, and after the intelligent sound box is electrified and the program of the method is run by the processor, the following steps are executed: the first intelligent sound box sets a health detection user according to a user type, wherein the user type comprises at least one of ancestors, friends and clients; after the first intelligent sound box and other terminal equipment are connected in a video call mode, if a calling user is the health detection user and a local health detection starting condition is met, at least one frame of image data of the calling user is collected; determining facial blood flow data of the calling user as health related data according to the at least one frame of image data; determining first emotion data of the calling user according to the image data; and sending a health detection request for the calling user to the server side, so that the server side determines the health information of the calling user at least according to the health related data carried by the detection request and the first emotion data.
22. An electronic device, comprising:
a processor; and
a memory for storing a program for implementing a remote health detection method, the apparatus being powered on and executing the program of the method by the processor, and performing the steps of: the device sets a remote health detection user according to a user type, wherein the user type comprises at least one of ancestors, evening, friends and clients; if the called user is a remote health detection user and the remote health detection starting condition is met, the equipment acquires at least one frame of image data of the called user from a video call data stream between the equipment and other equipment; determining face blood flow data of the called user as health related data according to the at least one frame of image data; according to the image data, determining first emotion data of the called user; and sending a health detection request for the called user to the server, so that the server determines health information of the called user at least according to the health related data carried by the detection request and the first emotion data.
23. The apparatus of claim 22, wherein the device comprises a plurality of sensors,
the apparatus comprises: smart phones, tablet computers, personal computers.
24. An electronic device, comprising:
a processor; and
a memory for storing a program for realizing the health detection method, the apparatus being powered on and executing the program of the method by the processor, and performing the steps of: the device sets a health detection user according to a user type, wherein the user type comprises at least one of ancestors, evening parents, friends and clients; after video call connection is established with other equipment, if the calling user is the health detection user and the health detection starting condition is met, collecting at least one frame of image data of the calling user; determining facial blood flow data of the calling user as health related data according to the at least one frame of image data; determining first emotion data of the calling user according to the image data; and sending a health detection request for the calling user to the server side, so that the server side determines the health information of the calling user at least according to the health related data carried by the detection request and the first emotion data.
25. The apparatus of claim 24, wherein the device comprises a plurality of sensors,
the apparatus comprises: smart phones, tablet computers, personal computers.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010126085.3A CN113316041B (en) | 2020-02-27 | 2020-02-27 | Remote health detection system, method, device and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010126085.3A CN113316041B (en) | 2020-02-27 | 2020-02-27 | Remote health detection system, method, device and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113316041A CN113316041A (en) | 2021-08-27 |
| CN113316041B true CN113316041B (en) | 2023-08-01 |
Family
ID=77370456
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010126085.3A Active CN113316041B (en) | 2020-02-27 | 2020-02-27 | Remote health detection system, method, device and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113316041B (en) |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170347899A1 (en) * | 2016-06-03 | 2017-12-07 | FOURTH FRONTIER TECHNOLOGIES, Pvt. Ltd. | Method and system for continuous monitoring of cardiovascular health |
| CN108574515B (en) * | 2017-03-07 | 2021-07-30 | 中移（杭州）信息技术有限公司 | Data sharing method, device and system based on intelligent sound box equipment |
| CN108833721B (en) * | 2018-05-08 | 2021-03-12 | 广东小天才科技有限公司 | Emotion analysis method based on call, user terminal and system |
| CN108968920A (en) * | 2018-07-12 | 2018-12-11 | 维沃移动通信有限公司 | A kind of data detection method and electronic equipment |
| CN110047588A (en) * | 2019-03-18 | 2019-07-23 | 平安科技（深圳）有限公司 | Method of calling, device, computer equipment and storage medium based on micro- expression |
| CN110444229A (en) * | 2019-06-17 | 2019-11-12 | 深圳壹账通智能科技有限公司 | Communication service method, device, computer equipment and storage medium based on speech recognition |
-
2020
- 2020-02-27 CN CN202010126085.3A patent/CN113316041B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN113316041A (en) | 2021-08-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102416558B1 (en) | Video data processing method, device and readable storage medium | |
| CN109446876B (en) | Sign language information processing method and device, electronic equipment and readable storage medium | |
| JP7221258B2 (en) | VOICEPRINT EXTRACT MODEL TRAINING METHOD, VOICEPRINT RECOGNITION METHOD, APPARATUS AND MEDIUM THEREOF | |
| CN110519636B (en) | Voice information playing method and device, computer equipment and storage medium | |
| CN110853646B (en) | Conference speaking role distinguishing method, device, equipment and readable storage medium | |
| WO2015090147A1 (en) | Virtual video call method and terminal | |
| EP4096222A1 (en) | Live broadcast assistance method and electronic device | |
| RU2500081C2 (en) | Information processing device, information processing method and recording medium on which computer programme is stored | |
| WO2020044099A1 (en) | Service processing method and apparatus based on object recognition | |
| WO2024000867A1 (en) | Emotion recognition method and apparatus, device, and storage medium | |
| CN113163272A (en) | Video editing method, computer device and storage medium | |
| CN110705356B (en) | Function control method and related equipment | |
| WO2022088447A1 (en) | Video playback method and system, electronic device, and storage medium | |
| WO2020052062A1 (en) | Detection method and device | |
| CN113703585A (en) | Interaction method, interaction device, electronic equipment and storage medium | |
| CN113301372A (en) | Live broadcast method, device, terminal and storage medium | |
| CN113284500B (en) | Audio processing method, device, electronic equipment and storage medium | |
| CN113316041B (en) | Remote health detection system, method, device and equipment | |
| CN111985252A (en) | Dialogue translation method and device, storage medium and electronic equipment | |
| KR100686076B1 (en) | Wireless Communication Terminal with Message Transmission According to Feeling of Terminal-User and Method of Message Transmission Using Same | |
| JP7206741B2 (en) | HEALTH CONDITION DETERMINATION SYSTEM, HEALTH CONDITION DETERMINATION DEVICE, SERVER, HEALTH CONDITION DETERMINATION METHOD, AND PROGRAM | |
| CN110196900A (en) | Exchange method and device for terminal | |
| JP2023051211A (en) | Information processor, information processing method, and information processing program | |
| CN113099305A (en) | Play control method and device | |
| CN111610851A (en) | Interaction method and device and user terminal for realizing interaction method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 40058047 Country of ref document: HK |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |