CN113316041A - Remote health detection system, method, device and equipment - Google Patents

Remote health detection system, method, device and equipment Download PDF

Info

Publication number
CN113316041A
CN113316041A CN202010126085.3A CN202010126085A CN113316041A CN 113316041 A CN113316041 A CN 113316041A CN 202010126085 A CN202010126085 A CN 202010126085A CN 113316041 A CN113316041 A CN 113316041A
Authority
CN
China
Prior art keywords
health
data
user
detection
sound box
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010126085.3A
Other languages
Chinese (zh)
Other versions
CN113316041B (en
Inventor
闫玮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN202010126085.3A priority Critical patent/CN113316041B/en
Publication of CN113316041A publication Critical patent/CN113316041A/en
Application granted granted Critical
Publication of CN113316041B publication Critical patent/CN113316041B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/02—Casings; Cabinets ; Supports therefor; Mountings therein
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/026—Measuring blood flow
    • A61B5/0261—Measuring blood flow using optical means, e.g. infrared light
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
    • A61B5/6898—Portable consumer electronic devices, e.g. music players, telephones, tablet computers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Molecular Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Surgery (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Child & Adolescent Psychology (AREA)
  • Hematology (AREA)
  • Physiology (AREA)
  • Acoustics & Sound (AREA)
  • Cardiology (AREA)
  • Developmental Disabilities (AREA)
  • Educational Technology (AREA)
  • Hospice & Palliative Care (AREA)
  • Psychiatry (AREA)
  • Psychology (AREA)
  • Social Psychology (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Medical Treatment And Welfare Office Work (AREA)

Abstract

The application discloses a remote health detection system, a method, a device and equipment. The remote health detection system acquires called user data from a call data stream between the remote health detection system and other terminal equipment through the intelligent sound box, extracts health related data from the called user data, and sends a health detection request aiming at the called user to a server; the server side determines the health information of the called user at least according to the health related data carried by the detection request, and the intelligent sound box receives the health information returned by the server side. By adopting the processing mode, the health detection and the sound box conversation application are combined, and the intelligent sound box end can carry out remote health detection on other people; therefore, the timeliness of the user health detection can be effectively improved, and the user experience is improved.

Description

Remote health detection system, method, device and equipment
Technical Field
The application relates to the technical field of intelligent sound boxes, in particular to a remote health detection system, a remote health detection method and a remote health detection device, an intelligent sound box and electronic equipment.
Background
The intelligent sound box is a product of sound box upgrading, is a tool for household consumers to surf the internet by voice, such as song ordering, internet shopping or weather forecast knowing, and can also control intelligent household equipment, such as opening a curtain, setting the temperature of a refrigerator, heating a water heater in advance and the like.
At present, the following functions are mainly realized by the intelligent sound box through a camera: video calls, home monitoring, textbook recognition, and the like. However, health class functional output and interaction is lacking locally at the loudspeaker. For the health detection requirements of users, at present, some skin detection functions need to be accessed by embedding some small programs in mobile phone apps in combination with devices such as smart phones. In addition, the skin quality detection can be directly carried out through the mobile phone without depending on the intelligent sound box.
In summary, how to perform health detection locally on the smart speaker becomes a problem that needs to be urgently solved by those skilled in the art.
Disclosure of Invention
The application provides a remote health detection system to solve the problem that remote health detection can not be carried out on other people locally at an intelligent sound box in the prior art. The application additionally provides a remote health detection method and device, a health detection system, method and device, a smart sound box and electronic equipment.
The present application provides a remote health detection system comprising:
the intelligent sound box is used for collecting called user data from a call data stream between the intelligent sound box and other terminal equipment, extracting health related data from the called user data and sending a health detection request aiming at a called user to a server; receiving the health information of the called user returned by the server;
the server is used for receiving the detection request; and determining the health information of the called user at least according to the health related data carried by the detection request, and returning the health information to the intelligent sound box.
The application also provides a remote health detection method, which comprises the following steps:
the first intelligent sound box collects called user data from a call data stream between the first intelligent sound box and the second terminal device;
extracting health related data from the called user data;
and sending a health detection request aiming at the called user to the server so that the server determines the health information of the called user at least according to the health related data carried by the detection request.
Optionally, the acquiring, by the first smart speaker, called user data from a call data stream with the second terminal device includes:
collecting at least one frame of image data of a called user from a video call data stream;
the extracting health related data from the called user data comprises:
and determining facial blood flow data of the called user according to the at least one frame of image data as the health related data.
Optionally, the facial blood flow data is determined by the following steps:
extracting a face image of the called user from the image data through a face detection algorithm;
performing a face scan on the face image;
and extracting the facial blood flow data according to the face scanning result.
Optionally, the method further includes:
determining first emotion data of a called user according to the image data;
the health detection request further comprises the first emotion data, so that the server side determines the health information of the called user at least according to the health related data and the first emotion data.
Optionally, the acquiring, by the first smart speaker, called user data from a call data stream with the second terminal device includes:
collecting at least one frame of voice data of a called user from a voice call data stream;
the extracting health related data from the called user data comprises:
extracting the health-related data from the at least one frame of speech data.
Optionally, the method further includes:
determining second emotion data of the called user according to the at least one frame of voice data;
the health detection request further comprises the second emotion data, so that the server side determines the health information of the called user at least according to the health related data and the second emotion data.
Optionally, the method further includes:
receiving the health information returned by the server;
and displaying the health information.
Optionally, the call data flow includes: a video call data stream;
the displaying the health information comprises:
and displaying the health information in a video call interface.
Optionally, the method further includes:
determining health change information of the called user according to the multiple health information of the called user determined by multiple health detections;
and sending the health change information to the second terminal equipment.
Optionally, if the remote health detection start condition is satisfied, the method is executed.
Optionally, the method further includes:
displaying an operation option for starting remote health detection;
and if the operation option is selected, judging that the condition is satisfied.
Optionally, whether the condition is satisfied is determined by one of the following modes:
if the called user is a remote health detection user and the call duration is greater than a first duration threshold, judging that the condition is satisfied;
if the called user is a remote health detection user and the time length from the last health detection is greater than a second time length threshold value, judging that the condition is satisfied;
and if the call duration is greater than the first duration threshold, judging that the condition is satisfied.
Optionally, the method further includes:
and setting the called user as a remote health detection user.
Optionally, the called user is set as a remote health detection user, and at least one of the following manners is adopted:
if the called user is a elder, setting the called user as a remote health detection user;
if the called user is a descendant, setting the called user as a remote health detection user;
if the called user is a friend, setting the called user as a remote health detection user;
and if the called user is a client, setting the called user as a remote health detection user.
Optionally, the method further includes:
setting the user type of the called user; the user types include: elder, evening, friend, client.
Optionally, the method further includes:
the second terminal device includes: a second smart speaker;
before collecting the called user data, the method further comprises:
a friend relationship is established between the first intelligent sound box and the second intelligent sound box;
the first intelligent sound box and the second intelligent sound box are communicated through communication application.
The present application also provides a health detection method, comprising:
receiving a health detection request aiming at a target user and sent by an intelligent sound box;
determining health information of the target user at least according to the health related data of the target user carried by the detection request; the health related data is extracted from target user data, and the target user data is acquired from a call data stream between the intelligent sound box and other terminal equipment;
and returning the health information to the intelligent sound box.
Optionally, determining characteristic data for determining a health condition at least based on the health-related data;
and determining the health information according to the characteristic data through a health detection model.
Optionally, the health-related data includes facial blood flow data of the target user, and the facial blood flow data is determined according to at least one frame of image data of the target user.
Optionally, the target user includes a called user, and the at least one frame of image data is acquired from a video call data stream.
Optionally, the detection request further carries first emotion data of the target user, and the first emotion data is determined according to image data of the target user;
and determining health information of the target user according to the health related data and the first emotion data.
Optionally, the detection request further carries second emotion data of the target user, where the second emotion data is determined according to at least one frame of voice data of the target user;
and determining health information of the target user according to the health related data and the second emotion data.
Optionally, the target user includes: a calling subscriber and/or a called subscriber.
The present application further provides a health detection system, comprising:
the intelligent sound box is used for acquiring calling user data, extracting health related data from the calling user data and sending a health detection request aiming at a calling user to the server side if a local health detection starting condition is met after call connection is established with other terminal equipment; receiving the health information of the calling user returned by the server;
the server is used for receiving the detection request; and determining the health information of the calling user at least according to the health related data carried by the detection request, and returning the health information to the intelligent sound box.
The present application also provides a health detection method, comprising:
after the first intelligent sound box establishes call connection with other terminal equipment, if a local health detection starting condition is met, acquiring calling user data;
extracting health-related data from the caller data;
and sending a health detection request aiming at the calling user to the server so that the server determines the health information of the calling user at least according to the health related data carried by the detection request.
Optionally, the method further includes:
after the first intelligent sound box is in conversation connection with other terminal equipment, displaying an operation option for starting local health detection; and if the operation option is selected, judging that the condition is satisfied.
Optionally, the other terminal device includes a second smart speaker.
The present application further provides a health detection system, comprising:
the intelligent sound box is used for starting a health detection application, acquiring user data, extracting health related data from the user data and sending a health detection request to the server; receiving user health information returned by the server;
the server is used for receiving the detection request; and determining user health information at least according to health related data carried by the detection request, and returning the health information to the intelligent sound box.
The present application also provides a health detection method, comprising:
after the health detection application is started, collecting user data;
extracting health-related data from the user data;
and sending a health detection request to the server so that the server determines the user health information at least according to the health related data carried by the detection request.
The present application further provides a health detection device, comprising:
the user data acquisition unit is used for acquiring called user data from a call data stream between the first intelligent sound box and the second terminal device;
the health data extraction unit is used for extracting health related data from the called user data;
the request sending unit is used for sending a health detection request aiming at the called user to the server side, so that the server side determines the health information of the called user at least according to the health related data carried by the detection request.
The application further provides an intelligent sound box, include:
a processor; and
a memory for storing a program for implementing the remote health detection method, the device performing the following steps after being powered on and running the program of the method by the processor: the first intelligent sound box collects called user data from a call data stream between the first intelligent sound box and the second terminal device; extracting health related data from the called user data; and sending a health detection request aiming at the called user to the server so that the server determines the health information of the called user at least according to the health related data carried by the detection request.
The present application further provides a health detection device, comprising:
the request receiving unit is used for receiving a health detection request aiming at a target user and sent by the intelligent sound box;
the health information determining unit is used for determining the health information of the target user at least according to the health related data of the target user carried by the detection request; the health related data is extracted from target user data, and the target user data is acquired from a call data stream between the intelligent sound box and other terminal equipment;
and the health information sending unit is used for sending the health information back to the intelligent sound box.
The present application further provides an electronic device, comprising:
a processor; and
a memory for storing a program for implementing the health detection method, the device being powered on and the program for the method being executed by the processor to perform the steps of: receiving a health detection request aiming at a target user and sent by an intelligent sound box; determining health information of the target user at least according to the health related data of the target user carried by the detection request; the health related data is extracted from target user data, and the target user data is acquired from a call data stream between the intelligent sound box and other terminal equipment; and returning the health information to the intelligent sound box.
The present application further provides a health detection device, comprising:
the system comprises a user data acquisition unit, a first intelligent sound box and a second intelligent sound box, wherein the user data acquisition unit is used for acquiring calling user data after the first intelligent sound box establishes call connection with other terminal equipment and if a local health detection starting condition is met;
a health data extraction unit for extracting health related data from the calling subscriber data;
the request sending unit is used for sending a health detection request aiming at the calling user to the server so that the server can determine the health information of the calling user at least according to the health related data carried by the detection request.
The application further provides an intelligent sound box, include:
a processor; and
a memory for storing a program for implementing the health detection method, the device being powered on and the program for the method being executed by the processor to perform the steps of: after the first intelligent sound box establishes call connection with other terminal equipment, if a local health detection starting condition is met, acquiring calling user data; extracting health-related data from the caller data; and sending a health detection request aiming at the calling user to the server so that the server determines the health information of the calling user at least according to the health related data carried by the detection request.
The present application further provides a health detection device, comprising:
the user data acquisition unit is used for acquiring user data after the health detection application is started;
a health data extraction unit for extracting health related data from the user data;
and the request sending unit is used for sending a health detection request to the server so that the server determines the user health information at least according to the health related data carried by the detection request.
The present application further provides an electronic device, comprising:
a processor; and
a memory for storing a program for implementing the health detection method, the device being powered on and the program for the method being executed by the processor to perform the steps of: after the health detection application is started, collecting user data; extracting health-related data from the user data; and sending a health detection request to the server so that the server determines the user health information at least according to the health related data carried by the detection request.
The present application further provides an electronic device, comprising:
a processor; and
a memory for storing a program for implementing the remote health detection method, the device performing the following steps after being powered on and running the program of the method by the processor: the equipment collects called user data from a call data stream with other equipment; extracting health related data from the called user data; and sending a health detection request aiming at the called user to the server so that the server determines the health information of the called user at least according to the health related data carried by the detection request.
Optionally, the apparatus includes: smart phones, tablet computers, personal computers.
The present application further provides an electronic device, comprising:
a processor; and
a memory for storing a program for implementing the health detection method, the device being powered on and the program for the method being executed by the processor to perform the steps of: after the equipment establishes call connection with other equipment, if a health detection starting condition is met, acquiring calling user data; extracting health-related data from the caller data; and sending a health detection request aiming at the calling user to the server so that the server determines the health information of the calling user at least according to the health related data carried by the detection request.
Optionally, the apparatus includes: smart phones, tablet computers, personal computers.
The present application also provides a computer-readable storage medium having stored therein instructions, which when run on a computer, cause the computer to perform the various methods described above.
The present application also provides a computer program product comprising instructions which, when run on a computer, cause the computer to perform the various methods described above.
Compared with the prior art, the method has the following advantages:
the remote health detection system provided by the embodiment of the application collects called user data from a call data stream between the intelligent sound box and other terminal equipment, extracts health related data from the called user data, and sends a health detection request aiming at the called user to a server; the server side determines the health information of the called user at least according to the health related data carried by the detection request, and the intelligent sound box receives the health information returned by the server side; the processing mode combines the health detection with the sound box conversation application, and realizes that the intelligent sound box end carries out remote health detection on other people; therefore, the timeliness of the user health detection can be effectively improved, the user experience is improved, and the utilization rate of the intelligent sound box is further improved. In addition, the cost of the intelligent sound box is much lower than that of other health detection instruments, so that the cost of health detection hardware can be effectively reduced.
According to the health detection system provided by the embodiment of the application, after the intelligent sound box establishes call connection with other terminal equipment, if the health detection starting condition is met, calling user data is collected, health related data is extracted from the calling user data, and a health detection request aiming at a calling user is sent to a server; the server side determines the health information of the calling user at least according to the health related data carried by the request, and the intelligent sound box receives the health information returned by the server side; the processing mode combines the health detection with the sound box conversation application, realizes the health detection of the intelligent sound box end to the owner, and uses the sound box conversation as the entrance of the health detection to remind the sound box owner of the health detection in time; therefore, the timeliness of the user health detection can be effectively improved, and the user experience is improved.
According to the health detection system provided by the embodiment of the application, the health detection application is started through the intelligent sound box, user data is collected, health related data are extracted from the user data, and a health detection request is sent to the server; the server side determines user health information at least according to the health related data carried by the request, and the intelligent sound box receives the health information returned by the server side; the processing mode combines the health detection with the sound box conversation application, and realizes that the intelligent sound box end carries out remote health detection on other people; therefore, the timeliness of the user health detection can be effectively improved, and the user experience is improved.
Drawings
FIG. 1 is a block diagram of an embodiment of a remote health detection system provided herein;
FIG. 2 is a schematic diagram illustrating an application scenario of an embodiment of a remote health detection system provided in the present application;
FIG. 3 is a schematic diagram of device interaction of an embodiment of a remote health detection system provided herein;
FIG. 4 is a schematic diagram of a specific device interaction of an embodiment of a remote health detection system provided by the present application;
FIG. 5 is a schematic diagram of an apparatus interaction of an embodiment of a health detection system provided herein;
FIG. 6 is a schematic diagram of device interaction of an embodiment of a health detection system provided by the present application.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. This application is capable of implementation in many different ways than those herein set forth and of similar import by those skilled in the art without departing from the spirit of this application and is therefore not limited to the specific implementations disclosed below.
In the application, a remote health detection system, a remote health detection method and a remote health detection device, a health detection system, a health detection method and a health detection device, a smart sound box and electronic equipment are provided. Each of the schemes is described in detail in the following examples.
First embodiment
Please refer to fig. 1, which is a block diagram of an embodiment of a remote health detection system according to the present application. The system comprises: the server side 1 and the intelligent sound box 2.
The server 1 may be a server deployed on a cloud server, or may be a server dedicated to implementing remote health detection, and may be deployed in a data center. The server may be a cluster server or a single server.
The smart speaker 2 may be a tool for a home consumer to surf the internet by voice, such as ordering songs, shopping on the internet, or knowing weather forecast, and may also control smart home devices, such as opening a curtain, setting a temperature of a refrigerator, raising a temperature of a water heater in advance, and the like.
Please refer to fig. 2, which is a schematic view illustrating a scenario of the remote health detection system according to the present application. Accessible network connection between server and intelligent audio amplifier A, intelligent audio amplifier B, like modes such as intelligent audio amplifier A and intelligent audio amplifier B accessible WIFI network, etc. The calling party can communicate in a voice mode or a video mode through the intelligent sound box A and the called party can communicate in a video mode through the intelligent sound box B. In the process of communication, a calling user can start remote health detection on a called user by clicking ' doing a health detection bar for the other party ' displayed on a screen of a sound box A '; correspondingly, the intelligent sound box A collects the multi-frame image data of the called user from the video stream according to the opening instruction, extracts the facial blood flow data of the called user from the image data, uploads the facial blood flow data to the server, performs health detection according to the facial blood flow data through the server, and the detection result can be displayed in the video call image in real time.
Please refer to fig. 3, which is a schematic diagram illustrating an apparatus interaction of an embodiment of the remote health detection system according to the present application. In the embodiment, the intelligent sound box collects called user data from a communication data stream between the intelligent sound box and other terminal equipment, extracts health related data from the called user data, and sends a health detection request aiming at a called user to a server; and the server side determines the health information of the called user at least according to the health related data carried by the detection request, and returns the health information to the intelligent sound box.
The other terminal devices include but are not limited to: smart speakers, smart phones, tablet computers, and the like. In this embodiment, the other terminal devices are smart speakers. For clarity, the calling user's smart speaker is referred to as a first smart speaker A, and the called user's smart speaker is referred to as a second smart speaker B.
In specific implementation, the first smart speaker a and the second smart speaker B communicate with each other through the communication application of the smart speakers, and before communication, a friend relationship between the two speakers can be established. Since the friend relationship between two speakers and the communication technology between intelligent speakers are established, which belong to the mature prior art, the details are not repeated here.
The health related data comprises user sign data from which the health condition of the user can be analyzed, such as facial blood flow data of the user and the like.
The call data stream can be a video call stream, namely, a video call mode is adopted between the devices; the call data stream may also be a voice call stream, that is, a voice call mode is adopted between the devices.
Please refer to fig. 4, which is a schematic diagram illustrating an apparatus interaction of an embodiment of the remote health detection system according to the present application. In one example, a video call mode is adopted between the devices; the first intelligent sound box A collects at least one frame of image data of a called user from a video call data stream, such as continuous 30 frames of image data; and determining facial blood flow data of the called user according to the at least one frame of image data as the health related data.
The first intelligent sound box A can collect N frames of continuous images by using the existing camera of the first intelligent sound box A, such as a CMOS/CCD camera, and extract facial light blood flow data; the server can perform analytical optical blood spectrum detection according to the detection data (facial optical blood flow data).
In a specific implementation, the facial blood flow data may be determined by: 1) extracting a face image of the called user from the image data through a face detection algorithm; 2) performing a face scan on the face image; 3) and extracting the facial blood flow data according to the face scanning result. In the present embodiment, a blood spectral optical imaging (TOI) technique is used to extract facial blood flow data, and since TOI belongs to a mature prior art, it is not described herein again.
In one example, the smart sound box is further configured to determine, according to the at least one frame of image data, expression data of the called user as first emotion data; the health detection request further comprises the first emotion data, so that the server side determines the health information of the called user at least according to the health related data and the first emotion data.
The first emotion data may be happy, sad, angry, etc. In specific implementation, the facial expression information of the user can be determined according to the facial image through a facial expression recognition technology. Because the facial expression recognition technology belongs to the mature prior art, the description is omitted here.
According to the system provided by the embodiment of the application, the expression data of the called user is determined through the intelligent sound box according to the at least one frame of image data; the health detection request also comprises the expression data, so that the server side determines the health information of the called user at least according to the health related data and the expression data; by the processing mode, different health information can be determined if the expression of the user is different for the same health related information, so that the health information of the user can be determined according to multi-modal data; therefore, the accuracy of the health detection can be effectively improved.
In this embodiment, the server is specifically configured to determine, at least according to the health-related data, characteristic data for determining a health condition; and determining the health information according to the characteristic data through a health detection model. The health detection model may be an artificial intelligence model, and the network structure thereof may include a common neural network structure such as DNN, CNN, RNN, and the like. Since the extraction of feature data and the health detection model belong to the mature prior art, they are not described herein again.
The health information, i.e. the detection result, includes but is not limited to: heartbeat, blood pressure, psychological stress, cardiovascular health, BMI, skin age, blood glucose, blood oxygen, and the like.
The system provided by the application utilizes the existing camera of the intelligent sound box and combines the optical spectrum health detection scheme to realize the real-time health detection of the remote user through the equipment interaction mode shown in figure 4.
In another example, voice communication is adopted between devices; the first intelligent sound box A collects at least one frame of voice data of a called user from a voice call data stream; extracting the health-related data from the at least one frame of speech data.
In one example, the smart sound box is further configured to determine emotion data of the called user as second emotion data according to the at least one frame of voice data; the health detection request further comprises the second emotion data, so that the server side determines the health information of the called user at least according to the health related data and the second emotion data.
The second mood data may be happy, feeble, angry, etc. In specific implementation, the emotion information of the user can be determined according to the voice data through a voice emotion recognition technology. Since the speech emotion recognition technology belongs to the mature prior art, it is not described here in detail.
In particular implementation, the characteristic data for determining the health condition may be determined according to the health-related data, the first emotion data and the second emotion data; by the processing mode, more accurate characteristic data can be extracted; therefore, the accuracy of the health information can be effectively improved.
According to the system provided by the embodiment of the application, the intelligent sound box determines the emotion data of the called user according to the at least one frame of voice data; the health detection request further comprises the emotion data, so that the server side determines health information of the called user at least according to the health related data and the emotion data; by the processing mode, different health information can be determined if the emotions of the users are different for the same health-related information, so that the health information of the users can be determined according to multi-modal data; therefore, the accuracy of the health detection can be effectively improved. In this embodiment, the first smart sound box a is specifically configured to execute the remote health detection processing on the called user if the remote health detection start condition is satisfied. The remote health detection turn-on condition includes, but is not limited to: the calling user selects an operation option for turning on the remote health detection, but other conditions are also possible.
In one example, the first smart speaker a may also be used to display an operation option for starting remote health detection, such as displaying "do a health detection bar for the other party" on the screen of the speaker a during the call in fig. 2, and the calling user may start remote health detection for the called user by clicking the option, that is: and judging that the remote health detection starting condition is satisfied.
In another example, the remote health detection turn-on condition is determined to be true if the call duration is greater than a first duration threshold. In specific implementation, if the call duration is greater than the first duration threshold and the called user is the designated remote health detection user, it may be determined that the remote health detection start condition is satisfied.
In another example, if the called user is the designated remote health detection user and the time length from the last health detection reaches the second time length threshold, the remote health detection starting condition is determined to be satisfied.
The designated remote health detection user may be an elderly person, a child, a customer, or the like. In this embodiment, the first smart sound box a is further configured to set the called user as a remote health detection user. In specific implementation, the called user may be set as a remote health detection user by at least one of the following ways: if the called user is a elder, setting the called user as a remote health detection user; if the called user is a descendant, setting the called user as a remote health detection user; if the called user is a friend, setting the called user as a remote health detection user; and if the called user is a client, setting the called user as a remote health detection user. The user type, such as elder, descendant, friend, client, etc., may be set in advance for the called user. By adopting the processing mode, the health detection data can be directly output in the video call, the health indexes of the crowds such as the old, children, customers and the like are output, and the nursing care and the remote monitoring detection are completed.
In an example, after the first smart sound box a receives the health detection result sent by the server, the health information of the called user may be displayed on the screen. In specific implementation, if the users communicate with each other in a video mode, the health information of the called user can be displayed in a video communication interface in real time, so that the two users can conveniently communicate with each other about the health information.
In another example, the first smart speaker a stores a result of multiple health detections of the called user, and may determine the health change information of the called user according to the multiple health information of the called user determined by the multiple health detections, so as to facilitate communication with the called user when subsequently communicating with the called user, or send the health change information of the called user to the called user, which may be a short message of a mobile phone, so as to be known by the called user.
It should be noted that, the system provided by this embodiment executes processing of extracting health-related data from called user data (such as a user face image) on the intelligent sound box side, so as to avoid uploading user information corresponding to the health-related data to the server, which may avoid leakage of personal privacy information of the user; therefore, the user experience can be effectively improved.
As can be seen from the above embodiments, the remote health detection system provided in the embodiments of the present application collects called user data from a call data stream with other terminal devices through the smart speaker, extracts health related data from the called user data, and sends a health detection request for the called user to the server; the server side determines the health information of the called user at least according to the health related data carried by the detection request, and the intelligent sound box receives the health information returned by the server side; the processing mode combines the health detection with the sound box conversation application, and realizes that the intelligent sound box end carries out remote health detection on other people; therefore, the timeliness of the user health detection can be effectively improved, the user experience is improved, and the utilization rate of the intelligent sound box is further improved. In addition, the cost of the intelligent sound box is much lower than that of other health detection instruments, so that the cost of health detection hardware can be effectively reduced.
Second embodiment
Corresponding to the remote health detection system, the application also provides a remote health detection method, and an execution main body of the method includes but is not limited to a smart sound box, and the method can also be other terminal equipment. Parts of this embodiment that are the same as the first embodiment are not described again, please refer to corresponding parts in the first embodiment.
In this embodiment, the method includes the steps of:
step 1: the first intelligent sound box collects called user data from a call data stream between the first intelligent sound box and the second terminal device;
step 2: extracting health related data from the called user data;
and step 3: and sending a health detection request aiming at the called user to the server so that the server determines the health information of the called user at least according to the health related data carried by the detection request.
In one example, step 1 may be implemented as follows: collecting at least one frame of image data of a called user from a video call data stream; step 2 can be realized by the following method: and determining facial blood flow data of the called user according to the at least one frame of image data as the health related data.
In one example, the facial blood flow data is determined using the following steps: extracting a face image of the called user from the image data through a face detection algorithm; performing a face scan on the face image; and extracting the facial blood flow data according to the face scanning result.
In one example, the method may further comprise the steps of: determining first emotion data of a called user according to the at least one frame of image data; the health detection request further comprises the first emotion data, so that the server side determines the health information of the called user at least according to the health related data and the first emotion data.
In another example, step 1 may be implemented as follows: collecting at least one frame of voice data of a called user from a voice call data stream; step 2 can be realized by the following method: extracting the health-related data from the at least one frame of speech data.
In one example, the method may further comprise the steps of: determining second emotion data of the called user according to the at least one frame of voice data; the health detection request further comprises the second emotion data, so that the server side determines the health information of the called user at least according to the health related data and the second emotion data.
In one example, the method may further comprise the steps of:
and 4, step 4: receiving the health information returned by the server;
and 5: and displaying the health information.
In one example, the call data flow includes: a video call data stream; step 5 can be implemented as follows: and displaying the health information in a video call interface.
In one example, the method may further comprise the steps of:
step 6: determining health change information of the called user according to the multiple health information of the called user determined by multiple health detections;
and 7: and sending the health change information to the second terminal equipment.
In one example, the method is performed if a remote health detection turn-on condition is established.
In one example, the method may further comprise the steps of: displaying an operation option for starting remote health detection; and if the operation option is selected, judging that the condition is satisfied.
In one example, whether the condition is satisfied is determined in one of the following ways: if the called user is a remote health detection user and the call duration is greater than a first duration threshold, judging that the condition is satisfied; if the called user is a remote health detection user and the time length from the last health detection is greater than a second time length threshold value, judging that the condition is satisfied; and if the call duration is greater than the first duration threshold, judging that the condition is satisfied.
In one example, the method may further comprise the steps of: and setting the called user as a remote health detection user.
In one example, the setting the called user as a remote health detection user may be performed in at least one of the following manners: if the called user is a elder, setting the called user as a remote health detection user; if the called user is a descendant, setting the called user as a remote health detection user; if the called user is a friend, setting the called user as a remote health detection user; and if the called user is a client, setting the called user as a remote health detection user.
In one example, the method may further comprise the steps of: setting the user type of the called user; the user types include, but are not limited to: elder, evening, friend, client.
In one example, the method may further comprise the steps of: the second terminal device includes: a second smart speaker; before collecting the data of the called user, the method can further comprise the following steps: a friend relationship is established between the first intelligent sound box and the second intelligent sound box; the first intelligent sound box and the second intelligent sound box are communicated through communication application.
As can be seen from the foregoing embodiments, in the remote health detection method provided in the embodiments of the present application, called user data is collected from a call data stream with a second terminal device through a first smart speaker; extracting health related data from the called user data; sending a health detection request aiming at a called user to a server so that the server at least determines the health information of the called user according to health related data carried by the detection request; the processing mode combines the health detection with the sound box conversation application, and realizes that the intelligent sound box end carries out remote health detection on other people; therefore, the timeliness of the user health detection can be effectively improved, the user experience is improved, and the utilization rate of the intelligent sound box is further improved. In addition, the cost of the intelligent sound box is much lower than that of other health detection instruments, so that the cost of health detection hardware can be effectively reduced.
Third embodiment
In the above embodiment, a remote health detection method is provided, and correspondingly, the present application also provides a remote health detection apparatus. The apparatus corresponds to an embodiment of the method described above.
Parts of this embodiment that are the same as the first embodiment are not described again, please refer to corresponding parts in the first embodiment. The application provides a remote health detection device includes:
the user data acquisition unit is used for acquiring called user data from a call data stream between the first intelligent sound box and the second terminal device;
the health data extraction unit is used for extracting health related data from the called user data;
the request sending unit is used for sending a health detection request aiming at the called user to the server side, so that the server side determines the health information of the called user at least according to the health related data carried by the detection request.
Fourth embodiment
The application also provides an intelligent sound box. Since the apparatus embodiments are substantially similar to the method embodiments, they are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for relevant points. The device embodiments described below are merely illustrative.
An intelligent audio amplifier of this embodiment, this intelligent audio amplifier includes: a processor and a memory; a memory for storing a program for implementing the remote health detection method, the device performing the following steps after being powered on and running the program of the method by the processor: the first intelligent sound box collects called user data from a call data stream between the first intelligent sound box and the second terminal device; extracting health related data from the called user data; and sending a health detection request aiming at the called user to the server so that the server determines the health information of the called user at least according to the health related data carried by the detection request.
Fifth embodiment
Corresponding to the remote health detection system, the application also provides a health detection method, and an execution subject of the method includes but is not limited to a server, and the method can be implemented by any device capable of implementing the method. Parts of this embodiment that are the same as the first embodiment are not described again, please refer to corresponding parts in the first embodiment.
In this embodiment, the method includes the steps of:
step 1: receiving a health detection request aiming at a target user and sent by an intelligent sound box; the target user can be a calling user or a called user, and health related data of the two users are included in the request.
Step 2: determining health information of the target user at least according to the health related data of the target user carried by the detection request; the health related data is extracted from target user data, and the target user data is acquired from a call data stream between the intelligent sound box and other terminal equipment;
and step 3: and returning the health information to the intelligent sound box.
In one example, step 2 may include the following sub-steps: 2.1 determining characteristic data for determining a health condition at least from the health-related data; 2.2 determining the health information according to the characteristic data through a health detection model.
In one example, the health-related data includes facial blood flow data of the target user, the facial blood flow data being determined from at least one frame of image data of the target user.
In one example, the target user comprises a called user, and the at least one frame of image data is collected from a video call data stream.
In one example, the detection request further carries first emotion data of the target user, the first emotion data being determined according to at least one frame of image data of the target user; and determining health information of the target user according to the health related data and the first emotion data.
In one example, the detection request further carries second emotion data of the target user, the second emotion data being determined according to at least one frame of voice data of the target user; and determining health information of the target user according to the health related data and the second emotion data.
As can be seen from the above embodiments, in the remote health detection method provided by the embodiments of the present application, a health detection request for a target user is received, where the health detection request is sent by a smart sound box; determining health information of the target user at least according to the health related data of the target user carried by the detection request; the health related data is extracted from target user data, and the target user data is acquired from a call data stream between the intelligent sound box and other terminal equipment; returning the health information to the intelligent sound box; the processing mode combines the health detection with the sound box conversation application, and realizes that the intelligent sound box end carries out remote health detection on other people; therefore, the timeliness of the user health detection can be effectively improved, the user experience is improved, and the utilization rate of the intelligent sound box is further improved. In addition, the cost of the intelligent sound box is much lower than that of other health detection instruments, so that the cost of health detection hardware can be effectively reduced.
Sixth embodiment
In the above embodiment, a health detection method is provided, and correspondingly, the present application also provides a health detection apparatus. The apparatus corresponds to an embodiment of the method described above.
Parts of this embodiment that are the same as the first embodiment are not described again, please refer to corresponding parts in the first embodiment. The present application provides a health detection device comprising:
the request receiving unit is used for receiving a health detection request aiming at a target user and sent by the intelligent sound box;
the health information determining unit is used for determining the health information of the target user at least according to the health related data of the target user carried by the detection request; the health related data is extracted from target user data, and the target user data is acquired from a call data stream between the intelligent sound box and other terminal equipment;
and the health information sending unit is used for sending the health information back to the intelligent sound box.
Seventh embodiment
The application also provides an electronic device embodiment. Since the apparatus embodiments are substantially similar to the method embodiments, they are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for relevant points. The device embodiments described below are merely illustrative.
An electronic device of the present embodiment includes: a processor and a memory; a memory for storing a program for implementing the health detection method, the device being powered on and the program for the method being executed by the processor to perform the steps of: receiving a health detection request aiming at a target user and sent by an intelligent sound box; determining health information of the target user at least according to the health related data of the target user carried by the detection request; the health related data is extracted from target user data, and the target user data is acquired from a call data stream between the intelligent sound box and other terminal equipment; and returning the health information to the intelligent sound box.
Eighth embodiment
In the above embodiments, a remote health detection system is provided, and correspondingly, the present application also provides a health detection system. The system corresponds to the embodiments of the system described above. Parts of this embodiment that are the same as the first embodiment are not described again, please refer to corresponding parts in the first embodiment.
As shown in fig. 1, the present application provides a health detection system comprising: server 1 and intelligent audio amplifier 2.
Please refer to fig. 5, which is a schematic device interaction diagram of an embodiment of the health detection system of the present application. After establishing communication connection with other terminal equipment, if a local health detection starting condition is met, acquiring calling party data, extracting health related data from the calling party data, and sending a health detection request aiming at a calling party to a server; receiving the health information of the calling user returned by the server; the server receives the detection request; and determining the health information of the calling user at least according to the health related data carried by the detection request, and returning the health information to the intelligent sound box.
The difference between the system provided by the present embodiment and the system of the first embodiment includes: the health detection objects are different, the embodiment aims at performing remote health detection on a called user, and the embodiment aims at performing local health detection on a calling user. The system that this embodiment provided utilizes first intelligent audio amplifier A's camera, combines the health detection of optical spectrum, realizes the local health detection function of audio amplifier A.
As shown in fig. 2, after the first smart speaker establishes a call connection with other terminal devices, an operation option "make a health detection bar for itself" for starting local health detection is displayed; and if the operation option is selected, judging that the condition is satisfied. In specific implementation, other starting conditions may also be used, for example, the time length from the last detection is greater than the time length threshold, and so on, which are not described herein again.
As can be seen from the above embodiments, in the health detection system provided in the embodiments of the present application, after establishing a call connection with other terminal devices through the smart speaker, if a health detection start condition is satisfied, the data of the calling party is collected, health-related data is extracted from the data of the calling party, and a health detection request for the calling party is sent to the server; the server side determines the health information of the calling user at least according to the health related data carried by the request, and the intelligent sound box receives the health information returned by the server side; the processing mode combines the health detection with the sound box conversation application, realizes the health detection of the intelligent sound box end to the owner, and uses the sound box conversation as the entrance of the health detection to remind the sound box owner of the health detection in time; therefore, the timeliness of the user health detection can be effectively improved, and the user experience is improved.
Ninth embodiment
Corresponding to the health detection system, the present application further provides a health detection method, where an execution subject of the method includes but is not limited to a smart speaker, and may also be other terminal devices, such as a smart phone, a tablet computer, and the like. Parts of this embodiment that are the same as the eighth embodiment will not be described again, please refer to corresponding parts in the eighth embodiment.
The health detection method provided by the application can comprise the following steps:
step 1: after the first intelligent sound box establishes call connection with other terminal equipment, if a local health detection starting condition is met, acquiring calling user data; the other terminal devices include, but are not limited to, a second smart speaker, a smart phone, a tablet computer, and the like.
Step 2: extracting health-related data from the caller data;
and step 3: and sending a health detection request aiming at the calling user to the server so that the server determines the health information of the calling user at least according to the health related data carried by the detection request.
In one example, the method may further comprise the steps of: after the first intelligent sound box is in conversation connection with other terminal equipment, displaying an operation option for starting local health detection; and if the operation option is selected, judging that the condition is satisfied.
Tenth embodiment
In the above embodiment, a health detection method is provided, and correspondingly, the present application also provides a health detection apparatus. The apparatus corresponds to an embodiment of the method described above. Parts of this embodiment that are the same as the first embodiment are not described again, please refer to corresponding parts in the first embodiment.
The present application provides a health detection device comprising:
the system comprises a user data acquisition unit, a first intelligent sound box and a second intelligent sound box, wherein the user data acquisition unit is used for acquiring calling user data after the first intelligent sound box establishes call connection with other terminal equipment and if a local health detection starting condition is met;
a health data extraction unit for extracting health related data from the calling subscriber data;
the request sending unit is used for sending a health detection request aiming at the calling user to the server so that the server can determine the health information of the calling user at least according to the health related data carried by the detection request.
Eleventh embodiment
The application also provides an intelligent sound box. Since the apparatus embodiments are substantially similar to the method embodiments, they are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for relevant points. The device embodiments described below are merely illustrative.
An intelligent audio amplifier of this embodiment, this intelligent audio amplifier includes: a processor and a memory; a memory for storing a program for implementing the health detection method, the device being powered on and the program for the method being executed by the processor to perform the steps of: after the first intelligent sound box establishes call connection with other terminal equipment, if a local health detection starting condition is met, acquiring calling user data; extracting health-related data from the caller data; and sending a health detection request aiming at the calling user to the server so that the server determines the health information of the calling user at least according to the health related data carried by the detection request.
Twelfth embodiment
In the above embodiments, a remote health detection system is provided, and correspondingly, the present application also provides a health detection system. The system corresponds to the embodiments of the system described above. Parts of this embodiment that are the same as the first embodiment are not described again, please refer to corresponding parts in the first embodiment.
As shown in fig. 1, the present application provides a health detection system comprising: server 1 and intelligent audio amplifier 2.
Please refer to fig. 6, which is a schematic device interaction diagram of an embodiment of the health detection system of the present application. The intelligent sound box starts a locally installed health detection application, collects user data, extracts health related data from the user data, and sends a health detection request to a server; and receiving the detection request; and determining user health information at least according to health related data carried by the detection request, and returning the health information to the intelligent sound box.
The difference between the system provided by the present embodiment and the system of the first embodiment includes: 1) the system provided by the embodiment utilizes the camera of the intelligent sound box and combines the health detection of optical spectrum to realize the local health detection function of the sound box; 2) the intelligent sound box of the embodiment does not need to communicate with other devices, and directly collects user data after the local health detection application is started, for example, collecting N frames of user image data through a camera, collecting user voice data for a period of time through a microphone, and the like.
As can be seen from the above embodiments, the health detection system provided in the embodiments of the present application starts a health detection application through an intelligent sound box, collects user data, extracts health-related data from the user data, and sends a health detection request to a server; the server side determines user health information at least according to the health related data carried by the request, and the intelligent sound box receives the health information returned by the server side; the processing mode combines the health detection with the sound box conversation application, and realizes that the intelligent sound box end carries out remote health detection on other people; therefore, the timeliness of the user health detection can be effectively improved, and the user experience is improved.
Thirteenth embodiment
Corresponding to the health detection system, the application also provides a health detection method, and an execution subject of the method includes but is not limited to a smart sound box, and the method can also be other terminal equipment. Parts of this embodiment that are the same as the eighth embodiment will not be described again, please refer to corresponding parts in the eighth embodiment.
The remote health detection method provided by the application can comprise the following steps:
step 1: after the health detection application is started, collecting user data;
step 2: extracting health-related data from the user data;
and step 3: and sending a health detection request to the server so that the server determines the user health information at least according to the health related data carried by the detection request.
Fourteenth embodiment
In the above embodiment, a health detection method is provided, and correspondingly, the present application also provides a health detection apparatus. The apparatus corresponds to an embodiment of the method described above. Parts of this embodiment that are the same as the first embodiment are not described again, please refer to corresponding parts in the first embodiment.
The present application provides a health detection device comprising:
the user data acquisition unit is used for acquiring user data after the health detection application is started;
a health data extraction unit for extracting health related data from the user data;
and the request sending unit is used for sending a health detection request to the server so that the server determines the user health information at least according to the health related data carried by the detection request.
Fifteenth embodiment
The application also provides an electronic device. Since the apparatus embodiments are substantially similar to the method embodiments, they are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for relevant points. The device embodiments described below are merely illustrative.
An electronic device of the present embodiment includes: a processor and a memory; a memory for storing a program for implementing the health detection method, the device being powered on and the program for the method being executed by the processor to perform the steps of: after the health detection application is started, collecting user data; extracting health-related data from the user data; and sending a health detection request to the server so that the server determines the user health information at least according to the health related data carried by the detection request.
Sixteenth embodiment
The application also provides an electronic device. Since the apparatus embodiments are substantially similar to the method embodiments, they are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for relevant points. The device embodiments described below are merely illustrative.
An electronic device of the present embodiment includes: a processor and a memory; a memory for storing a program for implementing the health detection method, the device being powered on and the program for the method being executed by the processor to perform the steps of: the equipment collects called user data from a call data stream with other equipment; extracting health related data from the called user data; and sending a health detection request aiming at the called user to the server so that the server determines the health information of the called user at least according to the health related data carried by the detection request.
The apparatus comprises: smart phones, tablet computers, personal computers.
Seventeenth embodiment
The application also provides an electronic device. Since the apparatus embodiments are substantially similar to the method embodiments, they are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for relevant points. The device embodiments described below are merely illustrative.
An electronic device of the present embodiment includes: a processor and a memory; a memory for storing a program for implementing the health detection method, the device being powered on and the program for the method being executed by the processor to perform the steps of: after the equipment establishes call connection with other equipment, if a health detection starting condition is met, acquiring calling user data; extracting health-related data from the caller data; and sending a health detection request aiming at the calling user to the server so that the server determines the health information of the calling user at least according to the health related data carried by the detection request.
The apparatus comprises: smart phones, tablet computers, personal computers.
Although the present application has been described with reference to the preferred embodiments, it is not intended to limit the present application, and those skilled in the art can make variations and modifications without departing from the spirit and scope of the present application, therefore, the scope of the present application should be determined by the claims that follow.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
1. Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include non-transitory computer readable media (transient media), such as modulated data signals and carrier waves.
2. As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Claims (42)

1. A remote health detection system, comprising:
the intelligent sound box is used for collecting called user data from a call data stream between the intelligent sound box and other terminal equipment, extracting health related data from the called user data and sending a health detection request aiming at a called user to a server; receiving the health information of the called user returned by the server;
the server is used for receiving the detection request; and determining the health information of the called user at least according to the health related data carried by the detection request, and returning the health information to the intelligent sound box.
2. A remote health detection method, comprising:
the first intelligent sound box collects called user data from a call data stream between the first intelligent sound box and the second terminal device;
extracting health related data from the called user data;
and sending a health detection request aiming at the called user to the server so that the server determines the health information of the called user at least according to the health related data carried by the detection request.
3. The method of claim 2,
the first intelligent sound box collects called user data from a call data stream between the first intelligent sound box and the second terminal device, and the method comprises the following steps:
collecting at least one frame of image data of a called user from a video call data stream;
the extracting health related data from the called user data comprises:
and determining facial blood flow data of the called user according to the at least one frame of image data as the health related data.
4. The method of claim 3, wherein the facial blood flow data is determined using the steps of:
extracting a face image of the called user from the image data through a face detection algorithm;
performing a face scan on the face image;
and extracting the facial blood flow data according to the face scanning result.
5. The method of claim 3, further comprising:
determining first emotion data of a called user according to the image data;
the health detection request further comprises the first emotion data, so that the server side determines the health information of the called user at least according to the health related data and the first emotion data.
6. The method of claim 2,
the first intelligent sound box collects called user data from a call data stream between the first intelligent sound box and the second terminal device, and the method comprises the following steps:
collecting at least one frame of voice data of a called user from a voice call data stream;
the extracting health related data from the called user data comprises:
extracting the health-related data from the at least one frame of speech data.
7. The method of claim 6, further comprising:
determining second emotion data of the called user according to the at least one frame of voice data;
the health detection request further comprises the second emotion data, so that the server side determines the health information of the called user at least according to the health related data and the second emotion data.
8. The method of claim 2, further comprising:
receiving the health information returned by the server;
and displaying the health information.
9. The method of claim 8,
the call data flow comprises: a video call data stream;
the displaying the health information comprises:
and displaying the health information in a video call interface.
10. The method of claim 2, further comprising:
determining health change information of the called user according to the multiple health information of the called user determined by multiple health detections;
and sending the health change information to the second terminal equipment.
11. The method of claim 2,
and if the remote health detection starting condition is satisfied, executing the method.
12. The method of claim 11, further comprising:
displaying an operation option for starting remote health detection;
and if the operation option is selected, judging that the condition is satisfied.
13. The method of claim 11, wherein determining whether the condition is true is performed by one of:
if the called user is a remote health detection user and the call duration is greater than a first duration threshold, judging that the condition is satisfied;
if the called user is a remote health detection user and the time length from the last health detection is greater than a second time length threshold value, judging that the condition is satisfied;
and if the call duration is greater than the first duration threshold, judging that the condition is satisfied.
14. The method of claim 13, further comprising:
and setting the called user as a remote health detection user.
15. The method of claim 14, wherein the setting the called user as a remote health check user is performed by at least one of:
if the called user is a elder, setting the called user as a remote health detection user;
if the called user is a descendant, setting the called user as a remote health detection user;
if the called user is a friend, setting the called user as a remote health detection user;
and if the called user is a client, setting the called user as a remote health detection user.
16. The method of claim 15, further comprising:
setting the user type of the called user; the user types include: elder, evening, friend, client.
17. The method of claim 2, further comprising:
the second terminal device includes: a second smart speaker;
before collecting the called user data, the method further comprises:
a friend relationship is established between the first intelligent sound box and the second intelligent sound box;
the first intelligent sound box and the second intelligent sound box are communicated through communication application.
18. A health detection method, comprising:
receiving a health detection request aiming at a target user and sent by an intelligent sound box;
determining health information of the target user at least according to the health related data of the target user carried by the detection request; the health related data is extracted from target user data, and the target user data is acquired from a call data stream between the intelligent sound box and other terminal equipment;
and returning the health information to the intelligent sound box.
19. The method of claim 18,
determining characteristic data for determining a health condition based at least on the health-related data;
and determining the health information according to the characteristic data through a health detection model.
20. The method of claim 18,
the health-related data comprises facial blood flow data of the target user, the facial blood flow data being determined from at least one frame of image data of the target user.
21. The method of claim 20,
the target user comprises a called user, and the at least one frame of image data is acquired from a video call data stream.
22. The method of claim 18,
the detection request also carries first emotion data of a target user, and the first emotion data is determined according to image data of the target user;
and determining health information of the target user according to the health related data and the first emotion data.
23. The method of claim 18,
the detection request also carries second emotion data of the target user, and the second emotion data is determined according to at least one frame of voice data of the target user;
and determining health information of the target user according to the health related data and the second emotion data.
24. The method of claim 18,
the target user includes: a calling subscriber and/or a called subscriber.
25. A health detection system, comprising:
the intelligent sound box is used for acquiring calling user data, extracting health related data from the calling user data and sending a health detection request aiming at a calling user to the server side if a local health detection starting condition is met after call connection is established with other terminal equipment; receiving the health information of the calling user returned by the server;
the server is used for receiving the detection request; and determining the health information of the calling user at least according to the health related data carried by the detection request, and returning the health information to the intelligent sound box.
26. A health detection method, comprising:
after the first intelligent sound box establishes call connection with other terminal equipment, if a local health detection starting condition is met, acquiring calling user data;
extracting health-related data from the caller data;
and sending a health detection request aiming at the calling user to the server so that the server determines the health information of the calling user at least according to the health related data carried by the detection request.
27. The method of claim 26, further comprising:
after the first intelligent sound box is in conversation connection with other terminal equipment, displaying an operation option for starting local health detection; and if the operation option is selected, judging that the condition is satisfied.
28. The method of claim 26,
the other terminal equipment comprises a second intelligent sound box.
29. A health detection system, comprising:
the intelligent sound box is used for starting a health detection application, acquiring user data, extracting health related data from the user data and sending a health detection request to the server; receiving user health information returned by the server;
the server is used for receiving the detection request; and determining user health information at least according to health related data carried by the detection request, and returning the health information to the intelligent sound box.
30. A health detection method, comprising:
after the health detection application is started, collecting user data;
extracting health-related data from the user data;
and sending a health detection request to the server so that the server determines the user health information at least according to the health related data carried by the detection request.
31. A remote health detection device, comprising:
the user data acquisition unit is used for acquiring called user data from a call data stream between the first intelligent sound box and the second terminal device;
the health data extraction unit is used for extracting health related data from the called user data;
the request sending unit is used for sending a health detection request aiming at the called user to the server side, so that the server side determines the health information of the called user at least according to the health related data carried by the detection request.
32. An intelligent sound box, comprising:
a processor; and
a memory for storing a program for implementing the remote health detection method, the device performing the following steps after being powered on and running the program of the method by the processor: the first intelligent sound box collects called user data from a call data stream between the first intelligent sound box and the second terminal device; extracting health related data from the called user data; and sending a health detection request aiming at the called user to the server so that the server determines the health information of the called user at least according to the health related data carried by the detection request.
33. A health detection device, comprising:
the request receiving unit is used for receiving a health detection request aiming at a target user and sent by the intelligent sound box;
the health information determining unit is used for determining the health information of the target user at least according to the health related data of the target user carried by the detection request; the health related data is extracted from target user data, and the target user data is acquired from a call data stream between the intelligent sound box and other terminal equipment;
and the health information sending unit is used for sending the health information back to the intelligent sound box.
34. An electronic device, comprising:
a processor; and
a memory for storing a program for implementing the health detection method, the device being powered on and the program for the method being executed by the processor to perform the steps of: receiving a health detection request aiming at a target user and sent by an intelligent sound box; determining health information of the target user at least according to the health related data of the target user carried by the detection request; the health related data is extracted from target user data, and the target user data is acquired from a call data stream between the intelligent sound box and other terminal equipment; and returning the health information to the intelligent sound box.
35. A health detection device, comprising:
the system comprises a user data acquisition unit, a first intelligent sound box and a second intelligent sound box, wherein the user data acquisition unit is used for acquiring calling user data after the first intelligent sound box establishes call connection with other terminal equipment and if a local health detection starting condition is met;
a health data extraction unit for extracting health related data from the calling subscriber data;
the request sending unit is used for sending a health detection request aiming at the calling user to the server so that the server can determine the health information of the calling user at least according to the health related data carried by the detection request.
36. An intelligent sound box, comprising:
a processor; and
a memory for storing a program for implementing the health detection method, the device being powered on and the program for the method being executed by the processor to perform the steps of: after the first intelligent sound box establishes call connection with other terminal equipment, if a local health detection starting condition is met, acquiring calling user data; extracting health-related data from the caller data; and sending a health detection request aiming at the calling user to the server so that the server determines the health information of the calling user at least according to the health related data carried by the detection request.
37. A health detection device, comprising:
the user data acquisition unit is used for acquiring user data after the health detection application is started;
a health data extraction unit for extracting health related data from the user data;
and the request sending unit is used for sending a health detection request to the server so that the server determines the user health information at least according to the health related data carried by the detection request.
38. An electronic device, comprising:
a processor; and
a memory for storing a program for implementing the health detection method, the device being powered on and the program for the method being executed by the processor to perform the steps of: after the health detection application is started, collecting user data; extracting health-related data from the user data; and sending a health detection request to the server so that the server determines the user health information at least according to the health related data carried by the detection request.
39. An electronic device, comprising:
a processor; and
a memory for storing a program for implementing the remote health detection method, the device performing the following steps after being powered on and running the program of the method by the processor: the equipment collects called user data from a call data stream with other equipment; extracting health related data from the called user data; and sending a health detection request aiming at the called user to the server so that the server determines the health information of the called user at least according to the health related data carried by the detection request.
40. The apparatus of claim 39,
the apparatus comprises: smart phones, tablet computers, personal computers.
41. An electronic device, comprising:
a processor; and
a memory for storing a program for implementing the health detection method, the device being powered on and the program for the method being executed by the processor to perform the steps of: after the equipment establishes call connection with other equipment, if a health detection starting condition is met, acquiring calling user data; extracting health-related data from the caller data; and sending a health detection request aiming at the calling user to the server so that the server determines the health information of the calling user at least according to the health related data carried by the detection request.
42. The apparatus of claim 41,
the apparatus comprises: smart phones, tablet computers, personal computers.
CN202010126085.3A 2020-02-27 2020-02-27 Remote health detection system, method, device and equipment Active CN113316041B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010126085.3A CN113316041B (en) 2020-02-27 2020-02-27 Remote health detection system, method, device and equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010126085.3A CN113316041B (en) 2020-02-27 2020-02-27 Remote health detection system, method, device and equipment

Publications (2)

Publication Number Publication Date
CN113316041A true CN113316041A (en) 2021-08-27
CN113316041B CN113316041B (en) 2023-08-01

Family

ID=77370456

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010126085.3A Active CN113316041B (en) 2020-02-27 2020-02-27 Remote health detection system, method, device and equipment

Country Status (1)

Country Link
CN (1) CN113316041B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170347899A1 (en) * 2016-06-03 2017-12-07 FOURTH FRONTIER TECHNOLOGIES, Pvt. Ltd. Method and system for continuous monitoring of cardiovascular health
CN108574515A (en) * 2017-03-07 2018-09-25 中移（杭州）信息技术有限公司 A kind of data sharing method based on intelligent sound box equipment, device and system
CN108833721A (en) * 2018-05-08 2018-11-16 广东小天才科技有限公司 Emotion analysis method based on call, user terminal and system
CN108968920A (en) * 2018-07-12 2018-12-11 维沃移动通信有限公司 A kind of data detection method and electronic equipment
CN110047588A (en) * 2019-03-18 2019-07-23 平安科技（深圳）有限公司 Method of calling, device, computer equipment and storage medium based on micro- expression
CN110444229A (en) * 2019-06-17 2019-11-12 深圳壹账通智能科技有限公司 Communication service method, device, computer equipment and storage medium based on speech recognition

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170347899A1 (en) * 2016-06-03 2017-12-07 FOURTH FRONTIER TECHNOLOGIES, Pvt. Ltd. Method and system for continuous monitoring of cardiovascular health
CN108574515A (en) * 2017-03-07 2018-09-25 中移（杭州）信息技术有限公司 A kind of data sharing method based on intelligent sound box equipment, device and system
CN108833721A (en) * 2018-05-08 2018-11-16 广东小天才科技有限公司 Emotion analysis method based on call, user terminal and system
CN108968920A (en) * 2018-07-12 2018-12-11 维沃移动通信有限公司 A kind of data detection method and electronic equipment
CN110047588A (en) * 2019-03-18 2019-07-23 平安科技（深圳）有限公司 Method of calling, device, computer equipment and storage medium based on micro- expression
CN110444229A (en) * 2019-06-17 2019-11-12 深圳壹账通智能科技有限公司 Communication service method, device, computer equipment and storage medium based on speech recognition

Also Published As

Publication number Publication date
CN113316041B (en) 2023-08-01

Similar Documents

Publication Publication Date Title
CN109446876B (en) Sign language information processing method and device, electronic equipment and readable storage medium
KR101533065B1 (en) Method and apparatus for providing animation effect on video telephony call
CN105654039B (en) The method and apparatus of image procossing
CN112860877B (en) Customer service operation processing method and device, electronic equipment and storage medium
RU2500081C2 (en) Information processing device, information processing method and recording medium on which computer programme is stored
CN110377761A (en) A kind of method and device enhancing video tastes
CN107871494B (en) Voice synthesis method and device and electronic equipment
CN106649290A (en) Speech translation method and system
CN111967770A (en) Questionnaire data processing method and device based on big data and storage medium
CN106911706B (en) Call background adding method and device
US20210020200A1 (en) Method and apparatus for obtaining audio-visual information, device, and storage medium
KR20130096983A (en) Method and apparatus for processing video information including face
CN112184540A (en) Image processing method, image processing device, electronic equipment and storage medium
CN113345461A (en) Voice processing method and device for voice processing
CN113284500A (en) Audio processing method and device, electronic equipment and storage medium
CN112818841A (en) Method and related device for recognizing user emotion
CN111985252A (en) Dialogue translation method and device, storage medium and electronic equipment
CN113316041B (en) Remote health detection system, method, device and equipment
CN110019965B (en) Method and device for recommending expression image, electronic equipment and storage medium
JP7206741B2 (en) HEALTH CONDITION DETERMINATION SYSTEM, HEALTH CONDITION DETERMINATION DEVICE, SERVER, HEALTH CONDITION DETERMINATION METHOD, AND PROGRAM
CN108345886A (en) A kind of video flowing text recognition method and device
CN110196900A (en) Exchange method and device for terminal
CN114758672A (en) Audio generation method and device and electronic equipment
CN114549327A (en) Video super-resolution method, device, electronic equipment and storage medium
CN114189719A (en) Video information extraction method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40058047

Country of ref document: HK

GR01 Patent grant
GR01 Patent grant