WO2022036624A1 - Monitoring method and apparatus, electronic device, and storage medium - Google Patents

Monitoring method and apparatus, electronic device, and storage medium Download PDF

Info

Publication number
WO2022036624A1
WO2022036624A1 PCT/CN2020/110223 CN2020110223W WO2022036624A1 WO 2022036624 A1 WO2022036624 A1 WO 2022036624A1 CN 2020110223 W CN2020110223 W CN 2020110223W WO 2022036624 A1 WO2022036624 A1 WO 2022036624A1
Authority
WO
WIPO (PCT)
Prior art keywords
monitoring
data
care
preset
evaluation model
Prior art date
Application number
PCT/CN2020/110223
Other languages
French (fr)
Chinese (zh)
Inventor
关健强
Original Assignee
关健强
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 关健强 filed Critical 关健强
Priority to PCT/CN2020/110223 priority Critical patent/WO2022036624A1/en
Publication of WO2022036624A1 publication Critical patent/WO2022036624A1/en

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons

Definitions

  • the present application relates to the field of video surveillance, and in particular, to a monitoring method, apparatus, electronic device, and storage medium.
  • a person under care commits abusive behavior it cannot be detected and stopped in time, and evidence may also be removed artificially, resulting in frequent abuse.
  • the present application provides a monitoring method, device, electronic device, and storage medium to solve the technical problem that automatic monitoring of nursing behavior cannot be realized in the prior art.
  • the present application provides a monitoring method, comprising:
  • monitoring data collected by an intelligent monitoring device includes behavior data and physiological data of an object to be monitored, and the object to be monitored includes: a nursing object and a nursing object;
  • a monitoring instruction is generated according to the state information, and the monitoring instruction is used to send prompt information to the care object and/or the supervision object, and record the behavior of the care object and/or the supervision object.
  • the monitoring data includes first behavior data of the monitored object, and correspondingly, the state information of the to-be-monitored object is determined according to the monitoring data and a preset monitoring evaluation model, include:
  • the state information is the first abnormal state
  • the generating a monitoring instruction according to the state information includes:
  • the method further includes:
  • the first position monitoring data is the position monitoring of the guarded object data
  • the safety activity area includes the video surveillance area and the non-video surveillance area
  • the state information is determined to be a second abnormal state
  • the monitoring instruction is used to generate second prompt information to prompt the care object
  • the state information is determined as a third abnormality state, the monitoring instruction is used to generate third prompt information for prompting the care object.
  • the monitoring data includes first physiological data of the monitored object, and the first physiological data includes first physiological characteristic data collected by a first wearable device and information in the safe activity zone.
  • the determining the state information of the object to be monitored according to the monitoring data and the preset monitoring evaluation model further includes:
  • the object under care If it is determined according to the first physiological feature data and the preset monitoring and evaluation model that the object under care meets a first preset pending abnormal condition, then the object is determined according to the environmental feature data and the preset monitoring and evaluation model. The person under care is in the fourth abnormal state;
  • the generating a monitoring instruction according to the state information includes:
  • Fourth prompt information for prompting the care object and/or the supervision object is generated according to the fourth abnormal state.
  • the monitoring data further includes second physiological data of the care object, and the second physiological data includes second physiological characteristic data collected by the second wearable device and environment collected by the infrared detection device in the safe activity area. characteristic data;
  • the state information of the object to be monitored is determined according to the monitoring data and the preset monitoring evaluation model, further comprising:
  • the nursing object is determined according to the environmental feature data and the preset monitoring evaluation model The subject is in the fifth abnormal state;
  • the generating a monitoring instruction according to the state information includes:
  • the monitoring data includes the second behavior data of the nursing object, and correspondingly, in the determining according to the environmental characteristic data and the preset monitoring evaluation model that the nursing object is in After the fourth abnormal state, it also includes:
  • the preset distance use the preset monitoring evaluation model and the second behavior data to determine the behavior characteristics of the care object;
  • the duration is greater than a preset time threshold, it is determined that the subject under care is in a state of being abused.
  • Eighth prompt information is sent to the supervision object, where the eighth prompt information is used to indicate that the care object has "neglected” abusive behavior to the care object.
  • the second behavior data includes: action features, facial expression features, and voice features
  • the determining that the object under care is in a state of being abused includes:
  • the sixth prompt is sent to the supervision object information
  • the seventh prompt information is sent to the supervision object.
  • the present application provides a monitoring device, comprising:
  • an acquisition module configured to acquire monitoring data collected by the intelligent monitoring device, the monitoring data includes behavioral data and physiological data of an object to be monitored, and the object to be monitored includes: a nursing object and a nursing object;
  • a processing module configured to determine the state information of the object to be monitored according to the monitoring data and a preset monitoring evaluation model
  • the processing module is further configured to generate a monitoring instruction according to the state information, where the monitoring instruction is used to send prompt information to the care object and/or the supervision object.
  • the monitoring data includes the first behavior data of the guarded object
  • the processing module is configured to determine the to-be-monitored according to the monitoring data and a preset monitoring evaluation model
  • the state information of the object including:
  • the processing module is configured to determine, according to the first video surveillance data in the first behavior data and the preset surveillance evaluation model, that the object under care is not in the video surveillance area, and the first video surveillance data is the The video surveillance data of the object under care, the state information is the first abnormal state;
  • the processing module is further configured to generate a monitoring instruction according to the status information, including:
  • the processing module is further configured to generate first prompt information for prompting the care object according to the first abnormal state.
  • the processing module is configured to determine, according to the first video surveillance data in the first behavior data and the preset surveillance evaluation model, that the guarded object is not behind the video surveillance area ,Also includes:
  • the processing module is further configured to: if it is determined according to the first position monitoring data in the first behavior data and the preset monitoring evaluation model that the guarded object leaves the safe activity area, the first position monitoring data is: The position monitoring data of the guarded object, the safe activity area includes the video monitoring area and the non-video monitoring area, then the state information is determined to be the second abnormal state, and the monitoring instruction is used to generate a prompt that the The second prompt information of the care object;
  • the processing module is further configured to: if it is determined according to the first position monitoring data in the first behavior data and the preset monitoring evaluation model that the object under care has not left the safe activity area, then The state information is determined to be a third abnormal state, and the monitoring instruction is used to generate third prompt information for prompting the care object.
  • the monitoring data includes first physiological data of the monitored object, and the first physiological data includes first physiological characteristic data collected by a first wearable device and information in the safe activity zone.
  • the processing module is further configured to determine the status information of the object to be monitored according to the monitoring data and a preset monitoring evaluation model, further comprising:
  • the processing module is further configured to, if it is determined according to the first physiological feature data and the preset monitoring and evaluation model that the object under care meets a first preset pending abnormal condition, then according to the environmental feature data and the The preset monitoring and evaluation model determines that the object under care is in the fourth abnormal state;
  • the processing module is further configured to generate a monitoring instruction according to the state information, including:
  • the processing module is further configured to generate fourth prompt information for prompting the care object and/or the supervision object according to the fourth abnormal state.
  • the monitoring data further includes second physiological data of the care object, and the second physiological data includes second physiological characteristic data collected by the second wearable device and environment collected by the infrared detection device in the safe activity area. characteristic data;
  • the processing module is further configured to determine the status information of the object to be monitored according to the monitoring data and a preset monitoring evaluation model, further comprising:
  • the processing module is further configured to, if it is determined according to the second physiological feature data and the preset monitoring and evaluation model that the care object meets a second preset pending abnormal condition, then according to the environmental feature data and the preset monitoring and evaluation model.
  • the monitoring evaluation model determines that the care object is in the fifth abnormal state
  • the processing module is further configured to generate a monitoring instruction according to the state information, including:
  • the processing module is further configured to generate fifth prompt information for prompting the supervised object according to the fifth abnormal state.
  • the monitoring data includes second behavior data of the care object, and correspondingly, in the processing module, it is further configured to determine according to the environmental feature data and the preset monitoring evaluation model After the object under care is in the fourth abnormal state, it also includes:
  • the processing module is further configured to determine the distance between the object of care and the object of care according to the first behavior data, the second behavior data and the preset monitoring and evaluation model;
  • the processing module is further configured to, if the distance is less than the preset distance, use the preset monitoring evaluation model and the second behavior data to determine the behavioral characteristics of the care object;
  • the processing module is further configured to monitor the duration that the object under care is in the fourth abnormal state
  • the processing module is further configured to determine that the object under care is in a state of being abused if the duration is greater than a preset time threshold.
  • the second behavior data includes: action features, facial expression features, and voice features
  • the processing module is further configured to determine that the object under care is in a state of being abused, including:
  • the processing module is further configured to judge whether the object of care has performed the abuse on the object of care according to the action feature and the preset monitoring and evaluation model, and if the judgment result is yes, then report to the object of care.
  • the supervision object sends the sixth prompt information;
  • the processing module is further configured to, if the judgment result is no, according to the facial expression feature and/or the sound feature and the preset monitoring evaluation model, to judge whether the object of care has performed any action on the object under care. If the judgment result is yes, send the seventh prompt message to the supervision object;
  • the processing module is further configured to send the seventh prompt information to the supervision object when the duration is greater than the preset time threshold if the determination result is no.
  • the application provides an electronic device, comprising:
  • the processor is configured to call and execute the program instructions in the memory, and execute any one of the possible monitoring methods provided in the first aspect.
  • the present application provides a storage medium, where a computer program is stored in the readable storage medium, and the computer program is used to execute any one of the possible monitoring methods provided in the first aspect.
  • the monitoring method, device, electronic device and storage medium provided by the present application obtain the monitoring data collected by the intelligent monitoring device, determine the status information of the object to be monitored according to the monitoring data and the preset monitoring evaluation model, and then generate the status information according to the status information.
  • Monitoring instructions It realizes the automatic monitoring and supervision of the care objects and the care objects in the care activities, and timely discovers the abnormal behavior and physiological state of the care objects, so as to notify the care objects to deal with them in time, and when the care objects' physiology or behavior is abnormal, it can Notify supervisory objects in a timely manner. It can improve the timely and effective care of the care recipients, and early detection of abnormal physiological problems such as illnesses of the care recipients. It can also timely evaluate and discover whether the care objects are in place, and whether the care objects have been abused. Technical effects such as behavior.
  • FIGS. 1a-1f are schematic diagrams of monitoring scenarios and monitoring equipment provided by embodiments of the present application.
  • FIG. 2 is a schematic flowchart of a monitoring method provided by the first embodiment of the present application.
  • FIG. 3 is a schematic flowchart of a monitoring method provided by the second embodiment of the present application.
  • FIG. 4 is a schematic flowchart of a monitoring method provided by a third embodiment of the present application.
  • FIG. 5 is a schematic flowchart of a monitoring method provided by a fourth embodiment of the present application.
  • FIG. 6 is a schematic flowchart of a monitoring method provided by a fifth embodiment of the present application.
  • FIG. 7 is a schematic structural diagram of a monitoring device according to an embodiment of the present application.
  • FIG. 8 is a schematic structural diagram of an electronic device provided by the present application.
  • the present application provides a monitoring method.
  • the trained preset monitoring and evaluation model is used to synthesize physiological and behavioral state information.
  • the data of two or more behaviors can realize the precise and precise monitoring of infants, the elderly, young students, and pets, improve the quality of care of the care recipients, and achieve the technical effect of timely detection and prevention of abusive behaviors of the care recipients. .
  • FIG. 1a-1f are schematic diagrams of monitoring scenarios and monitoring devices provided by embodiments of the present application.
  • Figure 1a is a schematic diagram of the layout of monitoring equipment in the house, that is, the safe activity area.
  • a plurality of fixed monitoring equipment 11 are arranged in the house, and each monitoring equipment can monitor the monitoring area 111 in real time.
  • the monitoring equipment 11 may include: cameras, infrared imagers, thermal sensors, sound sensors, temperature sensors, radars, etc.
  • the monitoring area covered by the cameras forms a video monitoring area, and the video monitoring area may cover the entire security activity area, or may be smaller than the security activity area.
  • non-video surveillance areas Infrared imagers and thermal sensors can be arranged. , temperature sensor, sound sensor, etc., when the care object enters the non-video surveillance area, it can still be monitored by the monitoring equipment.
  • FIG. 1b is a schematic diagram of a baby wearable monitoring device.
  • the wearable monitoring device 121 may include an abdominal physiological collection belt device and a leg physiological collection ring device.
  • the wearable monitoring device 121 can read the baby's physiological data and behavioral data, including: heart rate, blood oxygen content, blood pressure, respiratory rate, motion sensing data, body temperature detection data, etc., and the wearable monitoring device 121 can have a wireless communication function , the collected data can be sent to the monitoring center server.
  • the wearable monitoring device 121 may be configured to be waterproof.
  • the wearable monitoring device 121 can also collect the sound of the surrounding environment, including the sound of the baby and the voice of the caregiver.
  • the wearable monitoring device 121 also has a power indicator light to remind the user to charge or replace the battery in time.
  • FIG. 1c is a schematic diagram of a wearable monitoring device for infants or young learners.
  • the wearable monitoring device 122 may include a wristband and a foot ring, and the functions of the wristband and the foot ring are similar to those of the wearable monitoring device 121 , and details are not described herein again.
  • FIG. 1d is a schematic diagram of a wearable monitoring device for animals.
  • the wearable monitoring device 123 may include a collar, and the collar may collect the physiological data and behavioral data of the animal.
  • the wearable monitoring device 123 may also include: chest, abdomen and leg wearable devices.
  • wearable devices in the shape of "bracelets” or “watches” can be worn on horses on the chest, abdomen and legs, respectively, to detect the horse's daily activities and infection.
  • FIG. 1e is a schematic diagram of a wearable monitoring device for a caregiver, that is, a care object.
  • the nursing watch 13 may include the following functions, prompting functions: displaying prompting information, issuing prompting sounds, issuing warning vibrations, etc., including prompting the completion status of nursing tasks and emergency nursing needs according to time; Physiological state data, location information, etc. of the nursing object; monitoring function of the nursing object's own state: real-time monitoring of the nursing object's heart rate, blood pressure, blood oxygen, respiratory rate, movement, exercise status, etc.; wireless communication function: used to communicate with the monitoring center server Data interaction, and calls with supervisory objects.
  • Fig. 1f is a vital sign sensing pad 14, which is used to obtain the vital signs of the person under care or the care object, such as heart rate, respiratory rate, temperature change, body movement and posture change, etc. From the vital sign data, the person under care can be judged Or the physical activity of the care subject, such as sleep state.
  • the monitoring system may further include a GPS or Beidou positioning device and an indoor positioning radar, which are used to detect the position of the guarded object or the guarded object.
  • FIG. 2 is a schematic flowchart of the monitoring method provided by the first embodiment of the present application. As shown in Figure 2, the method includes:
  • the monitoring data includes behavior data and physiological data of the object to be monitored, and the object to be monitored includes: a nursing object and a nursing object.
  • the intelligent monitoring equipment includes fixed monitoring equipment, wearable monitoring equipment, global location positioning equipment such as GPS or Beidou navigation system, etc. shown in Figures 1a-1f. , and upload the collected monitoring data to the monitoring center server.
  • S202 Determine the state information of the object to be monitored according to the monitoring data and a preset monitoring evaluation model.
  • the monitoring center analyzes the collected monitoring data by using a preset monitoring evaluation model, so as to identify the physiological characteristics and behavioral characteristics of the nursing object and the nursing object. In this way, it can be obtained whether the care object needs to be looked after, or whether the care object has a sudden physiological disease, or whether the care object has abused the care object.
  • a person under care such as an elderly person
  • has a sudden myocardial infarction and the physiological data has changed.
  • the physiological data collected by the wearable device is identified by the preset monitoring and evaluation model of the monitoring center that the elderly is in a physiological abnormal state.
  • the nanny shows the action of slapping the infant in the surveillance video.
  • the monitoring center server judges the behavior as abuse to be further verified based on the video image, and then the monitoring center server can retrieve the nanny's monitoring watch, Wearable monitoring equipment for infants and young children, as well as monitoring data from fixed monitoring equipment in the room, comprehensively analyze whether the babysitter is really abusing infants and young children. Because if infants and young children are being abused, their physiological data such as heartbeat, blood pressure, body temperature, etc.
  • the care recipient will change, that is, the care recipient is in a physiologically abnormal state, and the time taken for the care recipient to recover from the physiological abnormal state to a normal state, or The duration of the abnormal physiological state can be used to determine whether the care object has insufficient care or abused the care object.
  • the babysitter or other caregivers may ignore the baby's cry. If the monitoring device detects that the baby's cry is longer than a preset time threshold, it can determine that the caregiver has "neglected" abuse.
  • the monitoring equipment can detect that the baby's sleep time is longer than the comparison reference time obtained by the detection model established based on historical data, and the baby's heartbeat or other physiological indicators are low, which can be detected by the monitoring system and reported to the supervisor. object.
  • the monitoring instruction is used to send prompt information to the care object and/or the supervision object.
  • the monitoring center server when it detects that the person under care has a sudden emergency physiological disease, it can send prompt information to the care object, including displaying the emergency state, making sounds and vibrations, and can classify the emergency degree by the intensity of the sound and vibration. For sudden diseases such as stroke, myocardial infarction, etc. that endanger life, you can also directly send alarm information to the emergency department of the hospital.
  • an alarm message will be sent to the supervision object, and the care object's wearable monitoring device will also issue an alarm prompt message, such as a voice prompt, to prompt the care object to stop his abusive behavior in time.
  • an alarm prompt message such as a voice prompt
  • the monitoring data collected by the intelligent monitoring device is acquired, the status information of the object to be monitored is determined according to the monitoring data and a preset monitoring evaluation model, and then a monitoring instruction is generated according to the status information.
  • a monitoring instruction is generated according to the status information. It realizes the automatic monitoring and supervision of the care objects and the care objects in the care activities, and timely discovers the abnormal behavior and physiological state of the care objects, so as to notify the care objects to deal with them in time, and when the care objects' physiology or behavior is abnormal, it can Notify supervisory objects in a timely manner. It can improve the timely and effective care of the care recipients, and early detection of abnormal physiological problems such as illnesses of the care recipients. It can also timely evaluate and find out whether the care objects are in place and whether the care objects have been abused. Technical effects such as behavior.
  • FIG. 3 is a schematic flowchart of the monitoring method provided by the second embodiment of the present application. As shown in Figure 3, the specific steps of the method include:
  • the first behavior data includes first video surveillance data of the guarded object. That is, the video data collected by the cameras installed in the safe activity area.
  • the first video surveillance data is the video surveillance data of the guarded object.
  • the preset monitoring evaluation model cannot identify the guarded object from the collected first video surveillance data, that is, the guarded object leaves the range of the video surveillance area.
  • the monitoring center server determines that the guarded object has left the video surveillance area, it will send the first prompt information to the guarded object, such as a buzzer alarm that lasts for 5s.
  • the monitoring method provided in this embodiment is suitable for application scenarios with high requirements for video monitoring of the object of care, such as the object of care is an infant, or an animal cub, or an area with many video surveillance blind spots, or non-video surveillance
  • the area is a high-risk area for the care object, which plays a role in reminding the care object to pay attention in time.
  • FIG. 4 is a schematic flowchart of a monitoring method provided by a third embodiment of the present application. As shown in Figure 4, the specific steps of the method include:
  • S402. Determine, according to the first video surveillance data in the first behavior data and the preset surveillance evaluation model, that the object to be guarded is not in the video surveillance area.
  • steps S401-S402 are similar to those of S301-S302, and will not be repeated here.
  • the first position monitoring data may be GPS positioning data
  • the preset monitoring evaluation model determines whether the guarded object has left the safe activity area according to the GPS positioning data. Steps S405-S406.
  • the second prompt information is used to remind the care object that the care object has left the safe activity area at the current moment, there is an unpredictable safety risk, and the care object needs to be brought back to the safe activity area in time.
  • the second prompt information may include display data, sound, vibration, and the like.
  • the preset monitoring evaluation model recognizes through the first location monitoring data, such as GPS positioning data, that the person under care has not left the safe activity area, but just left the video monitoring area, then the preset monitoring evaluation model can further use infrared imaging Monitoring equipment such as instrument and thermal sensor monitor the fat video monitoring area to find the location of the person under care, and can further monitor whether the physiological data of the person under care is abnormal. If there is a physiological abnormal state, enter the next step.
  • the first location monitoring data such as GPS positioning data
  • the preset monitoring evaluation model can further use infrared imaging Monitoring equipment such as instrument and thermal sensor monitor the fat video monitoring area to find the location of the person under care, and can further monitor whether the physiological data of the person under care is abnormal. If there is a physiological abnormal state, enter the next step.
  • the third prompt information is used to prompt the care object to pay attention to whether the care object in the non-video surveillance area needs to be looked after.
  • the monitoring method provided by this embodiment further determines whether the behavior of the object under care is abnormal through the first position monitoring data, so that the prompt information is classified and graded, so as to reduce the workload of the object under care, and automatically identify whether the intervention of the object under care is required. Take further caregiving actions.
  • FIG. 5 is a schematic flowchart of the monitoring method provided by the fourth embodiment of the present application. As shown in Figure 5, the specific steps of the method include:
  • the monitoring data includes first physiological data of the object under care, and the first physiological data includes first physiological feature data collected by a first wearable device and environmental features collected by a detection device in the safe activity area data.
  • the first physiological characteristic data includes physiological characteristic indicators such as heart rate, body temperature, blood pressure, blood oxygen, respiratory rate and the like of the care object.
  • Environmental characteristic data include: temperature field distribution, humidity, oxygen content, CO 2 concentration, etc.
  • the monitoring data further includes second physiological data of the care object, the second physiological data includes second physiological characteristic data collected by the second wearable device and collected by the detection device in the safe activity area environmental characteristics data.
  • the second physiological characteristic data includes physiological characteristic indicators such as heart rate, body temperature, blood pressure, blood oxygen, and respiratory rate of the care object.
  • the monitoring center server automatically uses a preset monitoring and evaluation model according to the first physiological characteristic data of the guarded object to determine whether the physiological characteristics of the guarded object are suspected to be abnormal, that is, the first preset pending Exceptional condition. For example, at least one of the heart rate, blood pressure, respiratory rate, and body temperature of the person under care exceeds the corresponding preset threshold.
  • the monitoring center server uses a preset monitoring evaluation model to determine whether the physiological characteristics of the nursing object are suspected to be abnormal, that is, the second preset pending abnormal condition is satisfied. . For example, at least one of the heart rate, blood pressure, respiratory rate, and body temperature of the care object exceeds a corresponding preset threshold.
  • the suspected abnormal situation of the physiological characteristics of the object under care may be caused by changes in the environment, in order to further confirm whether the object under care really has a physiological abnormality, it is necessary to combine the environmental characteristic data for confirmation.
  • the person being cared for is an elderly person, the elderly person enters the bathroom to take a bath, and the high temperature and high humidity environment in the bathroom will lead to an increase in the elderly's heartbeat, respiratory rate, body temperature and other indicators. It is possible that these indicators exceed the threshold and will be monitored by the monitoring center.
  • the server monitors that, in order to improve the accuracy of the judgment, the monitoring center server will retrieve the environmental characteristic data such as the temperature distribution, humidity, oxygen content, carbon dioxide concentration, etc. of the bathroom for comprehensive analysis. Coma, etc., then confirm that it is in the fourth abnormal state.
  • S505. Determine that the nursing object is in the fifth abnormal state according to the environmental characteristic data and the preset monitoring and evaluation model.
  • the monitoring center server detects that the body temperature of the care object has risen above a preset threshold. At this time, combined with the fact that the care object is in the kitchen environment, through the temperature distribution of the kitchen environment, it is found that the care object is cooking food, then its body temperature rises Probably due to false positives from cooking food.
  • the monitoring center server can then call the historical positioning data of the care object to confirm whether it has been to the infectious disease area. If you have been in contact with someone infected with an infectious disease and have symptoms of fever, notify the supervised objects such as community neighborhood committees, hospitals, epidemic prevention departments, police stations, etc., and prompt the supervised objects to take treatment or isolation measures for the care objects.
  • the supervised objects such as community neighborhood committees, hospitals, epidemic prevention departments, police stations, etc.
  • fourth prompt information is generated to prompt the object under care and/or the object under supervision, so as to timely rescue the object under care.
  • This embodiment shows that when the person under care or the person under care has a physiological disease, the monitoring center server can automatically discover the physiological abnormality of the object under care or the person under care, and report it to the object under care, the employer, the community neighborhood committee, the police station, and the hospital. and other supervision objects, so as to realize timely rescue of the care recipients or care objects.
  • FIG. 6 is a schematic flowchart of a monitoring method provided by a fifth embodiment of the present application. As shown in Figure 6, the specific steps of the method include:
  • the monitoring data includes: the first physiological data and the first behavior data of the care object, and the second physiological data and the second behavior data of the care object.
  • the first physiological data or the second physiological data include: heart rate, body temperature, blood pressure, blood oxygen, respiratory rate and other physiological characteristic data, and corresponding environmental characteristic data such as temperature distribution, humidity, oxygen concentration, carbon dioxide concentration, etc.
  • the first behavior data or the second behavior data includes: positioning position information, action features, expression features, voice features, and the like.
  • S602. Determine, according to the first physiological characteristic data and the preset monitoring and evaluation model, that the object under care satisfies the first preset pending abnormal condition.
  • steps S602-S603 are similar to those of steps S502 and S504, and are not repeated here.
  • S604. Determine the distance between the care object and the care object according to the first behavior data, the second behavior data, and the preset monitoring and evaluation model.
  • this step if it is determined that the care object is within 5 meters of the care object, whether the behavior characteristics such as the actions and expressions of the care object collected by the camera are to check the abnormal situation of the care object, or whether the care object is being monitored. Comfort or care for the person being cared for.
  • the monitoring center server starts timing when it confirms that the guarded object is in a physiological abnormal state, that is, a fourth abnormal state, that is, detects the duration of the fourth abnormal state.
  • the duration of the fourth abnormal state of the object under care is greater than the first preset time threshold, such as 2 minutes, and the object under care is near the object under care, that is, the distance between the two is less than the preset distance.
  • the monitoring and evaluation model recognizes through the action characteristics of the care object, the care object has not taken any comfort or rescue action to the care object, and it can be determined that the care object ignores the care object, which is a kind of abuse, that is, neglected abuse.
  • Step S608 is performed; or if the preset monitoring and evaluation model recognizes through the action features of the care object that the care object is beating or beating the care object, then step S608 is performed. If it is impossible to distinguish whether there is abusive behavior from the action, step S609 is executed.
  • the monitoring center server automatically collects the evidence data of the abuse, and sends a reminder message to the supervision object, such as the family member of the care object, the community neighborhood committee, the police station, the supervision institution of the welfare institution, etc. Promptly stop the abuse of care recipients.
  • the monitoring center server further uses the preset monitoring and evaluation model to determine the abusive behavior through facial expressions and/or voice characteristics, for example, whether the abusive behavior is abusive, verbal insult, Behaviors such as spitting can be aided by facial expressions and/or sounds. If it is determined that the object of care has abusive behavior, execute S611, and if it is still unable to determine, execute step S610.
  • control center server will send a message to the supervision object, such as the family member of the care object, the community neighborhood committee, the police station, the supervision institution of the welfare institution, the animal protection organization, etc. Prompt information to ensure that the person under care receives timely assistance.
  • the supervision object such as the family member of the care object, the community neighborhood committee, the police station, the supervision institution of the welfare institution, the animal protection organization, etc. Prompt information to ensure that the person under care receives timely assistance.
  • a warning prompt message may also be sent to the care object's wearable monitoring device, such as a watch, to remind the care object to stop the abusive behavior.
  • a prompt message is first sent to the care object's wearable device, and then it is determined whether the physiological abnormal state of the care object lasts for a period of time. If the value is greater than the third preset time threshold, such as 4 minutes, if it is, it is determined that the care object has "neglected" abusive behavior toward the care object, and S613 is executed.
  • a preset distance such as 10m
  • the eighth prompt information is used to prompt the supervision object that the care object has "neglected" abusive behavior to the care object.
  • the data recorded in real time by the monitoring equipment will be uploaded to the database of the monitoring center, which can be used as evidence materials for the abuse of the care object or to evaluate whether the care object is working properly or whether it is good or bad.
  • the behavior of the supervised object can also be recorded.
  • the monitoring method provided by this embodiment by using a preset monitoring evaluation model and according to monitoring data, evaluates whether the monitored object is properly cared for by the nursing object when the object under care has a physiological abnormality, and determines whether the object under care does not care about the object under care. Carry out abusive behavior, and if it is detected that the nursing behavior is unreasonable or there is abusive behavior, the supervision object will be notified to take timely rescue measures. It realizes the automatic monitoring and judgment of the work behavior of the care recipients, and avoids the problem that the care objects cannot receive timely assistance when they have physical diseases, or that the care objects cannot be detected and stopped in time and retain evidence when they are abused. The effect of security supervision on the object.
  • FIG. 7 is a schematic structural diagram of a monitoring device according to an embodiment of the present application.
  • the monitoring device can be implemented by software, hardware or a combination of the two.
  • the monitoring device 700 in this embodiment includes:
  • the acquisition module 701 is configured to acquire monitoring data collected by an intelligent monitoring device, the monitoring data includes behavior data and physiological data of an object to be monitored, and the object to be monitored includes: a nursing object and a nursing object;
  • a processing module 702 configured to determine the state information of the object to be monitored according to the monitoring data and a preset monitoring evaluation model
  • the processing module 702 is further configured to generate a monitoring instruction according to the state information, where the monitoring instruction is used to send prompt information to the care object and/or the supervision object.
  • the monitoring data includes first behavior data of the object to be cared for, and correspondingly, the processing module 702 is configured to determine the to-be-to-be based on the monitoring data and a preset monitoring evaluation model.
  • Status information of monitored objects including:
  • the processing module 702 is configured to determine, according to the first video surveillance data in the first behavior data and the preset surveillance evaluation model, that the guarded object is not in the video surveillance area, and the first video surveillance data is: The video surveillance data of the object under care, the state information is the first abnormal state;
  • processing module 702 is further configured to generate a monitoring instruction according to the status information, including:
  • the processing module 702 is further configured to generate first prompt information for prompting the care object according to the first abnormal state.
  • the processing module 702 is configured to determine, according to the first video surveillance data in the first behavior data and the preset surveillance evaluation model, that the guarded object is not in the video surveillance area After that, also include:
  • the processing module 702 is further configured to: if it is determined according to the first position monitoring data in the first behavior data and the preset monitoring evaluation model that the guarded object leaves the safe activity area, the first position monitoring data is the position monitoring data of the guarded object, the safe activity area includes the video monitoring area and the non-video monitoring area, then the state information is determined as the second abnormal state, and the monitoring instruction is used to generate a prompt Describe the second prompt information of the care object;
  • the processing module 702 is further configured to: if it is determined according to the first position monitoring data in the first behavior data and the preset monitoring evaluation model that the guarded object has not left the safe activity area, then The state information is determined to be a third abnormal state, and the monitoring instruction is used to generate third prompt information for prompting the care object.
  • the monitoring data includes first physiological data of the monitored object, and the first physiological data includes first physiological characteristic data collected by a first wearable device and information in the safe activity zone.
  • processing module 702 is further configured to determine the state information of the object to be monitored according to the monitoring data and a preset monitoring evaluation model, further comprising:
  • the processing module is further configured to, if it is determined according to the first physiological feature data and the preset monitoring and evaluation model that the object under care meets a first preset pending abnormal condition, then according to the environmental feature data and the The preset monitoring and evaluation model determines that the object under care is in the fourth abnormal state;
  • the processing module 702 is further configured to generate a monitoring instruction according to the state information, including:
  • the processing module 702 is further configured to generate fourth prompt information for prompting the care object and/or the supervision object according to the fourth abnormal state.
  • the monitoring data further includes second physiological data of the care object, and the second physiological data includes second physiological characteristic data collected by the second wearable device and environment collected by the infrared detection device in the safe activity area. characteristic data;
  • the processing module 702 is also used to determine the state information of the object to be monitored according to the monitoring data and a preset monitoring evaluation model, and also includes:
  • the processing module 702 is further configured to, if it is determined according to the second physiological characteristic data and the preset monitoring evaluation model that the care object satisfies a second preset pending abnormal condition, then according to the environmental characteristic data and the The preset monitoring and evaluation model determines that the care object is in the fifth abnormal state;
  • the processing module 702 is further configured to generate a monitoring instruction according to the state information, including:
  • the processing module 702 is further configured to generate fifth prompt information for prompting the supervised object according to the fifth abnormal state.
  • the monitoring data includes second behavior data of the care object, and correspondingly, in the processing module 702, it is further configured to monitor and evaluate the model according to the environmental feature data and the preset monitoring and evaluation model. After determining that the object under care is in the fourth abnormal state, the method further includes:
  • the processing module 702 is further configured to determine the distance between the object of care and the object of care according to the first behavior data, the second behavior data and the preset monitoring evaluation model;
  • the processing module 702 is further configured to, if the distance is less than the preset distance, use the preset monitoring evaluation model and the second behavior data to determine the behavior characteristics of the care object;
  • the processing module 702 is further configured to monitor the duration that the object under care is in the fourth abnormal state
  • the processing module 702 is further configured to determine that the object under care is in a state of being abused if the duration is greater than a preset time threshold.
  • the second behavior data includes action features, facial expression features, and voice features
  • the processing module 702 is further configured to determine that the object under care is in a state of being abused, including:
  • the processing module 702 is further configured to judge whether the object of care has performed the abusive behavior on the object of care according to the action feature and the preset monitoring and evaluation model, and if the judgment result is yes, send the sending the sixth prompt message by the supervision object;
  • the processing module 702 is further configured to, if the judgment result is no, according to the facial expression feature and/or the sound feature and the preset monitoring and evaluation model, to judge whether the care object performs the treatment on the care object. For the abuse, if the judgment result is yes, send the seventh prompt message to the supervision object;
  • the processing module 702 is further configured to send the seventh prompt information to the supervision object when the duration is greater than the preset time threshold if the determination result is no.
  • the monitoring device provided by the embodiment shown in FIG. 7 can execute a monitoring method provided by any of the above method embodiments, and its specific implementation principles, technical features, explanations of technical terms, and technical effects are similar. No longer.
  • FIG. 8 is a schematic structural diagram of an electronic device provided by the present application. As shown in FIG. 8 , the electronic device 800 may include: at least one processor 801 and a memory 802 . FIG. 8 shows an electronic device with a processor as an example.
  • the memory 802 is used to store programs.
  • the program may include program code, and the program code includes computer operation instructions.
  • Memory 802 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk memory.
  • the processor 801 is configured to execute the computer-executed instructions stored in the memory 802 to implement the methods described in the above method embodiments.
  • the processor 801 may be a central processing unit (central processing unit, referred to as CPU), or a specific integrated circuit (application specific integrated circuit, referred to as ASIC), or is configured to implement one or more of the embodiments of the present application. multiple integrated circuits.
  • CPU central processing unit
  • ASIC application specific integrated circuit
  • the memory 802 may be independent or integrated with the processor 501 .
  • the electronic device 800 may further include:
  • the bus 803 is used to connect the processor 801 and the memory 802 .
  • the bus may be an industry standard architecture (abbreviated as ISA) bus, a peripheral component (PCI) bus, or an extended industry standard architecture (EISA) bus or the like. Buses can be divided into address bus, data bus, control bus, etc., but it does not mean that there is only one bus or one type of bus.
  • ISA industry standard architecture
  • PCI peripheral component
  • EISA extended industry standard architecture
  • the memory 802 and the processor 801 can communicate through an internal interface.
  • the present application also provides a computer-readable storage medium
  • the computer-readable storage medium may include: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM) ), a magnetic disk or an optical disk and other media that can store program codes.
  • the computer-readable storage medium stores program instructions, and the program instructions are used for the methods in the above embodiments.

Landscapes

  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Alarm Systems (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

A monitoring method and apparatus, an electronic device, and a storage medium. The method comprises: obtaining monitoring data acquired by a smart monitoring device (S201); according to the monitoring data and a preset monitoring evaluation model, determining state information of an object to be monitored (S202); and then generating a monitoring instruction according to the state information (S203). The method implements the automatic monitoring and supervision of a nursing object and a nursed object in a nursing activity, timely discovers an abnormal behavior and physiological state of the monitored object to timely instruct the nursing object to deal with, and can timely notify a supervision object of the occurrence of a physiological or behavior anomaly of the nursing object. The method achieves the technical effects of improving timely and effective nursing of the nursed object, discovering an abnormal physiological problem, such as illness of the nursed object, as early as possible, and timely estimating and discovering whether a nursing behavior of the nursing object is appropriate and whether the nursing object maltreats the nursed object.

Description

监控方法、装置、电子设备以及存储介质Monitoring method, device, electronic device, and storage medium 技术领域technical field
本申请涉及视频监控领域,尤其涉及一种监控方法、装置、电子设备以及存储介质。The present application relates to the field of video surveillance, and in particular, to a monitoring method, apparatus, electronic device, and storage medium.
背景技术Background technique
对人或者动植物的看护已经是我们日常生活中十分常见的活动,如对婴幼儿的照看、对老人的看护、对老师对幼儿园或小学等幼龄学员的看管、宠物店服务员对宠物的看管、动物园中饲养员对动物的看管等等。The care of people or animals and plants has become a very common activity in our daily life, such as the care of infants and young children, the care of the elderly, the care of teachers for young students such as kindergartens or elementary schools, and the care of pets by pet shop attendants. , the care of animals in zoos, etc.
现有的看护活动,有的缺乏监控,而安装了监控系统的看护活动,也严重依赖人工来监视,无法实现对看护对象和被看护对象的生理及行为的自动监控,也导致了看护对象对被看护对象施行虐待行为时,无法被及时发现和制止,并且还可能被人为消除证据,导致施虐行为屡见不鲜。Some of the existing nursing activities lack monitoring, and the nursing activities installed with monitoring systems also rely heavily on manual monitoring, which cannot realize automatic monitoring of the physiology and behavior of the nursing objects and the objects under care. When a person under care commits abusive behavior, it cannot be detected and stopped in time, and evidence may also be removed artificially, resulting in frequent abuse.
因此,现有技术存在无法实现对看护行为的自动监控的技术问题。Therefore, the prior art has the technical problem that the automatic monitoring of the nursing behavior cannot be realized.
发明内容SUMMARY OF THE INVENTION
本申请提供一种监控方法、装置、电子设备以及存储介质,以解决现有技术存在无法实现对看护行为的自动监控的技术问题。The present application provides a monitoring method, device, electronic device, and storage medium to solve the technical problem that automatic monitoring of nursing behavior cannot be realized in the prior art.
第一方面,本申请提供一种监控方法,包括:In a first aspect, the present application provides a monitoring method, comprising:
获取智能监控设备采集的监控数据,所述监控数据包括待监测对象的行为数据和生理数据,所述待监测对象包括:看护对象以及被看护对象;acquiring monitoring data collected by an intelligent monitoring device, the monitoring data includes behavior data and physiological data of an object to be monitored, and the object to be monitored includes: a nursing object and a nursing object;
根据所述监控数据以及预设监控评估模型确定所述待监测对象的状态信息;Determine the state information of the object to be monitored according to the monitoring data and a preset monitoring evaluation model;
根据所述状态信息生成监控指令,所述监控指令用于向所述看护对象和/或监管对象发送提示信息,并记录看护对象和/或监管对象的行为。A monitoring instruction is generated according to the state information, and the monitoring instruction is used to send prompt information to the care object and/or the supervision object, and record the behavior of the care object and/or the supervision object.
在一种可能的设计中,所述监控数据包括所述被看护对象的第一行为数据,对应的,所述根据所述监控数据以及预设监控评估模型确定所述待监测对象的状态信息,包括:In a possible design, the monitoring data includes first behavior data of the monitored object, and correspondingly, the state information of the to-be-monitored object is determined according to the monitoring data and a preset monitoring evaluation model, include:
根据所述第一行为数据中的第一视频监控数据以及所述预设监控评估模 型确定所述被看护对象未在视频监控区,所述第一视频监控数据为所述被看护对象的视频监控数据,所述状态信息为第一异常状态;It is determined according to the first video surveillance data in the first behavior data and the preset surveillance evaluation model that the object under care is not in the video surveillance area, and the first video surveillance data is the video surveillance of the object under care data, the state information is the first abnormal state;
对应的,所述根据所述状态信息生成监控指令,包括:Correspondingly, the generating a monitoring instruction according to the state information includes:
根据所述第一异常状态生成用于提示所述看护对象的第一提示信息。Generate first prompt information for prompting the care object according to the first abnormal state.
在一种可能的设计中,在根据所述第一行为数据中的第一视频监控数据以及所述预设监控评估模型确定所述被看护对象未在视频监控区之后,还包括:In a possible design, after it is determined according to the first video surveillance data in the first behavior data and the preset surveillance evaluation model that the guarded object is not in the video surveillance area, the method further includes:
若根据所述第一行为数据中的第一位置监控数据以及所述预设监控评估模型确定所述被看护对象离开安全活动区,所述第一位置监控数据为所述被看护对象的位置监控数据,所述安全活动区包括所述视频监控区以及非视频监控区,则将所述状态信息确定为第二异常状态,所述监控指令用于生成提示所述看护对象的第二提示信息;If it is determined according to the first position monitoring data in the first behavior data and the preset monitoring evaluation model that the guarded object leaves the safe activity area, the first position monitoring data is the position monitoring of the guarded object data, the safety activity area includes the video surveillance area and the non-video surveillance area, then the state information is determined to be a second abnormal state, and the monitoring instruction is used to generate second prompt information to prompt the care object;
若根据所述第一行为数据中的所述第一位置监控数据以及所述预设监控评估模型确定所述被看护对象未离开所述安全活动区,则将所述状态信息确定为第三异常状态,所述监控指令用于生成提示所述看护对象的第三提示信息。If it is determined according to the first position monitoring data in the first behavior data and the preset monitoring evaluation model that the guarded object has not left the safe activity area, the state information is determined as a third abnormality state, the monitoring instruction is used to generate third prompt information for prompting the care object.
在一种可能的设计中,所述监控数据包括所述被看护对象的第一生理数据,所述第一生理数据包括第一穿戴式设备采集的第一生理特征数据以及所述安全活动区中的红外线探测设备采集的环境特征数据;In a possible design, the monitoring data includes first physiological data of the monitored object, and the first physiological data includes first physiological characteristic data collected by a first wearable device and information in the safe activity zone. Environmental characteristic data collected by infrared detection equipment;
对应的,所述根据所述监控数据以及预设监控评估模型确定所述待监测对象的状态信息,还包括:Correspondingly, the determining the state information of the object to be monitored according to the monitoring data and the preset monitoring evaluation model further includes:
若根据所述第一生理特征数据以及所述预设监控评估模型确定所述被看护对象满足第一预设待定异常条件,则根据所述环境特征数据以及所述预设监控评估模型确定所述被看护对象处于第四异常状态;If it is determined according to the first physiological feature data and the preset monitoring and evaluation model that the object under care meets a first preset pending abnormal condition, then the object is determined according to the environmental feature data and the preset monitoring and evaluation model. The person under care is in the fourth abnormal state;
所述根据所述状态信息生成监控指令,包括:The generating a monitoring instruction according to the state information includes:
根据所述第四异常状态生成用于提示所述看护对象和/或所述监管对象的第四提示信息。Fourth prompt information for prompting the care object and/or the supervision object is generated according to the fourth abnormal state.
可选的,所述监控数据还包括看护对象第二生理数据,所述第二生理数据包括第二穿戴式设备采集的第二生理特征数据以及所述安全活动区中的红外线探测设备采集的环境特征数据;Optionally, the monitoring data further includes second physiological data of the care object, and the second physiological data includes second physiological characteristic data collected by the second wearable device and environment collected by the infrared detection device in the safe activity area. characteristic data;
对应的,所述根据所述监控数据以及预设监控评估模型确定所述待监测 对象的状态信息,还包括:Correspondingly, the state information of the object to be monitored is determined according to the monitoring data and the preset monitoring evaluation model, further comprising:
若根据所述第二生理特征数据以及所述预设监控评估模型确定所述看护对象满足第二预设待定异常条件,则根据所述环境特征数据以及所述预设监控评估模型确定所述看护对象处于第五异常状态;If it is determined according to the second physiological feature data and the preset monitoring evaluation model that the nursing object meets a second preset pending abnormal condition, then the nursing object is determined according to the environmental feature data and the preset monitoring evaluation model The subject is in the fifth abnormal state;
所述根据所述状态信息生成监控指令,包括:The generating a monitoring instruction according to the state information includes:
根据所述第五异常状态生成用于提示监管对象的第五提示信息。Fifth prompt information for prompting the supervision object is generated according to the fifth abnormal state.
在一种可能的设计中,所述监控数据包括所述看护对象的第二行为数据,对应的,在所述根据所述环境特征数据以及所述预设监控评估模型确定所述被看护对象处于第四异常状态之后,还包括:In a possible design, the monitoring data includes the second behavior data of the nursing object, and correspondingly, in the determining according to the environmental characteristic data and the preset monitoring evaluation model that the nursing object is in After the fourth abnormal state, it also includes:
根据所述第一行为数据、所述第二行为数据以及所述预设监控评估模型确定所述看护对象与所述被看护对象的距离;Determine the distance between the object of care and the object of care according to the first behavior data, the second behavior data and the preset monitoring evaluation model;
若所述距离小于所述预设距离,利用所述预设监控评估模型以及所述第二行为数据,确定所述看护对象的行为特征;If the distance is less than the preset distance, use the preset monitoring evaluation model and the second behavior data to determine the behavior characteristics of the care object;
监测所述被看护对象处于所述第四异常状态的持续时间;monitoring the duration of time that the subject is in the fourth abnormal state;
若所述持续时间大于预设时间阈值,则确定所述被看护对象处于被虐待状态。If the duration is greater than a preset time threshold, it is determined that the subject under care is in a state of being abused.
若所述距离大于或等于所述预设距离,则确定持续时间大于第三预设时间阈值;If the distance is greater than or equal to the preset distance, determining that the duration is greater than a third preset time threshold;
向监管对象发送第八提示信息,所述第八提示信息用于表示看护对象存在对被看护对象的“忽视”虐待行为。Eighth prompt information is sent to the supervision object, where the eighth prompt information is used to indicate that the care object has "neglected" abusive behavior to the care object.
在一种可能的设计中,所述第二行为数据包括:动作特征、表情特征以及声音特征,所述确定所述被看护对象处于被虐待状态,包括:In a possible design, the second behavior data includes: action features, facial expression features, and voice features, and the determining that the object under care is in a state of being abused includes:
若根据所述动作特征以及所述预设监控评估模型判断所述看护对象是否对所述被看护对象施行所述虐待行为,若判断结果为是,则向所述监管对象发送所述第六提示信息;If it is determined according to the action feature and the preset monitoring evaluation model whether the care object performs the abusive behavior on the care object, if the judgment result is yes, the sixth prompt is sent to the supervision object information;
若判断结果为否,则根据所述表情特征和/或所述声音特征以及所述预设监控评估模型,判断所述看护对象是否对所述被看护对象施行所述虐待行为,若判断结果为是,则向所述监管对象发送所述第七提示信息;If the judgment result is no, then according to the facial expression feature and/or the sound feature and the preset monitoring evaluation model, it is judged whether the care object performs the abusive behavior on the care object, if the judgment result is If yes, send the seventh prompt information to the supervision object;
若判断结果为否,则当所述持续时间大于所述预设时间阈值时,向所述监管对象发送所述第七提示信息。If the determination result is no, when the duration is greater than the preset time threshold, the seventh prompt information is sent to the supervision object.
第二方面,本申请提供一种监控装置,包括:In a second aspect, the present application provides a monitoring device, comprising:
获取模块,用于获取智能监控设备采集的监控数据,所述监控数据包括待监测对象的行为数据和生理数据,所述待监测对象包括:看护对象以及被看护对象;an acquisition module, configured to acquire monitoring data collected by the intelligent monitoring device, the monitoring data includes behavioral data and physiological data of an object to be monitored, and the object to be monitored includes: a nursing object and a nursing object;
处理模块,用于根据所述监控数据以及预设监控评估模型确定所述待监测对象的状态信息;a processing module, configured to determine the state information of the object to be monitored according to the monitoring data and a preset monitoring evaluation model;
所述处理模块,还用于根据所述状态信息生成监控指令,所述监控指令用于向所述看护对象和/或监管对象发送提示信息。The processing module is further configured to generate a monitoring instruction according to the state information, where the monitoring instruction is used to send prompt information to the care object and/or the supervision object.
在一种可能的设计中,所述监控数据包括所述被看护对象的第一行为数据,对应的,所述处理模块,用于根据所述监控数据以及预设监控评估模型确定所述待监测对象的状态信息,包括:In a possible design, the monitoring data includes the first behavior data of the guarded object, and correspondingly, the processing module is configured to determine the to-be-monitored according to the monitoring data and a preset monitoring evaluation model The state information of the object, including:
所述处理模块,用于根据所述第一行为数据中的第一视频监控数据以及所述预设监控评估模型确定所述被看护对象未在视频监控区,所述第一视频监控数据为所述被看护对象的视频监控数据,所述状态信息为第一异常状态;The processing module is configured to determine, according to the first video surveillance data in the first behavior data and the preset surveillance evaluation model, that the object under care is not in the video surveillance area, and the first video surveillance data is the The video surveillance data of the object under care, the state information is the first abnormal state;
对应的,所述处理模块,还用于根据所述状态信息生成监控指令,包括:Correspondingly, the processing module is further configured to generate a monitoring instruction according to the status information, including:
所述处理模块,还用于根据所述第一异常状态生成用于提示所述看护对象的第一提示信息。The processing module is further configured to generate first prompt information for prompting the care object according to the first abnormal state.
在一种可能的设计中,在所述处理模块,用于根据所述第一行为数据中的第一视频监控数据以及所述预设监控评估模型确定所述被看护对象未在视频监控区之后,还包括:In a possible design, the processing module is configured to determine, according to the first video surveillance data in the first behavior data and the preset surveillance evaluation model, that the guarded object is not behind the video surveillance area ,Also includes:
所述处理模块,还用于若根据所述第一行为数据中的第一位置监控数据以及所述预设监控评估模型确定所述被看护对象离开安全活动区,所述第一位置监控数据为所述被看护对象的位置监控数据,所述安全活动区包括所述视频监控区以及非视频监控区,则将所述状态信息确定为第二异常状态,所述监控指令用于生成提示所述看护对象的第二提示信息;The processing module is further configured to: if it is determined according to the first position monitoring data in the first behavior data and the preset monitoring evaluation model that the guarded object leaves the safe activity area, the first position monitoring data is: The position monitoring data of the guarded object, the safe activity area includes the video monitoring area and the non-video monitoring area, then the state information is determined to be the second abnormal state, and the monitoring instruction is used to generate a prompt that the The second prompt information of the care object;
所述处理模块,还用于若根据所述第一行为数据中的所述第一位置监控数据以及所述预设监控评估模型确定所述被看护对象未离开所述安全活动区,则将所述状态信息确定为第三异常状态,所述监控指令用于生成提示所述看护对象的第三提示信息。The processing module is further configured to: if it is determined according to the first position monitoring data in the first behavior data and the preset monitoring evaluation model that the object under care has not left the safe activity area, then The state information is determined to be a third abnormal state, and the monitoring instruction is used to generate third prompt information for prompting the care object.
在一种可能的设计中,所述监控数据包括所述被看护对象的第一生理数据,所述第一生理数据包括第一穿戴式设备采集的第一生理特征数据以及所述安全活动区中的红外线探测设备采集的环境特征数据;In a possible design, the monitoring data includes first physiological data of the monitored object, and the first physiological data includes first physiological characteristic data collected by a first wearable device and information in the safe activity zone. Environmental characteristic data collected by infrared detection equipment;
对应的,所述处理模块,还用于根据所述监控数据以及预设监控评估模型确定所述待监测对象的状态信息,还包括:Correspondingly, the processing module is further configured to determine the status information of the object to be monitored according to the monitoring data and a preset monitoring evaluation model, further comprising:
所述处理模块,还用于若根据所述第一生理特征数据以及所述预设监控评估模型确定所述被看护对象满足第一预设待定异常条件,则根据所述环境特征数据以及所述预设监控评估模型确定所述被看护对象处于第四异常状态;The processing module is further configured to, if it is determined according to the first physiological feature data and the preset monitoring and evaluation model that the object under care meets a first preset pending abnormal condition, then according to the environmental feature data and the The preset monitoring and evaluation model determines that the object under care is in the fourth abnormal state;
所述处理模块,还用于根据所述状态信息生成监控指令,包括:The processing module is further configured to generate a monitoring instruction according to the state information, including:
所述处理模块,还用于根据所述第四异常状态生成用于提示所述看护对象和/或所述监管对象的第四提示信息。The processing module is further configured to generate fourth prompt information for prompting the care object and/or the supervision object according to the fourth abnormal state.
可选的,所述监控数据还包括看护对象第二生理数据,所述第二生理数据包括第二穿戴式设备采集的第二生理特征数据以及所述安全活动区中的红外线探测设备采集的环境特征数据;Optionally, the monitoring data further includes second physiological data of the care object, and the second physiological data includes second physiological characteristic data collected by the second wearable device and environment collected by the infrared detection device in the safe activity area. characteristic data;
对应的,所述处理模块,还用于根据所述监控数据以及预设监控评估模型确定所述待监测对象的状态信息,还包括:Correspondingly, the processing module is further configured to determine the status information of the object to be monitored according to the monitoring data and a preset monitoring evaluation model, further comprising:
所述处理模块,还用于若根据所述第二生理特征数据以及所述预设监控评估模型确定所述看护对象满足第二预设待定异常条件,则根据所述环境特征数据以及所述预设监控评估模型确定所述看护对象处于第五异常状态;The processing module is further configured to, if it is determined according to the second physiological feature data and the preset monitoring and evaluation model that the care object meets a second preset pending abnormal condition, then according to the environmental feature data and the preset monitoring and evaluation model. Suppose the monitoring evaluation model determines that the care object is in the fifth abnormal state;
所述处理模块,还用于根据所述状态信息生成监控指令,包括:The processing module is further configured to generate a monitoring instruction according to the state information, including:
所述处理模块,还用于根据所述第五异常状态生成用于提示监管对象的第五提示信息。The processing module is further configured to generate fifth prompt information for prompting the supervised object according to the fifth abnormal state.
在一种可能的设计中,所述监控数据包括所述看护对象的第二行为数据,对应的,在所述处理模块,还用于根据所述环境特征数据以及所述预设监控评估模型确定所述被看护对象处于第四异常状态之后,还包括:In a possible design, the monitoring data includes second behavior data of the care object, and correspondingly, in the processing module, it is further configured to determine according to the environmental feature data and the preset monitoring evaluation model After the object under care is in the fourth abnormal state, it also includes:
所述处理模块,还用于根据所述第一行为数据、所述第二行为数据以及所述预设监控评估模型确定所述看护对象与所述被看护对象的距离;The processing module is further configured to determine the distance between the object of care and the object of care according to the first behavior data, the second behavior data and the preset monitoring and evaluation model;
所述处理模块,还用于若所述距离小于所述预设距离,利用所述预设监控评估模型以及所述第二行为数据,确定所述看护对象的行为特征;The processing module is further configured to, if the distance is less than the preset distance, use the preset monitoring evaluation model and the second behavior data to determine the behavioral characteristics of the care object;
所述处理模块,还用于监测所述被看护对象处于所述第四异常状态的持续时间;The processing module is further configured to monitor the duration that the object under care is in the fourth abnormal state;
所述处理模块,还用于若所述持续时间大于预设时间阈值,则确定所述被看护对象处于被虐待状态。The processing module is further configured to determine that the object under care is in a state of being abused if the duration is greater than a preset time threshold.
在一种可能的设计中,所述第二行为数据包括:动作特征、表情特征以 及声音特征,所述处理模块,还用于确定所述被看护对象处于被虐待状态,包括:In a possible design, the second behavior data includes: action features, facial expression features, and voice features, and the processing module is further configured to determine that the object under care is in a state of being abused, including:
所述处理模块,还用于若根据所述动作特征以及所述预设监控评估模型判断所述看护对象是否对所述被看护对象施行所述虐待行为,若判断结果为是,则向所述监管对象发送所述第六提示信息;The processing module is further configured to judge whether the object of care has performed the abuse on the object of care according to the action feature and the preset monitoring and evaluation model, and if the judgment result is yes, then report to the object of care. The supervision object sends the sixth prompt information;
所述处理模块,还用于若判断结果为否,则根据所述表情特征和/或所述声音特征以及所述预设监控评估模型,判断所述看护对象是否对所述被看护对象施行所述虐待行为,若判断结果为是,则向所述监管对象发送所述第七提示信息;The processing module is further configured to, if the judgment result is no, according to the facial expression feature and/or the sound feature and the preset monitoring evaluation model, to judge whether the object of care has performed any action on the object under care. If the judgment result is yes, send the seventh prompt message to the supervision object;
所述处理模块,还用于若判断结果为否,则当所述持续时间大于所述预设时间阈值时,向所述监管对象发送所述第七提示信息。The processing module is further configured to send the seventh prompt information to the supervision object when the duration is greater than the preset time threshold if the determination result is no.
第三方面,本申请提供一种电子设备,包括:In a third aspect, the application provides an electronic device, comprising:
存储器,用于存储程序指令;memory for storing program instructions;
处理器,用于调用并执行所述存储器中的程序指令,执行第一方面所提供的任意一种可能的监控方法。The processor is configured to call and execute the program instructions in the memory, and execute any one of the possible monitoring methods provided in the first aspect.
第四个方面,本申请提供一种存储介质,所述可读存储介质中存储有计算机程序,所述计算机程序用于执行第一方面所提供的任意一种可能的监控方法。In a fourth aspect, the present application provides a storage medium, where a computer program is stored in the readable storage medium, and the computer program is used to execute any one of the possible monitoring methods provided in the first aspect.
本申请提供的监控方法、装置、电子设备以及存储介质,通过获取智能监控设备采集的监控数据,并根据监控数据以及预设监控评估模型确定待监测对象的状态信息,然后根据所述状态信息生成监控指令。实现了对看护活动中的看护对象和被看护对象的自动监控监管,及时发现被看护对象的异常行为和生理状态,以通知看护对象及时处理,并且在看护对象的生理或者行为出现异常时,能够及时通知监管对象。达到了提高被看护对象的及时有效看护,又及早发现看护对象生病等异常生理问题,还能够及时评估发现看护对象的看护行为是否到位,是否对被看护对象施行了虐待行为等技术效果。The monitoring method, device, electronic device and storage medium provided by the present application obtain the monitoring data collected by the intelligent monitoring device, determine the status information of the object to be monitored according to the monitoring data and the preset monitoring evaluation model, and then generate the status information according to the status information. Monitoring instructions. It realizes the automatic monitoring and supervision of the care objects and the care objects in the care activities, and timely discovers the abnormal behavior and physiological state of the care objects, so as to notify the care objects to deal with them in time, and when the care objects' physiology or behavior is abnormal, it can Notify supervisory objects in a timely manner. It can improve the timely and effective care of the care recipients, and early detection of abnormal physiological problems such as illnesses of the care recipients. It can also timely evaluate and discover whether the care objects are in place, and whether the care objects have been abused. Technical effects such as behavior.
附图说明Description of drawings
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍,显而易见地,下 面描述中的附图是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following will briefly introduce the accompanying drawings used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description These are some embodiments of the present application, and for those of ordinary skill in the art, other drawings can also be obtained from these drawings without any creative effort.
图1a-1f为本申请实施例提供的监控场景及监控设备示意图;1a-1f are schematic diagrams of monitoring scenarios and monitoring equipment provided by embodiments of the present application;
图2为本申请第一实施例提供的监控方法流程示意图;2 is a schematic flowchart of a monitoring method provided by the first embodiment of the present application;
图3为本申请第二实施例提供的监控方法流程示意图;3 is a schematic flowchart of a monitoring method provided by the second embodiment of the present application;
图4为本申请第三实施例提供的监控方法流程示意图;4 is a schematic flowchart of a monitoring method provided by a third embodiment of the present application;
图5为本申请第四实施例提供的监控方法流程示意图;5 is a schematic flowchart of a monitoring method provided by a fourth embodiment of the present application;
图6为本申请第五实施例提供的监控方法流程示意图;6 is a schematic flowchart of a monitoring method provided by a fifth embodiment of the present application;
图7为本申请实施例提供的一种监控装置的结构示意图;FIG. 7 is a schematic structural diagram of a monitoring device according to an embodiment of the present application;
图8为本申请提供的一种电子设备的结构示意图。FIG. 8 is a schematic structural diagram of an electronic device provided by the present application.
通过上述附图,已示出本申请明确的实施例,后文中将有更详细的描述。这些附图和文字描述并不是为了通过任何方式限制本申请构思的范围,而是通过参考特定实施例为本领域技术人员说明本申请的概念。Specific embodiments of the present application have been shown by the above-mentioned drawings, and will be described in more detail hereinafter. These drawings and written descriptions are not intended to limit the scope of the concepts of the present application in any way, but to illustrate the concepts of the present application to those skilled in the art by referring to specific embodiments.
具体实施方式detailed description
为使本申请实施例的目的、技术方案和优点更加清楚,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.
本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”、“第四”等(如果存在)是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便这里描述的本申请的实施例,例如能够以除了在这里图示或描述的那些以外的顺序实施。此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。The terms "first", "second", "third", "fourth", etc. (if any) in the description and claims of this application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances so that the embodiments of the application described herein, for example, can be implemented in sequences other than those illustrated or described herein. Furthermore, the terms "comprising" and "having" and any variations thereof, are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those expressly listed Rather, those steps or units may include other steps or units not expressly listed or inherent to these processes, methods, products or devices.
下面这几个具体的实施例可以相互结合,对于相同或相似的概念或过程可能在某些实施例中不再赘述。下面将结合附图,对本申请的实施例进行描 述。The following specific embodiments may be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below with reference to the accompanying drawings.
现有的看护活动有很多具体的应用场景,包括如下场景:There are many specific application scenarios for existing nursing activities, including the following scenarios:
一、保姆对婴幼儿的照看。1. The babysitter's care of infants and young children.
由于婴幼儿无法通过语言表达出自己的需求,或者说由于保姆在忙于做其它的事情而疏忽对婴幼儿的照看。现有技术中,一般都是在家中安装摄像头,声音传感器等来被动地监控婴幼儿的状态,摄像头需要有人工的监视才能够判断出婴幼儿是否需要照看,而当婴幼儿处于突发性的生理疾病,出现晕厥等就无法及时传递出声音,使得监控系统以及保姆无法及时发现婴幼儿的异常。Because infants and young children cannot express their needs through language, or because babysitters are busy doing other things and neglect to take care of infants and young children. In the prior art, cameras, sound sensors, etc. are generally installed at home to passively monitor the state of infants and young children. Physiological diseases, syncope, etc., cannot transmit the sound in time, making the monitoring system and the nanny unable to detect the abnormality of infants and young children in time.
二、护工对老人的看护。2. Nursing care for the elderly.
对于生病状态或者是长期卧床无法行走的老人,当护工没有待在老人身边守着时,老人的生理状态出现了异常,如心脏骤停,呼吸衰竭,发烧等,而老人可能无法及时发出声音来呼唤护工,视频监控也需要人工来时刻不停地监视,才能避免悲剧的发生。For the elderly who are sick or who are bedridden for a long time and cannot walk, when the carer does not stay by the elderly, the elderly's physiological state is abnormal, such as cardiac arrest, respiratory failure, fever, etc., and the elderly may not be able to make a sound in time Calling nurses, video surveillance also requires manual monitoring all the time, in order to avoid the occurrence of tragedies.
三、幼儿园或学校低龄学员的看管。3. Supervision of young students in kindergartens or schools.
在这个年龄段的被看护对象,已经具备了初步的自主行为能力,强烈的好奇心总是驱使着呗看护对象陷入到危险的环境中,而现有的学校或幼儿园的视频监控系统,也无法在监控到被看护对象擅自离开学校或者教室后及时提醒老师。并且低龄的被看护对象也还没有能够完全掌握用语言表达其生理或者行为需求的能力,这就导致低龄被看护对象在受虐待后,如果受到看护对象的恐吓而不敢说,而监控录像没有拍到或者是被人为销毁,就无法实现对看护对象的看管行为进行监管。The care recipients in this age group already have the initial ability to act autonomously, and strong curiosity always drives the care recipients into dangerous environments, and the existing video surveillance systems in schools or kindergartens cannot Remind teachers in a timely manner after monitoring that the person under care has left the school or classroom without authorization. In addition, young care recipients have not yet fully mastered the ability to express their physical or behavioral needs in language, which leads to young care recipients being intimidated and afraid to speak after being abused, while surveillance video does not. If it is photographed or destroyed artificially, it is impossible to supervise the custody behavior of the caregiver.
四、宠物店或者动物园饲养员对动物的看管。4. The care of animals by pet shop or zoo breeders.
动物无法开口说话,饲养员无法及时发现动物的异常状态,现有的监控系统需人工实时参与监管,但是由于动物的特殊性,使得监控系统也无法实现对看管行为的有效监管与评价,只能监管到严重的虐待行为,而无法实现精细化监管。Animals can't speak, and breeders can't detect the abnormal state of animals in time. The existing monitoring system requires manual supervision in real time. However, due to the particularity of animals, the monitoring system cannot achieve effective supervision and evaluation of custody behavior. Supervision to serious abuses, and can not achieve refined supervision.
基于上述各个具体应用场景中的各技术问题,本申请提供了一种监控方法,通过同时监控看护对象与被看护对象的生理和行为状态信息,利用训练好的预设监控评估模型来综合生理和行为两项甚至更多的数据,实现对婴幼儿、老人、低龄学员、以及宠物的精细化精准监控,提高看护对象的看护质 量,达到及时发现并制止看护对象的施虐行为的发生的技术效果。Based on the technical problems in the above-mentioned specific application scenarios, the present application provides a monitoring method. By simultaneously monitoring the physiological and behavioral state information of the nursing object and the nursing object, the trained preset monitoring and evaluation model is used to synthesize physiological and behavioral state information. The data of two or more behaviors can realize the precise and precise monitoring of infants, the elderly, young students, and pets, improve the quality of care of the care recipients, and achieve the technical effect of timely detection and prevention of abusive behaviors of the care recipients. .
图1a-1f为本申请实施例提供的监控场景及监控设备示意图。图1a为屋内即安全活动区的监控设备布置示意图,如图1a所示,在屋内布置有多个固定式监控设备11,每个监控设备可以实时监测监控区域111。监控设备11可以包括:摄像头、红外线成像仪、热传感器、声音传感器、温度传感器、雷达等,摄像头所覆盖的监控区域形成视频监控区,视频监控区可以覆盖整个安全活动区,也可以小于安全活动区,因为例如储物间、衣帽间、卫生间等涉及隐私的区域不便于设置摄像头监控,这些摄像头无法得到监控视频的区域就是非视频监控区,对于非视频监控区,可以布置红外线成像仪、热传感器、温度传感器、声音传感器等,本看护对象进入到非视频监控区时,仍能够被监控设备监控。1a-1f are schematic diagrams of monitoring scenarios and monitoring devices provided by embodiments of the present application. Figure 1a is a schematic diagram of the layout of monitoring equipment in the house, that is, the safe activity area. As shown in Figure 1a, a plurality of fixed monitoring equipment 11 are arranged in the house, and each monitoring equipment can monitor the monitoring area 111 in real time. The monitoring equipment 11 may include: cameras, infrared imagers, thermal sensors, sound sensors, temperature sensors, radars, etc. The monitoring area covered by the cameras forms a video monitoring area, and the video monitoring area may cover the entire security activity area, or may be smaller than the security activity area. Because it is not convenient to set up camera monitoring in privacy-related areas such as storage rooms, cloakrooms, and toilets, the areas where these cameras cannot obtain surveillance video are non-video surveillance areas. For non-video surveillance areas, infrared imagers and thermal sensors can be arranged. , temperature sensor, sound sensor, etc., when the care object enters the non-video surveillance area, it can still be monitored by the monitoring equipment.
图1b为婴儿穿戴式监控设备的示意图。穿戴式监控设备121可以包括腹部生理采集带装装置,以及腿部生理采集环装置。穿戴式监控设备121可以读取婴儿的生理数据以及行为动作数据,包括:心率、血氧含量、血压、呼吸频率、运动感知数据、体温检测数据等,并且穿戴式监控设备121可以具备无线通讯功能,可以将采集到的数据发送给监控中心服务器。穿戴式监控设备121可以设置成防水的。此外,穿戴式监控设备121还可以采集周围环境的声音,包括婴儿的声音和看护人员的声音等。可选的,穿戴式监控设备121还带有电源指示灯,以提醒用户及时充电或者更换电池。Figure 1b is a schematic diagram of a baby wearable monitoring device. The wearable monitoring device 121 may include an abdominal physiological collection belt device and a leg physiological collection ring device. The wearable monitoring device 121 can read the baby's physiological data and behavioral data, including: heart rate, blood oxygen content, blood pressure, respiratory rate, motion sensing data, body temperature detection data, etc., and the wearable monitoring device 121 can have a wireless communication function , the collected data can be sent to the monitoring center server. The wearable monitoring device 121 may be configured to be waterproof. In addition, the wearable monitoring device 121 can also collect the sound of the surrounding environment, including the sound of the baby and the voice of the caregiver. Optionally, the wearable monitoring device 121 also has a power indicator light to remind the user to charge or replace the battery in time.
图1c为幼儿或低龄学员的穿戴式监控设备的示意图。如图1c所示,穿戴式监控设备122可以包括手环和脚环,手环和脚环所具备的功能与穿戴式监控设备121类似,在此不再赘述。Figure 1c is a schematic diagram of a wearable monitoring device for infants or young learners. As shown in FIG. 1 c , the wearable monitoring device 122 may include a wristband and a foot ring, and the functions of the wristband and the foot ring are similar to those of the wearable monitoring device 121 , and details are not described herein again.
图1d为动物的穿戴式监控设备的示意图。如图1d所示,穿戴式监控设备123可以包括项圈,项圈可以采集动物的生理数据以及行为动作数据,其功能与穿戴式设备121类似,在此不再赘述。Figure 1d is a schematic diagram of a wearable monitoring device for animals. As shown in FIG. 1d , the wearable monitoring device 123 may include a collar, and the collar may collect the physiological data and behavioral data of the animal.
在一种可能的设计中,穿戴式监控设备123还可以包括:胸部、腹部和腿部穿戴式设备。例如,可以给马匹在胸部、腹部和腿部分别戴上“手镯”或“手表”形状的穿戴式设备,用以检测马匹的日常活动和疾病感染情况。In one possible design, the wearable monitoring device 123 may also include: chest, abdomen and leg wearable devices. For example, wearable devices in the shape of "bracelets" or "watches" can be worn on horses on the chest, abdomen and legs, respectively, to detect the horse's daily activities and infection.
图1e为看护人员即看护对象的穿戴式监控设备的示意图。如图1e所示,看护手表13可以包含以下功能,提示功能:显示提示信息、发出提示声音、发出警示振动等,包括按时间提示看护任务完成状态、紧急看护需求等;状 态查看功能:查看被看护对象的生理状态数据、位置信息等;看护对象自身状态监测功能:实时监测看护对象的心率、血压、血氧、呼吸频率、动作、运动状态等;无线通讯功能:用于与监控中心服务器进行数据交互,以及与监管对象进行通话。FIG. 1e is a schematic diagram of a wearable monitoring device for a caregiver, that is, a care object. As shown in FIG. 1e, the nursing watch 13 may include the following functions, prompting functions: displaying prompting information, issuing prompting sounds, issuing warning vibrations, etc., including prompting the completion status of nursing tasks and emergency nursing needs according to time; Physiological state data, location information, etc. of the nursing object; monitoring function of the nursing object's own state: real-time monitoring of the nursing object's heart rate, blood pressure, blood oxygen, respiratory rate, movement, exercise status, etc.; wireless communication function: used to communicate with the monitoring center server Data interaction, and calls with supervisory objects.
图1f为一种生命体征感应垫14,用于获取被看护对象或看护对象的生命体征,例如心率、呼吸频率、温度变化、身体移动和姿势变化等,从生命体征数据就可以判断被看护对象或看护对象的生理活动,如睡眠状态。Fig. 1f is a vital sign sensing pad 14, which is used to obtain the vital signs of the person under care or the care object, such as heart rate, respiratory rate, temperature change, body movement and posture change, etc. From the vital sign data, the person under care can be judged Or the physical activity of the care subject, such as sleep state.
还需要说明的是,监控系统还可以包括GPS或者北斗定位装置以及室内定位雷达,用来检测看护对象或者被看护对象的位置。It should also be noted that the monitoring system may further include a GPS or Beidou positioning device and an indoor positioning radar, which are used to detect the position of the guarded object or the guarded object.
图2为本申请第一实施例提供的监控方法流程示意图。如图2所示,该方法包括:FIG. 2 is a schematic flowchart of the monitoring method provided by the first embodiment of the present application. As shown in Figure 2, the method includes:
S201、获取智能监控设备采集的监控数据。S201. Obtain monitoring data collected by an intelligent monitoring device.
在本步骤中,所述监控数据包括待监测对象的行为数据和生理数据,所述待监测对象包括:看护对象以及被看护对象。In this step, the monitoring data includes behavior data and physiological data of the object to be monitored, and the object to be monitored includes: a nursing object and a nursing object.
具体的,智能监控设备包括图1a-1f所示的固定式监控设备、穿戴式监控设备、全球位置定位设备如GPS或北斗导航系统等,智能监控设备对看护对象和被看护对象实行全天候的检测,并将采集到的监控数据上传监控中心服务器。Specifically, the intelligent monitoring equipment includes fixed monitoring equipment, wearable monitoring equipment, global location positioning equipment such as GPS or Beidou navigation system, etc. shown in Figures 1a-1f. , and upload the collected monitoring data to the monitoring center server.
S202、根据监控数据以及预设监控评估模型确定待监测对象的状态信息。S202. Determine the state information of the object to be monitored according to the monitoring data and a preset monitoring evaluation model.
在本步骤中,监控中心利用预设监控评估模型,对采集到的监控数据进行分析,以识别出看护对象和被看护对象的生理特征和行为特征。从而得到被看护对象是否需要照看,或者是看护对象是否存在生理突发疾病,或者是监测看护对象是否对被看护对象施行了虐待行为。In this step, the monitoring center analyzes the collected monitoring data by using a preset monitoring evaluation model, so as to identify the physiological characteristics and behavioral characteristics of the nursing object and the nursing object. In this way, it can be obtained whether the care object needs to be looked after, or whether the care object has a sudden physiological disease, or whether the care object has abused the care object.
例如,在深夜被看护对象如老人突发心肌梗塞,生理数据发生了变化,穿戴式设备采集到的生理数据经监控中心的预设监控评估模型识别出老人处于生理异常状态。For example, in the middle of the night, a person under care, such as an elderly person, has a sudden myocardial infarction, and the physiological data has changed. The physiological data collected by the wearable device is identified by the preset monitoring and evaluation model of the monitoring center that the elderly is in a physiological abnormal state.
再例如,保姆在监控视频中表现出拍打婴幼儿的动作,此时,监控中心服务器根据视频图像,将其行为判定为待进一步验证的虐待行为,然后监控中心服务器可以调取保姆的监控手表、婴幼儿的穿戴式监控设备,以及在房间内的固定式监控设备的监控数据,综合分析保姆是否真的在虐待婴幼儿。 因为如果婴幼儿在被虐待,其生理数据如心跳、血压、体温等将会发生变化即被看护对象处于生理异常状态,并且可以根据被看护对象从生理异常状态恢复到正常状态的时间,或者是生理异常状态的持续时间来判定看护对象是否存在看护不到位或者是对被看护对象施行虐待行为。For another example, the nanny shows the action of slapping the infant in the surveillance video. At this time, the monitoring center server judges the behavior as abuse to be further verified based on the video image, and then the monitoring center server can retrieve the nanny's monitoring watch, Wearable monitoring equipment for infants and young children, as well as monitoring data from fixed monitoring equipment in the room, comprehensively analyze whether the babysitter is really abusing infants and young children. Because if infants and young children are being abused, their physiological data such as heartbeat, blood pressure, body temperature, etc. will change, that is, the care recipient is in a physiologically abnormal state, and the time taken for the care recipient to recover from the physiological abnormal state to a normal state, or The duration of the abnormal physiological state can be used to determine whether the care object has insufficient care or abused the care object.
还例如:当婴儿哭泣时,保姆或其他看护对象可能会忽略婴儿的哭声,监控设备若检测到婴儿哭泣时间大于预设时间阈值,就可以判定看护对象存在“忽视”虐待。Another example: when the baby is crying, the babysitter or other caregivers may ignore the baby's cry. If the monitoring device detects that the baby's cry is longer than a preset time threshold, it can determine that the caregiver has "neglected" abuse.
又例如:保姆给婴儿喂违禁药物,如安眠药。监控设备就可以检测到婴儿的睡眠时间比根据历史数据建立的检测模型所得到的对比参考时间要长,并且婴儿的心跳或其它生理指标都偏低迷,就可以被监控系统检测出来,上报给监管对象。Another example: babysitters feeding babies illegal drugs, such as sleeping pills. The monitoring equipment can detect that the baby's sleep time is longer than the comparison reference time obtained by the detection model established based on historical data, and the baby's heartbeat or other physiological indicators are low, which can be detected by the monitoring system and reported to the supervisor. object.
S203、根据状态信息生成监控指令。S203. Generate a monitoring instruction according to the status information.
在本步骤中,所述监控指令用于向所述看护对象和/或监管对象发送提示信息。In this step, the monitoring instruction is used to send prompt information to the care object and/or the supervision object.
具体的,监控中心服务器监测到被看护对象存在突发紧急生理疾病时,可以向看护对象发送提示信息,包括显示紧急状态,发出声音和振动,并且可以通过声音和振动的强度来划分紧急程度。对于如危及到生命安全的突发疾病如中风、心肌梗塞等,还可以直接向医院急救部门发送报警求助信息。Specifically, when the monitoring center server detects that the person under care has a sudden emergency physiological disease, it can send prompt information to the care object, including displaying the emergency state, making sounds and vibrations, and can classify the emergency degree by the intensity of the sound and vibration. For sudden diseases such as stroke, myocardial infarction, etc. that endanger life, you can also directly send alarm information to the emergency department of the hospital.
对于看护对象,如看护人员存在突发生理疾病,如晕倒,则直接向监管对象如家人、社区居委、警察局等发送报警求助信息。For caregivers, if the caregivers suffer from sudden physical diseases, such as fainting, they will directly send alarm and help information to the supervision objects such as family members, community neighborhood committees, and police stations.
对于看护对象存在对被看护对象的虐待行为,则向监管对象发送报警信息,并且看护对象的穿戴式监控设备也同时发出报警提示信息,如语音提示,以提示看护对象及时停止其虐待行为。If the care object abuses the care object, an alarm message will be sent to the supervision object, and the care object's wearable monitoring device will also issue an alarm prompt message, such as a voice prompt, to prompt the care object to stop his abusive behavior in time.
本实施例提供的监控方法,通过获取智能监控设备采集的监控数据,并根据监控数据以及预设监控评估模型确定待监测对象的状态信息,然后根据所述状态信息生成监控指令。实现了对看护活动中的看护对象和被看护对象的自动监控监管,及时发现被看护对象的异常行为和生理状态,以通知看护对象及时处理,并且在看护对象的生理或者行为出现异常时,能够及时通知监管对象。达到了提高被看护对象的及时有效看护,又及早发现看护对象生病等异常生理问题,还能够及时评估发现看护对象的看护行为是否到位,是否对被看护对象施行了虐待行为等技术效果。In the monitoring method provided by this embodiment, the monitoring data collected by the intelligent monitoring device is acquired, the status information of the object to be monitored is determined according to the monitoring data and a preset monitoring evaluation model, and then a monitoring instruction is generated according to the status information. It realizes the automatic monitoring and supervision of the care objects and the care objects in the care activities, and timely discovers the abnormal behavior and physiological state of the care objects, so as to notify the care objects to deal with them in time, and when the care objects' physiology or behavior is abnormal, it can Notify supervisory objects in a timely manner. It can improve the timely and effective care of the care recipients, and early detection of abnormal physiological problems such as illnesses of the care recipients. It can also timely evaluate and find out whether the care objects are in place and whether the care objects have been abused. Technical effects such as behavior.
图3为本申请第二实施例提供的监控方法流程示意图。如图3所示,该方法的具体步骤包括:FIG. 3 is a schematic flowchart of the monitoring method provided by the second embodiment of the present application. As shown in Figure 3, the specific steps of the method include:
S301、获取智能监控设备采集的监控数据,监控数据包括被看护对象的第一行为数据。S301. Acquire monitoring data collected by an intelligent monitoring device, where the monitoring data includes first behavior data of a guarded object.
在本步骤中,第一行为数据包括被看护对象的第一视频监控数据。即安装在安全活动区内的摄像头采集到的视频数据。In this step, the first behavior data includes first video surveillance data of the guarded object. That is, the video data collected by the cameras installed in the safe activity area.
S302、根据第一行为数据中的第一视频监控数据以及预设监控评估模型确定被看护对象未在视频监控区,则确定被看护对象的状态信息为第一异常状态。S302. Determine according to the first video surveillance data in the first behavior data and the preset monitoring evaluation model that the guarded object is not in the video surveillance area, and then determine that the state information of the guarded object is the first abnormal state.
在本步骤中,所述第一视频监控数据为所述被看护对象的视频监控数据。In this step, the first video surveillance data is the video surveillance data of the guarded object.
预设监控评估模型从采集到的第一视频监控数据中,无法识别到被看护对象,即被看护对象离开了视频监控区的范围。The preset monitoring evaluation model cannot identify the guarded object from the collected first video surveillance data, that is, the guarded object leaves the range of the video surveillance area.
S303、根据第一异常状态生成用于提示看护对象的第一提示信息。S303. Generate first prompt information for prompting the care object according to the first abnormal state.
在本步骤中,只要监控中心服务器确定被看护对象离开了视频监控区,则向看护对象,发送第一提示信息,如持续5s的蜂鸣报警。In this step, as long as the monitoring center server determines that the guarded object has left the video surveillance area, it will send the first prompt information to the guarded object, such as a buzzer alarm that lasts for 5s.
本实施例提供的监控方法,对于本看护对象的视频监控要求较高的应用场景,如本看护对象为婴幼儿,或者是动物幼崽,或者是视频监控盲区较多的区域,或者是非视频监控区对于看护对象来说存在较高危险的区域,起到了及时提醒看护对象关注的作用。The monitoring method provided in this embodiment is suitable for application scenarios with high requirements for video monitoring of the object of care, such as the object of care is an infant, or an animal cub, or an area with many video surveillance blind spots, or non-video surveillance The area is a high-risk area for the care object, which plays a role in reminding the care object to pay attention in time.
图4为本申请第三实施例提供的监控方法流程示意图。如图4所示,该方法的具体步骤包括:FIG. 4 is a schematic flowchart of a monitoring method provided by a third embodiment of the present application. As shown in Figure 4, the specific steps of the method include:
S401、获取智能监控设备采集的监控数据,监控数据包括被看护对象的第一行为数据。S401. Acquire monitoring data collected by an intelligent monitoring device, where the monitoring data includes first behavior data of a guarded object.
S402、根据第一行为数据中的第一视频监控数据以及预设监控评估模型确定被看护对象未在视频监控区。S402. Determine, according to the first video surveillance data in the first behavior data and the preset surveillance evaluation model, that the object to be guarded is not in the video surveillance area.
步骤S401-S402的原理及名词解释与S301-S302类似,在此不再赘述The principles and terminology of steps S401-S402 are similar to those of S301-S302, and will not be repeated here.
S403、若根据第一行为数据中的第一位置监控数据以及预设监控评估模型确定被看护对象离开安全活动区,则确定被看护对象的状态信息为第二异常状态。S403. If it is determined according to the first position monitoring data in the first behavior data and the preset monitoring evaluation model that the guarded object has left the safe activity area, determine that the state information of the guarded object is the second abnormal state.
S404、生成提示看护对象的第二提示信息。S404. Generate second prompt information for prompting the care object.
具体的,第一位置监控数据可以为GPS定位数据,预设监控评估模型根据GPS定位数据判断被看护对象是否离开了安全活动区,如果离开了就执行步骤S403-S404,如果没有离开,则执行步骤S405-S406。Specifically, the first position monitoring data may be GPS positioning data, and the preset monitoring evaluation model determines whether the guarded object has left the safe activity area according to the GPS positioning data. Steps S405-S406.
需要说明的是第二提示信息用于提示看护对象,当前时刻被看护对象离开了安全活动区,存在不可预知安全风险,需要及时将被看护对象带回安全活动区。第二提示信息可以包括显示数据、声音、振动等。It should be noted that the second prompt information is used to remind the care object that the care object has left the safe activity area at the current moment, there is an unpredictable safety risk, and the care object needs to be brought back to the safe activity area in time. The second prompt information may include display data, sound, vibration, and the like.
S405、若根据第一行为数据中的第一位置监控数据以及预设监控评估模型确定被看护对象未离开安全活动区,则将所述状态信息确定为第三异常状态。S405. If it is determined according to the first position monitoring data in the first behavior data and the preset monitoring evaluation model that the guarded object has not left the safe activity area, determine the state information as a third abnormal state.
在本步骤中,预设监控评估模型通过第一位置监控数据如GPS定位数据,识别到被看护对象没有离开安全活动区,只是离开了视频监控区,则预设监控评估模型可以进一步通过红外线成像仪、热传感器等监控设备对肥视频监控区进行监测,寻找被看护对象所处的位置,并且还可以进一步监测被看护对象的生理数据是否出现了异常状态,若出现生理异常状态则立即进入下一步。In this step, the preset monitoring evaluation model recognizes through the first location monitoring data, such as GPS positioning data, that the person under care has not left the safe activity area, but just left the video monitoring area, then the preset monitoring evaluation model can further use infrared imaging Monitoring equipment such as instrument and thermal sensor monitor the fat video monitoring area to find the location of the person under care, and can further monitor whether the physiological data of the person under care is abnormal. If there is a physiological abnormal state, enter the next step.
S406、生成提示看护对象的第三提示信息。S406. Generate third prompt information for prompting the care object.
在本步骤中,第三提示信息用于提示看护对象关注非视频监控区内的被看护对象是否需要被照看。In this step, the third prompt information is used to prompt the care object to pay attention to whether the care object in the non-video surveillance area needs to be looked after.
需要说明的是,若被看护对象的生理状态没有出现异常,并且在预设时间阈值内回到了视频监控区,则可以不向看护对象发送提示信息,或者是再发送一条警报解除信息It should be noted that if the physiological state of the person under care is not abnormal, and returns to the video surveillance area within the preset time threshold, it is not necessary to send a reminder message to the care object, or send another alarm cancellation message.
本实施例提供的监控方法,通过第一位置监控数据进一步判定被看护对象的行为是否异常,从而将提示信息进行了分类分级,以减轻看护对象的工作量,自动识别出是否需要看护对象介入,采取进一步的看护行为。The monitoring method provided by this embodiment further determines whether the behavior of the object under care is abnormal through the first position monitoring data, so that the prompt information is classified and graded, so as to reduce the workload of the object under care, and automatically identify whether the intervention of the object under care is required. Take further caregiving actions.
图5为本申请第四实施例提供的监控方法流程示意图。如图5所示,该方法的具体步骤包括:FIG. 5 is a schematic flowchart of the monitoring method provided by the fourth embodiment of the present application. As shown in Figure 5, the specific steps of the method include:
S501、获取智能监控设备采集的监控数据。S501. Obtain monitoring data collected by an intelligent monitoring device.
在本步骤中,监控数据包括被看护对象的第一生理数据,所述第一生理数据包括第一穿戴式设备采集的第一生理特征数据以及所述安全活动区中的探测设备采集的环境特征数据。In this step, the monitoring data includes first physiological data of the object under care, and the first physiological data includes first physiological feature data collected by a first wearable device and environmental features collected by a detection device in the safe activity area data.
第一生理特征数据包括被看护对象的心率、体温、血压、血氧、呼吸频 率等生理特征指标。The first physiological characteristic data includes physiological characteristic indicators such as heart rate, body temperature, blood pressure, blood oxygen, respiratory rate and the like of the care object.
环境特征数据包括:安全活动区的温度场分布情况、湿度、含氧量、CO 2浓度等 Environmental characteristic data include: temperature field distribution, humidity, oxygen content, CO 2 concentration, etc.
在一种可能的设计中,监控数据还包括看护对象的第二生理数据,所述第二生理数据包括第二穿戴式设备采集的第二生理特征数据以及所述安全活动区中的探测设备采集的环境特征数据。In a possible design, the monitoring data further includes second physiological data of the care object, the second physiological data includes second physiological characteristic data collected by the second wearable device and collected by the detection device in the safe activity area environmental characteristics data.
第二生理特征数据包括看护对象的心率、体温、血压、血氧、呼吸频率等生理特征指标。The second physiological characteristic data includes physiological characteristic indicators such as heart rate, body temperature, blood pressure, blood oxygen, and respiratory rate of the care object.
S502、根据第一生理特征数据以及预设监控评估模型确定被看护对象满足第一预设待定异常条件。S502. Determine, according to the first physiological characteristic data and the preset monitoring evaluation model, that the object under care meets the first preset pending abnormal condition.
在本步骤中,监控中心服务器,自动根据被看护对象的第一生理特征数据,利用预设监控评估模型,来判定被看护对象的生理特征是否出现了疑似异常的情况即满足第一预设待定异常条件。例如:被看护对象的心率、血压、呼吸频率、体温的至少一项超过对应的预设阈值。In this step, the monitoring center server automatically uses a preset monitoring and evaluation model according to the first physiological characteristic data of the guarded object to determine whether the physiological characteristics of the guarded object are suspected to be abnormal, that is, the first preset pending Exceptional condition. For example, at least one of the heart rate, blood pressure, respiratory rate, and body temperature of the person under care exceeds the corresponding preset threshold.
S503、根据第二生理特征数据以及预设监控评估模型确定看护对象满足第二预设待定异常条件。S503. Determine, according to the second physiological characteristic data and the preset monitoring evaluation model, that the care object satisfies the second preset pending abnormal condition.
在本步骤中,监控中心服务器,自动根据看护对象的第二生理特征数据,利用预设监控评估模型,来判定看护对象的生理特征是否出现了疑似异常的情况即满足第二预设待定异常条件。例如:看护对象的心率、血压、呼吸频率、体温的至少一项超过对应的预设阈值。In this step, the monitoring center server, according to the second physiological characteristic data of the nursing object, uses a preset monitoring evaluation model to determine whether the physiological characteristics of the nursing object are suspected to be abnormal, that is, the second preset pending abnormal condition is satisfied. . For example, at least one of the heart rate, blood pressure, respiratory rate, and body temperature of the care object exceeds a corresponding preset threshold.
S504、根据环境特征数据以及预设监控评估模型确定被看护对象处于第四异常状态。S504. Determine that the object under care is in a fourth abnormal state according to the environmental characteristic data and the preset monitoring and evaluation model.
在本步骤中,由于被看护对象的生理特征的疑似异常情况可能是由于环境的改变而引起的,所以为了进一步确认被看护对象是否真的发生了生理异常,需要结合环境特征数据来进行确认。例如,被看护对象为老人,老人进入浴室洗澡,浴室的高温高湿度环境,会导致老人的心跳、呼吸频率、体温等指标的升高,这是有可能这些指标超出了阈值就会被监控中心服务器监测到,此时为了提高判断的准确度,监控中心服务器就会调取环境特征数据如浴室的温度分布、湿度、含氧量、二氧化碳浓度等来综合分析,如果确认老人在浴室中发生了昏迷等,那么就确认其处于第四异常状态。In this step, since the suspected abnormal situation of the physiological characteristics of the object under care may be caused by changes in the environment, in order to further confirm whether the object under care really has a physiological abnormality, it is necessary to combine the environmental characteristic data for confirmation. For example, if the person being cared for is an elderly person, the elderly person enters the bathroom to take a bath, and the high temperature and high humidity environment in the bathroom will lead to an increase in the elderly's heartbeat, respiratory rate, body temperature and other indicators. It is possible that these indicators exceed the threshold and will be monitored by the monitoring center. The server monitors that, in order to improve the accuracy of the judgment, the monitoring center server will retrieve the environmental characteristic data such as the temperature distribution, humidity, oxygen content, carbon dioxide concentration, etc. of the bathroom for comprehensive analysis. Coma, etc., then confirm that it is in the fourth abnormal state.
S505、根据环境特征数据以及预设监控评估模型确定看护对象处于第五 异常状态。S505. Determine that the nursing object is in the fifth abnormal state according to the environmental characteristic data and the preset monitoring and evaluation model.
在本步骤中,由于看护对象的生理特征的疑似异常情况也可能是由于环境的改变而引起的,所以为了进一步确认看护对象是否真的发生了生理异常,需要结合环境特征数据来进行确认。例如:监控中心服务器监测到看护对象的体温升高超过了预设阈值,此时结合看护对象正处于厨房环境中,通过厨房环境的温度分布情况,发现看护对象正在烹饪食物,则其体温升高可能是由于烹饪食物产生的误报。再例如:看护对象处于客厅当中,但客厅环境温度正常,而看护对象的体温却超出了预设阈值,则监控中心服务器就可以再调用看护对象的历史定位数据,确认其是否到过传染病区,接触过传染病感染者,而导致出现了发烧的感染症状,若是则通知监管对象如社区居委、医院、防疫部门、警察局等,提示监管对象对看护对象采取救治或隔离措施。In this step, since the suspected abnormal situation of the physiological characteristics of the nursing object may also be caused by the change of the environment, in order to further confirm whether the physiological abnormality of the nursing object really occurs, it is necessary to combine the environmental feature data for confirmation. For example: the monitoring center server detects that the body temperature of the care object has risen above a preset threshold. At this time, combined with the fact that the care object is in the kitchen environment, through the temperature distribution of the kitchen environment, it is found that the care object is cooking food, then its body temperature rises Probably due to false positives from cooking food. Another example: if the care object is in the living room, but the ambient temperature in the living room is normal, but the body temperature of the care object exceeds the preset threshold, the monitoring center server can then call the historical positioning data of the care object to confirm whether it has been to the infectious disease area. If you have been in contact with someone infected with an infectious disease and have symptoms of fever, notify the supervised objects such as community neighborhood committees, hospitals, epidemic prevention departments, police stations, etc., and prompt the supervised objects to take treatment or isolation measures for the care objects.
S506、生成提示看护对象和/或监管对象的第四提示信息。S506. Generate fourth prompt information for prompting the care object and/or the supervision object.
在本步骤中,在确定被看护对象生理发生异常后,生成提示看护对象和/或监管对象的第四提示信息,以及时对被看护对象进行救助。In this step, after it is determined that the object under care is physiologically abnormal, fourth prompt information is generated to prompt the object under care and/or the object under supervision, so as to timely rescue the object under care.
S507、生成用于提示监管对象的第五提示信息。S507. Generate fifth prompt information for prompting the supervision object.
在本步骤中,在确定护对象生理发生异常后,生成提示监管对象的第五提示信息,以对看护对象进行救助。In this step, after it is determined that the nursing object is abnormal in physiology, fifth prompt information for prompting the supervision object is generated, so as to rescue the nursing object.
本实施例给出了当被看护对象或看护对象出现生理疾病时,监控中心服务器可以自动发现被看护对象或看护对象的生理异常,并上报给看护对象以及雇主、社区居委、警察局、医院等监管对象,以实现及时对被看护对象或看护对象进行救助。This embodiment shows that when the person under care or the person under care has a physiological disease, the monitoring center server can automatically discover the physiological abnormality of the object under care or the person under care, and report it to the object under care, the employer, the community neighborhood committee, the police station, and the hospital. and other supervision objects, so as to realize timely rescue of the care recipients or care objects.
图6为本申请第五实施例提供的监控方法流程示意图。如图6所示,该方法的具体步骤包括:FIG. 6 is a schematic flowchart of a monitoring method provided by a fifth embodiment of the present application. As shown in Figure 6, the specific steps of the method include:
S601、获取智能监控设备采集的监控数据。S601. Obtain monitoring data collected by an intelligent monitoring device.
在本步骤中,所述监控数据包括:被看护对象的第一生理数据与第一行为数据、看护对象的第二生理数据与第二行为数据。In this step, the monitoring data includes: the first physiological data and the first behavior data of the care object, and the second physiological data and the second behavior data of the care object.
第一生理数据或第二生理数据包括:心率、体温、血压、血氧、呼吸频率等生理特征数据,以及对应的环境特征数据如温度分布情况,湿度、氧气浓度、二氧化碳浓度等。The first physiological data or the second physiological data include: heart rate, body temperature, blood pressure, blood oxygen, respiratory rate and other physiological characteristic data, and corresponding environmental characteristic data such as temperature distribution, humidity, oxygen concentration, carbon dioxide concentration, etc.
第一行为数据或第二行为数据包括:定位位置信息,动作特征、表情特征、声音特征等。The first behavior data or the second behavior data includes: positioning position information, action features, expression features, voice features, and the like.
S602、根据第一生理特征数据以及预设监控评估模型确定被看护对象满足第一预设待定异常条件。S602. Determine, according to the first physiological characteristic data and the preset monitoring and evaluation model, that the object under care satisfies the first preset pending abnormal condition.
S603、根据环境特征数据以及预设监控评估模型确定被看护对象处于第四异常状态。S603. Determine, according to the environmental characteristic data and the preset monitoring and evaluation model, that the object under care is in a fourth abnormal state.
步骤S602-S603的实现原理与步骤S502、S504类似,在此不再赘述。The implementation principles of steps S602-S603 are similar to those of steps S502 and S504, and are not repeated here.
S604、根据第一行为数据、第二行为数据以及预设监控评估模型确定看护对象与被看护对象的距离。S604. Determine the distance between the care object and the care object according to the first behavior data, the second behavior data, and the preset monitoring and evaluation model.
在本步骤中,在确定被看护对象的生理状态发生异常后即处于第四异常状态后,向根据第一行为数据中的被看护对象的定位位置信息,以及第二行为数据中的,看护对象的定位位置信息来计算两者的距离,以帮助确认看护对象是否在被看护对象附近,以及看护对象能够发现被看护对象的生理异常。In this step, after it is determined that the physiological state of the object under care is abnormal, that is, it is in the fourth abnormal state, according to the positioning position information of the object under care in the first behavior data and the object of care in the second behavior data The distance between the two is calculated based on the positioning and position information, so as to help confirm whether the nursing object is near the nursing object, and the nursing object can find the physiological abnormality of the nursing object.
若看护对象在被看护对象附件,则执行S605,否则执行S612-S613。If the care object is attached to the care object, execute S605; otherwise, execute S612-S613.
S605、若距离小于预设距离,利用预设监控评估模型以及第二行为数据,确定看护对象的行为特征。S605. If the distance is less than the preset distance, use the preset monitoring evaluation model and the second behavior data to determine the behavior characteristics of the care object.
在本步骤中,若确定看护对象在被看护对象的5米范围内,则可以通过摄像头采集到的看护对象的动作,表情等行为特征是否为要去查看被看护对象的异常情况,或者是正在安抚或照顾被看护对象。In this step, if it is determined that the care object is within 5 meters of the care object, whether the behavior characteristics such as the actions and expressions of the care object collected by the camera are to check the abnormal situation of the care object, or whether the care object is being monitored. Comfort or care for the person being cared for.
S606、监测被看护对象处于第四异常状态的持续时间。S606. Monitor the duration that the object under care is in the fourth abnormal state.
在本步骤中,监控中心服务器在确认被看护对象处于生理异常状态即第四异常状态时,就开始计时,即检测第四异常状态的持续时间。In this step, the monitoring center server starts timing when it confirms that the guarded object is in a physiological abnormal state, that is, a fourth abnormal state, that is, detects the duration of the fourth abnormal state.
需要说明的是,本步骤与S604-S605没有顺序要求,可以同时进行。It should be noted that this step and S604-S605 have no sequence requirement, and can be performed simultaneously.
S607、若持续时间大于第一预设时间阈值,则根据看护对象的动作特征以及预设监控评估模型判断看护对象是否对被看护对象施行所述虐待行为。S607. If the duration is greater than the first preset time threshold, determine whether the nursing object performs the abusive behavior on the object under care according to the action characteristics of the nursing object and the preset monitoring and evaluation model.
在本步骤中,被看护对象的第四异常状态的持续时间大于第一预设时间阈值如2分钟,并且看护对象就在被看护对象附近即两者的距离小于预设距离,此时若预设监控评估模型通过看护对象的动作特征识别出,看护对象一直没有对被看护对象采取任何安抚或救助行动,则可以判定看护对象对被看护对象置之不理,属于一种虐待行为即忽略的虐待,则执行步骤S608;或者是预设监控评估模型通过看护对象的动作特征识别出,看护对象正在对被看护对象进行殴打、摔打等虐待行为,则执行步骤S608。若从 动作无法分辨是否存在虐待行为,则执行步骤S609。In this step, the duration of the fourth abnormal state of the object under care is greater than the first preset time threshold, such as 2 minutes, and the object under care is near the object under care, that is, the distance between the two is less than the preset distance. Assuming that the monitoring and evaluation model recognizes through the action characteristics of the care object, the care object has not taken any comfort or rescue action to the care object, and it can be determined that the care object ignores the care object, which is a kind of abuse, that is, neglected abuse. Step S608 is performed; or if the preset monitoring and evaluation model recognizes through the action features of the care object that the care object is beating or beating the care object, then step S608 is performed. If it is impossible to distinguish whether there is abusive behavior from the action, step S609 is executed.
S608、向监管对象发送第六提示信息。S608. Send sixth prompt information to the supervision object.
在本步骤中,对于看护对象的虐待行为,监控中心服务器自动采集虐待行为的证据数据,并向监管对象如被看护对象的家属、社区居委、警察局、福利院监管机构等发送提示信息,以及时制止看护对象的虐待行为。In this step, for the abuse of the care object, the monitoring center server automatically collects the evidence data of the abuse, and sends a reminder message to the supervision object, such as the family member of the care object, the community neighborhood committee, the police station, the supervision institution of the welfare institution, etc. Promptly stop the abuse of care recipients.
S609、根据表情特征和/或声音特征以及预设监控评估模型,判断看护对象是否对被看护对象施行虐待行为。S609 , according to the facial expression feature and/or the sound feature and the preset monitoring evaluation model, determine whether the care object abuses the care object.
在本步骤中,监控中心服务器在通过动作无法分辨施虐行为的时候,进一步利用预设监控评估模型通过表情特征和/或声音特征来进行虐待行为的判定,例如虐待行为是辱骂、言语侮辱、吐口水等行为,就可以通过表情和/或声音来辅助判断。若确定看护对象存在虐待行为则执行S611,若仍无法判定,则执行步骤S610。In this step, when the abusive behavior cannot be distinguished through actions, the monitoring center server further uses the preset monitoring and evaluation model to determine the abusive behavior through facial expressions and/or voice characteristics, for example, whether the abusive behavior is abusive, verbal insult, Behaviors such as spitting can be aided by facial expressions and/or sounds. If it is determined that the object of care has abusive behavior, execute S611, and if it is still unable to determine, execute step S610.
S610、判断持续时间是否大于第二预设时间阈值。S610. Determine whether the duration is greater than a second preset time threshold.
在本步骤中,通过S607、S609仍无法确定看护对象的行为是虐待行为,但是被看护对象的生理异常情况的持续时间大于第二预设时间,如10分钟时,可以确定看护对象采取的行为不能对应满足被看护对象的救助需求,此时直接执行S611。In this step, through S607 and S609, it is still impossible to determine that the behavior of the nursing object is abusive behavior, but the duration of the physiological abnormality of the nursing object is greater than the second preset time, such as 10 minutes, the behavior of the nursing object can be determined. If the rescue needs of the person under care cannot be met, S611 is directly executed in this case.
S611、向监管对象发送第七提示信息。S611. Send seventh prompt information to the supervision object.
在本步骤中,在确认看护对象的行为存在虐待或者是看护不当的时候,控制中心服务器就向监管对象如被看护对象家属、社区居委、警察局、福利院监管机构、动物保护组织等发送提示信息,以保障被看护对象得到及时的救助。In this step, when it is confirmed that the behavior of the care object is abuse or improper care, the control center server will send a message to the supervision object, such as the family member of the care object, the community neighborhood committee, the police station, the supervision institution of the welfare institution, the animal protection organization, etc. Prompt information to ensure that the person under care receives timely assistance.
还需要说明的是,在判定看护对象存在虐待行为时,还可以给看护对象的穿戴式监控设备如手表发送警告提示信息,提醒看护对象停止虐待行为。It should also be noted that when it is determined that the care object has abused behavior, a warning prompt message may also be sent to the care object's wearable monitoring device, such as a watch, to remind the care object to stop the abusive behavior.
S612、若距离大于或等于预设距离,则确定持续时间大于第三预设时间阈值。S612. If the distance is greater than or equal to the preset distance, determine that the duration is greater than a third preset time threshold.
在本步骤中,若看护对象与被看护对象的距离大于或等于预设距离如10m,则先向看护对象的穿戴式设备发送提示信息,然后要判断被看护对象的生理异常状态的持续时间是否大于第三预设时间阈值如4分钟,若是则判定看护对象存在对被看护对象的“忽视”虐待行为,执行S613。In this step, if the distance between the care object and the care object is greater than or equal to a preset distance such as 10m, a prompt message is first sent to the care object's wearable device, and then it is determined whether the physiological abnormal state of the care object lasts for a period of time. If the value is greater than the third preset time threshold, such as 4 minutes, if it is, it is determined that the care object has "neglected" abusive behavior toward the care object, and S613 is executed.
S613、向监管对象发送第八提示信息。S613. Send eighth prompt information to the supervision object.
在本步骤中,第八提示信息用于提示监管对象,看护对象存在对被看护对象的“忽视”虐待行为。In this step, the eighth prompt information is used to prompt the supervision object that the care object has "neglected" abusive behavior to the care object.
还需要说明的是,监控设备实时记录的数据,都会上传到监控中心的数据库中,可以作为看护对象的虐待行为或评价看护对象工作是否到位或好坏的证据材料,可选的,当监管对象进入到视频监控区时,也可以记录监管对象的行为。It should also be noted that the data recorded in real time by the monitoring equipment will be uploaded to the database of the monitoring center, which can be used as evidence materials for the abuse of the care object or to evaluate whether the care object is working properly or whether it is good or bad. When entering the video surveillance area, the behavior of the supervised object can also be recorded.
本实施例提供的监控方法,通过利用预设监控评估模型,根据监控数据,评估被看护对象存在生理异常情况时,被看护对象是否得到看护对象的合理照看,以及确定看护对象没有对被看护对象施行虐待行为,若检测到看护行为不合理或者存在虐待行为则通知监管对象及时采取救助措施。实现了自动监控及评判看护对象的工作行为,避免看护对象存在生理疾病时无法得到及时救助,或是被看护对象被虐待时无法及时发现和制止并留存证据的问题,提高了被看护对象和看护对象的安全监管效果。The monitoring method provided by this embodiment, by using a preset monitoring evaluation model and according to monitoring data, evaluates whether the monitored object is properly cared for by the nursing object when the object under care has a physiological abnormality, and determines whether the object under care does not care about the object under care. Carry out abusive behavior, and if it is detected that the nursing behavior is unreasonable or there is abusive behavior, the supervision object will be notified to take timely rescue measures. It realizes the automatic monitoring and judgment of the work behavior of the care recipients, and avoids the problem that the care objects cannot receive timely assistance when they have physical diseases, or that the care objects cannot be detected and stopped in time and retain evidence when they are abused. The effect of security supervision on the object.
图7为本申请实施例提供的一种监控装置的结构示意图。该监控装置可以通过软件、硬件或者两者的结合实现。如图7所示,本实施例监控装置700,包括:FIG. 7 is a schematic structural diagram of a monitoring device according to an embodiment of the present application. The monitoring device can be implemented by software, hardware or a combination of the two. As shown in FIG. 7 , the monitoring device 700 in this embodiment includes:
获取模块701,用于获取智能监控设备采集的监控数据,所述监控数据包括待监测对象的行为数据和生理数据,所述待监测对象包括:看护对象以及被看护对象;The acquisition module 701 is configured to acquire monitoring data collected by an intelligent monitoring device, the monitoring data includes behavior data and physiological data of an object to be monitored, and the object to be monitored includes: a nursing object and a nursing object;
处理模块702,用于根据所述监控数据以及预设监控评估模型确定所述待监测对象的状态信息;a processing module 702, configured to determine the state information of the object to be monitored according to the monitoring data and a preset monitoring evaluation model;
所述处理模块702,还用于根据所述状态信息生成监控指令,所述监控指令用于向所述看护对象和/或监管对象发送提示信息。The processing module 702 is further configured to generate a monitoring instruction according to the state information, where the monitoring instruction is used to send prompt information to the care object and/or the supervision object.
在一种可能的设计中,所述监控数据包括所述被看护对象的第一行为数据,对应的,所述处理模块702,用于根据所述监控数据以及预设监控评估模型确定所述待监测对象的状态信息,包括:In a possible design, the monitoring data includes first behavior data of the object to be cared for, and correspondingly, the processing module 702 is configured to determine the to-be-to-be based on the monitoring data and a preset monitoring evaluation model. Status information of monitored objects, including:
所述处理模块702,用于根据所述第一行为数据中的第一视频监控数据以及所述预设监控评估模型确定所述被看护对象未在视频监控区,所述第一视频监控数据为所述被看护对象的视频监控数据,所述状态信息为第一异常状态;The processing module 702 is configured to determine, according to the first video surveillance data in the first behavior data and the preset surveillance evaluation model, that the guarded object is not in the video surveillance area, and the first video surveillance data is: The video surveillance data of the object under care, the state information is the first abnormal state;
对应的,所述处理模块702,还用于根据所述状态信息生成监控指令,包括:Correspondingly, the processing module 702 is further configured to generate a monitoring instruction according to the status information, including:
所述处理模块702,还用于根据所述第一异常状态生成用于提示所述看护对象的第一提示信息。The processing module 702 is further configured to generate first prompt information for prompting the care object according to the first abnormal state.
在一种可能的设计中,在所述处理模块702,用于根据所述第一行为数据中的第一视频监控数据以及所述预设监控评估模型确定所述被看护对象未在视频监控区之后,还包括:In a possible design, the processing module 702 is configured to determine, according to the first video surveillance data in the first behavior data and the preset surveillance evaluation model, that the guarded object is not in the video surveillance area After that, also include:
所述处理模块702,还用于若根据所述第一行为数据中的第一位置监控数据以及所述预设监控评估模型确定所述被看护对象离开安全活动区,所述第一位置监控数据为所述被看护对象的位置监控数据,所述安全活动区包括所述视频监控区以及非视频监控区,则将所述状态信息确定为第二异常状态,所述监控指令用于生成提示所述看护对象的第二提示信息;The processing module 702 is further configured to: if it is determined according to the first position monitoring data in the first behavior data and the preset monitoring evaluation model that the guarded object leaves the safe activity area, the first position monitoring data is the position monitoring data of the guarded object, the safe activity area includes the video monitoring area and the non-video monitoring area, then the state information is determined as the second abnormal state, and the monitoring instruction is used to generate a prompt Describe the second prompt information of the care object;
所述处理模块702,还用于若根据所述第一行为数据中的所述第一位置监控数据以及所述预设监控评估模型确定所述被看护对象未离开所述安全活动区,则将所述状态信息确定为第三异常状态,所述监控指令用于生成提示所述看护对象的第三提示信息。The processing module 702 is further configured to: if it is determined according to the first position monitoring data in the first behavior data and the preset monitoring evaluation model that the guarded object has not left the safe activity area, then The state information is determined to be a third abnormal state, and the monitoring instruction is used to generate third prompt information for prompting the care object.
在一种可能的设计中,所述监控数据包括所述被看护对象的第一生理数据,所述第一生理数据包括第一穿戴式设备采集的第一生理特征数据以及所述安全活动区中的红外线探测设备采集的环境特征数据;In a possible design, the monitoring data includes first physiological data of the monitored object, and the first physiological data includes first physiological characteristic data collected by a first wearable device and information in the safe activity zone. Environmental characteristic data collected by infrared detection equipment;
对应的,所述处理模块702,还用于根据所述监控数据以及预设监控评估模型确定所述待监测对象的状态信息,还包括:Correspondingly, the processing module 702 is further configured to determine the state information of the object to be monitored according to the monitoring data and a preset monitoring evaluation model, further comprising:
所述处理模块,还用于若根据所述第一生理特征数据以及所述预设监控评估模型确定所述被看护对象满足第一预设待定异常条件,则根据所述环境特征数据以及所述预设监控评估模型确定所述被看护对象处于第四异常状态;The processing module is further configured to, if it is determined according to the first physiological feature data and the preset monitoring and evaluation model that the object under care meets a first preset pending abnormal condition, then according to the environmental feature data and the The preset monitoring and evaluation model determines that the object under care is in the fourth abnormal state;
所述处理模块702,还用于根据所述状态信息生成监控指令,包括:The processing module 702 is further configured to generate a monitoring instruction according to the state information, including:
所述处理模块702,还用于根据所述第四异常状态生成用于提示所述看护对象和/或所述监管对象的第四提示信息。The processing module 702 is further configured to generate fourth prompt information for prompting the care object and/or the supervision object according to the fourth abnormal state.
可选的,所述监控数据还包括看护对象第二生理数据,所述第二生理数据包括第二穿戴式设备采集的第二生理特征数据以及所述安全活动区中的红外线探测设备采集的环境特征数据;Optionally, the monitoring data further includes second physiological data of the care object, and the second physiological data includes second physiological characteristic data collected by the second wearable device and environment collected by the infrared detection device in the safe activity area. characteristic data;
对应的,所述处理模块702,还用于根据所述监控数据以及预设监控评估 模型确定所述待监测对象的状态信息,还包括:Correspondingly, the processing module 702 is also used to determine the state information of the object to be monitored according to the monitoring data and a preset monitoring evaluation model, and also includes:
所述处理模块702,还用于若根据所述第二生理特征数据以及所述预设监控评估模型确定所述看护对象满足第二预设待定异常条件,则根据所述环境特征数据以及所述预设监控评估模型确定所述看护对象处于第五异常状态;The processing module 702 is further configured to, if it is determined according to the second physiological characteristic data and the preset monitoring evaluation model that the care object satisfies a second preset pending abnormal condition, then according to the environmental characteristic data and the The preset monitoring and evaluation model determines that the care object is in the fifth abnormal state;
所述处理模块702,还用于根据所述状态信息生成监控指令,包括:The processing module 702 is further configured to generate a monitoring instruction according to the state information, including:
所述处理模块702,还用于根据所述第五异常状态生成用于提示监管对象的第五提示信息。The processing module 702 is further configured to generate fifth prompt information for prompting the supervised object according to the fifth abnormal state.
在一种可能的设计中,所述监控数据包括所述看护对象的第二行为数据,对应的,在所述处理模块702,还用于根据所述环境特征数据以及所述预设监控评估模型确定所述被看护对象处于第四异常状态之后,还包括:In a possible design, the monitoring data includes second behavior data of the care object, and correspondingly, in the processing module 702, it is further configured to monitor and evaluate the model according to the environmental feature data and the preset monitoring and evaluation model. After determining that the object under care is in the fourth abnormal state, the method further includes:
所述处理模块702,还用于根据所述第一行为数据、所述第二行为数据以及所述预设监控评估模型确定所述看护对象与所述被看护对象的距离;The processing module 702 is further configured to determine the distance between the object of care and the object of care according to the first behavior data, the second behavior data and the preset monitoring evaluation model;
所述处理模块702,还用于若所述距离小于所述预设距离,利用所述预设监控评估模型以及所述第二行为数据,确定所述看护对象的行为特征;The processing module 702 is further configured to, if the distance is less than the preset distance, use the preset monitoring evaluation model and the second behavior data to determine the behavior characteristics of the care object;
所述处理模块702,还用于监测所述被看护对象处于所述第四异常状态的持续时间;The processing module 702 is further configured to monitor the duration that the object under care is in the fourth abnormal state;
所述处理模块702,还用于若所述持续时间大于预设时间阈值,则确定所述被看护对象处于被虐待状态。The processing module 702 is further configured to determine that the object under care is in a state of being abused if the duration is greater than a preset time threshold.
在一种可能的设计中,所述第二行为数据包括:动作特征、表情特征以及声音特征,所述处理模块702,还用于确定所述被看护对象处于被虐待状态,包括:In a possible design, the second behavior data includes action features, facial expression features, and voice features, and the processing module 702 is further configured to determine that the object under care is in a state of being abused, including:
所述处理模块702,还用于若根据所述动作特征以及所述预设监控评估模型判断所述看护对象是否对所述被看护对象施行所述虐待行为,若判断结果为是,则向所述监管对象发送所述第六提示信息;The processing module 702 is further configured to judge whether the object of care has performed the abusive behavior on the object of care according to the action feature and the preset monitoring and evaluation model, and if the judgment result is yes, send the sending the sixth prompt message by the supervision object;
所述处理模块702,还用于若判断结果为否,则根据所述表情特征和/或所述声音特征以及所述预设监控评估模型,判断所述看护对象是否对所述被看护对象施行所述虐待行为,若判断结果为是,则向所述监管对象发送所述第七提示信息;The processing module 702 is further configured to, if the judgment result is no, according to the facial expression feature and/or the sound feature and the preset monitoring and evaluation model, to judge whether the care object performs the treatment on the care object. For the abuse, if the judgment result is yes, send the seventh prompt message to the supervision object;
所述处理模块702,还用于若判断结果为否,则当所述持续时间大于所述预设时间阈值时,向所述监管对象发送所述第七提示信息。The processing module 702 is further configured to send the seventh prompt information to the supervision object when the duration is greater than the preset time threshold if the determination result is no.
值得说明的是,图7所示实施例提供的监控装置,可以执行上述任一方 法实施例所提供的一种监控方法,其具体实现原理、技术特征、专业名词解释以及技术效果类似,在此不再赘述。It is worth noting that the monitoring device provided by the embodiment shown in FIG. 7 can execute a monitoring method provided by any of the above method embodiments, and its specific implementation principles, technical features, explanations of technical terms, and technical effects are similar. No longer.
图8为本申请提供的一种电子设备的结构示意图。如图8所示,该电子设备800可以包括:至少一个处理器801和存储器802。图8示出的是以一个处理器为例的电子设备。FIG. 8 is a schematic structural diagram of an electronic device provided by the present application. As shown in FIG. 8 , the electronic device 800 may include: at least one processor 801 and a memory 802 . FIG. 8 shows an electronic device with a processor as an example.
存储器802,用于存放程序。具体地,程序可以包括程序代码,程序代码包括计算机操作指令。The memory 802 is used to store programs. Specifically, the program may include program code, and the program code includes computer operation instructions.
存储器802可能包含高速RAM存储器,也可能还包括非易失性存储器(non-volatile memory),例如至少一个磁盘存储器。 Memory 802 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk memory.
处理器801用于执行存储器802存储的计算机执行指令,以实现以上各方法实施例所述的方法。The processor 801 is configured to execute the computer-executed instructions stored in the memory 802 to implement the methods described in the above method embodiments.
其中,处理器801可能是一个中央处理器(central processing unit,简称为CPU),或者是特定集成电路(application specific integrated circuit,简称为ASIC),或者是被配置成实施本申请实施例的一个或多个集成电路。Wherein, the processor 801 may be a central processing unit (central processing unit, referred to as CPU), or a specific integrated circuit (application specific integrated circuit, referred to as ASIC), or is configured to implement one or more of the embodiments of the present application. multiple integrated circuits.
可选地,存储器802既可以是独立的,也可以跟处理器501集成在一起。当所述存储器802是独立于处理器801之外的器件时,所述电子设备800,还可以包括:Optionally, the memory 802 may be independent or integrated with the processor 501 . When the memory 802 is a device independent of the processor 801, the electronic device 800 may further include:
总线803,用于连接所述处理器801以及所述存储器802。总线可以是工业标准体系结构(industry standard architecture,简称为ISA)总线、外部设备互连(peripheral component,PCI)总线或扩展工业标准体系结构(extended industry standard architecture,EISA)总线等。总线可以分为地址总线、数据总线、控制总线等,但并不表示仅有一根总线或一种类型的总线。The bus 803 is used to connect the processor 801 and the memory 802 . The bus may be an industry standard architecture (abbreviated as ISA) bus, a peripheral component (PCI) bus, or an extended industry standard architecture (EISA) bus or the like. Buses can be divided into address bus, data bus, control bus, etc., but it does not mean that there is only one bus or one type of bus.
可选的,在具体实现上,如果存储器802和处理器801集成在一块芯片上实现,则存储器802和处理器801可以通过内部接口完成通信。Optionally, in terms of specific implementation, if the memory 802 and the processor 801 are integrated on one chip, the memory 802 and the processor 801 can communicate through an internal interface.
本申请还提供了一种计算机可读存储介质,该计算机可读存储介质可以包括:U盘、移动硬盘、只读存储器(read-only memory,ROM)、随机存取存储器(random access memory,RAM)、磁盘或者光盘等各种可以存储程序代码的介质,具体的,该计算机可读存储介质中存储有程序指令,程序指令用于上述各实施例中的方法。The present application also provides a computer-readable storage medium, the computer-readable storage medium may include: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM) ), a magnetic disk or an optical disk and other media that can store program codes. Specifically, the computer-readable storage medium stores program instructions, and the program instructions are used for the methods in the above embodiments.
本领域技术人员在考虑说明书及实践这里公开的发明后,将容易想到本申请的其它实施方案。本申请旨在涵盖本申请的任何变型、用途或者适应性 变化,这些变型、用途或者适应性变化遵循本申请的一般性原理并包括本申请未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本申请的真正范围和精神由下面的权利要求书指出。Other embodiments of the present application will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of this application that follow the general principles of this application and include common knowledge or conventional techniques in the technical field not disclosed in this application . The specification and examples are to be regarded as exemplary only, with the true scope and spirit of the application being indicated by the following claims.
应当理解的是,本申请并不局限于上面已经描述并在附图中示出的精确结构,并且可以在不脱离其范围进行各种修改和改变。本申请的范围仅由所附的权利要求书来限制。It is to be understood that the present application is not limited to the precise structures described above and illustrated in the accompanying drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the application is limited only by the appended claims.

Claims (10)

  1. 一种监控方法,其特征在于,包括:A monitoring method, comprising:
    获取智能监控设备采集的监控数据,所述监控数据包括待监测对象的行为数据和生理数据,所述待监测对象包括:看护对象以及被看护对象;acquiring monitoring data collected by an intelligent monitoring device, the monitoring data includes behavior data and physiological data of an object to be monitored, and the object to be monitored includes: a nursing object and a nursing object;
    根据所述监控数据以及预设监控评估模型确定所述待监测对象的状态信息;Determine the state information of the object to be monitored according to the monitoring data and a preset monitoring evaluation model;
    根据所述状态信息生成监控指令,所述监控指令用于向所述看护对象和/或监管对象发送提示信息。A monitoring instruction is generated according to the state information, and the monitoring instruction is used to send prompt information to the care object and/or the supervision object.
  2. 根据权利要求1所述的监控方法,其特征在于,所述监控数据包括所述被看护对象的第一行为数据,对应的,所述根据所述监控数据以及预设监控评估模型确定所述待监测对象的状态信息,包括:The monitoring method according to claim 1, wherein the monitoring data includes first behavior data of the object under care, and correspondingly, the monitoring data and a preset monitoring evaluation model are determined to determine the Status information of monitored objects, including:
    根据所述第一行为数据中的第一视频监控数据以及所述预设监控评估模型确定所述被看护对象未在视频监控区,所述第一视频监控数据为所述被看护对象的视频监控数据,所述状态信息为第一异常状态;It is determined according to the first video surveillance data in the first behavior data and the preset surveillance evaluation model that the object under care is not in the video surveillance area, and the first video surveillance data is the video surveillance of the object under care data, the state information is the first abnormal state;
    对应的,所述根据所述状态信息生成监控指令,包括:Correspondingly, the generating a monitoring instruction according to the state information includes:
    根据所述第一异常状态生成用于提示所述看护对象的第一提示信息。Generate first prompt information for prompting the care object according to the first abnormal state.
  3. 根据权利要求2所述的监控方法,其特征在于,在根据所述第一行为数据中的第一视频监控数据以及所述预设监控评估模型确定所述被看护对象未在视频监控区之后,还包括:The monitoring method according to claim 2, characterized in that, after determining that the guarded object is not in the video monitoring area according to the first video monitoring data in the first behavior data and the preset monitoring evaluation model, Also includes:
    若根据所述第一行为数据中的第一位置监控数据以及所述预设监控评估模型确定所述被看护对象离开安全活动区,所述第一位置监控数据为所述被看护对象的位置监控数据,所述安全活动区包括所述视频监控区以及非视频监控区,则将所述状态信息确定为第二异常状态,所述监控指令用于生成提示所述看护对象的第二提示信息;If it is determined according to the first position monitoring data in the first behavior data and the preset monitoring evaluation model that the guarded object leaves the safe activity area, the first position monitoring data is the position monitoring of the guarded object data, the safety activity area includes the video surveillance area and the non-video surveillance area, then the state information is determined to be a second abnormal state, and the monitoring instruction is used to generate second prompt information to prompt the care object;
    若根据所述第一行为数据中的所述第一位置监控数据以及所述预设监控评估模型确定所述被看护对象未离开所述安全活动区,则将所述状态信息确定为第三异常状态,所述监控指令用于生成提示所述看护对象的第三提示信息。If it is determined according to the first position monitoring data in the first behavior data and the preset monitoring evaluation model that the guarded object has not left the safe activity area, the state information is determined as a third abnormality state, the monitoring instruction is used to generate third prompt information for prompting the care object.
  4. 根据权利要求3所述的监控方法,其特征在于,所述监控数据包括所述被看护对象的第一生理数据,所述第一生理数据包括第一穿戴式设备采集 的第一生理特征数据以及所述安全活动区中的探测设备采集的环境特征数据;The monitoring method according to claim 3, wherein the monitoring data includes first physiological data of the object under care, the first physiological data includes first physiological characteristic data collected by a first wearable device, and Environmental characteristic data collected by the detection equipment in the safe activity area;
    对应的,所述根据所述监控数据以及预设监控评估模型确定所述待监测对象的状态信息,还包括:Correspondingly, the determining the state information of the object to be monitored according to the monitoring data and the preset monitoring evaluation model further includes:
    若根据所述第一生理特征数据以及所述预设监控评估模型确定所述被看护对象满足第一预设待定异常条件,则根据所述环境特征数据以及所述预设监控评估模型确定所述被看护对象处于第四异常状态;If it is determined according to the first physiological feature data and the preset monitoring and evaluation model that the object under care meets a first preset pending abnormal condition, then the object is determined according to the environmental feature data and the preset monitoring and evaluation model. The person under care is in the fourth abnormal state;
    所述根据所述状态信息生成监控指令,包括:The generating a monitoring instruction according to the state information includes:
    根据所述第四异常状态生成用于提示所述看护对象和/或监管对象的第四提示信息。Fourth prompt information for prompting the care object and/or the supervision object is generated according to the fourth abnormal state.
  5. 根据权利要求2-4中任意一项所述的监控方法,其特征在于,所述监控数据还包括看护对象第二生理数据,所述第二生理数据包括第二穿戴式设备采集的第二生理特征数据以及所述安全活动区中的探测设备采集的环境特征数据;The monitoring method according to any one of claims 2-4, wherein the monitoring data further includes second physiological data of the care object, and the second physiological data includes second physiological data collected by a second wearable device characteristic data and environmental characteristic data collected by the detection equipment in the safe activity area;
    对应的,所述根据所述监控数据以及预设监控评估模型确定所述待监测对象的状态信息,还包括:Correspondingly, the determining the state information of the object to be monitored according to the monitoring data and the preset monitoring evaluation model further includes:
    若根据所述第二生理特征数据以及所述预设监控评估模型确定所述看护对象满足第二预设待定异常条件,则根据所述环境特征数据以及所述预设监控评估模型确定所述看护对象处于第五异常状态;If it is determined according to the second physiological feature data and the preset monitoring evaluation model that the nursing object meets a second preset pending abnormal condition, then the nursing object is determined according to the environmental feature data and the preset monitoring evaluation model The subject is in the fifth abnormal state;
    所述根据所述状态信息生成监控指令,包括:The generating a monitoring instruction according to the state information includes:
    根据所述第五异常状态生成用于提示所述监管对象的第五提示信息。Fifth prompt information for prompting the supervision object is generated according to the fifth abnormal state.
  6. 根据权利要求4所述的监控方法,其特征在于,所述监控数据包括所述看护对象的第二行为数据,对应的,在所述根据所述环境特征数据以及所述预设监控评估模型确定所述被看护对象处于第四异常状态之后,还包括:The monitoring method according to claim 4, wherein the monitoring data includes second behavior data of the nursing object, and correspondingly, in the determining according to the environmental characteristic data and the preset monitoring evaluation model After the object under care is in the fourth abnormal state, it also includes:
    根据所述第一行为数据、所述第二行为数据以及所述预设监控评估模型确定所述看护对象与所述被看护对象的距离;determining the distance between the object of care and the object of care according to the first behavior data, the second behavior data and the preset monitoring and evaluation model;
    若所述距离小于所述预设距离,利用所述预设监控评估模型以及所述第二行为数据,确定所述看护对象的行为特征;If the distance is less than the preset distance, use the preset monitoring evaluation model and the second behavior data to determine the behavior characteristics of the care object;
    监测所述被看护对象处于所述第四异常状态的持续时间;monitoring the duration of time that the subject is in the fourth abnormal state;
    若所述持续时间大于预设时间阈值,则确定所述被看护对象处于被虐待状态。If the duration is greater than a preset time threshold, it is determined that the subject under care is in a state of being abused.
  7. 根据权利要求6所述的监控方法,其特征在于,所述第二行为数据包 括:动作特征、表情特征以及声音特征,所述确定所述被看护对象处于被虐待状态,包括:monitoring method according to claim 6, is characterized in that, described second behavior data comprises: action characteristic, facial expression characteristic and sound characteristic, described determining that described object under care is in the state of being abused, comprises:
    若根据所述动作特征以及所述预设监控评估模型判断所述看护对象是否对所述被看护对象施行所述虐待行为,若判断结果为是,则向所述监管对象发送所述第六提示信息;If it is determined according to the action feature and the preset monitoring evaluation model whether the care object performs the abusive behavior on the care object, if the judgment result is yes, the sixth prompt is sent to the supervision object information;
    若判断结果为否,则根据所述表情特征和/或所述声音特征以及所述预设监控评估模型,判断所述看护对象是否对所述被看护对象施行所述虐待行为,若判断结果为是,则向所述监管对象发送所述第七提示信息;If the judgment result is no, then according to the facial expression feature and/or the sound feature and the preset monitoring evaluation model, it is judged whether the care object performs the abusive behavior on the care object, if the judgment result is If yes, send the seventh prompt information to the supervision object;
    若判断结果为否,则当所述持续时间大于所述预设时间阈值时,向所述监管对象发送所述第七提示信息。If the determination result is no, when the duration is greater than the preset time threshold, the seventh prompt information is sent to the supervision object.
  8. 一种监控装置,其特征在于,包括:A monitoring device, characterized in that it includes:
    获取模块,用于获取智能监控设备采集的监控数据,所述监控数据包括待监测对象的行为数据和生理数据,所述待监测对象包括:看护对象以及被看护对象;an acquisition module, configured to acquire monitoring data collected by the intelligent monitoring device, the monitoring data includes behavioral data and physiological data of an object to be monitored, and the object to be monitored includes: a nursing object and a nursing object;
    处理模块,用于根据所述监控数据以及预设监控评估模型确定所述待监测对象的状态信息;a processing module, configured to determine the state information of the object to be monitored according to the monitoring data and a preset monitoring evaluation model;
    所述处理模块,还用于根据所述状态信息生成监控指令,所述监控指令用于向所述看护对象和/或监管对象发送提示信息。The processing module is further configured to generate a monitoring instruction according to the state information, where the monitoring instruction is used to send prompt information to the care object and/or the supervision object.
  9. 一种电子设备,其特征在于,包括:An electronic device, comprising:
    处理器;以及,processor; and,
    存储器,用于存储所述处理器的可执行指令;a memory for storing executable instructions for the processor;
    其中,所述处理器配置为经由执行所述可执行指令来执行权利要求1至7任一项所述的监控方法。Wherein, the processor is configured to execute the monitoring method of any one of claims 1 to 7 by executing the executable instructions.
  10. 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现权利要求1至7任一项所述的监控方法。A computer-readable storage medium on which a computer program is stored, characterized in that, when the computer program is executed by a processor, the monitoring method according to any one of claims 1 to 7 is implemented.
PCT/CN2020/110223 2020-08-20 2020-08-20 Monitoring method and apparatus, electronic device, and storage medium WO2022036624A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/110223 WO2022036624A1 (en) 2020-08-20 2020-08-20 Monitoring method and apparatus, electronic device, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/110223 WO2022036624A1 (en) 2020-08-20 2020-08-20 Monitoring method and apparatus, electronic device, and storage medium

Publications (1)

Publication Number Publication Date
WO2022036624A1 true WO2022036624A1 (en) 2022-02-24

Family

ID=80322438

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/110223 WO2022036624A1 (en) 2020-08-20 2020-08-20 Monitoring method and apparatus, electronic device, and storage medium

Country Status (1)

Country Link
WO (1) WO2022036624A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115414032A (en) * 2022-08-03 2022-12-02 浙江大华技术股份有限公司 Nursing monitoring system, method and device, monitoring equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104243928A (en) * 2014-09-26 2014-12-24 上海斐讯数据通信技术有限公司 Electronic terminal and remote monitoring method implemented by same
US20180182497A1 (en) * 2016-12-22 2018-06-28 DxRx, Inc. Creating engagement with an inner circle social network in substance abuse treatment
CN208673497U (en) * 2018-07-06 2019-03-29 江苏师范大学 A kind of alarm system for preventing the cruel child in kindergarten
CN111274881A (en) * 2020-01-10 2020-06-12 中国平安财产保险股份有限公司 Driving safety monitoring method and device, computer equipment and storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104243928A (en) * 2014-09-26 2014-12-24 上海斐讯数据通信技术有限公司 Electronic terminal and remote monitoring method implemented by same
US20180182497A1 (en) * 2016-12-22 2018-06-28 DxRx, Inc. Creating engagement with an inner circle social network in substance abuse treatment
CN208673497U (en) * 2018-07-06 2019-03-29 江苏师范大学 A kind of alarm system for preventing the cruel child in kindergarten
CN111274881A (en) * 2020-01-10 2020-06-12 中国平安财产保险股份有限公司 Driving safety monitoring method and device, computer equipment and storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115414032A (en) * 2022-08-03 2022-12-02 浙江大华技术股份有限公司 Nursing monitoring system, method and device, monitoring equipment and storage medium
CN115414032B (en) * 2022-08-03 2023-10-03 浙江大华技术股份有限公司 Nursing monitoring system, method, device, monitoring equipment and storage medium

Similar Documents

Publication Publication Date Title
US11369321B2 (en) Monitoring and tracking system, method, article and device
US12011259B2 (en) Systems and methods for fall detection
US9501919B2 (en) Method and system for monitoring the activity of a subject within spatial temporal and/or behavioral parameters
JP6670777B2 (en) Watching system and life support proposal system
CN107194191A (en) A kind of health nurse intelligent ecological system
CN102525434A (en) Remote electronic monitoring device
AU2013296153A1 (en) A system, method, software application and data signal for determining movement
EP3432772B1 (en) Using visual context to timely trigger measuring physiological parameters
JP3225990U (en) A system for recording, analyzing and providing real-time alerts of accident risk or need for assistance based on continuous sensor signals
JP2020071503A (en) Care system, method for managing the same, and program
WO2022036624A1 (en) Monitoring method and apparatus, electronic device, and storage medium
WO2020075675A1 (en) Care system management method, management device and program
WO2020003715A1 (en) Report output program, report output method, and report output device
Jähne-Raden et al. Wireless sensor network for fall prevention on geriatric wards: A report
Poon et al. Towards using tiny multi-sensors unit for child care reminders
Sundarajoo et al. A Remote Baby Surveillance System with RFID and GPS Tracking
JP2020190889A (en) Monitoring system for care-needing person
Ahamed et al. Identification of the Onset of Dementia of Older Adults in the Age of Internet of Things
Talib et al. Elderly condition monitoring and alert system
WO2019156665A1 (en) Methods and systems for locating patients in a facility
TWM642584U (en) Pet Health Management System
Kutzik et al. Technological tools of the future
JP2020013367A (en) Information processing device, method, program, and watching system
JP2021064327A (en) Method executed by computer for proposing health care content, program for making computer execute the method, and information processing device
Nagamani et al. Advanced Cardiac Health Care Monitoring Using Iot

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20949835

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20949835

Country of ref document: EP

Kind code of ref document: A1