CN114926634A - Event detection method and device, equipment, system and medium - Google Patents
Event detection method and device, equipment, system and medium Download PDFInfo
- Publication number
- CN114926634A CN114926634A CN202210418921.4A CN202210418921A CN114926634A CN 114926634 A CN114926634 A CN 114926634A CN 202210418921 A CN202210418921 A CN 202210418921A CN 114926634 A CN114926634 A CN 114926634A
- Authority
- CN
- China
- Prior art keywords
- temperature
- preset
- target
- interval
- target object
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 57
- 238000001931 thermography Methods 0.000 claims abstract description 110
- 230000008859 change Effects 0.000 claims abstract description 59
- 230000004044 response Effects 0.000 claims abstract description 40
- 238000000034 method Methods 0.000 claims description 40
- 208000005346 nocturnal enuresis Diseases 0.000 claims description 26
- 230000036760 body temperature Effects 0.000 claims description 23
- 230000000474 nursing effect Effects 0.000 claims description 15
- 238000012545 processing Methods 0.000 claims description 14
- 210000004197 pelvis Anatomy 0.000 claims description 13
- 230000011218 segmentation Effects 0.000 claims description 10
- 238000006243 chemical reaction Methods 0.000 claims description 7
- 238000012935 Averaging Methods 0.000 claims description 6
- 230000000875 corresponding effect Effects 0.000 description 33
- 230000008569 process Effects 0.000 description 13
- 238000004891 communication Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 210000001217 buttock Anatomy 0.000 description 4
- 230000010365 information processing Effects 0.000 description 4
- 238000012549 training Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000007423 decrease Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000009413 insulation Methods 0.000 description 3
- 206010023126 Jaundice Diseases 0.000 description 2
- 206010047700 Vomiting Diseases 0.000 description 2
- 230000009471 action Effects 0.000 description 2
- 238000005452 bending Methods 0.000 description 2
- QVFWZNCVPCJQOP-UHFFFAOYSA-N chloralodol Chemical compound CC(O)(C)CC(C)OC(O)C(Cl)(Cl)Cl QVFWZNCVPCJQOP-UHFFFAOYSA-N 0.000 description 2
- 230000002596 correlated effect Effects 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 239000011229 interlayer Substances 0.000 description 2
- 230000008673 vomiting Effects 0.000 description 2
- PEDCQBHIVMGVHV-UHFFFAOYSA-N Glycerine Chemical compound OCC(O)CO PEDCQBHIVMGVHV-UHFFFAOYSA-N 0.000 description 1
- 241001465754 Metazoa Species 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 210000000038 chest Anatomy 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000011982 device technology Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 239000008267 milk Substances 0.000 description 1
- 210000004080 milk Anatomy 0.000 description 1
- 235000013336 milk Nutrition 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000035699 permeability Effects 0.000 description 1
- 230000035790 physiological processes and functions Effects 0.000 description 1
- 238000004321 preservation Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 210000000115 thoracic cavity Anatomy 0.000 description 1
- 210000002700 urine Anatomy 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/26—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61G—TRANSPORT, PERSONAL CONVEYANCES, OR ACCOMMODATION SPECIALLY ADAPTED FOR PATIENTS OR DISABLED PERSONS; OPERATING TABLES OR CHAIRS; CHAIRS FOR DENTISTRY; FUNERAL DEVICES
- A61G11/00—Baby-incubators; Couveuses
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/48—Thermography; Techniques using wholly visual means
- G01J5/485—Temperature profile
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/44—Event detection
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61G—TRANSPORT, PERSONAL CONVEYANCES, OR ACCOMMODATION SPECIALLY ADAPTED FOR PATIENTS OR DISABLED PERSONS; OPERATING TABLES OR CHAIRS; CHAIRS FOR DENTISTRY; FUNERAL DEVICES
- A61G2200/00—Information related to the kind of patient or his position
- A61G2200/10—Type of patient
- A61G2200/14—Children
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61G—TRANSPORT, PERSONAL CONVEYANCES, OR ACCOMMODATION SPECIALLY ADAPTED FOR PATIENTS OR DISABLED PERSONS; OPERATING TABLES OR CHAIRS; CHAIRS FOR DENTISTRY; FUNERAL DEVICES
- A61G2203/00—General characteristics of devices
- A61G2203/10—General characteristics of devices characterised by specific control means, e.g. for adjustment or steering
- A61G2203/20—Displays or monitors
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61G—TRANSPORT, PERSONAL CONVEYANCES, OR ACCOMMODATION SPECIALLY ADAPTED FOR PATIENTS OR DISABLED PERSONS; OPERATING TABLES OR CHAIRS; CHAIRS FOR DENTISTRY; FUNERAL DEVICES
- A61G2203/00—General characteristics of devices
- A61G2203/30—General characteristics of devices characterised by sensor means
- A61G2203/46—General characteristics of devices characterised by sensor means for temperature
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Pediatric Medicine (AREA)
- Gynecology & Obstetrics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Pregnancy & Childbirth (AREA)
- Life Sciences & Earth Sciences (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
The application discloses an event detection method and device, equipment, a system and a medium, wherein the event detection method comprises the following steps: acquiring at least one temperature related to a preset part of a target object based on at least one target thermal imaging graph containing the preset part; judging whether the temperature change of the preset part meets a preset condition or not by using at least one temperature related to the preset part; and in response to the temperature change meeting a preset condition, determining that a preset event is detected. According to the scheme, the detection of the preset event can be realized.
Description
Technical Field
The present application relates to the field of nursing device technologies, and in particular, to an event detection method, apparatus, system, and medium.
Background
Under the scenes of jaundice and the like in infant incubators such as hospitals, moon centers and the like, medical staff cannot look after an infant for 24 hours, so that the condition that the infant urinates cannot be handled in time, the infant is always difficult to feel, and even the health state of the infant is reduced. At present, a device for detecting baby's bed-wetting is a humidity sensor device, judges whether the baby is bed-wetting through measuring the humidity of the baby's bed-wetting with the humidity sensor, but this kind of mode leads to the comfort of baby to reduce because humidity sensor and baby contact to there is potential safety hazards such as electric leakage still.
Disclosure of Invention
The application at least provides an event detection method, an event detection device, an event detection equipment, an event detection system and an event detection medium.
The application provides an event detection method, which comprises the following steps: acquiring at least one temperature related to a preset part of a target object based on at least one target thermal imaging graph containing the preset part; judging whether the temperature change of the preset part meets a preset condition or not by using at least one temperature related to the preset part; and in response to the temperature change meeting a preset condition, determining that a preset event is detected.
Therefore, whether the target object has the preset event or not can be determined by the temperature change of the target thermal imaging image according to the preset part of the target object. In addition, because the target thermal imaging image of the target object is acquired without contacting the target object, the comfort and safety of the target object can be guaranteed in the event detection process.
Wherein the preset event comprises a bed wetting event, the preset part comprises a region where a pelvis is located, and/or the temperature of at least one preset part is acquired based on at least one target thermal imaging map of the preset part containing a target object, and the method comprises the following steps: for each target thermal imaging image, determining a target position of a preset part of a target object in the target thermal imaging image; and determining the temperature of the preset part based on the data at the target position in the target thermal imaging graph.
Therefore, since the temperature of the region where the pelvis is located is different before and after occurrence of the bedwetting, whether the bedwetting event occurs can be detected by acquiring the temperature change of the region where the pelvis is located. In addition, the position of the preset part in the target thermal imaging image is determined firstly, and the temperature of the preset part is determined based on the data at the position, so that the accuracy of the acquired temperature can be improved.
The method for determining the target position of the preset part of the target object in the target thermal imaging map comprises the following steps: performing target segmentation on the target thermal imaging image to obtain a target position of a preset part; or acquiring a reference position of a preset part of the target object in the reference image; and determining the target position based on the reference position and a preset conversion relation between the reference image and the target thermal imaging image.
Therefore, the position of the preset part is determined by performing target segmentation on the target thermal imaging image, and the position of the preset part in the target thermal imaging image can be obtained first, and then the position of the preset part in the target thermal imaging image is obtained according to the position of the preset part in the reference image, so that the mode of determining the target position is more flexible.
Wherein, utilize at least one temperature about predetermineeing the position, judge that the temperature change of predetermineeing the position satisfies the preset condition, include: judging whether the temperature of at least one preset part is in a preset temperature interval or not; and in response to the existence of at least one temperature in the preset temperature interval, determining that the temperature change of the preset part meets a preset condition.
Therefore, in the case where there is at least one temperature in the preset temperature section, it is determined that the temperature change of the preset portion satisfies the preset condition, so that it can be determined whether the preset event is detected according to the temperature change of the preset portion.
Wherein, predetermine the temperature interval and include that first temperature interval and second temperature interval, the temperature in first temperature interval is higher than the temperature in second temperature interval, judges whether the temperature that has at least one preset position is in predetermineeing the temperature interval, includes: judging whether at least part of the temperature is in a first temperature interval or not; in response to at least part of the temperatures being in the first temperature interval, determining whether there is at least part of the temperatures in the second temperature interval among the temperatures acquired after the temperatures in the first temperature interval; in response to the existence of at least a portion of the temperatures acquired after being at the temperature within the first temperature interval being at the second temperature interval, it is determined that there is at least one temperature within the preset temperature interval.
Therefore, by acquiring the temperature change of the preset part in a plurality of time periods, the existence of the preset event is determined, so that the detection result is more accurate.
Wherein before determining whether there is at least a portion of the temperatures acquired after the temperatures within the first temperature interval being within the second temperature interval in response to at least a portion of the temperatures being within the first temperature interval, the method further comprises: judging whether the duration of a plurality of temperatures in a first temperature interval is greater than or equal to a preset duration, wherein the duration is the time difference between the temperature with the earliest acquisition time and the temperature with the latest acquisition time, and the acquisition time of the temperatures is the shooting time of a target thermal imaging image corresponding to the temperatures; in response to the existence of the duration greater than or equal to the preset duration, the step of determining whether at least part of the temperatures acquired after the temperature within the first temperature interval is in the second temperature interval is performed.
Therefore, by basing the duration of the plurality of temperatures in the first temperature interval, the problem of false detection of subsequent events due to accidental temperature changes can be reduced.
Wherein, in response to there being at least a portion of the temperatures acquired after being at the temperature within the first temperature interval being at a second temperature interval, determining that there is at least one temperature within a preset temperature interval comprises: in response to the fact that at least part of the temperatures acquired after the temperatures within the first temperature interval are within a second temperature interval, acquiring a plurality of temperature differences and judging whether the temperature differences which are greater than or equal to the preset temperature difference exist, wherein the temperature differences are the temperature differences between the temperatures within the first temperature interval and the temperatures within the second temperature interval; in response to the presence of a temperature difference greater than or equal to a preset temperature difference, it is determined that there is at least one temperature in a preset temperature interval.
Therefore, the accuracy of event detection can be improved by acquiring a temperature difference between a plurality of temperatures.
Wherein, predetermine the position and correspond a plurality of characteristic points in the target thermal imaging picture, each temperature that is in the first temperature interval includes the first candidate temperature of a plurality of characteristic points, and each temperature that is in the second temperature interval includes the second candidate temperature of a plurality of characteristic points, obtains a plurality of temperature difference and judges whether there is the temperature difference that is greater than or equal to and predetermines the temperature difference of temperature difference, include: and for each feature point, acquiring a candidate temperature difference between a first candidate temperature and a second candidate temperature corresponding to the feature point as a temperature difference, wherein if at least one candidate temperature difference is greater than or equal to a preset temperature difference, the temperature difference greater than or equal to the preset temperature difference is determined to exist.
Therefore, the temperature difference is determined through the temperature change of the plurality of pixel points, and the accuracy of the obtained temperature difference can be improved.
Wherein, the method further comprises: acquiring the temperature of each part of a target object in a target thermal imaging image; the temperatures of the respective parts are averaged to obtain the body temperature of the target object.
Therefore, not only the preset event can be detected, but also the body temperature of the target object can be detected, and the state of the target object can be better understood. In addition, by averaging the temperatures of the respective portions of the target object, the body temperature of the target object is obtained more accurately than when only the temperature of a certain portion is specifically detected as the body temperature.
Wherein, in response to the temperature change satisfying the preset condition, after determining that the preset event is detected, further comprising: and sending an alarm signal to a preset receiver, wherein the alarm signal comprises a preset event and an identifier of a target object corresponding to the preset event.
Therefore, the alarm signal is sent to the preset receiver, so that the preset receiver can timely know the preset event and timely process the preset event, and the comfort level of the target object is improved.
The application provides an event detection device, including: an acquisition module for acquiring at least one temperature related to a preset portion of a target object based on at least one target thermal imaging map including the preset portion; the judging module is used for judging whether the temperature change of the preset part meets a preset condition or not by utilizing at least one temperature related to the preset part; and the processing module is used for responding to the condition that the temperature change meets the preset condition and determining that the preset event is detected.
The present application provides a care device comprising a memory and a processor for executing program instructions stored in the memory to implement the above-described event detection method.
The nursing system comprises a thermal imager and the nursing device, wherein the nursing device is connected with the thermal imager, and the thermal imager is used for acquiring a target thermal imaging image of a preset part containing a target object; and the nursing equipment is used for executing the event detection method after receiving the target thermal imaging image acquired by the thermal imager.
The present application provides a computer readable storage medium having stored thereon program instructions which, when executed by a processor, implement the above-described event detection method.
According to the scheme, whether the target object has the preset event or not can be determined according to the temperature change of the target thermal imaging image of the preset part of the target object. In addition, because the target thermal imaging image of the target object is acquired without contacting the target object, the comfort and safety of the target object can be guaranteed in the event detection process.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the application.
FIG. 1 is a schematic flow chart diagram illustrating an event detection method according to an embodiment of the present application;
FIG. 2 is a schematic sub-flowchart illustrating step S11 according to an embodiment of the event detection method of the present application;
FIG. 3 is a partial flowchart of an embodiment of the event detection method according to the present application, showing step S12;
FIG. 4 is a partial sub-flowchart diagram illustrating step S23 according to an embodiment of the event detection method of the present application;
FIG. 5 is a schematic structural diagram of an embodiment of an event detection device according to the present application;
FIG. 6 is a schematic view of an embodiment of the present application;
FIG. 7 is a schematic structural view of an embodiment of the care system of the present application;
FIG. 8 is a schematic structural diagram of an embodiment of a computer-readable storage medium of the present application.
Detailed Description
The following describes in detail the embodiments of the present application with reference to the drawings attached hereto.
In the following description, for purposes of explanation rather than limitation, specific details are set forth such as the particular system architecture, interfaces, techniques, etc., in order to provide a thorough understanding of the present application.
The term "and/or" herein is merely an association describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship. Further, the term "plurality" herein means two or more than two. In addition, the term "at least one" herein means any one of a plurality or any combination of at least two of a plurality, for example, including at least one of A, B, C, and may mean including any one or more elements selected from the group consisting of A, B and C.
Referring to fig. 1, fig. 1 is a schematic flowchart illustrating an event detection method according to an embodiment of the present application. Specifically, the method may include the steps of:
step S11: at least one temperature related to a preset portion of the target object is acquired based on at least one target thermal imaging map containing the preset portion.
The target object may be a human body or an animal. The disclosed embodiments take the target object as an infant as an example. The preset part can be a part which can cause temperature change due to the baby bed-wetting, namely, the temperature of the part before and after the bed-wetting can be changed, and the part can be used as the preset part. The target thermal imaging graph can be obtained by shooting through a thermal imager. The thermal imager may photograph the whole body of the target object, or may photograph only a partial region of the body, for example, the thermal imager may photograph the whole body of the target object or a region where a predetermined portion is located by bending down or bending up. The thermal imager and the execution device of the scheme provided by the embodiment of the disclosure can be in an integrated setting or in a non-integrated setting.
One thermal imaging map corresponds to a temperature of a preset portion of the target object, and similarly, a plurality of thermal imaging maps correspond to a plurality of temperatures of the preset portion. In this case, after one target thermal imaging map is acquired and the temperature of the preset portion is acquired based on the target thermal imaging map, the next target thermal imaging map is acquired and the temperature of the preset portion is determined based on the newly acquired thermal imaging map, so as to perform the cycle. The thermal imaging system can also continuously shoot a target object to obtain a continuous target thermal imaging graph sequence, and the execution equipment sequentially processes the target thermal imaging graphs obtained from the thermal imaging system to obtain a temperature sequence of the preset part.
The manner of acquiring the temperature of the preset portion based on the target thermal imaging map may be to determine the corresponding temperature based on data, such as information of a gray scale value, of each pixel position corresponding to the preset portion. For example, the temperatures corresponding to the pixel positions corresponding to the preset portion are averaged to obtain the temperature of the preset portion, or the statistical result such as the maximum value or the minimum value of the temperatures corresponding to the pixel positions is used as the temperature of the preset portion.
Step S12: and judging whether the temperature change of the preset part meets a preset condition or not by using at least one temperature related to the preset part.
In some disclosed embodiments, the at least one preset portion temperature may be plural, and the time-series temperature change of the preset portion temperature is determined by using the plural preset portion temperatures. In some application scenarios, the target object is an infant, and the target object is located in an infant incubator in a hospital or a lunar center.
As described above, the temperature of the predetermined location may vary due to bed wetting events. Therefore, the time-series change of the temperature of the preset part can be used for judging whether the target object is bedwetting. The preset conditions may be obtained from a number of bed wetting experiments.
Step S13: and determining that a preset event is detected in response to the temperature change meeting a preset condition.
And if the change of the temperature of the preset part on the time sequence is detected to meet the preset condition, determining that a preset event occurs in the target object.
According to the scheme, whether the target object has the preset event or not can be determined according to the temperature change of the target thermal imaging image of the preset part of the target object. In addition, because the target thermal imaging image of the target object is acquired without contacting the target object, the comfort and safety of the target object can be guaranteed in the event detection process.
Optionally, the event detection method provided in the embodiment of the present disclosure may further include the following steps:
step S14: and in response to the temperature change not meeting the preset condition, determining that the preset event is not detected.
Under the condition that the preset event is determined not to be detected, the temperature change of the preset part can be continuously acquired, and whether the temperature change of the preset part meets the preset condition or not is judged so as to determine whether the preset event is detected or not.
In some disclosed embodiments, the predetermined event is a bed wetting event. In other disclosed embodiments, the predetermined event may be a vomiting event, a milk vomiting event, or the like, in which the occurrence of the event causes a temperature change at a predetermined location of the target subject. The embodiment of the present disclosure takes a preset event as an example of a bed wetting event. In the case where the predetermined event is a bed wetting event, the predetermined location includes an area in which the pelvis is located. The area of the pelvis may specifically include the buttocks and the like. Since buttocks fat is relatively thick, the temperature of the buttocks is generally lower, e.g. lower than the axillary temperature. The temperature of urine is generally the same as the temperature of the armpits and is the body temperature of the human body, so that whether the bedwetting condition of the target object occurs or not can be judged by detecting the temperature change of the buttocks. Because the temperature in the region where the pelvis is located is different before and after the occurrence of the bedwetting, whether the bedwetting event occurs can be detected by acquiring the temperature change in the region where the pelvis is located. In addition, the position of the preset part in the target thermal imaging image is determined firstly, and the temperature of the preset part is determined based on the data at the position, so that the accuracy of the acquired temperature can be improved.
Please refer to fig. 2, wherein fig. 2 is a sub-flowchart illustrating step S11 according to an embodiment of the event detection method of the present application. As shown in fig. 2, step S11 includes the following steps:
step S111: and for each target thermal imaging map, determining the target position of the preset part of the target object in the target thermal imaging map.
The specific determination method may be various:
and in the first mode, target segmentation is carried out on the target thermal imaging image to obtain the target position of the preset part. Namely, inputting the target thermal imaging image into a pre-trained target segmentation network to obtain a target position of the preset part in the target thermal imaging image. The target segmentation network may be a convolutional neural network. Specifically, the target segmentation network may be obtained by training sample thermal imaging maps corresponding to a plurality of training objects. The sample thermal imaging graph can be obtained by shooting under the condition that the training object can wear clothes, or can be obtained by shooting under the condition that the training object does not wear clothes. Similarly, the target thermal imaging map may be captured when the target object is wearing clothes, or may be captured when the target object is not wearing clothes.
And secondly, acquiring a reference position of the preset part of the target object in the reference image. Then, the target position is determined based on the reference position and a preset conversion relation between the reference image and the target thermal imaging image. The reference image may be an image including a preset portion of the target object captured by the reference capture component. Wherein the reference image is taken in synchronization with the target thermography image. The shooting time may have a certain error due to a timestamp error or the like, so that the shooting time of the reference image and the shooting time of the target thermal imaging image are not completely consistent, that is, a certain interval is allowed to exist between the shooting time of the reference image and the shooting time of the target thermal imaging image. The reference shooting component can be a visible light shooting component or a near-infrared shooting component except for a thermal imager. That is, the reference image may be a visible light image or a near infrared image.
The position of the thermal imager and the position of the shooting assembly corresponding to the reference image are relatively fixed, and the moving range of the infant in the incubator is small, so that the corresponding relation between each characteristic point in the reference image and each characteristic point in a thermal imaging image obtained by shooting with the thermal imager is pre-established, and the preset conversion relation between the reference image and the target thermal imaging image is obtained based on the corresponding relation.
The position of the preset part is determined by performing target segmentation on the target thermal imaging image, or the position of the preset part in the reference image is obtained firstly, and then the position of the preset part in the target thermal imaging image is obtained according to the position of the preset part in the reference image, so that the mode of determining the target position is more flexible.
Step S112: and determining the temperature of the preset part based on the data at the target position in the target thermal imaging graph.
Wherein the data at the target position in the target thermal imaging map may be a binary temperature. And obtaining the decimal temperature of the preset part through binary conversion. In other disclosed embodiments, the detection of the preset event may be performed by directly using a binary temperature value without converting the temperature.
In some disclosed embodiments, the target position of the preset portion may include a plurality of feature points, and the pixel value corresponding to each feature point, the manner of obtaining the temperature of the preset portion may be to use the temperature of each feature point as the temperature of the preset portion to obtain a temperature sequence of the preset portion, and may further use statistical results such as a maximum value, an average value, a minimum value, and the like in the temperatures of the feature points as the temperature of the preset portion. How to obtain the temperature of the predetermined portion is not specifically defined herein.
In some disclosed embodiments, performing step S12 may include the steps of:
firstly, whether at least one temperature is in a preset temperature interval is judged. And under the condition that the preset event does not occur to the target object, the temperature of the preset part is lower than the preset temperature interval corresponding to the target object. For example, the preset temperature interval may be a preset body temperature interval, and the temperature of the region where the pelvis is located is lower than the preset body temperature interval in the case that the target subject does not have a bedwetting condition. If the temperature of the preset part of the target object is detected to process the preset temperature interval, the target object may be bedwetting. For example, in the case where the target object is a human body, the preset temperature interval may be between 36 degrees and 37.5 degrees. As described above, in the case where the preset event of the target object is not detected, the target thermal imaging map including the preset portion of the target object is continuously acquired, and the temperature of the preset portion is acquired based on the target thermal imaging map.
And in response to the existence of at least one temperature in the preset temperature interval, determining that the temperature change of the preset part meets the preset condition. In other disclosed embodiments, in response to the absence of at least one temperature within the preset temperature interval, the foregoing step S11 is continuously performed. Optionally, whether at least one temperature is in the preset temperature interval or not, the step S11 is continuously executed.
In some disclosed embodiments, the predetermined temperature interval includes a first temperature interval and a second temperature interval. The temperature of the first temperature interval is higher than the temperature of the second temperature interval. Illustratively, the first temperature interval is 36 degrees to 37.5 degrees and the second temperature interval is less than 36 degrees. That is, when the preset event does not occur in the target object, the temperature of the preset portion is in the second temperature interval, and when the preset event occurs in the target object, the temperature of the preset portion may be increased to the first temperature interval in a short time.
Referring to fig. 3, fig. 3 is a partial flowchart illustrating step S12 according to an embodiment of the event detection method of the present application. As shown in fig. 3, the manner of determining whether the temperature of at least one preset portion is in the preset temperature interval may be:
step S21: it is determined whether there is at least a portion of the temperature in the first temperature interval.
At least one or more of the above-mentioned elements may be used. The number of at least some of the temperatures may be customized or selected by the user as a default. If it is determined that at least a portion of the temperature is within the first temperature range, step S22 is executed. If the determination result in the step S21 is that at least part of the temperatures are not in the first temperature interval, then step S24 is executed, i.e., it is determined that at least one temperature is not in the preset temperature interval.
Step S22: it is determined whether there is at least a portion of the temperatures acquired after being within the first temperature interval that is within the second temperature interval.
The temperature acquisition time is the shooting time of the target thermal imaging graph corresponding to the temperature, and the temperature acquired after the temperature in the first temperature interval is later than the latest acquired temperature in the first temperature interval. For example, the temperatures in the first temperature interval include three temperatures, which are obtained at time a, time b, and time c, where time a is later than time b, and time c is later than time b, and then the temperature obtained after the temperature in the first temperature interval is the temperature obtained later than time c. In some disclosed embodiments, if there is no temperature interval in which at least the temperature is in the second temperature interval in the temperatures acquired after the temperature in the first temperature interval, the step S11 is continuously performed, and it is determined whether at least part of the acquired temperatures are in the second temperature interval. Optionally, after the preset time is continuously detected, if the detected temperature is always in the first temperature range, an abnormal alarm may be issued or it may be determined that the preset event is not detected. Wherein, the step S23 is executed if the determination result at the step S22 is that at least part of the temperatures acquired after the temperature within the first temperature interval is within the second temperature interval, otherwise, the step S24 is executed.
Step S23: it is determined that there is at least one temperature in the preset temperature interval.
As mentioned above, at least some of the temperatures herein may be at least one temperature or at least a plurality of temperatures, and the number of at least some of the temperatures may be customized or selected by the user as a default.
Step S24: it is determined that there is no at least one temperature in the preset temperature interval.
In some disclosed embodiments, before performing step S22, the following steps may also be performed:
and judging whether the duration of the temperatures in the first temperature interval is greater than or equal to a preset duration. The duration is the time difference between the temperature at the earliest time of acquisition and the temperature at the latest time of acquisition. And the temperature acquisition time is the shooting time of the target thermal imaging graph corresponding to the temperature. Wherein the specific length of the duration can be customized by the user or a default setting can be selected.
In response to the existence of a duration greater than or equal to a preset duration, a step of determining whether at least a portion of the temperatures acquired after the temperature within the first temperature interval is in a second temperature interval in response to at least a portion of the temperatures being in the first temperature interval is performed.
After the baby gets into bed, the temperature of the preset part of the baby generally shows a trend that the temperature rises to a preset temperature interval first and then falls after being kept for a few seconds. Therefore, according to the scheme provided by the embodiment of the disclosure, after the temperature of the preset part is increased to the preset temperature interval, whether the subsequent temperature meets the rule is observed. Of course, in other embodiments, the temperature change of the predetermined portion may be analyzed from the beginning of the temperature increase of the predetermined portion of the infant, whether the temperature is increased to the predetermined temperature, and whether the temperature is maintained for a period of time and then decreased. That is, it is determined whether the temperature of the preset portion of the target object continuously rises to the preset temperature section and whether the temperature starts to fall after a certain period of time. If the judgment result is yes, the preset event is determined to be detected.
Referring to fig. 4, fig. 4 is a partial sub-flowchart illustrating step S23 according to an embodiment of the event detection method of the present application. As shown in fig. 4, step S23 may include the steps of:
step S231: and acquiring a plurality of temperature differences and judging whether the temperature differences larger than or equal to the preset temperature differences exist or not.
Specifically, in response to the existence of at least a portion of the temperatures in the second temperature interval among the temperatures acquired after being in the first temperature interval, several temperature differences are acquired and it is determined whether there is a temperature difference greater than or equal to a preset temperature difference. Wherein the temperature difference is a temperature difference between a temperature in the first temperature interval and a temperature in the second temperature interval. If the determination result in the step S231 is that there is a temperature difference greater than or equal to the preset temperature difference, the step S232 is executed, otherwise, the step S233 is executed.
In some disclosed embodiments, the predetermined locations correspond to a plurality of feature points in the target thermal imaging map. That is, the predetermined portion corresponds to a region in the target thermal imaging map, and the region includes a plurality of feature points. Each temperature in the first temperature interval comprises a first candidate temperature corresponding to a plurality of feature points. Each temperature in the second temperature interval comprises a second candidate temperature corresponding to the plurality of characteristic points. That is, the same feature point may include a plurality of first candidate temperatures and a plurality of second candidate temperatures, but one feature point corresponds to one candidate temperature at a time, and the candidate temperatures of the plurality of feature points constitute the temperature of the preset portion. The feature points may be pixel points.
Wherein, the step S231 may include the steps of:
and for each feature point, acquiring a candidate temperature difference between the first candidate temperature and the second candidate temperature corresponding to the feature point as a temperature difference. Before obtaining the candidate temperature difference, the corresponding relation of each characteristic point between each target thermal imaging graph is obtained. The corresponding relationship between the feature points can be obtained by means of feature point matching. Specifically, each feature point is matched according to the position relationship between each feature point and a preset part boundary or a center point, so that the corresponding relationship between the feature points is determined. Specifically, the first candidate temperatures corresponding to the same feature point at different times are respectively differentiated from the second candidate temperatures to obtain a plurality of candidate temperature differences.
And if at least one candidate temperature difference is larger than or equal to a preset temperature difference, determining that the temperature difference larger than or equal to the preset temperature difference exists.
In other disclosed embodiments, the manner of obtaining the temperature difference may also be: and taking the first candidate temperature of each characteristic point as a first set, and taking the second candidate temperature of each characteristic point as a second set. And taking the temperature difference between the temperature in the first set and each temperature in the second set as a candidate temperature difference.
The temperature difference is determined through the temperature change of the multiple pixel points, and the accuracy of the obtained temperature difference can be improved.
Step S232: it is determined that there is at least one temperature in the preset temperature interval.
In some disclosed embodiments, before performing step S232, the following steps may also be performed:
and in response to the temperature difference being greater than or equal to the preset temperature difference, determining whether at least part of the temperature in the second temperature interval is negatively correlated with the time. Wherein at least part of the temperatures in the second temperature interval are temperatures which are acquired later in time than the temperatures in the first temperature interval. That is, it is determined whether the temperature in the second temperature interval decreases with the increase in time. Since it is not excluded that the temperature difference between the previously acquired temperature in the second temperature interval and the first temperature interval is still small and starts to decrease over time, it is possible to determine whether the temperature in the second temperature interval has at least a partial temperature decrease over time. In response to the determination result that at least a part of the temperature in the second temperature interval is negatively correlated with the time, step S232 is executed.
Step S233: it is determined that there is no at least one temperature in the preset body temperature interval.
Under the condition that the temperature change of the preset part is determined not to meet the preset condition, the temperature change of the subsequent preset part can be continuously acquired, and whether the temperature change of the preset part meets the preset condition or not is judged to determine whether the preset event is detected or not.
By acquiring the temperature changes of the preset part in a plurality of time periods, whether the preset event exists or not is determined, so that the detection result is more accurate.
In other disclosed embodiments, the predetermined portion includes a first region where the temperature is not changed by a predetermined event and a second region where the temperature is changed by the predetermined event. For example, in the bedwetting time detection, the first region may be a chest region and the second region may be a region where a pelvis is located. The temperature change of the preset portion may be a change in a time sequence of a temperature difference between the first region and the second region. The temperature difference between the first area and the second area is not changed under the condition that the preset event does not occur. If the change in the temperature difference between the first region and the second region is greater than a threshold, it is determined that a preset event is detected.
In some disclosed embodiments, the event detection method further comprises the steps of:
and acquiring the temperature of each part of the target object in the target thermal imaging image. Then, the temperature of each part is averaged to obtain the body temperature of the target object. Each part of the target object may be divided in advance according to the physiological structure, the temperature aggregation, and the like of the target object, and the specific division method of each part is not specifically defined here. The obtaining of the body temperature of the target object may be performed in parallel with the event detection process after the obtaining of the target thermal imaging image corresponding to the target object.
Optionally, each part of the target object includes all pixel points of the region where the target object is located in the target thermal imaging map, and in other disclosed embodiments, each part of the target object includes the region where the chest cavity is located. The embodiments of the present disclosure take as an example that each part of the target object includes all pixel points in the region where the target object is located in the target thermal imaging graph. And averaging the temperatures corresponding to all pixel points in the region where the target object is located to obtain the body temperature of the target object. In other disclosed embodiments, a weighted average may be performed in addition to the average. That is, a weight of the temperature corresponding to each part of the target object is established in advance, and the body temperature of the target object is determined based on the weight and the temperature of each part. The specific way of setting the weight of the temperature corresponding to each part of the target object may be set according to the difference between the temperature of each part and the actual temperature observed in advance.
Optionally, the preset temperature interval is obtained based on the currently determined body temperature of the target object. Optionally, the body temperature of the currently acquired target object is floated up and down by a preset range to obtain a preset temperature interval. The preset range can be specifically set according to actual conditions. Illustratively, the target object is an infant, the current body temperature of the infant is 36 degrees, the preset range may be 0.3 degrees, and the preset temperature interval is 35.7 degrees to 36.3 degrees.
The technical scheme provided by the embodiment of the disclosure can detect not only the preset event, but also the body temperature of the target object, and can better understand the state of the target object. In addition, by averaging the temperatures of the respective portions of the target object, the body temperature of the target object is obtained more accurately than when only the temperature of a certain portion is specifically detected as the body temperature.
In some disclosed embodiments, after step S13 is performed, the following steps may also be performed:
and sending an alarm signal to a preset receiver, wherein the alarm signal comprises a preset event and an identifier of a target object corresponding to the preset event. Illustratively, the alarm signal includes an identifier of the bed wetting event and a target object corresponding to the bed wetting event, so that the preset receiver executes a preset alarm action, for example, sending an alarm prompt (flashing an indicator light, voice broadcasting, etc.), after receiving the alarm signal. The communication technology between the execution device and the preset receiver may be various, for example, WiFi, bluetooth, 4G, 5G, and other various communication modes or combined modes may be used, and the method is applicable to different scenarios.
The embodiment of the disclosure is suitable for application scenes that a target object is in a heat preservation box or a warm box for observation or jaundice irradiation and the like. Specifically, the bed-wetting detection mode provided by the embodiment of the disclosure can be applied to health care products, intelligent video analysis products and physiological state detection products.
For example, in a hospital setting, the intended recipient may be an alarm. The preset receiving party can be connected to the wireless router of the hospital through WiFi, and the execution equipment is also connected to the wireless router through WiFi. The execution equipment transmits the data to a preset receiver through a hospital local area network; the preset receiver can also be connected to the hospital Bluetooth gateway through Bluetooth, and the Bluetooth gateway and the execution equipment are connected to the hospital wireless router together. The execution device transmits data to a preset receiver through a hospital local Area Network and a bluetooth gateway, and similarly, communication technologies such as LoRa (LoRa Wide Area Network, Wide Area Network) and Zigbee (short-range wireless networking communication technology) can be used.
And when the receiver (alarm) is not in the coverage range of the hospital wireless router, the alarm can be connected to the mobile phone hotspot through WiFi, and the execution equipment is connected to the hospital wireless router through WiFi. The execution equipment transmits data to the alarm through a hospital local area network, a wide area network, a mobile phone network and a mobile phone hotspot; similarly, the alarm can be connected to the mobile phone through Bluetooth. The execution equipment transmits the data to the alarm through a hospital local area network, a wide area network, a mobile phone network and Bluetooth.
By sending the alarm signal to the preset receiver, the preset receiver can timely know the preset event and timely process the preset event, so that the comfort level of the target object is improved.
For example, the event detection method may be executed by a care device (e.g., a care instrument, etc.) or a server or other processing device, wherein the terminal device may be a User Equipment (UE), a mobile device, a User terminal, a cellular phone, a cordless phone, a Personal Digital Assistant (PDA), a handheld device, a computing device, a vehicle-mounted device, a wearable device, or the like. In some possible implementations, the event detection method may be implemented by a processor calling computer readable instructions stored in a memory.
Referring to fig. 5, fig. 5 is a schematic structural diagram of an embodiment of an event detection device according to the present application. The event detection device 40 includes an acquisition module 41, a judgment module 42, and a processing module 43. An obtaining module 41, configured to obtain at least one temperature related to a preset portion of a target object based on at least one target thermal imaging map including the preset portion; a determining module 42, configured to determine whether a temperature change of the preset portion satisfies a preset condition by using at least one temperature related to the preset portion; and the processing module 43 is configured to determine that a preset event is detected in response to the temperature change meeting a preset condition.
According to the scheme, whether the target object has the preset event or not can be determined according to the temperature change of the target thermal imaging graph of the preset part of the target object. In addition, because the target thermal imaging image of the target object is acquired without contacting the target object, the comfort and safety of the target object can be guaranteed in the event detection process.
In some disclosed embodiments, the predetermined event includes a bed wetting event, the predetermined region includes a region in which a pelvis is located, and/or the obtaining module 41 obtains at least one temperature related to the predetermined region based on at least one target thermal imaging map of the predetermined region including the target object, including: for each target thermal imaging map, determining a target position of a preset part of the target object in the target thermal imaging map; and determining the temperature of the preset part based on the data at the target position in the target thermal imaging graph.
According to the scheme, the temperature of the area where the pelvis is located is different before and after the occurrence of the bedwetting, and whether the preset event occurs or not can be detected by obtaining the temperature change of the area where the pelvis is located. In addition, the position of the preset part in the target thermal imaging image is determined firstly, and the temperature of the preset part is determined based on the data at the position, so that the accuracy of the acquired temperature can be improved.
In some disclosed embodiments, the determining the target position of the preset portion of the target object in the target thermal imaging map by the obtaining module 41 includes: performing target segmentation on the target thermal imaging image to obtain a target position of a preset part; or acquiring a reference position of a preset part of the target object in the reference image; and determining the target position based on the reference position and a preset conversion relation between the reference image and the target thermal imaging image.
According to the scheme, the position of the preset part is determined by performing target segmentation on the target thermal imaging image, the position of the preset part in the reference image can be obtained firstly, and then the position of the preset part in the target thermal imaging image is obtained according to the position of the preset part in the reference image, so that the mode of determining the target position is more flexible.
In some disclosed embodiments, the determining module 42 determines whether the temperature change of the predetermined portion satisfies the predetermined condition by using at least one temperature related to the predetermined portion, including: judging whether the temperature of at least one preset part is in a preset temperature interval or not; and in response to the existence of at least one temperature in the preset temperature interval, determining that the temperature change of the preset part meets a preset condition.
According to the scheme, under the condition that at least one temperature is in the preset temperature interval, the temperature change of the preset part is determined to meet the preset condition, so that whether the preset event is detected or not can be determined according to the temperature change of the preset part.
In some disclosed embodiments, the preset temperature interval includes a first temperature interval and a second temperature interval, the temperature of the first temperature interval is higher than the temperature of the second temperature interval, and the determining module 42 determines whether the temperature of at least one preset portion is in the preset temperature interval, including: judging whether at least part of the temperature is in a first temperature interval or not; in response to at least part of the temperatures being in the first temperature interval, determining whether there is at least part of the temperatures in the second temperature interval among the temperatures acquired after the temperatures in the first temperature interval; in response to there being at least a portion of the temperatures acquired after being within the first temperature interval that is within the second temperature interval, it is determined that there is at least one temperature that is within the preset temperature interval.
According to the scheme, whether the preset event exists or not is determined by acquiring the temperature change of the preset part in a plurality of time periods, so that the detection result is more accurate.
In some disclosed embodiments, before determining whether at least a portion of the temperatures obtained after being at the temperatures within the first temperature interval are at the second temperature interval in response to at least a portion of the temperatures being at the first temperature interval, the determination module 42 is further configured to: judging whether the duration of a plurality of temperatures in a first temperature interval is greater than or equal to a preset duration, wherein the duration is the time difference between the temperature with the earliest acquisition time and the temperature with the latest acquisition time, and the acquisition time of the temperatures is the shooting time of a target thermal imaging graph corresponding to the temperatures; in response to the existence of the duration greater than or equal to the preset duration, the step of determining whether at least part of the temperatures acquired after the temperature within the first temperature interval is in the second temperature interval is performed.
According to the scheme, the duration based on the temperatures in the first temperature interval can reduce the false detection problem of the subsequent events caused by accidental temperature changes.
In some disclosed embodiments, determining that at least one temperature is in the preset temperature interval in response to at least a portion of the temperatures acquired after being in the first temperature interval being in the second temperature interval by the determining module 42 includes: in response to the fact that at least part of the temperatures acquired after the temperatures within the first temperature interval are within a second temperature interval, acquiring a plurality of temperature differences and judging whether the temperature differences greater than or equal to a preset temperature difference exist, wherein the temperature differences are the temperature differences between the temperatures within the first temperature interval and the temperatures within the second temperature interval; in response to the presence of a temperature difference greater than or equal to a preset temperature difference, it is determined that there is at least one temperature in a preset temperature interval.
According to the scheme, the accuracy of event detection can be improved by acquiring the temperature difference among a plurality of temperatures.
In some disclosed embodiments, the determining module 42 obtains a plurality of temperature differences and determines whether there is a temperature difference greater than or equal to the preset temperature difference, where the preset location corresponds to a plurality of feature points in the target thermal imaging map, each temperature in the first temperature interval includes a first candidate temperature of the plurality of feature points, and each temperature in the second temperature interval includes a second candidate temperature of the plurality of feature points, and the determining module includes: and for each feature point, acquiring a candidate temperature difference between a first candidate temperature and a second candidate temperature corresponding to the feature point, and using the candidate temperature difference as a temperature difference, wherein if at least one candidate temperature difference is greater than or equal to a preset temperature difference, the temperature difference greater than or equal to the preset temperature difference is determined to exist.
According to the scheme, the temperature difference is determined through the temperature change of the plurality of pixel points, and the accuracy of the obtained temperature difference can be improved.
In some disclosed embodiments, the obtaining module 41 is further configured to: acquiring the temperature of each part of a target object in a target thermal imaging image; and averaging the temperatures of all parts to obtain the body temperature of the target object.
According to the scheme, the preset events can be detected, the body temperature of the target object can be detected, and the state of the target object can be better known. In addition, by averaging the temperatures of the respective portions of the target object, the body temperature of the target object is obtained more accurately than when only the temperature of a certain portion is specifically detected as the body temperature.
In some disclosed embodiments, the processing module 43, in response to the temperature variation satisfying the preset condition, determines that the preset event is detected, and further includes: and sending an alarm signal to a preset receiver, wherein the alarm signal comprises a preset event and an identifier of a target object corresponding to the preset event.
According to the scheme, the alarm signal is sent to the preset receiver, so that the preset receiver can timely know the preset event and timely process the preset event, and the comfort level of the target object is improved.
Referring to fig. 6, fig. 6 is a schematic structural diagram of an embodiment of a nursing device of the present application. The care device 50 comprises a memory 51 and a processor 52, the processor 52 being adapted to execute program instructions stored in the memory 51 for carrying out the steps in any of the above described embodiments of the event detection method. In one particular implementation scenario, the care device 50 may include, but is not limited to: the nursing apparatus, the medical device, the microcomputer, the desktop computer, and the server, and the nursing device 50 may further include a mobile device such as a notebook computer and a tablet computer, which is not limited herein.
In particular, the processor 52 is configured to control itself and the memory 51 to implement the steps in any of the above-described event detection method embodiments. Processor 52 may also be referred to as a CPU (Central Processing Unit). Processor 52 may be an integrated circuit chip having signal processing capabilities. The Processor 52 may also be a general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. In addition, the processor 52 may be commonly implemented by an integrated circuit chip.
According to the scheme, whether the target object has the preset event or not can be determined according to the temperature change of the target thermal imaging image of the preset part of the target object. In addition, because the target thermal imaging image of the target object is acquired without contacting the target object, the comfort and safety of the target object can be guaranteed in the event detection process.
Referring to fig. 7, fig. 7 is a schematic structural diagram of an embodiment of the nursing system of the present application. As shown in fig. 7, a care system 1 provided by embodiments of the present disclosure includes a thermal imager 60 and a care device 50 provided by embodiments of the care device 50.
The thermal imager 60 is configured to obtain a target thermal image including a preset portion of the target object.
The nursing device 50 is connected to the thermal imager 60, and the nursing device 50 is configured to execute the steps in any of the above-described event detection method embodiments after receiving the target thermal imaging image acquired by the thermal imager 60.
In some application scenarios, the care apparatus 50 is applied in a hospital or a lunar center. Specifically, the thermal imager 60 is mounted on an incubator and a target object (e.g., an infant) in the incubator is pitched. Illustratively, the thermal imager 60 is mounted at one corner of the upper end of the incubator. In other embodiments, if the incubator has an interlayer with heat-transparent properties, the thermal imager 60 may also be installed in the interlayer to take a look at the target object in the incubator. Alternatively, if the bottom of the thermal insulation box has a heat-permeable property, the thermal imager 60 may be mounted on the outer bottom wall of the thermal insulation box to take a downward shot of the target object in the thermal insulation box. Similarly, if the side wall or the top wall of the incubator has heat permeability, the thermal imager 60 can also shoot the target object in the incubator through the side wall or the top wall. There are many ways to mount the thermal imager 60, and no limitation is made here.
In some disclosed embodiments, the care system 1 further comprises a reference camera assembly (not shown). The reference shooting component is used for shooting a reference image. The reference image is used for assisting in acquiring a target position of a preset part of the target object in the target thermal imaging map. So as to obtain the temperature of the preset part according to the data at the target position in the target thermal imaging image, and determine whether the preset event is detected according to the change of the temperature of the preset part.
Specifically, the care device 50 receives the target thermal imaging image and the reference image which are shot synchronously, and then obtains the target position of the preset part in the target thermal imaging image according to the preset conversion relationship between the target thermal imaging image and the reference image after obtaining the position of the preset part of the target object in the reference image. The synchronous shooting does not mean that the shooting is not necessarily carried out at the same time, and a certain error may exist in the shooting time due to a timestamp error and the like, so that the shooting time between the target thermal imaging image and the reference image is allowed to have a certain interval. Wherein, the reference shooting component can be a visible light shooting component or a near infrared light shooting component. The installation position of the reference shooting component can be set according to specific requirements and is not specifically specified here.
In some disclosed embodiments, the care system 1 further comprises an alarm 70. The alarm 70 establishes a communication connection with the care apparatus 50. For a specific communication connection manner, reference may be made to the communication manner provided in the above-mentioned embodiment of the event detection method, and details are not described here.
The care device 50 sends an alarm signal to the alarm 70 after detecting the preset event. The alarm signal comprises a preset event and a mark of a target object corresponding to the preset event. Wherein the alarm 70 performs a preset alarm action upon receiving the alarm signal. The preset alarm behavior comprises the step of sending out an alarm prompt (flashing an indicator light, voice broadcasting and the like) and the like.
According to the scheme, whether the target object has the preset event or not can be determined according to the temperature change of the target thermal imaging graph of the preset part of the target object. In addition, because the target thermal imaging image of the target object is acquired without contacting the target object, the comfort and safety of the target object can be guaranteed in the event detection process.
Referring to fig. 8, fig. 8 is a schematic structural diagram of an embodiment of a computer-readable storage medium according to the present application. The computer readable storage medium 80 stores program instructions 81, and the program instructions 81 when executed by the processor implement the steps in any of the above described embodiments of the event detection method.
According to the scheme, whether the target object has the preset event or not can be determined according to the temperature change of the target thermal imaging image of the preset part of the target object. In addition, because the target thermal imaging image of the target object is acquired without contacting the target object, the comfort and safety of the target object can be guaranteed in the event detection process.
In some embodiments, functions of or modules included in the apparatus provided in the embodiments of the present disclosure may be used to execute the method described in the above method embodiments, and specific implementation thereof may refer to the description of the above method embodiments, and for brevity, will not be described again here.
The foregoing description of the various embodiments is intended to highlight various differences between the embodiments, and the same or similar parts may be referred to each other, and for brevity, will not be described again herein.
In the several embodiments provided in the present application, it should be understood that the disclosed method and apparatus may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, a division of a module or a unit is only one type of logical division, and other divisions may be implemented in practice, for example, the unit or component may be combined or integrated with another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some interfaces, and may be in an electrical, mechanical or other form.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application, which are essential or contributing to the prior art, or all or part of the technical solutions may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, a network device, or the like) or a processor (processor) to execute all or part of the steps of the methods of the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
If the technical scheme of the application relates to personal information, a product applying the technical scheme of the application clearly informs personal information processing rules before processing the personal information, and obtains personal independent consent. If the technical scheme of the application relates to sensitive personal information, a product applying the technical scheme of the application obtains individual consent before processing the sensitive personal information, and simultaneously meets the requirement of 'express consent'. For example, at a personal information collection device such as a camera, a clear and significant identifier is set to inform that the personal information collection range is entered, the personal information is collected, and if the person voluntarily enters the collection range, the person is considered as agreeing to collect the personal information; or on the device for processing the personal information, under the condition of informing the personal information processing rule by using obvious identification/information, obtaining personal authorization in the modes of pop-up window information or asking the person to upload personal information thereof and the like; the personal information processing rule may include information such as a personal information processor, a personal information processing purpose, a processing method, and a type of personal information to be processed.
Claims (14)
1. An event detection method, comprising:
acquiring at least one temperature related to a preset part of a target object based on at least one target thermal imaging graph containing the preset part;
judging whether the temperature change of the preset part meets a preset condition or not by using the temperature of the at least one preset part;
and determining that a preset event is detected in response to the temperature change meeting the preset condition.
2. The method according to claim 1, wherein the predetermined event comprises a bed wetting event, the predetermined location comprises a region in which a pelvis is located, and/or the obtaining at least one temperature related to the predetermined location based on at least one target thermography image of the predetermined location containing the target object comprises:
for each target thermal imaging map, determining a target position of a preset part of the target object in the target thermal imaging map;
and determining the temperature of the preset part based on the data at the target position in the target thermal imaging map.
3. The method of claim 2, wherein the determining the target position of the preset portion of the target object in the target thermal imaging map comprises:
performing target segmentation on the target thermal imaging image to obtain a target position of the preset part; or the like, or, alternatively,
acquiring a reference position of a preset part of the target object in a reference image;
and determining the target position based on the reference position and a preset conversion relation between the reference image and the target thermal imaging image.
4. The method according to claim 1, wherein the determining whether the temperature change of the preset portion satisfies a preset condition by using the at least one temperature of the preset portion comprises:
judging whether the temperature of at least one preset part is in a preset temperature interval or not;
and in response to the fact that at least one temperature is in the preset temperature interval, determining that the temperature change of the preset part meets a preset condition.
5. The method of claim 4, wherein the preset temperature intervals comprise a first temperature interval and a second temperature interval, the temperature of the first temperature interval is higher than that of the second temperature interval, and the determining whether the temperature of at least one preset part is in the preset temperature interval comprises:
judging whether at least part of the temperature is in the first temperature interval or not;
in response to at least part of the temperatures being within the first temperature interval, determining whether there is at least part of the temperatures being within the second temperature interval among the temperatures acquired after the temperatures being within the first temperature interval;
in response to there being at least a portion of the temperatures acquired after being at the temperature within the first temperature interval being at the second temperature interval, determining that there is at least one temperature within the preset temperature interval.
6. The method of claim 5, wherein, in response to at least a portion of the temperature being within the first temperature interval, determining whether there is at least a portion of the temperatures obtained after the temperature being within the first temperature interval being before the second temperature interval, the method further comprises:
judging whether the duration of a plurality of temperatures in the first temperature interval is greater than or equal to a preset duration, wherein the duration is the time difference between the temperature with the earliest acquisition time and the temperature with the latest acquisition time, and the acquisition time of the temperatures is the shooting time of a target thermal imaging image corresponding to the temperatures;
in response to the presence of a duration greater than or equal to the preset duration, performing the step of determining whether there is at least a portion of the temperatures acquired after the temperature within the first temperature interval at the second temperature interval.
7. The method of claim 5, wherein the determining that there is at least one temperature in the preset temperature interval in response to there being at least a portion of the temperatures in the second temperature interval in the temperatures acquired after the temperature in the first temperature interval comprises:
in response to the fact that at least part of the temperatures acquired after the temperature within the first temperature interval is within the second temperature interval, acquiring a plurality of temperature differences and judging whether a temperature difference larger than or equal to a preset temperature difference exists, wherein the temperature difference is the temperature difference between the temperature within the first temperature interval and the temperature within the second temperature interval;
in response to there being a temperature difference greater than or equal to the preset temperature difference, determining that there is at least one temperature in the preset temperature interval.
8. The method according to claim 7, wherein the step of obtaining a plurality of temperature differences and determining whether there is a temperature difference greater than or equal to a preset temperature difference comprises:
and for each feature point, acquiring a candidate temperature difference between a first candidate temperature and a second candidate temperature corresponding to the feature point, and using the candidate temperature difference as the temperature difference, wherein if at least one candidate temperature difference is greater than or equal to the preset temperature difference, the temperature difference greater than or equal to the preset temperature difference is determined to exist.
9. The method according to any one of claims 1-8, further comprising:
acquiring the temperature of each part of the target object in the target thermal imaging image;
and averaging the temperature of each part to obtain the body temperature of the target object.
10. The method according to any one of claims 1-9, wherein the determining after detecting a preset event in response to the temperature change satisfying the preset condition further comprises:
and sending an alarm signal to a preset receiver, wherein the alarm signal comprises the preset event and the identification of the target object corresponding to the preset event.
11. An event detection device, comprising:
the device comprises an acquisition module, a processing module and a processing module, wherein the acquisition module is used for acquiring at least one temperature related to a preset part of a target object based on at least one target thermal imaging graph containing the preset part;
the judging module is used for judging whether the temperature change of the preset part meets a preset condition or not by utilizing the at least one temperature related to the preset part;
and the processing module is used for responding to the temperature change meeting the preset condition and determining that a preset event is detected.
12. A care apparatus comprising a memory and a processor coupled to the memory for executing program instructions stored in the memory to implement the method of any of claims 1 to 10.
13. Nursing system comprising a thermal imager and a nursing device according to claim 11, said nursing device being connected to said thermal imager,
the thermal imager is used for acquiring a target thermal imaging image containing a preset part of a target object;
the nursing device is used for executing the method according to any one of claims 1 to 10 after receiving the target thermal imaging image acquired by the thermal imager.
14. A computer readable storage medium having stored thereon program instructions, which when executed by a processor implement the method of any of claims 1 to 10.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210418921.4A CN114926634A (en) | 2022-04-20 | 2022-04-20 | Event detection method and device, equipment, system and medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210418921.4A CN114926634A (en) | 2022-04-20 | 2022-04-20 | Event detection method and device, equipment, system and medium |
Publications (1)
Publication Number | Publication Date |
---|---|
CN114926634A true CN114926634A (en) | 2022-08-19 |
Family
ID=82805871
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210418921.4A Pending CN114926634A (en) | 2022-04-20 | 2022-04-20 | Event detection method and device, equipment, system and medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN114926634A (en) |
-
2022
- 2022-04-20 CN CN202210418921.4A patent/CN114926634A/en active Pending
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7065459B2 (en) | Communication device, error notification system, and error notification method | |
US9597016B2 (en) | Activity analysis, fall detection and risk assessment systems and methods | |
JP6101878B1 (en) | Diagnostic equipment | |
US9801544B2 (en) | Monitor subject monitoring device and method, and monitor subject monitoring system | |
CN109961058B (en) | Non-contact fall detection method and device | |
CN108662728B (en) | Information processing method, information processing apparatus, and recording medium | |
CN205994491U (en) | A kind of remote detecting system of health sign Index | |
JP7065447B2 (en) | Information processing methods, information processing devices, and programs | |
EP3430897A1 (en) | Monitoring device, monitoring method, and monitoring program | |
WO2017184201A1 (en) | Methods for thermal breast cancer detection | |
Chaudhry et al. | Internet of Things (IoT) and machine learning (ML) enabled livestock monitoring | |
CN110215212A (en) | A kind of intelligent fall detection system based on low resolution infrared thermal imaging | |
JPWO2017213136A1 (en) | Biological monitoring apparatus and biological monitoring method | |
KR20170021936A (en) | Animal management server and animal management method thereof | |
WO2021044421A1 (en) | System and method for remotely detecting and alerting actual or impending stress in animals in corrals and during transportation | |
CN115695734A (en) | Infrared thermal imaging protection monitoring method, device, equipment, system and medium | |
CN114926634A (en) | Event detection method and device, equipment, system and medium | |
KR101978987B1 (en) | Contactless temperature measurement device and operation method for measuring temperature using thermal imaging sensors | |
CN111780330B (en) | Control method and device of air conditioner and air conditioner | |
JP7388199B2 (en) | Biological information collection system, biological information collection method and program | |
KR20190054590A (en) | Method and system for behavior analysis of a dog | |
CN110495874B (en) | Information processing method and electronic equipment | |
JPH11155823A (en) | At-home health control system | |
CN112315426A (en) | Turning-over monitoring device and turning-over monitoring method | |
Nakajima | Short-range wireless network and wearable bio-sensors for healthcare applications |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |