CN115299896A - Vital sign monitoring method, equipment, system and storage medium - Google Patents
Vital sign monitoring method, equipment, system and storage medium Download PDFInfo
- Publication number
- CN115299896A CN115299896A CN202211056676.3A CN202211056676A CN115299896A CN 115299896 A CN115299896 A CN 115299896A CN 202211056676 A CN202211056676 A CN 202211056676A CN 115299896 A CN115299896 A CN 115299896A
- Authority
- CN
- China
- Prior art keywords
- vital sign
- real
- transported
- organism
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 138
- 238000000034 method Methods 0.000 title claims abstract description 69
- 206010000117 Abnormal behaviour Diseases 0.000 claims abstract description 79
- 230000005236 sound signal Effects 0.000 claims abstract description 61
- 230000036541 health Effects 0.000 claims abstract description 56
- 230000008569 process Effects 0.000 claims abstract description 25
- 238000004891 communication Methods 0.000 claims description 47
- 238000012806 monitoring device Methods 0.000 claims description 33
- 230000003993 interaction Effects 0.000 claims description 14
- 230000002159 abnormal effect Effects 0.000 claims description 12
- 230000036760 body temperature Effects 0.000 claims description 11
- 230000008859 change Effects 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 10
- 230000003862 health status Effects 0.000 claims description 10
- 230000036387 respiratory rate Effects 0.000 claims description 10
- 241001465754 Metazoa Species 0.000 claims description 6
- 238000012549 training Methods 0.000 claims description 4
- 230000029058 respiratory gaseous exchange Effects 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 7
- 230000006399 behavior Effects 0.000 description 4
- 230000007613 environmental effect Effects 0.000 description 4
- 230000005802 health problem Effects 0.000 description 4
- 241000282472 Canis lupus familiaris Species 0.000 description 3
- 238000013528 artificial neural network Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000002372 labelling Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000003062 neural network model Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000005406 washing Methods 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 206010001488 Aggression Diseases 0.000 description 1
- 208000019901 Anxiety disease Diseases 0.000 description 1
- 241000271566 Aves Species 0.000 description 1
- 241000282326 Felis catus Species 0.000 description 1
- 241000282414 Homo sapiens Species 0.000 description 1
- 241000700159 Rattus Species 0.000 description 1
- 230000005856 abnormality Effects 0.000 description 1
- 208000012761 aggressive behavior Diseases 0.000 description 1
- 230000016571 aggressive behavior Effects 0.000 description 1
- 238000004887 air purification Methods 0.000 description 1
- 230000036506 anxiety Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 235000019504 cigarettes Nutrition 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000002996 emotional effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000035772 mutation Effects 0.000 description 1
- 239000004033 plastic Substances 0.000 description 1
- 239000011347 resin Substances 0.000 description 1
- 229920005989 resin Polymers 0.000 description 1
- 235000015096 spirit Nutrition 0.000 description 1
- 229910001220 stainless steel Inorganic materials 0.000 description 1
- 239000010935 stainless steel Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000010408 sweeping Methods 0.000 description 1
- 239000002023 wood Substances 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/0205—Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
- A61B5/02055—Simultaneously evaluating both cardiovascular condition and temperature
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/024—Detecting, measuring or recording pulse rate or heart rate
- A61B5/02416—Detecting, measuring or recording pulse rate or heart rate using photoplethysmograph signals, e.g. generated by infrared radiation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/08—Detecting, measuring or recording devices for evaluating the respiratory organs
- A61B5/0816—Measuring devices for examining respiratory frequency
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4803—Speech analysis specially adapted for diagnostic purposes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/254—Analysis of motion involving subtraction of images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2503/00—Evaluating a particular growth phase or type of persons or animals
- A61B2503/40—Animals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20224—Image subtraction
Abstract
The application discloses a vital sign monitoring method, equipment, a system and a storage medium, which relate to the technical field of smart home/smart home, wherein the method comprises the following steps: receiving a vital sign signal, a real-time image signal and a real-time sound signal of a to-be-transported organism sent by target vital sign monitoring equipment; determining a life health prediction result of the organism to be transported based on the vital sign signal; determining a first abnormal behavior prediction result of the organism to be transported based on the real-time image signal; determining a second abnormal behavior prediction result of the organism to be transported based on the real-time sound signal; determining a health state of the organism to be transported based on at least one of the life health prediction result, the first abnormal behavior prediction result, and the second abnormal behavior prediction result. The method and the system provided by the application improve the safety and comfort of the living beings in the transportation process.
Description
Technical Field
The application relates to the technical field of smart home/smart home, in particular to a vital sign monitoring method, equipment, a system and a storage medium.
Background
With the continuous development of society and economy, people are no longer concerned only about the satisfaction of materials, the demand for spirits is also increasing, and pets as companion animals for our human beings are one of the sources from which we have a happy and healthy life.
In the long-distance transportation process of pets or other creatures in recent years, as transportation personnel cannot monitor vital signs of the pets in the transportation process by an effective means in the transportation process, pet owners cannot see the state of the pets in the long-distance transportation process in real time, and the pets are difficult to respond in time when accidents happen, finally tragedies occur.
Disclosure of Invention
The application provides a vital sign monitoring device and a vital sign monitoring method, which are used for solving the technical problem that the health state of a living being in the transportation process cannot be monitored in the prior art.
The application provides a vital sign monitoring method, which comprises the following steps:
receiving a vital sign signal, a real-time image signal and a real-time sound signal of a to-be-transported organism sent by target vital sign monitoring equipment;
determining a life health prediction result of the organism to be transported based on the vital sign signal;
determining a first abnormal behavior prediction result of the creature to be transported based on the real-time image signal;
determining a second abnormal behavior prediction result of the organism to be transported based on the real-time sound signal;
determining a health state of the organism to be transported based on at least one of the life health prediction result, the first abnormal behavior prediction result, and the second abnormal behavior prediction result.
According to the vital sign monitoring method provided by the application, the determining a first abnormal behavior prediction result of the to-be-transported living being based on the real-time image signal comprises the following steps:
continuously acquiring multi-frame images based on the real-time image signals;
determining pixels which change in the current frame image based on the difference between pixel values of pixels at corresponding positions in the current frame image and the previous frame image;
determining the pixel point change proportion of the current frame image based on the number of the changed pixel points in the current frame image and the total number of the pixel points in the current frame image;
and determining a first abnormal behavior prediction result of the creature to be transported based on the average value of the pixel point variation proportion of the multi-frame image.
According to the vital sign monitoring method provided by the application, the determining of the second abnormal behavior prediction result of the to-be-transported living being based on the real-time sound signal comprises the following steps:
determining the real-time sound signal;
inputting the real-time sound signal into an abnormal behavior prediction model to obtain a second abnormal behavior prediction result output by the abnormal behavior prediction model;
the abnormal behavior prediction model is obtained by training based on a sample sound signal and a second abnormal behavior prediction result of the sample sound signal; the sample sound signal is obtained by collecting the sound of the same type of animal of the organism to be transported.
According to the vital sign monitoring method provided by the application, after the health state of the organism to be transported is determined, the method comprises the following steps:
generating biological health abnormal alarm information under the condition that the health state of the organism to be transported is abnormal;
and sending the biological health abnormity alarm information to a transportation client corresponding to the target vital sign monitoring device and a user client corresponding to the target vital sign monitoring device.
The application provides vital sign monitoring equipment which comprises a box body, a biological wearable module, a video monitoring module, a sound interaction module and a communication module, wherein the video monitoring module, the sound interaction module and the communication module are arranged on the box body;
the biological wearable module is connected with the communication module and used for acquiring a vital sign signal of a biological to be transported;
the video monitoring module is connected with the communication module and is used for acquiring a real-time image signal of the organism to be transported in the box body;
the sound interaction module is connected with the communication module and is used for acquiring a real-time sound signal of the organism to be transported in the box body;
the communication module is used for sending the vital sign signals, the real-time image signals and the real-time sound signals of the organisms to be transported to the vital sign monitoring system, so that the vital sign monitoring system can determine the health state of the organisms to be transported based on at least one of the vital sign signals, the real-time image signals and the real-time sound signals.
The vital sign monitoring device provided according to the present application further comprises:
the positioning module is connected with the communication module and used for determining a real-time position signal of the vital sign monitoring equipment;
the communication module is further used for sending the real-time position signal of the vital sign monitoring equipment to the vital sign monitoring system, so that the vital sign monitoring system can determine the transportation track of the living being to be transported based on the real-time position signal.
The vital sign monitoring device provided according to the present application further comprises:
the environment sensing module is connected with the communication module, comprises a temperature sensor, a humidity sensor and a vibration sensor, and is used for acquiring the temperature and the humidity in the box of the vital sign monitoring equipment and the vibration frequency of the vital sign monitoring equipment in the transportation process;
the communication module is further used for sending the in-box temperature, the in-box humidity and the vibration frequency to the vital sign monitoring system, so that the vital sign monitoring system can determine the in-box environment information of the vital sign monitoring equipment based on the in-box temperature, the in-box humidity and the vibration frequency.
According to the vital sign monitoring device provided by the application, the biological wearable module comprises a body temperature sensor, a heart rate sensor and a respiratory rate sensor;
the vital sign signals comprise a biological body temperature signal, a biological heart rate signal and a biological respiratory rate signal.
The application provides a vital sign monitoring system, which comprises a remote server, a transportation client, a user client and a plurality of vital sign monitoring devices;
the remote server comprises a memory in which a computer program is stored and a processor arranged to execute the vital signs monitoring method by means of the computer program.
The present application provides a computer-readable storage medium comprising a stored program, wherein the program when executed performs the vital signs monitoring method.
According to the vital sign monitoring method, the vital sign monitoring equipment, the vital sign monitoring system and the storage medium, the vital health prediction result of the organism to be transported is determined according to the vital sign signal; determining a first abnormal behavior prediction result of the creature to be transported according to the real-time image signal; determining a second abnormal behavior prediction result of the creature to be transported according to the real-time sound signal; the health state of the organism to be transported is determined according to at least one of the life health prediction result, the first abnormal behavior prediction result and the second abnormal behavior prediction result, multi-mode monitoring of the organism in the vital sign monitoring device is achieved, the health state of the organism in the transportation process is predicted through vital signs, images and sounds, a user or a transporter can check the health state of the organism in real time, health problems of the organism in the transportation process are avoided, and safety and comfort of the organism in the transportation process are improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application.
In order to more clearly illustrate the technical solutions in the present application or the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flow chart of a vital sign monitoring method provided herein;
figure 2 is a schematic structural view of a vital signs monitoring device as provided herein;
fig. 3 is a schematic structural diagram of a vital signs monitoring system provided herein;
fig. 4 is a schematic view of a login process of the vital signs monitoring software provided in the present application;
fig. 5 is a schematic hardware environment diagram of a vital sign monitoring method provided in the present application;
fig. 6 is a schematic structural diagram of an electronic device provided in the present application.
Reference numerals:
200: a vital signs monitoring device; 210: a box body; 220: a biological wearable module; 230: a video monitoring module; 240: a sound interaction module; 250: a communication module;
310: a remote server; 320: a transport client; 330: a user client; 501: a terminal device; 502: and (4) a server.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that the terms "first," "second," and the like in this application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It should be understood that the data so used may be interchanged under appropriate circumstances such that embodiments of the application described herein may be implemented in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Fig. 1 is a schematic flow chart of the vital sign monitoring method provided in the present application, and as shown in fig. 1, the method is applied to a vital sign monitoring system, and the vital sign monitoring system is in communication connection with a plurality of vital sign monitoring devices, including:
and 150, determining the health state of the organism to be transported based on at least one of the life health prediction result, the first abnormal behavior prediction result and the second abnormal behavior prediction result.
In particular, the target vital signs monitoring device may be any vital signs monitoring device that is in communicative connection with the vital signs monitoring system. The vital signs monitoring device may be a device, such as a pet transport case, equipped with vital signs monitoring sensors.
The vital sign monitoring system receives vital sign signals, real-time image signals and real-time sound signals of the to-be-transported living beings, which are sent by the target vital sign monitoring equipment.
The vital sign monitoring system can determine a vital health prediction result of the organism to be transported according to the vital sign signal. For example, if the biological body temperature signal of the organism to be transported is greater than a preset body temperature threshold, or the biological heart rate signal is greater than a preset heart rate threshold, or the biological respiratory rate signal is lower than a preset respiratory rate threshold, it may be determined that the life health prediction result of the organism to be transported is unhealthy.
The vital sign monitoring system can determine a first abnormal behavior prediction result of the organism to be transported according to the real-time image signal. For example, the activity area of the living being to be transported in the real-time image signal is identified, if the activity area changes frequently, it indicates that the living being to be transported moves back and forth, and may be in a fidgety state, that is, the first abnormal behavior prediction result of the living being to be transported is the existence of abnormal behavior.
The vital sign monitoring system can determine a second abnormal behavior prediction result of the organism to be transported according to the real-time sound signal. For example, the loudness characteristic and/or the tone characteristic in the real-time sound signal are/is analyzed, and if the loudness characteristic is greater than the preset loudness value or the tone characteristic is greater than the preset tone value, it can be determined that the to-be-transported organism may reflect the emotional abnormal state of the to-be-transported organism by calling, that is, the second abnormal behavior prediction result of the to-be-transported organism is the abnormal behavior.
The health status of the organism to be transported may be determined based on at least one of the life health prediction, the first abnormal behavior prediction, and the second abnormal behavior prediction. For the organisms to be transported, the health state of the organisms to be transported can be predicted according to only one of the three prediction results, and the health state of the organisms to be transported can also be predicted by combining the three prediction results. For example, if the first abnormal behavior prediction result and the second abnormal behavior prediction result both show that the abnormal behavior does not exist in the organism to be transported, but the life health prediction result shows that the respiration of the organism is weak, the health state of the organism can be determined to be an unhealthy state, and corresponding measures should be taken to protect the organism.
According to the vital sign monitoring method provided by the embodiment of the application, the vital health prediction result of the organism to be transported is determined according to the vital sign signal; determining a first abnormal behavior prediction result of the organism to be transported according to the real-time image signal; determining a second abnormal behavior prediction result of the organism to be transported according to the real-time sound signal; the health state of the organism to be transported is determined according to at least one of the life health prediction result, the first abnormal behavior prediction result and the second abnormal behavior prediction result, multi-mode monitoring of the organism in the vital sign monitoring device is achieved, the health state of the organism in the transportation process is predicted through vital signs, images and sounds, a user or a transporter can check the health state of the organism in real time, health problems of the organism in the transportation process are avoided, and safety and comfort of the organism in the transportation process are improved.
Based on the above embodiment, step 130 includes:
continuously acquiring multi-frame images based on the real-time image signals;
determining the changed pixel points in the current frame image based on the difference of the pixel values of the pixel points at the corresponding positions in the current frame image and the previous frame image;
determining the pixel point change proportion of the current frame image based on the number of the changed pixel points in the current frame image and the total number of the pixel points in the current frame image;
and determining a first abnormal behavior prediction result of the creature to be transported based on the average value of the pixel point change proportion of the multi-frame image.
Specifically, the vital sign monitoring system can continuously acquire multi-frame images through real-time image signals sent by the communication module in the target biological box. The number of frames of the acquired image may be set as necessary.
The vital sign monitoring system can calculate the difference value of the adjacent frame images, namely, the adjacent frame images are divided into the current frame image and the previous frame image, the corresponding relation of pixel points in the two frame images is established according to the positions of the pixel points in the images, and then the pixel values of the pixel points in the corresponding positions are calculated. If the pixel value of any pixel point in the current frame image has a difference value with the pixel value of the corresponding pixel point in the previous frame image or the difference value is greater than the preset pixel difference value, the pixel point in the current frame image can be determined as the changed pixel point.
And determining the ratio of the number of the changed pixels in the current frame image to the total number of the pixels in the current frame image as the pixel change proportion of the current frame image. After the average value of the pixel point change proportion of the continuous multi-frame images is obtained, the average value of the pixel point change proportion can be obtained. If the average value of the change proportion of the pixel points is larger than the average threshold value of the preset proportion, the fact that the movement of the organism to be transported in the box is violent is indicated, and the first abnormal behavior prediction result may be that abnormal behaviors exist.
In this embodiment, the average value of the change proportion of the pixel points of the multi-frame image is determined, so that the inaccuracy of image data caused by light mutation or image sensor failure is avoided, and the accuracy of the first abnormal behavior prediction result is improved.
Based on any of the above embodiments, step 140 includes:
determining a real-time sound signal;
inputting the real-time sound signal into the abnormal behavior prediction model to obtain a second abnormal behavior prediction result output by the abnormal behavior prediction model;
the abnormal behavior prediction model is obtained by training based on the sample sound signal and a second abnormal behavior prediction result of the sample sound signal; the sample sound signal is obtained by collecting the sound of the same type of animal of the organism to be transported.
In particular, a neural network model in an artificial intelligence algorithm may be employed to analyze the real-time sound signal.
An abnormal behavior prediction model can be established based on the neural network model and deployed in the vital sign monitoring system. And inputting the received real-time sound signals into the abnormal behavior prediction model by the vital sign monitoring system to obtain a second abnormal behavior prediction result output by the abnormal behavior prediction model.
The abnormal behavior prediction model can be obtained by the following method:
first, a large number of sample sound signals, and second abnormal-behavior prediction results (sample labels) of the sample sound signals are collected. In order to improve the robustness and generalization capability of the abnormal behavior prediction model, the sounds of the same type of animals of the organisms to be transported can be collected to obtain a sample sound signal. For example, if the creature to be transported is a dog, the sound of other kinds of dogs may be used as the sample sound signal.
Then, labeling each sample sound signal to obtain a second abnormal behavior prediction result (sample label) of each sample sound signal. For example, a manual labeling method may be adopted to determine, according to any sample sound signal, a possible existing behavior of a living being corresponding to the sample sound signal, and determine a second abnormal behavior prediction result.
And thirdly, taking the neural network as an initial model. The initial model may select a fully-connected neural network, a convolutional neural network, an impulse neural network, and the like. Training the initial model according to the sample sound signal and the second abnormal behavior prediction result of the sample sound signal, so that the initial model can learn the association characteristics between the sample sound signal and the abnormal behavior, the prediction capability of the abnormal behavior of the living beings is improved, and the abnormal behavior prediction model is finally obtained.
In a vital signs monitoring system, a plurality of different kinds of abnormal behavior prediction models of living beings may be established.
Based on any of the above embodiments, step 150 includes:
generating biological health abnormal alarm information under the condition that the health state of the organism to be transported is abnormal;
and sending biological health abnormal alarm information to a transportation client corresponding to the target vital sign monitoring device and a user client corresponding to the target vital sign monitoring device.
In particular, the vital signs monitoring system may further comprise a transport client and a user client. The transportation client is mainly used for undertaking biological transportation staff; the user client is mainly used for the owner of the living being.
Under the condition that the vital sign monitoring system determines that the health state of the organism to be transported is abnormal, the vital sign monitoring system can generate abnormal biological health alarm information and simultaneously send the abnormal biological health alarm information to the transport client and the user client.
Based on any of the above embodiments, fig. 2 is a schematic structural diagram of the vital signs monitoring device provided in the present application, and as shown in fig. 2, the vital signs monitoring device 200 includes a box 210, a biological wearable module 220, and a video monitoring module 230, a sound interaction module 240 and a communication module 250 disposed on the box 210;
the biological wearable module 220 is connected with the communication module 250 and used for acquiring a vital sign signal of a biological to be transported; the video monitoring module 230 is connected with the communication module 250 and is used for acquiring real-time image signals of the organisms to be transported in the box body; the sound interaction module 240 is connected with the communication module 250 and is used for acquiring real-time sound signals of the organisms to be transported in the box body;
the communication module 250 is configured to send the vital sign signal, the real-time image signal, and the real-time sound signal of the to-be-transported living being to the vital sign monitoring system, so that the vital sign monitoring system determines the health status of the to-be-transported living being based on at least one of the vital sign signal, the real-time image signal, and the real-time sound signal.
Specifically, the vital signs monitoring device 200 provided by the embodiment of the present application is suitable for long-distance transportation of living beings, and monitoring the health status of the living beings during the long-distance transportation. The organisms to be transported herein include animals such as cats, dogs, birds and rats. The housing 210 of the vital signs monitoring device 200 can be sized according to the size of the living being to be transported. The material of the case 210 may be selected from resin, plastic, stainless steel, wood, and the like.
The biological wearable module 220 is used for acquiring a vital sign signal of a biological to be transported. The bio-wearable module 220 may be embodied in the form of a collar, a wristwatch, or the like, which monitors vital sign signals of a living being in a non-invasive manner.
The video monitoring module 230 may employ a wide-angle camera or the like, and is configured to monitor a state of the living being to be transported in the box 210 to obtain a real-time image signal. The real-time image signal may be a black-and-white image signal or a color image signal. In order to facilitate monitoring the to-be-transported creatures under the dark condition, the video monitoring module 230 may also employ an infrared camera.
The sound interaction module 240 may adopt a sound sensor, and is configured to collect real-time sound signals of the living being to be transported in the tank; a combination of a sound sensor and a sound reproducer, etc. may also be employed for reproducing music or a sound of a user (owner of the creature to be transported) or the like to the creature to be transported.
The communication module 250 may adopt at least one of a WiFi module, a bluetooth module, a 4G module, a 5G module, etc. for sending the vital sign signal, the real-time image signal and the real-time sound signal of the organism to be transported to the vital sign monitoring system. The vital sign monitoring system can be deployed in a remote server and is realized through a cloud technology.
The vital sign signals comprise heart rate signals, respiratory rate signals, body temperature signals and the like of the organism to be transported, and the signals can directly describe the health state of the organism to be transported in the transportation process.
The real-time image signals are used for recording the behavior of the organisms to be transported during the transportation process. When the health status of the organism to be transported changes, some abnormal behavior may be exhibited, such as walking around or there being an aggressive behavior. By analyzing the behavior of the organism to be transported in the real-time image signal, the health status of the organism to be transported can be determined.
The real-time sound signal is used for recording the sound of the living beings to be transported in the transportation process. When the health status of the living being to be transported changes, it is possible to transmit information by a cry, such as making a louder cry or a sharper cry than usual. By analyzing the real-time sound signals of the living being to be transported, the health status of the living being to be transported can be determined.
The vital sign monitoring system determines the health state of the organism to be transported according to at least one of the vital sign signal, the real-time image signal and the real-time sound signal.
In order to facilitate the movement of the living being to be transported in the case 210, the biological wearable module 220 may be wirelessly connected to the communication module 250, and the video monitoring module 230 and the sound interaction module 240 may be connected to the communication module 250 by wire or wirelessly.
The video monitoring module 230, the sound interaction module 240, and the communication module 250 may be detachably provided on the housing 210.
The vital sign monitoring equipment provided by the embodiment of the application comprises a box body, a biological wearable module, a video monitoring module, a sound interaction module and a communication module, wherein the biological wearable module is used for acquiring a vital sign signal of a to-be-transported organism; the video monitoring module is used for acquiring a real-time image signal of the organism to be transported in the box body; the sound interaction module is used for acquiring a real-time sound signal of the organism to be transported in the box body; the communication module is used for sending the vital sign signal of the organism to be transported, real-time image signal and real-time sound signal to the vital sign monitoring system, so that the vital sign monitoring system can determine the health state of the organism to be transported, the device can monitor the health state of the organism when transporting the organism, so that a user or a transporter can check the health state of the organism in real time, the health problem of the organism in the transportation process is avoided, and the safety and the comfort of the organism in the transportation process are improved.
Based on any of the above embodiments, the apparatus further comprises:
the positioning module is connected with the communication module and used for determining a real-time position signal of the vital sign monitoring equipment;
the communication module is further used for sending the real-time position signal of the vital sign monitoring equipment to the vital sign monitoring system, so that the vital sign monitoring system can determine the transportation track of the organism to be transported based on the real-time position signal.
Specifically, a positioning module can be further disposed in the vital sign monitoring device. The module may be a GPS (Global Positioning System) Positioning module, a BDS (BeiDou Navigation Satellite System) Positioning module, or the like. The positioning module can be arranged on the box body, and can determine the real-time position signal of the vital sign monitoring equipment according to the received satellite positioning signal.
The positioning module sends the real-time position signal to the vital sign monitoring system through the communication module. The vital sign monitoring system can generate a transport trajectory of the organism to be transported according to the real-time position signal.
The user can log in the vital sign monitoring system, check the real-time position and the transportation track of the organism to be transported, and conveniently know the transportation condition of the organism to be transported. The vital sign monitoring equipment provided by the embodiment of the application improves the use experience of a user.
Based on any embodiment above, the apparatus further comprises:
the environment sensing module is connected with the communication module, comprises a temperature sensor, a humidity sensor and a vibration sensor, and is used for acquiring the temperature and the humidity in the box of the vital sign monitoring equipment and the vibration frequency of the vital sign monitoring equipment in the transportation process;
the communication module is also used for sending the in-box temperature, the in-box humidity and the vibration frequency to the vital sign monitoring system, so that the vital sign monitoring system can determine the in-box environmental information of the vital sign monitoring equipment based on the in-box temperature, the in-box humidity and the vibration frequency.
Specifically, the vital sign monitoring device may further include an environment sensing module configured to monitor an internal environment of the vital sign monitoring device, so as to ensure that internal environment parameters of the vital sign monitoring device are suitable for transporting a living being.
The environment sensing module may specifically include a temperature sensor, a humidity sensor, and a vibration sensor. The temperature sensor is mainly used for monitoring the temperature in the vital sign monitoring equipment to generate the temperature in the box; the humidity sensor is mainly used for monitoring the humidity in the box of the vital sign monitoring equipment to generate the humidity in the box; the vibration sensor is mainly used for monitoring vibration generated by the vital sign monitoring equipment in the transportation process to generate vibration frequency.
The communication module is also used for sending the temperature in the box, the humidity in the box and the vibration frequency to the vital sign monitoring system, and the vital sign monitoring system determines the environmental information in the box of the vital sign monitoring equipment. The in-box environment information is mainly used for describing the transportation environment of the organisms to be transported in the box body.
The vital sign monitoring system can also predict the health state of the organism to be transported according to the environmental information in the box. For example, if the temperature in the box in the environmental information in the box is higher than the preset temperature, physiological abnormality of the organism to be transported will occur, the body temperature will rise, and in severe cases, the organism will die. For another example, if the vibration frequency of the box body is greater than the preset frequency, the to-be-transported living beings are psychologically uneasy, and anxiety, attack behaviors and the like are reflected.
The vital sign monitoring system can send the in-box environment information to the transport client, so that the transport client prompts a transporter, the driving road is changed, or the in-car environment where the vital sign monitoring equipment is located is improved, and the transport environment of the organism to be transported is improved.
According to any one of the above embodiments, the bio-wearable module comprises a body temperature sensor, a heart rate sensor and a respiratory rate sensor;
the vital sign signals include a biological temperature signal, a biological heart rate signal, and a biological respiratory rate signal.
Specifically, from a functional structural point of view, the bio-wearable module may include a body temperature sensor, a heart rate sensor, a respiratory rate sensor, and the like. These sensors can monitor vital sign signals of the organism to be transported in a non-invasive manner.
Accordingly, the monitored vital sign signals may include a biological body temperature signal, a biological heart rate signal, and a biological respiratory rate signal.
Fig. 3 is a schematic structural diagram of a vital signs monitoring system provided by the present application, and as shown in fig. 3, the system includes a plurality of vital signs monitoring devices 200, a remote server 310, a transport client 320, and a user client 330, wherein the dashed lines represent communication connections.
The remote server 310 is connected to the vital signs monitoring device 200, the transport client 320 and the user client 330 via a wireless network. The remote server 310 can perform real-time localization and path tracking of the vital signs monitoring device 200; the vital sign signal, the real-time image signal and the real-time sound signal of the organism to be transported sent by the vital sign monitoring equipment 200 can be obtained, and the health state of the organism to be transported is determined; biological health anomaly alarm information can also be generated to give alarm prompts to the transport client 320 and the user client 330.
In addition, the remote server 310 may further receive a voice communication request sent by the user client 330, and send the voice sent by the user to the vital signs monitoring device 200, so as to enable the user to communicate with the living being through the voice.
The remote server 310 comprises a memory in which a computer program is stored and a processor arranged to execute the above described vital signs monitoring method by means of the computer program.
The application provides a vital sign monitoring system has realized monitoring biological health status when transporting biology for user or carrier can look over biological health status in real time, avoid living beings to take place the health problem in the transportation, have improved biological security and travelling comfort in the transportation.
Fig. 4 is a schematic view of a login process of the vital sign monitoring software provided in the present application, and as shown in fig. 4, the vital sign monitoring software may be installed in the transportation client and the user client to implement the above functions.
After logging in the vital sign monitoring software, the user can perform corresponding operation, wherein the login identity is divided into three login identities, namely, the identity of a common user, the identity of a transporter and the identity of an administrator. When a common user logs in, checking biological related information in a corresponding pet transport box by inputting the number of the target pet transport box (target vital sign monitoring equipment); when the identity of the transporter is logged in, the related information of organisms in all pet transport boxes which are responsible for the transporter can be checked; when the administrator logs in, the relevant information of all creatures in the pet transport case in use can be checked. The user can look over the real-time picture in the pet transport case and carry out pronunciation and exchange, can show the biological vital sign when wearing wearable module simultaneously, and when its vital sign appears unusually, the system interface can glimmer ruddiness and send out the alert and remind the user.
Based on any one of the above embodiments, the present application further provides a vital sign monitoring method. The vital sign monitoring method is widely applied to full-House intelligent digital control application scenes such as Smart homes (Smart Home), intelligent homes, intelligent Home equipment ecology, intelligent residence (Intelligent House) ecology and the like. In this embodiment, fig. 5 is a schematic diagram of a hardware environment of the vital sign monitoring method provided in this application, and the vital sign monitoring method can be applied to the hardware environment formed by the terminal device 501 and the server 502 shown in fig. 5. The server 502 is connected to the terminal device 501 through a network, and may be configured to provide services (such as application services) for the terminal or a client installed on the terminal, provide a database on the server or independent of the server, provide a data storage service for the server 502, configure a cloud computing and/or edge computing service on the server or independent of the server, and provide a data operation service for the server 502.
The network may include, but is not limited to, at least one of: wired networks, wireless networks. The wired network may include, but is not limited to, at least one of: wide area networks, metropolitan area networks, local area networks, which may include, but are not limited to, at least one of the following: WIFI (Wireless Fidelity ), bluetooth. Terminal equipment 501 can be but not limited to PC, the cell-phone, the panel computer, intelligent air conditioner, intelligent cigarette machine, intelligent refrigerator, intelligent oven, intelligent kitchen range, intelligent washing machine, intelligent water heater, intelligent washing equipment, intelligent dish washer, intelligent projection equipment, intelligent TV, intelligent clothes hanger, intelligent (window) curtain, intelligence audio-visual, smart jack, intelligent stereo set, intelligent audio amplifier, intelligent new trend equipment, intelligent kitchen guarding equipment, intelligent bathroom equipment, intelligence robot of sweeping the floor, intelligence robot of wiping the window, intelligence robot of mopping the ground, intelligent air purification equipment, intelligent steam ager, intelligent microwave oven, intelligent kitchen treasure, intelligent clarifier, intelligent water dispenser, intelligent lock etc..
Based on any one of the above embodiments, fig. 6 is a schematic structural diagram of an electronic device provided in the present application, and as shown in fig. 6, the electronic device may include: a Processor (Processor) 610, a communication Interface 620, a Memory (Memory) 630 and a communication Bus (communication Bus) 640, wherein the Processor 610, the communication Interface 620 and the Memory 630 are communicated with each other via the communication Bus 640. The processor 610 may call logical commands in the memory 630 to perform the following method:
receiving a vital sign signal, a real-time image signal and a real-time sound signal of a to-be-transported organism, which are sent by target vital sign monitoring equipment; determining a life health prediction result of the organism to be transported based on the vital sign signal; determining a first abnormal behavior prediction result of the organism to be transported based on the real-time image signal; determining a second abnormal behavior prediction result of the creature to be transported based on the real-time sound signal; determining a health state of the organism to be transported based on at least one of the life health prediction result, the first abnormal behavior prediction result, and the second abnormal behavior prediction result.
In addition, the logic commands in the memory 630 may be implemented in the form of software functional units and stored in a computer readable storage medium when the logic commands are sold or used as independent products. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including commands for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The processor in the electronic device provided in the embodiment of the present application may call a logic instruction in the memory to implement the method, and a specific implementation manner of the method is consistent with the implementation manner of the method, and the same beneficial effects may be achieved, which is not described herein again.
The embodiments of the present application further provide a computer-readable storage medium, on which a computer program is stored, where the computer program is implemented by a processor to execute the methods provided by the foregoing embodiments.
The specific implementation manner is the same as the implementation manner of the method, and the same beneficial effects can be achieved, which is not described herein again.
Embodiments of the present application provide a computer program product, comprising a computer program, which when executed by a processor, implements the method as described above.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.
Claims (10)
1. A vital sign monitoring method, comprising:
receiving a vital sign signal, a real-time image signal and a real-time sound signal of a to-be-transported organism sent by target vital sign monitoring equipment;
determining a life health prediction result of the organism to be transported based on the vital sign signal;
determining a first abnormal behavior prediction result of the organism to be transported based on the real-time image signal;
determining a second abnormal behavior prediction result of the organism to be transported based on the real-time sound signal;
determining the health state of the organism to be transported based on at least one of the life health prediction result, the first abnormal behavior prediction result and the second abnormal behavior prediction result.
2. The vital sign monitoring method of claim 1, wherein determining a first abnormal-behavior prediction of the living being to be transported based on the real-time image signal comprises:
continuously acquiring multi-frame images based on the real-time image signals;
determining pixels which change in the current frame image based on the difference between pixel values of pixels at corresponding positions in the current frame image and the previous frame image;
determining the change proportion of the pixels of the current frame image based on the number of the changed pixels in the current frame image and the total number of the pixels in the current frame image;
and determining a first abnormal behavior prediction result of the creature to be transported based on the average value of the pixel point variation proportion of the multi-frame image.
3. The vital sign monitoring method of claim 1, wherein determining a second abnormal-behavior prediction of the living being to be transported based on the real-time acoustic signal comprises:
determining the real-time sound signal;
inputting the real-time sound signal into an abnormal behavior prediction model to obtain a second abnormal behavior prediction result output by the abnormal behavior prediction model;
the abnormal behavior prediction model is obtained by training based on a sample sound signal and a second abnormal behavior prediction result of the sample sound signal; the sample sound signal is obtained by collecting the sound of the same type of animal of the organism to be transported.
4. Vital signs monitoring method according to claim 1, wherein after determining the health status of the living being to be transported, the method comprises:
generating biological health abnormal alarm information under the condition that the health state of the organism to be transported is abnormal;
and sending the biological health abnormal alarm information to a transportation client corresponding to the target vital sign monitoring equipment and a user client corresponding to the target vital sign monitoring equipment.
5. The vital sign monitoring equipment is characterized by comprising a box body, a biological wearable module, a video monitoring module, a sound interaction module and a communication module, wherein the video monitoring module, the sound interaction module and the communication module are arranged on the box body;
the biological wearable module is connected with the communication module and is used for acquiring vital sign signals of the organisms to be transported;
the video monitoring module is connected with the communication module and is used for acquiring a real-time image signal of the organism to be transported in the box body;
the sound interaction module is connected with the communication module and is used for acquiring a real-time sound signal of the organism to be transported in the box body;
the communication module is used for sending the vital sign signals, the real-time image signals and the real-time sound signals of the organisms to be transported to the vital sign monitoring system, so that the vital sign monitoring system can determine the health state of the organisms to be transported based on at least one of the vital sign signals, the real-time image signals and the real-time sound signals.
6. Vital signs monitoring device according to claim 5, further comprising:
the positioning module is connected with the communication module and used for determining a real-time position signal of the vital sign monitoring equipment;
the communication module is further used for sending the real-time position signal of the vital sign monitoring equipment to the vital sign monitoring system, so that the vital sign monitoring system can determine the transportation track of the living being to be transported based on the real-time position signal.
7. Vital signs monitoring device according to claim 5, further comprising:
the environment sensing module is connected with the communication module, comprises a temperature sensor, a humidity sensor and a vibration sensor, and is used for acquiring the temperature and the humidity in the box of the vital sign monitoring equipment and the vibration frequency of the vital sign monitoring equipment in the transportation process;
the communication module is further used for sending the in-box temperature, the in-box humidity and the vibration frequency to the vital sign monitoring system, so that the vital sign monitoring system can determine the in-box environment information of the vital sign monitoring equipment based on the in-box temperature, the in-box humidity and the vibration frequency.
8. Vital signs monitoring device according to claim 5, wherein the bio-wearable module comprises a body temperature sensor, a heart rate sensor and a breathing rate sensor;
the vital sign signals comprise a biological body temperature signal, a biological heart rate signal and a biological respiratory rate signal.
9. Vital signs monitoring system comprising a remote server, a transport client, a user client, and a plurality of vital signs monitoring devices as claimed in any one of claims 5 to 8;
the remote server comprises a memory in which a computer program is stored and a processor arranged to execute the vital signs monitoring method according to any of claims 1 to 4 by means of the computer program.
10. A computer-readable storage medium, comprising a stored program, wherein the program when executed performs the vital signs monitoring method of any of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211056676.3A CN115299896A (en) | 2022-08-30 | 2022-08-30 | Vital sign monitoring method, equipment, system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211056676.3A CN115299896A (en) | 2022-08-30 | 2022-08-30 | Vital sign monitoring method, equipment, system and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115299896A true CN115299896A (en) | 2022-11-08 |
Family
ID=83865544
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211056676.3A Pending CN115299896A (en) | 2022-08-30 | 2022-08-30 | Vital sign monitoring method, equipment, system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115299896A (en) |
-
2022
- 2022-08-30 CN CN202211056676.3A patent/CN115299896A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| García et al. | A systematic literature review on the use of machine learning in precision livestock farming | |
| KR102022893B1 (en) | Pet care method and system using the same | |
| US10362769B1 (en) | System and method for detection of disease breakouts | |
| JP5156030B2 (en) | Activity monitoring and display | |
| KR101725659B1 (en) | Animal Management System based on Internet of Things and Providing Method thereof | |
| BE1026887B1 (en) | METHOD OF INTELLIGENT MONITORING OF ONE OR MULTIPLE COMMERCIAL SITES FOR CREATIVE ANIMALS | |
| US20200383299A1 (en) | Systems and methods of homecage monitoring | |
| US20210287056A1 (en) | Ultrasound Analytics for Actionable Information | |
| KR102381906B1 (en) | Sensor-based pet ring for companion animal management and companion animal total care system using the same | |
| US20220022426A1 (en) | Device for monitoring the status of a livestock facility | |
| US11409989B2 (en) | Video object detection with co-occurrence | |
| EP3899934A1 (en) | Method for monitoring a livestock facility and/or livestock animals in a livestock facility using improved sound processing techniques | |
| KR102026183B1 (en) | Method and system for state analysis of pets using sensor technology | |
| Geers | Electronic monitoring of farm animals: a review of research and development requirements and expected benefits | |
| KR20200108964A (en) | A Iot Sensing type of a System for Detecting a Condition of a Pet and A System for Managing the Pet Using the Same | |
| US11011048B2 (en) | System and method for generating a status output based on sound emitted by an animal | |
| CN109709546B (en) | Pet state monitoring method and device | |
| CN111414829B (en) | Method and device for sending alarm information | |
| CN115299896A (en) | Vital sign monitoring method, equipment, system and storage medium | |
| KR102341715B1 (en) | Apparatus and method for livestock monitoring | |
| CN115171153A (en) | Object type determination method and device, storage medium and electronic device | |
| CN112711233A (en) | Intelligent household control method and device, processor, storage medium and electronic equipment | |
| Zhang et al. | Advancements in artificial intelligence technology for improving animal welfare: Current applications and research progress | |
| KR102457230B1 (en) | Companion animal judgment and prediction system through big data learning | |
| Kandepan et al. | A Novel Approach to Diagnose the Animal Health Continuous Monitoring Using IoT Based Sensory Data. |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |