CN114038162A - Vulnerable user nursing and alarming method, equipment and medium - Google Patents
Vulnerable user nursing and alarming method, equipment and medium Download PDFInfo
- Publication number
- CN114038162A CN114038162A CN202111636140.4A CN202111636140A CN114038162A CN 114038162 A CN114038162 A CN 114038162A CN 202111636140 A CN202111636140 A CN 202111636140A CN 114038162 A CN114038162 A CN 114038162A
- Authority
- CN
- China
- Prior art keywords
- state
- information
- vulnerable user
- vulnerable
- human body
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 50
- 230000000474 nursing effect Effects 0.000 title claims abstract description 30
- 230000002159 abnormal effect Effects 0.000 claims abstract description 46
- 238000001514 detection method Methods 0.000 claims abstract description 30
- 238000004458 analytical method Methods 0.000 claims abstract description 17
- 238000012544 monitoring process Methods 0.000 claims description 27
- 230000006399 behavior Effects 0.000 claims description 16
- 238000004891 communication Methods 0.000 claims description 12
- 238000006243 chemical reaction Methods 0.000 claims description 7
- 230000029058 respiratory gaseous exchange Effects 0.000 claims description 7
- 230000005856 abnormality Effects 0.000 claims description 6
- 238000012806 monitoring device Methods 0.000 claims description 6
- 230000000241 respiratory effect Effects 0.000 claims description 6
- 238000001914 filtration Methods 0.000 claims description 4
- 238000010606 normalization Methods 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 11
- 238000004590 computer program Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 230000009286 beneficial effect Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000004422 calculation algorithm Methods 0.000 description 3
- 230000005611 electricity Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 208000030090 Acute Disease Diseases 0.000 description 1
- 208000024172 Cardiovascular disease Diseases 0.000 description 1
- 208000003443 Unconsciousness Diseases 0.000 description 1
- 230000032683 aging Effects 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000036772 blood pressure Effects 0.000 description 1
- 230000036760 body temperature Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 208000026106 cerebrovascular disease Diseases 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 201000010099 disease Diseases 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 230000002526 effect on cardiovascular system Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000009545 invasion Effects 0.000 description 1
- 230000033001 locomotion Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
- G08B21/0407—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
- G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
- G08B25/08—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using communication transmission lines
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
- G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
- G08B25/10—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using wireless transmission systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Emergency Management (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Psychiatry (AREA)
- Gerontology & Geriatric Medicine (AREA)
- General Health & Medical Sciences (AREA)
- Social Psychology (AREA)
- Psychology (AREA)
- Computer Networks & Wireless Communication (AREA)
- Alarm Systems (AREA)
- Emergency Alarm Devices (AREA)
Abstract
The application discloses a nursing and alarming method, equipment and medium for vulnerable groups, which are used for solving the technical problem that the existing nursing method for vulnerable groups is difficult to ensure the privacy of users and can also fully ensure the body safety of the users. The method comprises the following steps: acquiring a human body reflection signal; acquiring human body point cloud information corresponding to the vulnerable user according to the human body reflection signal so as to obtain body state information of the vulnerable user according to the human body point cloud information; carrying out abnormity detection on the body state information, controlling a camera in an unpowered state to be powered on under the condition that the body state information is abnormal, and acquiring a state video stream of the vulnerable user through the powered camera so as to carry out behavior analysis on the state video stream and determine the field state of the vulnerable user; and sending alarm information under the condition of determining that the field state is abnormal, and distributing the permission of checking the camera for a receiving end corresponding to the alarm information.
Description
Technical Field
The application relates to the field of intelligent nursing, in particular to a nursing alarm method, equipment and medium for vulnerable users.
Background
The vulnerable users generally refer to the groups of the old, the weak, the sick, the disabled, the pregnant and the like which need to be cared by others, and the nursing problem of the vulnerable user groups is more prominent with the increasing population.
At present, monitoring products such as a video monitoring camera and a millimeter wave radar are used for nursing the old, but the camera is difficult to be widely applied due to invasion of personal privacy, the false alarm rate of the millimeter wave radar is high, the existing nursing products are difficult to accurately know the body state of a vulnerable user while the privacy of the vulnerable user is fully ensured, and the monitoring personnel are difficult to help to take corresponding emergency measures.
Disclosure of Invention
In order to solve the above problem, the present application provides a method for nursing and alarming a vulnerable user, including: acquiring a human body reflection signal; acquiring human body point cloud information corresponding to the vulnerable user according to the human body reflection signal so as to obtain body state information of the vulnerable user according to the human body point cloud information; carrying out abnormity detection on the body state information, controlling a camera in an unpowered state to be powered on under the condition that the body state information is abnormal, and acquiring a state video stream of the vulnerable user through the powered camera so as to carry out behavior analysis on the state video stream and determine the field state of the vulnerable user; and sending alarm information under the condition of determining that the field state is abnormal, and distributing the permission of checking the camera for a receiving end corresponding to the alarm information.
In one implementation of the present application, the body state information includes vital sign information and body posture information, the vital sign information includes respiration data and heart rate data; obtaining the body state information of the vulnerable user according to the human body point cloud information, which specifically comprises the following steps: carrying out coordinate conversion on the human body point cloud information to obtain point cloud data based on a three-dimensional coordinate system; according to the point cloud data, respiratory heart rate detection is carried out on the vulnerable user to obtain corresponding respiratory data and heart rate data; the abnormal detection of the body state information specifically comprises the following steps: normalizing the point cloud data; determining whether the body posture of the vulnerable user accords with the falling posture or not according to the normalized point cloud data based on a preset falling detection model; and determining that the body state information is abnormal under the condition that the respiratory data or the heart rate data are not accordant with the vital sign information acquired under the normal state or the body posture of the vulnerable user is a falling posture.
In one implementation manner of the application, an electromagnetic opening and closing baffle is arranged on the camera and is in a normally closed state; controlling a camera in a non-powered state to be powered on, acquiring a state video stream of a vulnerable user through the powered camera, and performing behavior analysis on the state video stream to determine the field state of the vulnerable user, wherein the method specifically comprises the following steps: under the condition that the body state information is abnormal, controlling the electromagnetic type opening and closing baffle to be electrified so as to convert the electromagnetic type opening and closing baffle from a normally closed state to an open state; under the condition that the electromagnetic type opening and closing baffle is in an opening state, controlling the camera to be electrified so as to obtain state video stream of a vulnerable user through the electrified camera; and performing behavior analysis on the state video stream to determine the field state of the vulnerable user.
In one implementation manner of the present application, after performing behavior analysis on the state video stream, the method further includes: under the condition that the field state of the vulnerable user is abnormal, target detection is carried out on the appointed frame image in the state video stream to obtain a target detection result; and confirming that the field state is abnormal when the target detection result confirms that the field state of the vulnerable user is also abnormal.
In an implementation manner of the present application, the alarm information is sent, and a permission for checking the camera is allocated to a receiving end corresponding to the alarm information, which specifically includes: sending the associated information corresponding to the vulnerable user to a monitoring system and a terminal corresponding to a contact of the vulnerable user, wherein the associated information comprises identity information, position information and body state information of the vulnerable user; and the permission of viewing the camera is distributed to the terminals corresponding to the monitoring system and the contact person, so that the monitoring personnel and the contact person corresponding to the monitoring system can view the field state of the vulnerable user.
In one implementation manner of the present application, after the abnormality detection is performed on the body state information, the method further includes: under the condition that the body state information is abnormal, carrying out emergency communication with the vulnerable user through the two-way voice intercom module, and inquiring the current body state of the vulnerable user; the two-way voice talkback module realizes two-way voice talkback based on a wireless communication mode.
In one implementation manner of the present application, after acquiring the human body reflection signal, the method further includes: filtering the human body reflection signal to filter noise in the human body reflection signal; amplifying the filtered human body reflection signal to ensure that the amplitude of the human body reflection signal reaches a preset analog-to-digital conversion threshold value.
In one implementation manner of the present application, after sending the alarm information, the method further includes: the wireless control electromagnetic lock arranged at the door of the house is opened through a terminal corresponding to a contact under the condition that the monitoring device arranged at the door of the house where the vulnerable user is located determines that rescue workers arrive at the door of the house.
The embodiment of the application provides a vulnerable user nurse alarm device, and the device includes: at least one processor, and a memory communicatively coupled to the at least one processor, wherein the memory stores executable instructions of the at least one processor to enable the at least one processor to: acquiring a human body reflection signal; acquiring human body point cloud information corresponding to the vulnerable user according to the human body reflection signal so as to obtain body state information of the vulnerable user according to the human body point cloud information; carrying out abnormity detection on the body state information, controlling a camera in an unpowered state to be powered on under the condition that the body state information is abnormal, and acquiring a state video stream of the vulnerable user through the powered camera so as to carry out behavior analysis on the state video stream and determine the field state of the vulnerable user; and sending alarm information under the condition of determining that the field state is abnormal, and distributing the permission of checking the camera for a receiving end corresponding to the alarm information.
An embodiment of the present application further provides a non-volatile storage medium, in which computer-executable instructions are stored, where the computer-executable instructions include: acquiring a human body reflection signal; acquiring human body point cloud information corresponding to the vulnerable user according to the human body reflection signal so as to obtain body state information of the vulnerable user according to the human body point cloud information; carrying out abnormity detection on the body state information, controlling a camera in an unpowered state to be powered on under the condition that the body state information is abnormal, and acquiring a state video stream of the vulnerable user through the powered camera so as to carry out behavior analysis on the state video stream and determine the field state of the vulnerable user; and sending alarm information under the condition of determining that the field state is abnormal, and distributing the permission of checking the camera for a receiving end corresponding to the alarm information.
The nursing and alarming method, equipment and medium for the vulnerable user provided by the embodiment of the application have the following beneficial effects at least:
the body state of the vulnerable user is monitored in real time through the human body reflection signal, and when the vulnerable user is in a normal state, the camera is in an unpowered state, so that the privacy of the user is fully protected from being invaded; under the condition that the weak user is judged to have abnormity, the on-site state of the weak user can be secondarily confirmed through the electrified camera, and the body state abnormity can be determined only under the condition that the secondary verification is passed, so that the probability of false detection is reduced. And when the alarm information is sent, the receiving end can automatically obtain the permission to check the camera, so that the privacy of the vulnerable user can be ensured under the abnormal state, the physical condition of the vulnerable user can be comprehensively known through the electrified camera under the abnormal condition, and the blind worry is avoided.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a schematic flow chart of a vulnerable user nursing alarm method according to an embodiment of the present application;
fig. 2 is a schematic structural diagram of a main controller according to an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of a vulnerable user nursing alarm device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be described in detail and completely with reference to the following specific embodiments of the present application and the accompanying drawings. It should be apparent that the described embodiments are only some of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The vulnerable user generally refers to an individual with relatively weak adaptability and resistance to social environment and natural environment, such as the elderly, children, pregnant women, handicapped people, and the like. In the case of the elderly, the population of 60 years old and older in China at the end of 2018 is counted to be 2.49 hundred million people and accounts for 17.9 percent, wherein the population of 65 years old and older is counted to be 1.6 hundred million people and accounts for 11.9 percent. The population of the aged people in China will further increase in the future. By 2020, the empty nester in China has more than 1 hundred million people, and the solitary old people have more than 2000 million people, which means that the peak of population aging is coming. Even if a professional nursing institution is available for old people, the old people are difficult to take care of in real time due to the restriction of manpower and operation cost. In addition, the elderly are weak in constitution and high in acute disease incidence rate, so that the elderly are prone to fall down or sudden cardiovascular and cerebrovascular diseases, so that the elderly are life-threatening, and serious consequences can be caused if the elderly cannot find the diseases in time.
The embodiment of the application provides a nursing alarm method, equipment and medium for vulnerable users by taking the elderly as an example, and aims to solve the technical problem that the existing nursing method for vulnerable groups is difficult to guarantee the privacy of the users and can also fully guarantee the body safety of the users. Of course, other types of vulnerable users can also realize real-time nursing through the nursing alarm method provided by the embodiment of the application, and the detailed description is omitted here.
The technical solutions provided by the embodiments of the present application are described in detail below with reference to the accompanying drawings.
As shown in fig. 1, an embodiment of the present application provides a method for nursing and alarming a vulnerable user, including:
s101: and acquiring a human body reflection signal.
The millimeter wave radar as a monitoring device can be installed in rooms such as living rooms, bedrooms and toilets of houses where the elderly live, and can also be installed in a living room of an elderly care institution, where the living room refers to a room where the elderly often take activities and no one attends to the living room in real time, such as the living room of the elderly.
The embodiment of the application selects 60GHz FMCW millimeter wave radar as monitoring equipment, and is provided with 4 transmitting channels T1, T2, T3 and T4 and 4 receiving channels R1, R2, R3 and R4. The millimeter wave radar can be installed in a hanging mode or in a ceiling mode, a transmitting channel of the millimeter wave radar is used for transmitting radar signals to all directions in space, and a receiving channel of the millimeter wave radar is used for receiving the radar signals reflected by a human body. In practical application, the millimeter wave radar can be installed in a hidden mode, the environment is detected in a non-sensing mode, and the trouble of monitoring at any moment is not brought to the old people while the safety of the old people is protected.
After receiving the human body reflection signal, the server can filter the human body reflection signal through the filtering module, so that noise in the human body reflection signal is filtered. And then, amplifying the filtered human body reflection signal through a signal amplification module to ensure that the amplitude of the human body reflection signal reaches a preset ADC threshold value. The filtering module consists of a low-pass filter and a high-pass filter, and the signal amplifying module consists of a signal amplifying module.
It should be noted that, the server in the embodiment of the present application is used as an execution subject, and is only exemplary, and is not limited to the server as an execution subject, and may be specifically adjusted according to actual situations.
S102: and acquiring the human body point cloud information corresponding to the vulnerable user according to the human body reflection signal so as to obtain the body state information of the vulnerable user according to the human body point cloud information.
In the embodiment of the application, the server can process the waveform data formed by the transmitting-receiving antenna array through the DSP processing module, so that the human body point cloud information of the old people can be obtained. However, coordinates of each point in the point cloud information exist in the form of a (distance, horizontal angle, vertical angle), and in order to extract spatial information, coordinate conversion needs to be performed on the point cloud information to obtain point cloud data a (X, Y, Z) based on a three-dimensional coordinate system. And then, detecting the breathing data and the heart rate data corresponding to the old people according to the point cloud data after coordinate conversion by using a breathing heart rate detection algorithm. The current body posture information of the old can be extracted through the human point cloud information after coordinate conversion.
S103: and carrying out abnormity detection on the body state information, controlling the camera in the unpowered state to be powered on under the condition that the body state information is abnormal, and acquiring a state video stream of the vulnerable user through the powered camera so as to carry out behavior analysis on the state video stream and determine the field state of the vulnerable user.
The body state information includes vital sign information and body posture information. The body posture information is used for judging whether the old people fall down currently, and the vital sign information comprises respiration data and heart rate data and can also comprise characteristic data such as blood pressure, pulse, body temperature and the like. This application is exemplified with respiratory data and heart rate data, and it is no longer repeated to other types of vital sign information.
After the body state information of the old people is obtained, the server needs to normalize the point cloud data, then inputs the normalized point cloud data into a preset falling detection model, and determines whether the body posture of the old people meets the falling posture. If the breathing data or the heart rate data do not accord with the vital sign information collected in the normal state, or the body posture of the old man is a falling posture, the fact that the body state information of the current old man is abnormal can be obtained. However, there may be a certain error in monitoring the state of the old people only by the millimeter wave radar, for example, a nursing product such as the millimeter wave radar falls down to misdetect the fall of the old people, and therefore, the current situation of the old people needs to be further checked to confirm the real state of the old people on site.
In the embodiment of the application, the confirmation of the field state of the old can be realized through the camera. The camera here is the hidden camera of electromagnetism switching, is equipped with the electromagnetic type switching baffle on the camera, and the accessible main control unit control is electrified from top to bottom to realize closing and opening of window. As shown in fig. 2, the main controller adopts a Jetson Nano core module, which can provide 472GFLOPS calculation performance for running AI algorithm and has rich interfaces such as USB, mipi, IIS, UART, GPIO, and the like. Wherein, main control unit accessible USB interface control USB's connection, through SDIO interface control WIFI, the bluetooth, through the switch of GPIO interface control state pilot lamp, can also pass through the electricity from top to bottom of GPIO interface control electromagnetic type switching baffle, through the switching of UART interface control radar module, through the electricity from top to bottom of mipi interface control camera, decode through the code of IIS interface control audio frequency, carry out wireless communication through corresponding 4G or 5G module of M.2USB interface apolegamy. The electromagnetic opening and closing hidden camera can be realized by adopting a camera with USB, RGB and mipi interfaces and is matched with the main controller.
The electromagnetic type switching baffle is in normally closed state, and under normal condition, the window of the hidden camera of electromagnetism switching is closed, and the camera lens is sheltered from by physics, can not form images. When the body state of the old is monitored to be abnormal, the server can control the electromagnetic type opening and closing baffle to be electrified through the main controller, and therefore the electromagnetic type opening and closing baffle is converted into an opening state from a normally closed state. Therefore, when the electromagnetic type opening and closing baffle is in an opening state, the window is opened, the server can control the electromagnetic opening and closing hidden camera to be electrified through the main controller to obtain the state video stream of the old, and the old in the state video stream is subjected to behavior analysis through a behavior analysis algorithm built in the main controller, so that the field state of the old is determined. When the abnormal condition takes place, the camera is in outage closed condition, and the camera lens is sheltered from by electromagnetic type switching baffle, has guaranteed old man's privacy, has also reduced simultaneously and has been in the extra energy consumption that the open mode brought often.
Under the condition that the body state of the old is monitored to be abnormal, the bidirectional voice intercom module can be driven to carry out emergency communication with the old through the main controller, the current body state of the old is inquired, and the old is duly pacified. Two-way pronunciation are talkbacked the module and are become by the adapter of making an uproar, loudspeaker, audio frequency codec chip of falling, and the old man's accessible falls the adapter of making an uproar and talks with other people. It should be noted that, the two-way voice intercom module in the embodiment of the present application implements two-way voice intercom based on a wireless communication mode, where the wireless communication mode may be Wi-Fi communication, or may be 4G or 5G communication.
However, the video stream collected by the camera is used for determining the scene state of the old people, and occasionally misjudgment may occur. In order to further reduce errors, human body target detection can be carried out through specified frame images in the state video stream, and the specified frame images can be intercepted continuous frame images or a plurality of frame break images acquired at fixed intervals. After the target detection result of the image frame is obtained, if the target detection result also confirms that the field state of the old man is abnormal, the abnormality of the current body state of the old man is determined, and an alarm is required to wait for emergency treatment.
S104: and sending alarm information under the condition of determining that the field state is abnormal, and distributing the permission of checking the camera for a receiving end corresponding to the alarm information.
The receiving end includes the terminal that backstage monitoring system and guardian correspond, and the terminal includes but not limited to portable's terminal equipment such as cell-phone, flat board, electron bracelet, and backstage monitoring system can set up in the control room of endowment mechanism, has special monitoring personnel to monitor here. The server can send the alarm information to the monitoring system and the terminal corresponding to the contact of the old person in a wireless communication mode. The contact person can be a guardian or a relatives and friends mutually trusting the old. The monitoring system is arranged on the background and is composed of a data display large screen, the state information of the laid monitoring point positions can be displayed in real time, when alarm information is generated, the monitoring system can give an alarm through sound and light and push desktop information, so that monitoring personnel can be prompted to find abnormal conditions in time and take corresponding treatment measures. The old man guardian's terminal is equipped with corresponding warning application software, and when the old man took place the abnormity and reports to the police, the warning information accessible application software carries out the message propelling movement, still accompanies special message suggestion and the suggestion of popping up the window repeatedly simultaneously.
The alarm information can be pictures or transient video clips of the site where the old people are located, and the server can send the relevant information of the old people to the monitoring system and the contact terminal at the same time. The associated information includes the identity information, position information and body state information of the elderly. Of course, if the old people are abnormal in the living room of the nursing mechanism, the server can also send the relevant information of the monitoring device to the background monitoring system and the contact person terminal, wherein the relevant information represents the relevant relationship between the monitoring device and the monitored old people, for example, the millimeter wave radar can be numbered, the millimeter wave radar No. 1 is arranged in the living room 101, and the living room 101 is populated with the old people A, so that when the millimeter wave radar No. 1 detects the abnormality, the identity A of the old people with the abnormality and the living room position 101 of the old people can be determined through the relevant information recorded when the device is installed in advance. When sending alarm information, the server also can look over the authority of the hidden camera of electromagnetism switching simultaneously, distributes to the terminal that backstage monitoring system and contact correspond, and like this, monitoring personnel and contact could look over old man's on-the-spot state through the camera in the very first time of receiving alarm information. Moreover, the background monitoring personnel and the contact person can check the condition of the aged who is cared only when receiving the alarm information through the camera, so that the privacy of the aged can be guaranteed under the abnormal condition, the field state of the aged can be comprehensively known when the abnormal condition occurs, and blind worry is avoided.
After the background system and the contact receive the alarm information, corresponding emergency measures can be taken for processing according to the geographical position and the abnormal degree of the old. For example, if the old falls down but the consciousness is still awake, the old can be checked by a guardian or a neighbor and corresponding measures are taken; if the elderly are unconscious, the nearest rescue center needs to be dispatched to rescue immediately, and persons with rescue experience need to be informed to participate in the first aid before professional rescuers arrive. When professional rescue workers do not arrive, the millimeter wave radar can also acquire the body state information of the old people in real time, and the information is sent to a rescue worker side in a wireless communication mode through the scheduling of the main controller, so that the rescue workers can master the body state of the old people to be rescued in real time.
For the old people living alone, children and women are not around, if the body of the old people is abnormal, the old people can be unlocked through the remote control equipment arranged on the contact terminal. Specifically, whether rescue workers arrive at the house door is determined through a monitoring device arranged at the house door where the old people are located. When the rescue workers are driven to the room, the wireless control electromagnetic lock arranged at the door of the room can be remotely opened through the terminal of the guardian. Like this just can in time open the room door in the very first time that the rescue personnel arrived, reduced the rescue degree of difficulty, reduced the extra time of rescuing the cost on the way, ensured old man's life safety.
The above is the method embodiment proposed by the present application. Based on the same idea, some embodiments of the present application further provide a device and a non-volatile computer storage medium corresponding to the above method.
Fig. 3 is a schematic structural diagram of a vulnerable user nursing alarm device according to an embodiment of the present application. As shown in fig. 3, includes:
at least one processor; and the number of the first and second groups,
at least one processor communicatively coupled memory; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to cause the at least one processor to:
acquiring a human body reflection signal;
acquiring human body point cloud information corresponding to the vulnerable user according to the human body reflection signal so as to obtain body state information of the vulnerable user according to the human body point cloud information;
carrying out abnormity detection on the body state information, controlling a camera in an unpowered state to be powered on under the condition that the body state information is abnormal, and acquiring a state video stream of the vulnerable user through the powered camera so as to carry out behavior analysis on the state video stream and determine the field state of the vulnerable user;
and sending alarm information under the condition of determining that the field state is abnormal, and distributing the permission of checking the camera for a receiving end corresponding to the alarm information.
A non-volatile computer storage medium provided in an embodiment of the present application stores computer-executable instructions, and the computer-executable instructions are configured to:
acquiring a human body reflection signal;
acquiring human body point cloud information corresponding to the vulnerable user according to the human body reflection signal so as to obtain body state information of the vulnerable user according to the human body point cloud information;
carrying out abnormity detection on the body state information, controlling a camera in an unpowered state to be powered on under the condition that the body state information is abnormal, and acquiring a state video stream of the vulnerable user through the powered camera so as to carry out behavior analysis on the state video stream and determine the field state of the vulnerable user;
and sending alarm information under the condition of determining that the field state is abnormal, and distributing the permission of checking the camera for a receiving end corresponding to the alarm information.
The embodiments in the present application are described in a progressive manner, and the same and similar parts among the embodiments can be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the device and media embodiments, the description is relatively simple as it is substantially similar to the method embodiments, and reference may be made to some descriptions of the method embodiments for relevant points.
The device and the medium provided by the embodiment of the application correspond to the method one to one, so the device and the medium also have the similar beneficial technical effects as the corresponding method, and the beneficial technical effects of the method are explained in detail above, so the beneficial technical effects of the device and the medium are not repeated herein.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (10)
1. A method for nursing and alarming a vulnerable user, the method comprising:
acquiring a human body reflection signal;
acquiring human body point cloud information corresponding to the vulnerable user according to the human body reflection signal so as to obtain body state information of the vulnerable user according to the human body point cloud information;
carrying out abnormity detection on the body state information, controlling a camera in an unpowered state to be powered on under the condition that the body state information is abnormal, acquiring a state video stream of the vulnerable user through the powered camera, and carrying out behavior analysis on the state video stream to determine the field state of the vulnerable user;
and sending alarm information under the condition that the field state is determined to be abnormal, and distributing the permission for checking the camera to a receiving end corresponding to the alarm information.
2. The vulnerable user nursing alarm method of claim 1, wherein the body state information comprises vital sign information and body posture information, the vital sign information comprises respiration data and heart rate data;
obtaining the body state information of the vulnerable user according to the human body point cloud information, which specifically comprises the following steps:
performing coordinate conversion on the human body point cloud information to obtain point cloud data based on a three-dimensional coordinate system;
according to the point cloud data, respiratory heart rate detection is carried out on the vulnerable user to obtain corresponding respiratory data and heart rate data;
carrying out abnormality detection on the body state information, which specifically comprises the following steps:
normalizing the point cloud data;
determining whether the body posture of the vulnerable user accords with a falling posture or not according to the point cloud data after normalization on the basis of a preset falling detection model;
and determining that the body state information is abnormal under the condition that the respiration data or the heart rate data does not accord with the vital sign information acquired under the normal state or the body posture of the vulnerable user is a falling posture.
3. The method for nursing and alarming the vulnerable user of claim 1, wherein the camera is provided with an electromagnetic opening and closing baffle which is in a normally closed state;
controlling a camera in a non-powered state to be powered on, acquiring a state video stream of the vulnerable user through the powered camera, performing behavior analysis on the state video stream, and determining the field state of the vulnerable user, wherein the method specifically comprises the following steps:
under the condition that the body state information is abnormal, controlling the electromagnetic type opening and closing baffle to be electrified so as to convert the electromagnetic type opening and closing baffle from a normally closed state to an open state;
under the condition that the electromagnetic type opening and closing baffle is in an opening state, controlling the camera to be electrified so as to obtain the state video stream of the vulnerable user through the electrified camera;
and performing behavior analysis on the state video stream to determine the field state of the vulnerable user.
4. A vulnerable user nursing alarm method according to claim 3, wherein after analyzing the status video stream, the method further comprises:
under the condition that the field state of the vulnerable user is abnormal, carrying out target detection on a specified frame image in the state video stream to obtain a target detection result;
and confirming that the field state is abnormal when the target detection result confirms that the field state of the vulnerable user is also abnormal.
5. The method for nursing and alarming a vulnerable user according to claim 1, wherein sending alarm information and assigning a right to view the camera to a receiving end corresponding to the alarm information specifically comprises:
sending the associated information corresponding to the vulnerable user to a monitoring system and a terminal corresponding to a contact of the vulnerable user, wherein the associated information comprises identity information, position information and body state information of the vulnerable user;
and distributing the permission for viewing the camera to terminals corresponding to the monitoring system and the contact person so that the monitoring personnel corresponding to the monitoring system and the contact person can view the field state of the vulnerable user.
6. A vulnerable user nursing alarm method according to claim 1, wherein after abnormality detection of said body state information, said method further comprises:
under the condition that the body state information is abnormal, carrying out emergency communication with the vulnerable user through a two-way voice intercom module, and inquiring the current body state of the vulnerable user; the two-way voice talkback module realizes two-way voice talkback based on a wireless communication mode.
7. The vulnerable user nursing alarm method of claim 1, wherein after acquiring the human body reflection signal, the method further comprises:
filtering the human body reflection signal to filter noise in the human body reflection signal;
amplifying the filtered human body reflection signal to ensure that the amplitude of the human body reflection signal reaches a preset analog-to-digital conversion threshold value.
8. A vulnerable user nursing alarm method according to claim 1, wherein after sending alarm information, said method further comprises:
the wireless control electromagnetic lock arranged at the door of the house is opened through a terminal corresponding to a contact under the condition that the monitoring device arranged at the door of the house where the vulnerable user is located determines that rescue workers arrive at the door of the house.
9. An vulnerable user care alarm device, characterized in that the device comprises:
at least one processor, and,
a memory communicatively coupled to the at least one processor, wherein,
the memory stores executable instructions of at least one processor to enable the at least one processor to:
acquiring a human body reflection signal;
acquiring human body point cloud information corresponding to the vulnerable user according to the human body reflection signal so as to obtain body state information of the vulnerable user according to the human body point cloud information;
carrying out abnormity detection on the body state information, controlling a camera in an unpowered state to be powered on under the condition that the body state information is abnormal, acquiring a state video stream of the vulnerable user through the powered camera, and carrying out behavior analysis on the state video stream to determine the field state of the vulnerable user;
and sending alarm information under the condition that the field state is determined to be abnormal, and distributing the permission for checking the camera to a receiving end corresponding to the alarm information.
10. A non-volatile storage medium storing computer-executable instructions, the executable instructions comprising:
acquiring a human body reflection signal;
acquiring human body point cloud information corresponding to the vulnerable user according to the human body reflection signal so as to obtain body state information of the vulnerable user according to the human body point cloud information;
carrying out abnormity detection on the body state information, controlling a camera in an unpowered state to be powered on under the condition that the body state information is abnormal, acquiring a state video stream of the vulnerable user through the powered camera, and carrying out behavior analysis on the state video stream to determine the field state of the vulnerable user;
and sending alarm information under the condition that the field state is determined to be abnormal, and distributing the permission for checking the camera to a receiving end corresponding to the alarm information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111636140.4A CN114038162A (en) | 2021-12-29 | 2021-12-29 | Vulnerable user nursing and alarming method, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111636140.4A CN114038162A (en) | 2021-12-29 | 2021-12-29 | Vulnerable user nursing and alarming method, equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114038162A true CN114038162A (en) | 2022-02-11 |
Family
ID=80141059
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111636140.4A Pending CN114038162A (en) | 2021-12-29 | 2021-12-29 | Vulnerable user nursing and alarming method, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114038162A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114706318A (en) * | 2022-04-18 | 2022-07-05 | 深圳亿思腾达集成股份有限公司 | Monitoring method and system based on smart home and terminal equipment |
| CN115268281A (en) * | 2022-06-27 | 2022-11-01 | 青岛海尔科技有限公司 | Control instruction sending method and device, storage medium and electronic device |
| CN115770013A (en) * | 2022-11-30 | 2023-03-10 | 北京中科睿医信息科技有限公司 | Eye movement test method, device, equipment and medium for assisting vulnerable group |
Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20080073802A (en) * | 2007-02-06 | 2008-08-12 | (주)시대전기 | Method for providing security service using internet |
| US20120314901A1 (en) * | 2011-04-04 | 2012-12-13 | Alarm.Com | Fall Detection and Reporting Technology |
| CN103325080A (en) * | 2013-06-21 | 2013-09-25 | 电子科技大学 | Gerocamium intelligent nursing system and method based on Internet of Things technology |
| CN104660991A (en) * | 2015-02-02 | 2015-05-27 | 上海理工大学 | Indoor video monitoring system |
| CN105979220A (en) * | 2016-06-21 | 2016-09-28 | 南京工业大学 | Household old person monitoring intelligent mobile trolley, monitoring system and monitoring method thereof |
| CN107613852A (en) * | 2015-06-09 | 2018-01-19 | 柯尼卡美能达株式会社 | The central processing unit and central processing method and monitored person's monitoring system of monitored person's monitoring system |
| CN108091105A (en) * | 2018-01-31 | 2018-05-29 | 重庆大学 | A kind of house old man nursing method and care system |
| KR101863846B1 (en) * | 2016-12-06 | 2018-06-01 | (주)월드정보기술 | Method and system for sensing event and providing spot picture |
| CN108833586A (en) * | 2018-07-05 | 2018-11-16 | 浙江中点人工智能科技有限公司 | A kind of household old man nurse intelligence system |
| CN110708422A (en) * | 2019-09-24 | 2020-01-17 | 捷开通讯(深圳)有限公司 | Intelligent emergency method, device, storage medium and terminal |
| CN111510665A (en) * | 2019-01-30 | 2020-08-07 | 杭州海康威视数字技术股份有限公司 | Monitoring system, monitoring method and device combining millimeter wave radar and camera |
| CN111680651A (en) * | 2020-06-12 | 2020-09-18 | 武汉星巡智能科技有限公司 | Non-contact vital sign detection method, device, storage medium and system |
| CN112346055A (en) * | 2020-10-23 | 2021-02-09 | 无锡威孚高科技集团股份有限公司 | Fall detection method and device based on millimeter wave radar and millimeter wave radar equipment |
| CN112837504A (en) * | 2021-02-09 | 2021-05-25 | 中云沃达（山东）物联网科技有限公司 | Nursing device, system and monitored control system based on millimeter wave detection |
| CN113114977A (en) * | 2021-02-20 | 2021-07-13 | 广州颐寿科技有限公司 | Intelligent nursing system and intelligent nursing method |
| JP2021103391A (en) * | 2019-12-25 | 2021-07-15 | 本田技研工業株式会社 | Watching device |
| CN113658412A (en) * | 2021-08-05 | 2021-11-16 | 南京信息职业技术学院 | Millimeter wave radar-based household old people behavior monitoring method and system |
| CN215006886U (en) * | 2021-05-24 | 2021-12-03 | 上海千帆科技股份有限公司 | Anti-falling system of nursing home |
-
2021
- 2021-12-29 CN CN202111636140.4A patent/CN114038162A/en active Pending
Patent Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20080073802A (en) * | 2007-02-06 | 2008-08-12 | (주)시대전기 | Method for providing security service using internet |
| US20120314901A1 (en) * | 2011-04-04 | 2012-12-13 | Alarm.Com | Fall Detection and Reporting Technology |
| CN103325080A (en) * | 2013-06-21 | 2013-09-25 | 电子科技大学 | Gerocamium intelligent nursing system and method based on Internet of Things technology |
| CN104660991A (en) * | 2015-02-02 | 2015-05-27 | 上海理工大学 | Indoor video monitoring system |
| CN107613852A (en) * | 2015-06-09 | 2018-01-19 | 柯尼卡美能达株式会社 | The central processing unit and central processing method and monitored person's monitoring system of monitored person's monitoring system |
| CN105979220A (en) * | 2016-06-21 | 2016-09-28 | 南京工业大学 | Household old person monitoring intelligent mobile trolley, monitoring system and monitoring method thereof |
| KR101863846B1 (en) * | 2016-12-06 | 2018-06-01 | (주)월드정보기술 | Method and system for sensing event and providing spot picture |
| CN108091105A (en) * | 2018-01-31 | 2018-05-29 | 重庆大学 | A kind of house old man nursing method and care system |
| CN108833586A (en) * | 2018-07-05 | 2018-11-16 | 浙江中点人工智能科技有限公司 | A kind of household old man nurse intelligence system |
| CN111510665A (en) * | 2019-01-30 | 2020-08-07 | 杭州海康威视数字技术股份有限公司 | Monitoring system, monitoring method and device combining millimeter wave radar and camera |
| CN110708422A (en) * | 2019-09-24 | 2020-01-17 | 捷开通讯(深圳)有限公司 | Intelligent emergency method, device, storage medium and terminal |
| JP2021103391A (en) * | 2019-12-25 | 2021-07-15 | 本田技研工業株式会社 | Watching device |
| CN111680651A (en) * | 2020-06-12 | 2020-09-18 | 武汉星巡智能科技有限公司 | Non-contact vital sign detection method, device, storage medium and system |
| CN112346055A (en) * | 2020-10-23 | 2021-02-09 | 无锡威孚高科技集团股份有限公司 | Fall detection method and device based on millimeter wave radar and millimeter wave radar equipment |
| CN112837504A (en) * | 2021-02-09 | 2021-05-25 | 中云沃达（山东）物联网科技有限公司 | Nursing device, system and monitored control system based on millimeter wave detection |
| CN113114977A (en) * | 2021-02-20 | 2021-07-13 | 广州颐寿科技有限公司 | Intelligent nursing system and intelligent nursing method |
| CN215006886U (en) * | 2021-05-24 | 2021-12-03 | 上海千帆科技股份有限公司 | Anti-falling system of nursing home |
| CN113658412A (en) * | 2021-08-05 | 2021-11-16 | 南京信息职业技术学院 | Millimeter wave radar-based household old people behavior monitoring method and system |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114706318A (en) * | 2022-04-18 | 2022-07-05 | 深圳亿思腾达集成股份有限公司 | Monitoring method and system based on smart home and terminal equipment |
| CN115268281A (en) * | 2022-06-27 | 2022-11-01 | 青岛海尔科技有限公司 | Control instruction sending method and device, storage medium and electronic device |
| CN115770013A (en) * | 2022-11-30 | 2023-03-10 | 北京中科睿医信息科技有限公司 | Eye movement test method, device, equipment and medium for assisting vulnerable group |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114038162A (en) | Vulnerable user nursing and alarming method, equipment and medium | |
| US11462090B2 (en) | Facility monitoring apparatus and method | |
| US11580843B2 (en) | Intelligent emergency response for multi-tenant dwelling units | |
| TW201342313A (en) | Voice recognition nursing method and system thereof | |
| KR20190052190A (en) | PROTECTION SYSTEM FOR VULNERABLE CLASSES USING Internet Of Things AND METHOD THEREFOR | |
| US20210244352A1 (en) | Home occupant detection and monitoring system | |
| JP5457148B2 (en) | Security system | |
| CN104793504A (en) | Smart elderly apartment system | |
| CN111369765A (en) | Intelligent home nursing method and device based on Internet of things technology | |
| Marquis-Faulkes et al. | Gathering the requirements for a fall monitor using drama and video with older people | |
| KR102546460B1 (en) | Platform for service and detecting of body action employing AI | |
| CN113225363A (en) | Intelligent endowment system and method | |
| US20220036722A1 (en) | Emergency remote data access based on an emergency communication link and sensor data | |
| CN109089254A (en) | A kind of emergency response system | |
| JP5363215B2 (en) | Security system | |
| CN111372041A (en) | Monitoring equipment and monitoring system | |
| WO2021002293A1 (en) | Emergency responding method, safety confirmation system, management device, space section, and method for controlling management device | |
| KR102407150B1 (en) | Emergency notification service system and method for Resident in House | |
| CA3101308A1 (en) | Emergency kit | |
| CN214550836U (en) | Environment fire control management and control system for nursing home | |
| FI129564B (en) | Monitoring system and method for recognizing the activity of determined persons | |
| JP2021009549A (en) | Watching system and watching method | |
| CN117893161A (en) | Campus security intelligent management system | |
| CN115515119A (en) | Interactive rescue scheduling system based on Internet of things | |
| TWM635852U (en) | Smart recognition device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220211 |