CN116386276A - Institution and home multimode safety monitoring system and method - Google Patents
Institution and home multimode safety monitoring system and method Download PDFInfo
- Publication number
- CN116386276A CN116386276A CN202310660042.7A CN202310660042A CN116386276A CN 116386276 A CN116386276 A CN 116386276A CN 202310660042 A CN202310660042 A CN 202310660042A CN 116386276 A CN116386276 A CN 116386276A
- Authority
- CN
- China
- Prior art keywords
- communication
- address
- monitoring
- background
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 226
- 238000000034 method Methods 0.000 title claims abstract description 60
- 238000004891 communication Methods 0.000 claims abstract description 193
- 230000008569 process Effects 0.000 claims abstract description 29
- 238000003745 diagnosis Methods 0.000 claims abstract description 14
- 230000005021 gait Effects 0.000 claims description 30
- 230000002159 abnormal effect Effects 0.000 claims description 28
- 238000012545 processing Methods 0.000 claims description 28
- 230000003993 interaction Effects 0.000 claims description 22
- 230000036541 health Effects 0.000 claims description 14
- 238000010195 expression analysis Methods 0.000 claims description 11
- 230000006835 compression Effects 0.000 claims description 9
- 238000007906 compression Methods 0.000 claims description 9
- 230000002452 interceptive effect Effects 0.000 claims description 8
- 238000001514 detection method Methods 0.000 claims description 6
- 230000003340 mental effect Effects 0.000 claims description 6
- 230000002996 emotional effect Effects 0.000 claims description 5
- 230000006996 mental state Effects 0.000 claims description 4
- 230000005856 abnormality Effects 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 claims description 3
- 230000008451 emotion Effects 0.000 claims description 3
- 238000013507 mapping Methods 0.000 claims description 3
- 230000006870 function Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 5
- 230000007246 mechanism Effects 0.000 description 5
- 238000012806 monitoring device Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 238000013527 convolutional neural network Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 230000000241 respiratory effect Effects 0.000 description 2
- 239000000779 smoke Substances 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005587 bubbling Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000029058 respiratory gaseous exchange Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
- G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
- G08B25/08—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using communication transmission lines
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
- G08B21/0407—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B29/00—Checking or monitoring of signalling or alarm systems; Prevention or correction of operating errors, e.g. preventing unauthorised operation
- G08B29/12—Checking intermittently signalling or alarm systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/10—Active monitoring, e.g. heartbeat, ping or trace-route
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- General Health & Medical Sciences (AREA)
- Gerontology & Geriatric Medicine (AREA)
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Cardiology (AREA)
- Computer Security & Cryptography (AREA)
- Psychiatry (AREA)
- Psychology (AREA)
- Social Psychology (AREA)
- Alarm Systems (AREA)
Abstract
The invention provides a system and a method for monitoring the security of institutions and households in a multimode mode, which are applied to the field of monitoring systems and comprise the following steps: the monitoring terminal monitors the environment and people to obtain monitoring data, and sends the monitoring data to the background through the direct communication unit and the multimode communication gateway; the background processes the data after receiving the monitored data through the direct communication unit, sets a timer of preset time, and sends a fault diagnosis instruction if the monitored data with the time stamp is not received through the multimode communication gateway within the preset time; the monitoring terminal sequentially sends the inquiry information to the background through the direct communication unit and the multimode communication gateway, and fault information is obtained by diagnosing the communication link according to the reply information of the background; the background dynamically schedules a communication link according to the fault information; through redundant link communication, communication diagnosis and link scheduling, the normal communication of the monitoring system is ensured, and the monitoring work is more reliable.
Description
Technical Field
The invention relates to the technical field of monitoring systems, in particular to a system and a method for monitoring multi-mode security of institutions and households.
Background
The existing intelligent monitoring system is usually used for simply collecting data and uploading the data to a child mobile phone, the service mode and the service function are single, the cost performance is low, the monitoring effect is poor, and the large-scale popularization and promotion are difficult.
The Chinese patent of publication No. CN114463938A discloses an intelligent monitoring system for empty-nest old people, wherein all monitoring components and other families are connected through an intelligent sound box, and when the health condition of the old people is detected, automatic alarm and automatic help seeking are carried out, so that the automatic care for the empty-nest old people is completed; however, the communication and alarm are carried out through a single intelligent sound box, hidden danger of communication faults exists, and the safety monitoring effect is greatly weakened by a feedback monitoring mechanism of a single network; the monitoring component may fail and not be found in time, so that the safety of the old cannot be monitored, and the monitoring component cannot be sent to the intelligent sound box and the mobile terminal.
Therefore, the invention discloses an intelligent monitoring system and method aiming at multimode communication.
Disclosure of Invention
The invention aims to provide a mechanism and home multimode safety monitoring system and method, and aims to solve the problems that when a single network fails, the timeliness of monitoring the safety of the old cannot be guaranteed, and the detection equipment fails and cannot be found in time, so that the old is monitored unreliably.
In order to achieve the above purpose, the present invention provides the following technical solutions:
the invention relates to a institution and home multimode safety monitoring method, which comprises the following steps:
step one: the monitoring terminal monitors the environment and people to obtain monitoring data, marks a time stamp on the monitoring data, and sends the monitoring data to the background and the remote interaction terminal through the direct communication unit and the multimode communication gateway;
step two: the background processes the data after receiving the monitored data through a direct communication unit, sets a timer of preset time, and sends a fault diagnosis instruction to a monitoring terminal if the monitored data with the time stamp is not received through the multimode communication gateway within the preset time;
step three: after receiving the fault diagnosis instruction, the monitoring terminal sequentially sends inquiry information to a background through a direct communication unit and a multimode communication gateway, diagnoses a communication link according to reply information of the background to obtain fault information, and sends the fault information to the background;
step four: and the background starts to dynamically schedule a communication link according to the fault information, and maintains the normal communication between the monitoring terminal and the background.
Further, in step four, the process of dynamically scheduling the communication link includes:
the background calculates the communication rate of other normal communication links and selects a maximum communication rate path;
acquiring a monitoring terminal in the maximum communication rate path as a main monitoring terminal, acquiring an IP address of the main monitoring terminal as a first IP address, acquiring an MAC address of the main monitoring terminal as a first MAC address, and acquiring a port of the main monitoring terminal as a first port;
taking the monitoring terminal in the fault communication link as a guest monitoring terminal, acquiring the MAC address of the guest monitoring terminal as a second MAC address, acquiring the IP address of the guest monitoring terminal as a second IP address, and acquiring a port of the guest monitoring terminal as a second port;
creating a sub-IP address of the first IP address to obtain a first sub-IP address, and creating a sub-IP address of the second IP address to obtain a second sub-IP address;
the first sub-IP address and the second sub-IP address are associated with the first IP address in a routing table in the multimode communication gateway, and a second MAC address and a second IP address are stored in a monitoring terminal of a maximum communication rate path;
when data is sent, the guest monitoring terminal adds a mark to the monitored data as guest monitoring data, the guest monitoring data is sent to the main monitoring terminal through the first MAC address and the first port, the main monitoring terminal forwards the guest monitoring data to a multimode communication gateway, the multimode communication gateway identifies whether the received monitoring data has the mark, if yes, the source IP address of the monitoring data is changed into the second sub-IP address, and if not, the source IP address of the monitoring data is changed into the first sub-IP address and sent to the background;
when receiving data, the multimode communication gateway sends the monitored data to the main monitoring terminal, the main monitoring terminal identifies whether the received monitored data has a mark, if yes, the data is forwarded to the guest monitoring terminal according to the second MAC address and the second port, and if not, the destination of the monitored data is the main monitoring terminal.
Further, the step of calculating the communication rate of other normal communication links in the background and selecting the maximum communication rate path includes:
the communication rate of the communication link is calculated as:
the communication path with the maximum current rate is selected and expressed as:
Further, in the step of creating the sub IP address of the first IP address to obtain the first sub IP address, creating the sub IP address of the second IP address to obtain the second sub IP address, the method includes:
converting the MAC address of the monitoring terminal into 1 byte form through a compression algorithm to obtain a new host bit;
mapping the IP address into a C-type address, and replacing the last host bit with the new host bit to obtain a corresponding sub-IP address;
the above steps are performed on the first IP address and the second IP address.
Further, in the step of converting the MAC address of the monitoring terminal into 1 byte form by a compression algorithm to obtain a new host bit, the compression algorithm includes:
wherein ,
is a 10-ary form of a new host bit, X is a MAC address, and n represents a binary form of the MAC address; mod will be
Into a new host bit in a 2-ary form.
Further, in the second step, the method includes:
the background is divided into a local background and a cloud background, the local background carries out instant processing on the text monitoring data, and the cloud background carries out intelligent processing on the video monitoring data.
Further, the background is divided into a local background and a cloud background, the local background performs instant processing on the text monitoring data, and the cloud background performs intelligent processing on the video monitoring data, wherein the intelligent processing process comprises the following steps:
extracting continuous image frames containing characters from the video monitoring data, and carrying out gesture analysis, gait analysis and mental analysis on the characters to obtain analysis results;
and if the analysis result shows that the health condition of the person is abnormal, sending an abnormal warning to the remote interactive terminal.
Further, the posture analysis, gait analysis and mental analysis processes comprise:
the gesture analysis process includes:
extracting pixel coordinates of the person in the continuous image frames according to a motion detection algorithm;
comparing the pixel coordinates with the pixel coordinates of the daily posture of the person to obtain a pixel difference value;
when the pixel difference value is larger than a preset threshold value, judging that the figure gesture is abnormal;
the gait analysis process comprises the following steps:
creating a normal gait model according to the daily travel route and the walking posture of the person;
extracting gait information of the person from the continuous image frames, and creating an actual gait model;
comparing the normal gait model with the actual gait model to obtain a shaking value, a speed deviation value and a path deviation value;
judging gait abnormality of the person when the shaking value is greater than a preset shaking threshold value and/or the speed deviation value is greater than a preset speed deviation value and/or the path deviation value is greater than a preset path deviation value;
the process of the mental state analysis comprises the following steps:
extracting face information from the continuous image frames, performing expression analysis on the face information to obtain an expression analysis result, and judging that the emotional state of the person is abnormal when the expression analysis result is negative emotion.
Further, in step one, the multimode communication gateway includes: a routing component, a switch component, a path scheduling component,
the routing component maintains a sub-IP routing table of the monitoring terminal, an IP address of the cloud background and an IP address of the remote interaction terminal to complete remote communication, the switch component maintains a front-end module and an MAC address table of the local background to complete local communication, and the path scheduling component receives abnormal equipment information sent by the monitoring terminal and path information sent by the cloud module, breaks a communication link of the abnormal equipment and enables the abnormal equipment to communicate by using a maximum communication rate path.
An institution and home multimode safety monitoring system applied to any one of the institution and home multimode safety monitoring methods, wherein the institution and home multimode safety monitoring system comprises:
monitoring terminal module: monitoring the environment and people to obtain monitored data, stamping a time stamp for the monitored data, and sending the monitored data to a background and a remote interaction terminal through a direct communication unit and a multimode communication gateway;
a background module: the background is divided into a local background and a cloud background, the local background carries out instant processing on text monitoring data, the cloud background carries out intelligent processing on video monitoring data, and meanwhile, the background keeps diagnosis on a communication link and dynamically schedules the communication link when communication fails;
and a remote interaction module: passively receiving real-time monitoring data of the monitoring terminal module, receiving an operation instruction of a user, and executing the operation instruction on the background module and the monitoring terminal module;
multimode communication module: and monitoring the communication state of the monitoring terminal module, dynamically adjusting a communication link, and matching the communication link of the dynamic scheduling system with the cloud background to serve as a redundant communication hub among the monitoring terminal module, the background module and the remote interaction module.
The invention provides a mechanism and home multimode safety monitoring system, which has the following beneficial effects:
(1) The communication states of the terminal devices are monitored mutually, and when the terminal devices fail, timely discovery and timely treatment can be achieved, so that the old can be normally nursed in health;
(2) The terminal equipment is directly connected with the cloud background and is connected with the cloud background through the multimode communication module, communication supervision is carried out between the equipment, and when one communication link of one terminal equipment fails, the cloud background enables the communication link to communicate by using other links through communication link scheduling, so that the problem that the situation of the old cannot be transmitted and reported in time when a single network fails is solved;
(3) The cloud background extracts character information from the monitored video data, performs gesture analysis, gait analysis and expression analysis, and immediately notifies the remote interactive terminal when abnormal expression of the character body is found, so that a user can view the character in time, and the health and safety of the monitored character are guaranteed.
Drawings
FIG. 1 is a schematic flow chart of a method for institutional and home multimode security monitoring in accordance with an embodiment of the present invention;
FIG. 2 is a schematic diagram of a mechanism and a home multimode safety monitoring system according to an embodiment of the invention;
the realization, functional characteristics and advantages of the present invention are further described with reference to the accompanying drawings in combination with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Referring to fig. 1, a schematic flow chart of a institution and home multimode safety monitoring method according to the present invention is shown;
the invention provides a mechanism and a home multimode safety monitoring method, which comprises the following steps:
s1: the monitoring terminal monitors the environment and people to obtain monitoring data, marks a time stamp on the monitoring data, and sends the monitoring data to the background and the remote interaction terminal through the direct communication unit and the multimode communication gateway;
s2: the background processes the data after receiving the monitored data through a direct communication unit, sets a timer of preset time, and sends a fault diagnosis instruction to a monitoring terminal if the monitored data with the time stamp is not received through the multimode communication gateway within the preset time;
s3: after receiving the fault diagnosis instruction, the monitoring terminal sequentially sends inquiry information to a background through a direct communication unit and a multimode communication gateway, diagnoses a communication link according to reply information of the background to obtain fault information, and sends the fault information to the background;
s4: and the background starts to dynamically schedule a communication link according to the fault information, and maintains the normal communication between the monitoring terminal and the background.
In one embodiment, the monitoring terminals include a fall monitor, a respiratory heart rate vital sign monitor, a monitoring camera, a smoke alarm, a gas alarm, a flame detector, an air controller and other monitoring terminals, the monitoring terminals are connected with each other through an intranet, the intranet is an ethernet, the monitoring terminals are connected with each other through an optical fiber and indirectly communicate through a switch component, wherein the smoke alarm, the gas alarm and the respiratory heart rate vital sign monitor can directly alarm when danger is monitored, and other non-urgent monitoring terminals can send monitoring data to the background; the background is divided into a local background and a cloud background, the local background carries out instant processing on urgent data and light-weight data, for example, an air controller sends air quality data, if the air quality is judged to be poor after the local background is processed, an air adjusting instruction is sent to the air controller, the air controller starts air adjusting work, data of normal vital signs monitored by vital sign monitoring instruments are also sent to the local background, the local background carries out processing, conventional analysis is carried out to obtain an analysis result, and the analysis result is sent to the cloud background and a remote interactive terminal; for video data of daily monitoring, a large amount of calculation is needed during processing, the video data are sent to a cloud background, the video data are analyzed by utilizing the calculation capacity of the cloud background, the posture analysis, gait analysis and expression analysis are carried out on a monitored person in the video, the health condition of the person is judged according to the analysis result, the alarm is carried out according to a preset alarm strategy and the grade of the health condition, and if the health condition is slightly abnormal, a prompt message is sent to a remote interactive terminal; if the health condition is judged to be normal, the analysis result is sent to the remote interactive terminal for the user to check at any time, and if the health condition is judged to be serious abnormal, alarm information is directly sent to the remote terminal, wherein the alarm information comprises whether the ambulance is called immediately or not; the processing records of the local background to the data are sent to the cloud background and stored together as processing logs for a user to check; because the number of the monitoring terminals is numerous and concentrated in one place to communicate with the cloud background and the remote terminal, if a single communication link is used, the monitoring data is blocked and is difficult to process or give an alarm in real time, and if the single link fails, all monitoring terminals of the whole organization or family cannot communicate with the outside, the health of the monitoring personnel is abnormal and the alarm cannot be found and given out in real time; when communication faults occur in the independent communication links of one monitoring terminal, the cloud back stage selects a communication path with the highest communication rate and the largest transmissible data volume by calculating the communication rates of all the communication links, and equipment in the fault communication path is scheduled to use the communication path with the highest communication rate and the largest transmissible data volume for communication; the specific fault location searching method comprises the following steps: each monitoring terminal sequentially sends inquiry information to the background through the direct communication unit and the multimode communication gateway, and if a certain link does not receive a reply, the link is indicated to have a fault; by the link diagnosis and link scheduling method, all monitoring terminals can send monitoring data to the background and remote interaction terminals in real time, and timeliness and effectiveness of monitoring are guaranteed.
In S4, the process of dynamically scheduling a communication link includes:
the background calculates the communication rate of other normal communication links and selects a maximum communication rate path;
acquiring a monitoring terminal in the maximum communication rate path as a main monitoring terminal, acquiring an IP address of the main monitoring terminal as a first IP address, acquiring an MAC address of the main monitoring terminal as a first MAC address, and acquiring a port of the main monitoring terminal as a first port;
taking the monitoring terminal in the fault communication link as a guest monitoring terminal, acquiring the MAC address of the guest monitoring terminal as a second MAC address, acquiring the IP address of the guest monitoring terminal as a second IP address, and acquiring a port of the guest monitoring terminal as a second port;
creating a sub-IP address of the first IP address to obtain a first sub-IP address, and creating a sub-IP address of the second IP address to obtain a second sub-IP address;
the first sub-IP address and the second sub-IP address are associated with the first IP address in a routing table in the multimode communication gateway, and a second MAC address and a second IP address are stored in a monitoring terminal of a maximum communication rate path;
when data is sent, the guest monitoring terminal adds a mark to the monitored data as guest monitoring data, the guest monitoring data is sent to the main monitoring terminal through the first MAC address and the first port, the main monitoring terminal forwards the guest monitoring data to a multimode communication gateway, the multimode communication gateway identifies whether the received monitoring data has the mark, if yes, the source IP address of the monitoring data is changed into the second sub-IP address, and if not, the source IP address of the monitoring data is changed into the first sub-IP address and sent to the background;
when receiving data, the multimode communication gateway sends the monitored data to the main monitoring terminal, the main monitoring terminal identifies whether the received monitored data has a mark, if yes, the data is forwarded to the guest monitoring terminal according to the second MAC address and the second port, and if not, the destination of the monitored data is the main monitoring terminal.
The communication rate of the communication link is calculated as:
the communication path with the maximum current rate is selected and expressed as:
In the case of a specific implementation of the present invention,
the unit is byte, t is a prescribed interception time, typically 10 seconds, m is the number of terminals communicating using the communication path, the initial value is 1, when a certain communication link fails, the communication path is shared, and the communication path is changed to 2, and the like, the communication rates of all communication paths are ordered to obtain the path with the largest communication rate, and the ordering process can adopt bubbling algorithm and insertionA ranking algorithm.
The step of creating the sub IP address of the first IP address to obtain a first sub IP address and creating the sub IP address of the second IP address to obtain a second sub IP address includes:
converting the MAC address of the monitoring terminal into 1 byte form through a compression algorithm to obtain a new host bit;
mapping the IP address into a C-type address, and replacing the last host bit with the new host bit to obtain a corresponding sub-IP address;
the above steps are performed on the first IP address and the second IP address.
In the step of converting the MAC address of the monitoring terminal into 1 byte form by a compression algorithm to obtain a new host bit, the compression algorithm includes:
wherein ,
is a 10-ary form of a new host bit, X is a MAC address, and n represents a binary form of the MAC address; mod will->
Into a new host bit in a 2-ary form.
In specific implementation, the MAC address of a monitoring terminal is: 08:00:20:0A:8C: and 6D, carrying out conversion of various systems, and bringing the converted data into the formula to obtain a new host bit 01100101.
Further, in S2, the method includes:
the background is divided into a local background and a cloud background, the local background carries out instant processing on the text monitoring data, and the cloud background carries out intelligent processing on the video monitoring data.
In a specific implementation, the text monitoring data comprise data related to vital signs and data of some environmental information, and the video monitoring data are shooting data of daily life of a monitored person.
Further, the background is divided into a local background and a cloud background, the local background performs instant processing on the text monitoring data, and the cloud background performs intelligent processing on the video monitoring data, wherein the intelligent processing process comprises the following steps:
extracting continuous image frames containing characters from the video monitoring data, and carrying out gesture analysis, gait analysis and mental analysis on the characters to obtain analysis results;
and if the analysis result shows that the health condition of the person is abnormal, sending an abnormal warning to the remote interactive terminal.
In the implementation, when the analysis result shows that the health of the monitored person is abnormal, for example, the monitored person is stopped when the monitored person walks to half of the time frequently, or the monitored person is slowly shaken and even falls down in some cases than usual, at the moment, an execution instruction is sent to voice equipment in the system, the voice equipment provides advice for the monitored person, and meanwhile, details of the abnormal situation are sent to a remote interaction terminal so that the family of the monitored person can know the details to take corresponding measures.
Further, the posture analysis, gait analysis and mental analysis processes comprise:
the gesture analysis process includes:
extracting pixel coordinates of the person in the continuous image frames according to a motion detection algorithm;
comparing the pixel coordinates with the pixel coordinates of the daily posture of the person to obtain a pixel difference value;
when the pixel difference value is larger than a preset threshold value, judging that the figure gesture is abnormal;
the gait analysis process comprises the following steps:
creating a normal gait model according to the daily travel route and the walking posture of the person;
extracting gait information of the person from the continuous image frames, and creating an actual gait model;
comparing the normal gait model with the actual gait model to obtain a shaking value, a speed deviation value and a path deviation value;
judging gait abnormality of the person when the shaking value is greater than a preset shaking threshold value and/or the speed deviation value is greater than a preset speed deviation value and/or the path deviation value is greater than a preset path deviation value;
the process of the mental state analysis comprises the following steps:
extracting face information from the continuous image frames, performing expression analysis on the face information to obtain an expression analysis result, and judging that the emotional state of the person is abnormal when the expression analysis result is negative emotion.
In the implementation, the monitoring equipment comprises a radar and a camera device, the monitoring range covers each corner of the monitored area, the radar equipment is millimeter wave radar, the specific position of the monitored person can be detected, the specific position is accurate to cm, and the video monitoring equipment is combined, so that the information such as the travelling route of the monitored person can be accurately restored in the image, and more accurate data are provided for health detection of the monitored person.
The motion detection algorithm is a combination of a three-frame difference method and a background difference method for extracting a character image and a moving route in a video, and the process can be expressed as follows:
the gait analysis algorithm is an OpenPose algorithm, the positions of joints of a human body are analyzed, a posture diagram of the human body is synthesized according to the joint positions, the posture diagram is compared with a normal posture diagram to obtain pixel difference values, and whether the posture of the human body is abnormal or not is judged according to a preset threshold value;
the process of the mental state analysis algorithm is as follows: the convolutional neural network is pre-trained by using 10 ten thousand face photos marked with emotional states, and then the extracted face photos of the guardianship person are input into the convolutional neural network to be identified to obtain emotional state information, wherein the convolutional neural network can be any one of VGG16 and AlexNet.
The remote interactive terminal includes:
the remote interaction module receives the monitoring data sent by the monitoring terminal module and visualizes the monitoring data for a user to check;
receiving alarm information sent by the background module or the monitoring terminal module;
a data calling interface is provided for a user to actively call the monitored data.
In the implementation, the remote interaction terminal can be a mobile phone, a tablet personal computer, a PC (personal computer), an intelligent watch and the like, a remote interaction program of the system is installed on the remote interaction terminal, a user can check monitoring data generated by the monitoring terminal through the program, and alarm information sent by a background is received.
The multimode communication terminal includes:
the multi-mode communication module comprises a routing component, a switch component and a path scheduling component, wherein the routing component maintains a sub-IP routing table of the monitoring terminal, an IP address of a cloud background and an IP address of a remote interaction terminal to complete remote communication, the switch component maintains a front-end module and a MAC address table of a local background to complete local communication, and the path scheduling component receives abnormal equipment information sent by the monitoring terminal and path information sent by a cloud module, disconnects a communication link of the abnormal equipment and enables the abnormal equipment to use a maximum communication rate path to conduct communication.
In a specific implementation, the multimode communication module is a router with enhanced functions, has the function of a switch, can perform data communication of a network layer and a data link layer, and also has an MCU chip, wherein an embedded program is developed to schedule a communication link.
Referring to fig. 2, a schematic structural diagram of a institution and a home multimode safety monitoring system according to the present invention is shown;
an institutional and home multimode safety monitoring system comprising:
monitoring terminal module: monitoring environment and people to obtain monitored data, stamping a time stamp for the monitored data, and sending the monitored data to a background and remote interaction terminal through a direct communication unit and a multimode communication gateway, wherein the monitored terminal comprises a plurality of monitoring devices;
a background module: the background is divided into a local background and a cloud background, the local background carries out instant processing on text monitoring data, the cloud background carries out intelligent processing on video monitoring data, and meanwhile, the background keeps diagnosis on a communication link and dynamically schedules the communication link when communication fails;
and a remote interaction module: passively receiving real-time monitoring data of the monitoring terminal module, receiving an operation instruction of a user, and executing the operation instruction on the background module and the monitoring terminal module;
multimode communication module: and monitoring the communication state of the monitoring terminal module, dynamically adjusting a communication link, and matching the communication link of the dynamic scheduling system with the cloud background to serve as a redundant communication hub among the monitoring terminal module, the background module and the remote interaction module.
The monitoring terminal module comprises various monitoring devices, the monitoring devices have monitoring and alarming functions, and the monitoring device comprises: fall monitor, breathing heart rate vital sign monitor, guardianship camera, flame detector, smog alarm, emergency alarm switch, gas alarm, guardianship terminal has two communication links with the backstage: a mobile communication link, a multimode communication gateway; the background module is used for processing the monitored data, sending instructions to the monitored terminal and the remote terminal according to the alarm strategy and the processing result of the monitored data, the background is also used for carrying out communication diagnosis, and a resource scheduling system is used for scheduling a communication link according to the diagnosis result, the remote interaction terminal module can be a terminal with calculation and communication functions such as a smart phone, a tablet personal computer, a general purpose computer, a smart watch, an acousto-optic alarm and the like, and the multimode communication module is a multimode communication gateway integrating a routing function, a switch function and a path scheduling function.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, apparatus, article, or method that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, apparatus, article, or method. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, apparatus, article or method that comprises the element.
The foregoing description is only of the preferred embodiments of the present invention and is not intended to limit the scope of the invention, and all equivalent structures or equivalent processes using the descriptions and drawings of the present invention or direct or indirect application in other related technical fields are included in the scope of the present invention.
Although embodiments of the present invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made therein without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (10)
1. An institutional and home multi-mode security monitoring method, comprising:
step one: the monitoring terminal monitors the environment and people to obtain monitoring data, marks a time stamp on the monitoring data, and sends the monitoring data to the background and the remote interaction terminal through the direct communication unit and the multimode communication gateway;
step two: the background processes the data after receiving the monitored data through a direct communication unit, sets a timer of preset time, and sends a fault diagnosis instruction to a monitoring terminal if the monitored data with the time stamp is not received through the multimode communication gateway within the preset time;
step three: after receiving the fault diagnosis instruction, the monitoring terminal sequentially sends inquiry information to a background through a direct communication unit and a multimode communication gateway, diagnoses a communication link according to reply information of the background to obtain fault information, and sends the fault information to the background;
step four: and the background starts to dynamically schedule a communication link according to the fault information, and maintains the normal communication between the monitoring terminal and the background.
2. The institutional and home multi-mode security monitoring method of claim 1, wherein in step four, the process of dynamically scheduling the communication link comprises:
the background calculates the communication rate of other normal communication links and selects a maximum communication rate path;
acquiring a monitoring terminal in the maximum communication rate path as a main monitoring terminal, acquiring an IP address of the main monitoring terminal as a first IP address, acquiring an MAC address of the main monitoring terminal as a first MAC address, and acquiring a port of the main monitoring terminal as a first port;
taking the monitoring terminal in the fault communication link as a guest monitoring terminal, acquiring the MAC address of the guest monitoring terminal as a second MAC address, acquiring the IP address of the guest monitoring terminal as a second IP address, and acquiring a port of the guest monitoring terminal as a second port;
creating a sub-IP address of the first IP address to obtain a first sub-IP address, and creating a sub-IP address of the second IP address to obtain a second sub-IP address;
the first sub-IP address and the second sub-IP address are associated with the first IP address in a routing table in the multimode communication gateway, and a second MAC address and a second IP address are stored in a monitoring terminal of a maximum communication rate path;
when data is sent, the guest monitoring terminal adds a mark to the monitored data as guest monitoring data, the guest monitoring data is sent to the main monitoring terminal through the first MAC address and the first port, the main monitoring terminal forwards the guest monitoring data to a multimode communication gateway, the multimode communication gateway identifies whether the received monitoring data has the mark, if yes, the source IP address of the monitoring data is changed into the second sub-IP address, and if not, the source IP address of the monitoring data is changed into the first sub-IP address and sent to the background;
when receiving data, the multimode communication gateway sends the monitored data to the main monitoring terminal, the main monitoring terminal identifies whether the received monitored data has a mark, if yes, the data is forwarded to the guest monitoring terminal according to the second MAC address and the second port, and if not, the destination of the monitored data is the main monitoring terminal.
3. The institutional and home multi-mode security monitoring method of claim 2, wherein in the step of selecting a maximum communication rate path in the step of calculating communication rates of other normal communication links in the background, comprising:
the communication rate of the communication link is calculated as:
the communication path with the maximum current rate is selected and expressed as:
4. The institutional and home multimode security monitoring method of claim 3, wherein the step of creating the sub-IP address of the first IP address to obtain a first sub-IP address and creating the sub-IP address of the second IP address to obtain a second sub-IP address comprises:
converting the MAC address of the monitoring terminal into 1 byte form through a compression algorithm to obtain a new host bit;
mapping the IP address into a C-type address, and replacing the last host bit with the new host bit to obtain a corresponding sub-IP address;
the above steps are performed on the first IP address and the second IP address.
5. The institutional and home multimode security monitoring method of claim 4, wherein in the step of converting the MAC address of the monitoring terminal into 1 byte form by a compression algorithm to obtain a new host bit, the compression algorithm comprises:
wherein ,
is a 10-ary form of a new host bit, X is a MAC address, and n represents a binary form of the MAC address; mod will->
Into a new host bit in a 2-ary form.
6. The institutional and home multi-mode security monitoring method of claim 1, wherein in step two, comprising:
the background is divided into a local background and a cloud background, the local background carries out instant processing on the text monitoring data, and the cloud background carries out intelligent processing on the video monitoring data.
7. The method for institutional and home multimode security monitoring according to claim 6, wherein the background is divided into a local background and a cloud background, the local background performs instant processing on text monitored data, and the cloud background performs intelligent processing on video monitored data, wherein the intelligent processing includes:
extracting continuous image frames containing characters from the video monitoring data, and carrying out gesture analysis, gait analysis and mental analysis on the characters to obtain analysis results;
and if the analysis result shows that the health condition of the person is abnormal, sending an abnormal warning to the remote interactive terminal.
8. The institutional and home multi-mode safety monitoring method according to claim 7, wherein the process of posture analysis, gait analysis, mental analysis comprises:
the gesture analysis process includes:
extracting pixel coordinates of the person in the continuous image frames according to a motion detection algorithm;
comparing the pixel coordinates with the pixel coordinates of the daily posture of the person to obtain a pixel difference value;
when the pixel difference value is larger than a preset threshold value, judging that the figure gesture is abnormal;
the gait analysis process comprises the following steps:
creating a normal gait model according to the daily travel route and the walking posture of the person;
extracting gait information of the person from the continuous image frames, and creating an actual gait model;
comparing the normal gait model with the actual gait model to obtain a shaking value, a speed deviation value and a path deviation value;
judging gait abnormality of the person when the shaking value is greater than a preset shaking threshold value and/or the speed deviation value is greater than a preset speed deviation value and/or the path deviation value is greater than a preset path deviation value;
the process of the mental state analysis comprises the following steps:
extracting face information from the continuous image frames, performing expression analysis on the face information to obtain an expression analysis result, and judging that the emotional state of the person is abnormal when the expression analysis result is negative emotion.
9. The institutional and home multimode security monitoring method of claim 1, wherein in step one, the multimode communication gateway comprises: a routing component, a switch component, a path scheduling component,
the routing component maintains a sub-IP routing table of the monitoring terminal, an IP address of the cloud background and an IP address of the remote interaction terminal to complete remote communication, the switch component maintains a front-end module and an MAC address table of the local background to complete local communication, and the path scheduling component receives abnormal equipment information sent by the monitoring terminal and path information sent by the cloud module, breaks a communication link of the abnormal equipment and enables the abnormal equipment to communicate by using a maximum communication rate path.
10. An institutional and home multimode safety monitoring system for use in the institutional and home multimode safety monitoring method of any one of claims 1 to 9, the institutional and home multimode safety monitoring system comprising:
monitoring terminal module: monitoring the environment and people to obtain monitored data, stamping a time stamp for the monitored data, and sending the monitored data to a background and a remote interaction terminal through a direct communication unit and a multimode communication gateway;
a background module: the background is divided into a local background and a cloud background, the local background carries out instant processing on text monitoring data, the cloud background carries out intelligent processing on video monitoring data, and meanwhile, the background keeps diagnosis on a communication link and dynamically schedules the communication link when communication fails;
and a remote interaction module: passively receiving real-time monitoring data of the monitoring terminal module, receiving an operation instruction of a user, and executing the operation instruction on the background module and the monitoring terminal module;
multimode communication module: and monitoring the communication state of the monitoring terminal module, dynamically adjusting a communication link, and matching the communication link of the dynamic scheduling system with the cloud background to serve as a redundant communication hub among the monitoring terminal module, the background module and the remote interaction module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310660042.7A CN116386276B (en) | 2023-06-06 | 2023-06-06 | Institution and home multimode safety monitoring system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310660042.7A CN116386276B (en) | 2023-06-06 | 2023-06-06 | Institution and home multimode safety monitoring system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116386276A true CN116386276A (en) | 2023-07-04 |
| CN116386276B CN116386276B (en) | 2023-09-05 |
Family
ID=86967909
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310660042.7A Active CN116386276B (en) | 2023-06-06 | 2023-06-06 | Institution and home multimode safety monitoring system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116386276B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105282770A (en) * | 2015-07-16 | 2016-01-27 | 北京中科瑞峰科技有限公司 | Wireless self-healing networking optimization and self-inspection method |
| CN106937867A (en) * | 2016-01-04 | 2017-07-11 | 南京理工大学 | A kind of home-use multi-parameter monitor |
| CN109495300A (en) * | 2018-11-07 | 2019-03-19 | 西安交通大学 | A kind of reliable SDN virtual network mapping algorithm |
| CN110311860A (en) * | 2019-07-24 | 2019-10-08 | 北京天融信网络安全技术有限公司 | Multi-link load balance method and device under VXLAN |
| CN111193664A (en) * | 2020-01-16 | 2020-05-22 | 郑州轻工业大学 | Link backup method and device for computer network |
| CN112617767A (en) * | 2020-12-17 | 2021-04-09 | 江苏盖睿健康科技有限公司 | Home health supervision system and method based on Internet of things |
| CN115188176A (en) * | 2022-05-19 | 2022-10-14 | 安徽南瑞中天电力电子有限公司 | Intelligent electric meter and concentrator converged communication method based on dual-mode communication |
| CN115826421A (en) * | 2022-10-20 | 2023-03-21 | 里辰科技发展有限公司 | Intelligent home-based care system for nursing aged based on Internet of things |
-
2023
- 2023-06-06 CN CN202310660042.7A patent/CN116386276B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105282770A (en) * | 2015-07-16 | 2016-01-27 | 北京中科瑞峰科技有限公司 | Wireless self-healing networking optimization and self-inspection method |
| CN106937867A (en) * | 2016-01-04 | 2017-07-11 | 南京理工大学 | A kind of home-use multi-parameter monitor |
| CN109495300A (en) * | 2018-11-07 | 2019-03-19 | 西安交通大学 | A kind of reliable SDN virtual network mapping algorithm |
| CN110311860A (en) * | 2019-07-24 | 2019-10-08 | 北京天融信网络安全技术有限公司 | Multi-link load balance method and device under VXLAN |
| CN111193664A (en) * | 2020-01-16 | 2020-05-22 | 郑州轻工业大学 | Link backup method and device for computer network |
| CN112617767A (en) * | 2020-12-17 | 2021-04-09 | 江苏盖睿健康科技有限公司 | Home health supervision system and method based on Internet of things |
| CN115188176A (en) * | 2022-05-19 | 2022-10-14 | 安徽南瑞中天电力电子有限公司 | Intelligent electric meter and concentrator converged communication method based on dual-mode communication |
| CN115826421A (en) * | 2022-10-20 | 2023-03-21 | 里辰科技发展有限公司 | Intelligent home-based care system for nursing aged based on Internet of things |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116386276B (en) | 2023-09-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11722949B2 (en) | Static memory device with shared memory for an instrument and a wireless radio | |
| US11607182B2 (en) | Voice controlled assistance for monitoring adverse events of a user and/or coordinating emergency actions such as caregiver communication | |
| Lloret et al. | A smart communication architecture for ambient assisted living | |
| US10212570B1 (en) | System for providing notifications to user devices | |
| US20220181020A1 (en) | System and method for remote patient monitoring | |
| CN108476260A (en) | The method and system of Situation Awareness for emergency response | |
| CN206948586U (en) | A kind of intelligent sound box equipment | |
| JP2009211574A (en) | Server and sensor network system for measuring quality of activity | |
| CN102488502B (en) | Intelligent monitoring system for post-disaster advance rescue and control method thereof | |
| KR20100032586A (en) | Apparatus and method for providing event based situation awareness information | |
| CN102325155A (en) | Vital sign monitoring method and system based on wireless sensor network | |
| CN108574515A (en) | A kind of data sharing method based on intelligent sound box equipment, device and system | |
| CN103679601A (en) | Method for processing user health support and terminals | |
| US20220277254A1 (en) | Contextualized sensor systems | |
| CN112651867A (en) | Big data-based smart campus management method and system | |
| CN215231835U (en) | Intelligent simple spraying system based on Internet of things technology | |
| CN116386276B (en) | Institution and home multimode safety monitoring system and method | |
| CN110928305B (en) | Patrol method and system for patrol robot of railway passenger station | |
| CN110840421A (en) | SOS mutual rescue system | |
| KR20200062003A (en) | Systems and methods for protecting social vulnerable groups | |
| JP6585319B1 (en) | System, bot, and method for information sharing | |
| KR20220032662A (en) | System for providing emergency alarming service using voice message | |
| TWI656502B (en) | Method, apparatus and system for portable safety care | |
| CN113065500A (en) | Abnormal behavior control system for special actions | |
| Andriopoulou et al. | SEEK: SIP-based emergency embedded framework supports elderly and disabled to perform emergency calls |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |