WO2024027330A1 - Real-time monitoring method based on user behavior, and related device - Google Patents

Real-time monitoring method based on user behavior, and related device Download PDF

Info

Publication number
WO2024027330A1
WO2024027330A1 PCT/CN2023/098459 CN2023098459W WO2024027330A1 WO 2024027330 A1 WO2024027330 A1 WO 2024027330A1 CN 2023098459 W CN2023098459 W CN 2023098459W WO 2024027330 A1 WO2024027330 A1 WO 2024027330A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
behavior
door
real
isolation
Prior art date
Application number
PCT/CN2023/098459
Other languages
French (fr)
Chinese (zh)
Inventor
刘向华
Original Assignee
深圳市震有智联科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市震有智联科技有限公司 filed Critical 深圳市震有智联科技有限公司
Priority to ZA2023/11634A priority Critical patent/ZA202311634B/en
Publication of WO2024027330A1 publication Critical patent/WO2024027330A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01DMEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR
    • G01D5/00Mechanical means for transferring the output of a sensing member; Means for converting the output of a sensing member to another variable where the form or nature of the sensing member does not constrain the means for converting; Transducers not specially adapted for a specific variable
    • G01D5/12Mechanical means for transferring the output of a sensing member; Means for converting the output of a sensing member to another variable where the form or nature of the sensing member does not constrain the means for converting; Transducers not specially adapted for a specific variable using electric or magnetic means
    • G01D5/14Mechanical means for transferring the output of a sensing member; Means for converting the output of a sensing member to another variable where the form or nature of the sensing member does not constrain the means for converting; Transducers not specially adapted for a specific variable using electric or magnetic means influencing the magnitude of a current or voltage
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/25Determination of region of interest [ROI] or a volume of interest [VOI]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00Burglar, theft or intruder alarms
    • G08B13/18Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19602Image analysis to detect motion of the intruder, e.g. by frame subtraction
    • G08B13/19613Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00Burglar, theft or intruder alarms
    • G08B13/18Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19695Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • G08B25/08Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using communication transmission lines

Definitions

  • the present invention relates to the field of intelligent monitoring technology, and in particular to a real-time monitoring method based on user behavior, an isolation monitoring system, an isolation platform and a computer-readable storage medium.
  • the main transmission routes of pneumonia are direct transmission, aerosol transmission and contact transmission.
  • direct transmission refers to the infection caused by the direct inhalation of droplets and exhaled gas at close range when the patient sneezes, coughs, and talks
  • aerosol transmission refers to the droplets mixed in the air and travels into aerosols, causing infection after inhalation
  • contact transmission is Refers to droplets deposited on the surface of objects, contact with contaminated hands, and then contact with mucous membranes such as the mouth, nose, eyes, etc., leading to infection.
  • centralized isolation or home isolation is often required to facilitate monitoring and investigation of suspected persons to ensure that the above persons are not infected with related transmissible pneumonia.
  • the number of people to be quarantined has increased, and the number of people quarantined at home has also increased. It is more difficult to control people quarantined at home than in centralized quarantine. Therefore, How to monitor in real time the outing behavior of quarantined people at home is an urgent problem that needs to be solved in the current environment.
  • the main purpose of the present invention is to provide a real-time monitoring method, an isolation monitoring system, an isolation platform and a computer-readable storage medium based on user behavior, aiming to solve the problem in the existing technology of being unable to effectively monitor the out-of-home behavior of isolated persons in home isolation in real time. question.
  • the present invention provides a real-time monitoring method based on user behavior.
  • the real-time monitoring method based on user behavior is applied to an isolation monitoring system.
  • the isolation monitoring system includes a door sensor module and a camera module.
  • the camera module Communicating with the door sensor module, the real-time monitoring method based on user behavior includes the following steps:
  • the door sensor module When the door sensor module detects the door-opening state, it receives the shooting content of the target area captured by the camera module and uploaded;
  • the real-time monitoring method based on user behavior, wherein the behavioral attributes of the user in the activity area are determined based on the user behavior and duration in the photographed content, specifically including:
  • the real-time monitoring method based on user behavior, wherein the behavioral attributes of the user are determined based on the user's behavior in each activity area and the corresponding duration, specifically including:
  • the third person is not the staff member, it is determined that the user's behavioral attribute is social behavior
  • the first activity area is a non-compliant area.
  • the real-time monitoring method based on user behavior wherein the determining whether the third person is a staff member specifically includes:
  • the third party is determined to be the staff member.
  • the isolation monitoring system also includes a beacon sensor
  • the above-mentioned judgment on whether the third party is a staff member includes:
  • the third party is determined to be the staff member, and the identification information of the beacon is uploaded to the isolation platform.
  • the real-time monitoring method based on user behavior also includes:
  • sampling exception information includes the specific address information of the user. .
  • the real-time monitoring method based on user behavior wherein the step of determining whether the user's behavior attribute is a violation based on the behavior level of the behavior attribute includes:
  • the present invention also provides an isolation monitoring system, wherein the isolation monitoring system includes:
  • Door sensor module camera module, beacon sensor and isolation platform
  • the door sensor module is used to detect the door opening status
  • the camera module photographs the target area and uploads the photographed content
  • the beacon sensor is used to scan whether there is a beacon within the preset range
  • the isolation platform is used to determine the behavior attributes of the user in the activity area based on the user behavior and duration in the shooting content; and is also used to determine whether the behavior attributes of the user are based on the behavior level of the behavior attributes. It is a violation; it is also used to trigger an alarm reporting operation in real time and prompt the user if the user's behavior is a violation.
  • the present invention also provides an isolation platform, wherein the isolation platform includes: a memory, a processor, and a real-time user behavior-based system stored in the memory and capable of running on the processor.
  • Monitoring program when the real-time monitoring program based on user behavior is executed by the processor, the steps of the real-time monitoring method based on user behavior as described above are implemented.
  • the present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a real-time monitoring program based on user behavior, and the real-time monitoring program based on user behavior is processed by the processor.
  • the steps of implementing the real-time monitoring method based on user behavior as described above are executed.
  • the camera module when the door sensor module detects the door-opening state, the camera module receives the shooting content of the target area and uploads it; and determines the user's behavior in the active area based on the user behavior and duration in the shooting content.
  • attribute the activity area includes the target area; according to the behavior level of the behavior attribute, it is judged whether the behavior attribute of the user is a violation; if the user's behavior is a violation, a report is triggered in real time alarm operation and prompt the user.
  • the invention monitors the behavior of quarantined personnel in real time. When the quarantined personnel have behaviors that do not meet the regulations, it can be reported in real time to promptly prevent the consequences of possible transmission of the quarantined personnel's illegal behavior, improve the intensity of quarantine monitoring and reduce the isolation cost.
  • Figure 1 is a flow chart of a preferred embodiment of the real-time monitoring method based on user behavior of the present invention
  • Figure 2 is a schematic diagram of a scenario in which quarantined personnel leave home in violation of regulations in a preferred embodiment of the real-time monitoring method based on user behavior of the present invention
  • Figure 3 is a schematic diagram of a scene where quarantined personnel normally throw away garbage or take meals in a preferred embodiment of the real-time monitoring method based on user behavior of the present invention
  • Figure 4 is a schematic diagram of the scene where isolated personnel open the door and talk to non-staff in the preferred embodiment of the real-time monitoring method based on user behavior of the present invention
  • Figure 5 is a schematic diagram of the normal passing scene of aisle personnel in a preferred embodiment of the real-time monitoring method based on user behavior of the present invention
  • Figure 6 is a schematic diagram of the scene where staff come to sample isolated personnel in a preferred embodiment of the real-time monitoring method based on user behavior of the present invention
  • Figure 7 is a schematic diagram of the principle of a preferred embodiment of the isolation monitoring system of the present invention.
  • Figure 8 is a schematic diagram of the operating environment of the preferred embodiment of the isolation platform of the present invention.
  • the real-time monitoring method based on user behavior is applied to an isolation monitoring system.
  • the isolation monitoring system includes a door sensor module and a camera module (as shown in Figure 7, the isolation monitoring system
  • the monitoring system also includes an isolation platform and a beacon sensor), and the camera module is communicatively connected with the door sensor module.
  • the door sensor module communicates with the camera module through the 433 wireless communication protocol.
  • the real-time monitoring method based on user behavior includes the following steps:
  • Step S10 When the door sensor module detects the door-opening state, the camera module receives the shooting content of the target area and uploads it.
  • the isolation monitoring system includes a door sensor module and a camera module, which can be applied to the monitoring of home isolation personnel in certain specific scenarios or other scenarios where temporary monitoring of personnel is required.
  • the user may open the door and go out, which may lead to the following situations: 1. The user leaves home in violation of regulations; 2. The user normally throws away garbage/picks up food; 3. The user opens the door to communicate with non-staff; 4. Staff come to your door to take nucleic acid sampling. Therefore, how to detect and stop situations that do not meet the regulations in a timely manner is an issue that needs to be considered during the isolation process.
  • the camera module and the door sensor module cooperate with each other.
  • the camera module monitors the user's behavior in the target area in real time.
  • the door sensor module is used to sense whether the door is open.
  • the door sensor module can be used to trigger the startup of the camera module. That is, when the door sensor module detects that the door is open, the camera module is triggered to start shooting.
  • the door sensor module After the module detects that the door is closed for a preset period of time, it triggers the camera module to stop shooting.
  • the main part of the camera module Control CPU is in shutdown state.
  • the door sensor module and the MCU module of the camera module are connected through the local 433 wireless protocol. Compared with the existing technology, the door sensor module sends the door opening and closing status to the isolation platform, and then the isolation platform processes and instructs the camera module.
  • This method can reduce the system delay, because if the door sensor is opened, the isolation platform is first notified through public network wireless protocols such as NB ⁇ IoT or 4G, and then the isolation platform issues commands to the camera to capture video footage.
  • the cycle will be very long. , may be as high as 5-10 seconds, which cannot effectively control home isolation. Therefore, the present invention adopts a local wireless protocol. It is understandable that in addition to the 433 protocol, other local wireless protocols can also be applied to the present invention, such as Bluetooth, etc.
  • the MCU of the door sensor module will wake up the main control CPU of the camera module, thereby taking video of the scene and uploading it to the isolation platform through the 4G wireless network, and responding in a direct connection. degree is higher.
  • the door sensor can also add an NB-IoT module based on the 433 protocol according to customer needs, so that the door sensor itself can also directly communicate with the platform through NB-IoT.
  • NB ⁇ IoT is added because 433 is only a one-way protocol, that is, the door sensor can only push data to the camera.
  • the camera cannot reversely determine whether the door sensor is connected or whether it is open or closed.
  • the isolation platform cannot actively view the camera's monitoring screen. It can only passively wait for the door sensor to be triggered, because when the camera is sleeping, the 4G module of the camera is also sleeping, and the isolation platform cannot pass.
  • the 4G communicates with the dormant camera. Then adding the NB ⁇ IoT module to the door sensor can solve these two problems.
  • the power status/connection status with the camera/opening and closing status of the door sensor can be directly obtained through the isolation platform.
  • it can also be obtained through the isolation platform.
  • the platform issues a command to the door sensor and calls the 433 protocol to start the camera to capture and upload the video.
  • the isolation platform can actively view the live video footage.
  • the target area can be photographed through the camera module and the photographed content can be uploaded.
  • Step S20 Determine the user's behavior attributes in the activity area according to the user behavior and duration in the photographed content, and the activity area includes the target area.
  • the isolation platform will perform video decoding and AI analysis on the uploaded video data.
  • AI analysis is mainly a computer vision algorithm based on deep learning, which can identify whether there are people at the scene. Appearing within the video screen, or within the warning range of the video screen, the term is also called ROI (region of interest, region of interest).
  • the ROI area can be drawn and adjusted on the management platform.
  • the isolation platform supports the deployment of camera images at each isolation point, and the ROI warning area is drawn online. This ROI warning area can be defined on the isolation platform by dragging an irregular polygon in the video window.
  • the ROI warning area is usually Draw the area that must be passed outside the resident's door to leave home (but 10-30cm away from the resident's door frame). When the quarantined person appears in the drawn ROI warning area, the leaving home alarm will be triggered. If the quarantined person does not enter the ROI warning area area, then residents may just lean out to get takeout or throw away garbage without triggering the leaving alarm.
  • the behavioral attributes of the user in the activity area can be determined according to the shooting content, wherein the target area is included in the activity area (that is, the activity area includes the target area), specifically Determining the behavioral attributes of the user in the activity area according to the photographed content includes: determining the user behavior and corresponding duration of the user in each activity area according to the photographed content; determining the user's behavior in each activity area according to the photographed content; The user behavior in the activity area and the corresponding duration determine the user's behavior attributes.
  • the user is in the target area and there is a third person in the target area; determine whether the third person is a staff member; if the third person is not the staff member, determine whether the third person is a staff member;
  • the user's behavior attribute is social behavior; if the third person is the staff member, it is determined that the user's behavior attribute is detection-related behavior; if the user is in the first activity area and is in the first activity area
  • the duration exceeds the first preset value, then it is determined that the user's behavior attribute is the behavior of leaving home, and the first activity area is a non-compliant area.
  • determining whether the third person is a staff member includes: determining whether the clothing of the third person meets the dress requirements of the staff member based on an image analysis method; if so, determining that the third party is the staff member. .
  • determining whether the third person is a staff member may also include: scanning whether there is a beacon within the preset range through the beacon sensor; if there is The beacon determines that the third party is the staff member, and uploads the identification information of the beacon to the isolation platform.
  • the isolation platform when the door sensor module detects that the door is opened, and the AI algorithm does not recognize the person in the video picture or ROI warning area, then the person may not have gone out, or may have just gone out to get food/throw away garbage, and Without entering the ROI warning area, the isolation platform will only generate an abnormal record of opening the door privately. Because the isolation platform supports classified and hierarchical alarms and customized linkage strategies, for example, the abnormality of opening the door privately is defined as a third-level alarm, and only the alarm and video and screenshot recording are made on the isolation platform, and there is no need to link SMS/phone/email notifications. personnel, it will not trigger false alarms, it will just be recorded. And when the door sensor is not opened, passers-by outside will not trigger false alarms.
  • the present invention can combine the data of the beacon and the beacon sensor to make the judgment.
  • the beacon sensor can be a work badge.
  • the beacon has a Bluetooth module that continuously broadcasts its own ID and other information through Bluetooth.
  • the work badge also has a Bluetooth module that can scan nearby Bluetooth. Since one work badge can scan multiple beacons, although one beacon must be installed at each isolation point, the work badge only requires community workers, epidemic prevention personnel or property personnel to have one badge, because often a staff member Manage multiple isolation points in an area.
  • the work badge scans the beacon and determines that the signal strength is within 1-2m (the distance can be customized)
  • the work badge will upload the beacon information to the isolation platform through 4G, and the isolation platform can determine the location of the beacon. There are staff visiting the isolation points. In this case, the staff often do nucleic acid sampling for the residents.
  • the isolation platform supports inputting the isolation period (such as 7 days, 14 days, 21 days) and isolation sampling period (such as one test a day, two tests in three days, 1/3/7 test, 2/4/6 test, etc.), and you can also Custom selection), when it is past midnight on a certain day, the work card has not reported the information of the isolation point beacon. However, on this day, according to the nucleic acid policy, nucleic acid needs to be done for residents, the isolation platform will trigger an untimely nucleic acid sampling alarm.
  • the isolation period such as 7 days, 14 days, 21 days
  • isolation sampling period such as one test a day, two tests in three days, 1/3/7 test, 2/4/6 test, etc.
  • the beacon is a device that broadcasts Bluetooth signals and is installed at the door of a household.
  • staff come to the door or take nucleic acid tests, they will wear a 4G (cat 1) + Bluetooth badge.
  • the badge will scan the 4G signal.
  • the data will be reported to the quarantine through 4G (cat 1).
  • Platform so that it can be determined from the background that the resident has staff coming to the door to perform a nucleic acid test, and even if the door is opened, a first-level "violation of leaving home" alarm will not be generated.
  • the isolation platform will also generate a video record of the door opening for subsequent viewing.
  • the isolation platform will also record a record of "nucleic acid door-to-door sampling" because when staff deploy home isolation cameras, they will record the required home isolation sampling date through the mini program. If the resident is not sampled on time, the isolation platform will also The detected nucleic acid sampling records are generated, and an alarm of "nucleic acid sampling not on time” is generated, and an alarm prompt is given.
  • Step S30 Based on the behavior level of the behavior attribute, determine whether the user's behavior attribute is a violation.
  • the corresponding behavior level is determined based on the user's behavior attributes; when the user's behavior attributes correspond to When the behavior level is higher than the preset level, it is determined to be a violation.
  • Step S40 If the user's behavior is a violation, trigger an alarm reporting operation in real time and prompt the user.
  • the user's behavior attribute determines that the corresponding behavior level is level three, and the preset level is level one, then a behavior higher than the preset level is considered a violation, and an alarm reporting operation is triggered and the user is prompted; This allows staff to take timely measures to reduce the risk of disease transmission and enable intelligent monitoring of quarantined personnel.
  • FIG. 2 it represents the scene where residents (persons in quarantine) leave home in violation of regulations.
  • a video/screenshot alarm will be issued, or a linked text message/telephone alarm will be issued.
  • FIG. 3 it represents a scenario in which residents (quarantine personnel) normally throw away garbage/take meals. When it is detected that residents (quarantine personnel) normally throw away garbage/take meals, only an abnormal record of opening the door privately will be generated, and no linkage alarm will be generated. .
  • FIG. 4 it represents a scene in which residents (isolated personnel) open the door and talk to non-staff.
  • residents isolated personnel
  • a video/screenshot alarm will be issued, or a linked text message/phone alarm will be issued.
  • FIG. 6 it represents the scene of door-to-door nucleic acid sampling.
  • a staff member medical staff
  • the isolation platform will not generate an abnormality or alarm, and only record the nucleic acid sampling information.
  • the present invention also provides an isolation monitoring system, wherein the isolation monitoring system includes:
  • Door sensor module 51 camera module 52, beacon sensor 53 and isolation platform 54;
  • the door sensor module 51 is used to detect the door opening status
  • the camera module 52 photographs the target area and uploads the photographed content
  • the beacon sensor 53 is used to scan whether there is a beacon within the preset range
  • the isolation platform 54 is used to determine the behavior attributes of the user in the activity area based on the user behavior and duration in the shooting content; and is also used to determine the behavior attributes of the user based on the behavior level of the behavior attributes. Whether it is a violation; it is also used to trigger an alarm reporting operation in real time and prompt the user if the user's behavior is a violation.
  • the present invention also provides an isolation platform.
  • the isolation platform includes a processor 10, a memory 20 and a display 30.
  • FIG. 8 only shows some components of the isolation platform, but it should be understood that implementation of all the components shown is not required, and more or fewer components may be implemented instead.
  • the memory 20 may be an internal storage unit of the isolation platform in some embodiments, such as a hard disk or memory of the isolation platform. In other embodiments, the memory 20 may also be an external storage device of the isolation platform, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), or a secure digital (Secure) device equipped on the isolation platform. Digital, SD) card, Flash Card, etc. Further, the memory 20 may also include both an internal storage unit of the isolation platform and an external storage device.
  • the memory 20 is used to store application software and various data installed on the isolation platform, such as program codes for installing the isolation platform, etc.
  • the memory 20 can also be used to temporarily store data that has been output or is to be output.
  • a real-time monitoring program 40 based on user behavior is stored on the memory 20, and the real-time monitoring program 40 based on user behavior can be executed by the processor 10, thereby realizing the real-time monitoring method based on user behavior in this application.
  • the processor 10 may be a central processing unit (CPU), a microprocessor or other data processing chip, used to run program codes or process data stored in the memory 20, for example Execute the real-time monitoring method based on user behavior, etc.
  • CPU central processing unit
  • microprocessor or other data processing chip
  • the display 30 may be an LED display, a liquid crystal display, a touch-controlled liquid crystal display, an OLED (Organic Light-Emitting Diode, organic light-emitting diode) touch device, etc.
  • the display 30 is used to display information on the isolation platform and to display a visual user interface.
  • the components 10-30 of the isolation platform communicate with each other via a system bus.
  • the processor 10 executes the real-time monitoring program 40 based on user behavior in the memory 20, the following steps are implemented:
  • the door sensor module When the door sensor module detects the door-opening state, it receives the shooting content of the target area captured by the camera module and uploaded;
  • the behavioral attributes of the user in the activity area are determined based on the user behavior and duration in the photographed content, specifically including:
  • the user's behavior attributes are determined.
  • the behavioral attributes of the user are determined based on the user's user behavior in each activity area and the corresponding duration, specifically including:
  • the third person is not the staff member, it is determined that the user's behavior attribute is social behavior
  • the first activity area is a non-compliant area.
  • the judgment of whether the third person is a staff member specifically includes:
  • the third party is determined to be the staff member.
  • the isolation monitoring system also includes a beacon sensor
  • the above-mentioned judgment on whether the third party is a staff member includes:
  • the third party is determined to be the staff member, and the identification information of the beacon is uploaded to the isolation platform.
  • the real-time monitoring method based on user behavior also includes:
  • sampling exception information includes the specific address information of the user. .
  • judging whether the user's behavioral attributes are illegal behaviors based on the behavior level of the behavioral attributes specifically includes:
  • the present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a real-time monitoring program based on user behavior, and when the real-time monitoring program based on user behavior is executed by the processor, the above-mentioned methods are implemented. Steps of real-time monitoring method based on user behavior.
  • the present invention provides a real-time monitoring method based on user behavior and related equipment.
  • the real-time monitoring method based on user behavior is applied to an isolation monitoring system.
  • the isolation monitoring system includes a door sensor module and a camera module.
  • the camera module is communicatively connected to the door sensor module, and the method includes: when the door sensor module detects the door-opening state, receiving the shooting content of the target area photographed by the camera module and uploaded; according to the shooting content
  • the user's behavior and duration determine the user's behavior attributes in the activity area, which includes the target area; based on the behavior level of the behavior attributes, it is judged whether the user's behavior attributes are illegal behaviors; if If the user's behavior is a violation, the reporting alarm operation will be triggered in real time and the user will be prompted.
  • the invention monitors the behavior of quarantined personnel in real time.
  • the quarantined personnel have behaviors that do not meet the regulations, it can be reported in real time to promptly prevent the consequences of possible transmission of the quarantined personnel's illegal behavior, improve the intensity of quarantine monitoring and reduce the cost of quarantine.
  • the terms “comprises,” “comprises” or any other variation thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or isolation platform that includes a list of elements includes not only those elements , but also includes other elements not expressly listed or inherent to the process, method, article or isolation platform. Without further limitation, an element qualified by the statement “comprises a" does not exclude the presence of additional identical elements in the process, method, article or isolation platform that includes the element.
  • the processes in the methods of the above embodiments can be implemented by instructing relevant hardware (such as processors, controllers, etc.) through computer programs, and the programs can be stored in a computer.
  • a computer-readable computer-readable storage medium when executed, the program may include the processes of the above method embodiments.
  • the computer-readable storage medium may be a memory, a magnetic disk, an optical disk, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Evolutionary Computation (AREA)
  • Health & Medical Sciences (AREA)
  • Signal Processing (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Emergency Management (AREA)
  • Business, Economics & Management (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Alarm Systems (AREA)

Abstract

Disclosed in the present invention are a real-time monitoring method based on a user behavior, and a related device. The real-time monitoring method based on a user behavior is applied to a quarantine monitoring system. The quarantine monitoring system comprises a door sensor module and a camera module, wherein the camera module is in communication connection with the door sensor module. The method comprises: when a door sensor module detects a door-open state, receiving photographic content which is obtained by means of photographing a target area and is uploaded by a camera module; determining a behavior attribute of a user in an activity area according to a user behavior and the duration in the photographic content, wherein the activity area comprises the target area; according to a behavior level of the behavior attribute, determining whether the behavior attribute of the user belongs to a violation behavior; and if the behavior of the user is a violation behavior, triggering a reporting alarm operation in real time, and giving a prompt to the user. By means of the present invention, the monitoring strength for quarantine is improved, and the quarantine cost is reduced.

Description

一种基于用户行为的实时监控方法及相关设备A real-time monitoring method and related equipment based on user behavior 技术领域Technical field
  本发明涉及智能监控技术领域,尤其涉及一种基于用户行为的实时监控方法、隔离监控系统、隔离平台及计算机可读存储介质。The present invention relates to the field of intelligent monitoring technology, and in particular to a real-time monitoring method based on user behavior, an isolation monitoring system, an isolation platform and a computer-readable storage medium.
背景技术Background technique
  肺炎的传播途径主要为直接传播、气溶胶传播和接触传播。其中直接传播是指患者喷嚏、咳嗽、说话的飞沫,呼出的气体近距离直接吸入导致的感染;气溶胶传播是指飞沫混合在空气中,行程气溶胶,吸入后导致感染;接触传播是指飞沫沉积在物品表面,接触污 染手后,再接触口腔、鼻腔、眼睛等黏膜,导致感染。 The main transmission routes of pneumonia are direct transmission, aerosol transmission and contact transmission. Among them, direct transmission refers to the infection caused by the direct inhalation of droplets and exhaled gas at close range when the patient sneezes, coughs, and talks; aerosol transmission refers to the droplets mixed in the air and travels into aerosols, causing infection after inhalation; contact transmission is Refers to droplets deposited on the surface of objects, contact with contaminated hands, and then contact with mucous membranes such as the mouth, nose, eyes, etc., leading to infection.​
  针对具有发热症状或者从国外、国内风险地区归来的人员,往往需要采用集中隔离或者居家隔离的方式,便于对疑似人员进行监测和排查,确保上述人员没有感染相关具有传播性的肺炎。例如随着具有传播性的肺炎的爆发,待隔离人员的数量随之增大,居家隔离的人也随之增多,而居家隔离的隔离人员相对集中隔离的隔离人员在管控上更有难度, 因此如何能实时监控居家隔离的隔离人员的外出行为,是当前大环境下亟需解决的问题。 For those who have fever symptoms or who have returned from foreign or domestic risk areas, centralized isolation or home isolation is often required to facilitate monitoring and investigation of suspected persons to ensure that the above persons are not infected with related transmissible pneumonia. For example, with the outbreak of contagious pneumonia, the number of people to be quarantined has increased, and the number of people quarantined at home has also increased. It is more difficult to control people quarantined at home than in centralized quarantine. Therefore, How to monitor in real time the outing behavior of quarantined people at home is an urgent problem that needs to be solved in the current environment.​
 因此,现有技术还有待于改进和发展。 Therefore, existing technology still needs to be improved and developed.​
发明内容Contents of the invention
  本发明的主要目的在于提供一种基于用户行为的实时监控方法、隔离监控系统、 隔离平台及计算机可读存储介质,旨在解决现有技术中无法实时有效监测居家隔离的隔离人员的外出行为的问题。 The main purpose of the present invention is to provide a real-time monitoring method, an isolation monitoring system, an isolation platform and a computer-readable storage medium based on user behavior, aiming to solve the problem in the existing technology of being unable to effectively monitor the out-of-home behavior of isolated persons in home isolation in real time. question.​
  为实现上述目的,本发明提供一种基于用户行为的实时监控方法,所述基于用户行为的实时监控方法应用于隔离监控系统,所述隔离监控系统包括门磁模块和摄像头模块,所述摄像头模块与所述门磁模块通信连接,所述基于用户行为的实时监控方法包括如下步骤: In order to achieve the above object, the present invention provides a real-time monitoring method based on user behavior. The real-time monitoring method based on user behavior is applied to an isolation monitoring system. The isolation monitoring system includes a door sensor module and a camera module. The camera module Communicating with the door sensor module, the real-time monitoring method based on user behavior includes the following steps:
   当所述门磁模块检测到开门状态时,接收所述摄像头模块拍摄目标区域并上传的拍摄内容; When the door sensor module detects the door-opening state, it receives the shooting content of the target area captured by the camera module and uploaded;
   根据所述拍摄内容中的用户行为和持续时间确定在活动区域内用户的行为属性, 所述活动区域包括所述目标区域; Determine the behavioral attributes of the user in the activity area based on the user behavior and duration in the shooting content, and the activity area includes the target area;
   根据所述行为属性的行为等级,判断所述用户的所述行为属性是否属于违规行为; Based on the behavior level of the behavior attribute, determine whether the user's behavior attribute is a violation;
   若所述用户的行为属于违规行为,则实时触发上报告警操作并提示所述用户。 If the user's behavior is illegal, an alarm reporting operation will be triggered in real time and the user will be prompted.​
   可选地,所述的基于用户行为的实时监控方法,其中,所述根据所述拍摄内容中的用户行为和持续时间确定在活动区域内用户的行为属性,具体包括: Optionally, the real-time monitoring method based on user behavior, wherein the behavioral attributes of the user in the activity area are determined based on the user behavior and duration in the photographed content, specifically including:
  根据所述拍摄内容确定所述用户在各活动区域的用户行为和对应的持续时间; Determine the user's user behavior and corresponding duration in each activity area based on the shooting content;
  根据所述用户在各活动区域的用户行为和对应的持续时间,确定所述用户的行为 属性。  Determine the behavioral attributes of the user based on the user's behavior in each activity area and the corresponding duration.​
  可选地,所述的基于用户行为的实时监控方法,其中,所述根据所述用户在各活动区域的用户行为和对应的持续时间,确定所述用户的行为属性,具体包括: Optionally, the real-time monitoring method based on user behavior, wherein the behavioral attributes of the user are determined based on the user's behavior in each activity area and the corresponding duration, specifically including:
  若所述用户在所述目标区域内且所述目标区域内存在第三人,则判断所述第三人是否为工作人员; If the user is in the target area and there is a third person in the target area, determine whether the third person is a staff member;
  若所述第三人不是所述工作人员,则确定所述用户的行为属性为社交行为; If the third person is not the staff member, it is determined that the user's behavioral attribute is social behavior;
  若所述第三人是所述工作人员,则确定所述用户的行为属性为检测相关行为; If the third person is the staff member, determine the behavioral attributes of the user to detect relevant behaviors;
  若所述用户在第一活动区域且在所述第一活动区域的持续时间超过第一预设值, 则确定所述用户的行为属性为离家行为; If the user is in the first activity area and the duration in the first activity area exceeds the first preset value, it is determined that the user's behavior attribute is the behavior of leaving home;
  其中,所述第一活动区域为非合规区域。 Among them, the first activity area is a non-compliant area.​
  可选地,所述的基于用户行为的实时监控方法,其中,所述判断所述第三人是否为工作人员,具体包括: Optionally, the real-time monitoring method based on user behavior, wherein the determining whether the third person is a staff member specifically includes:
  基于图像分析判断所述第三人的服装是否满足所述工作人员的着装要求; Determine whether the clothing of the third person meets the dress requirements of the staff based on image analysis;
  若满足,则确定所述第三人为所述工作人员。 If satisfied, the third party is determined to be the staff member.​
  可选地,所述的基于用户行为的实时监控方法,其中,所述隔离监控系统还包括信标传感器; Optionally, the real-time monitoring method based on user behavior, wherein the isolation monitoring system also includes a beacon sensor;
  所述判断所述第三人是否为工作人员,具体包括: The above-mentioned judgment on whether the third party is a staff member includes:
  基于所述信标传感器扫描预设范围内是否存在信标; Based on the beacon sensor, scan whether there is a beacon within the preset range;
  若存在所述信标,则确定所述第三人为所述工作人员,并将所述信标的标识信息上传至隔离平台。 If the beacon exists, the third party is determined to be the staff member, and the identification information of the beacon is uploaded to the isolation platform.​
  可选地,所述的基于用户行为的实时监控方法,其中,所述基于用户行为的实时监 控方法还包括: Optionally, the real-time monitoring method based on user behavior, wherein the real-time monitoring method based on user behavior also includes:
  接收所述工作人员对所述用户的采样时间,以根据所述用户的采样时间和预设采样周期确定下一次采样时间节点; Receive the sampling time of the user from the staff to determine the next sampling time node based on the user's sampling time and the preset sampling period;
  若当前时刻达到所述下一次采样时间节点,且所述信标传感器未扫描到所述信 标,生成采样异常信息并下发以进行告警,所述采样异常信息包括所述用户的具体地址信 息。 If the current time reaches the next sampling time node and the beacon sensor does not scan the beacon, sampling exception information is generated and sent for alarm. The sampling exception information includes the specific address information of the user. .​
  可选地,所述的基于用户行为的实时监控方法,其中,所述根据所述行为属性的行为等级,判断所述用户的所述行为属性是否属于违规行为,具体包括: Optionally, the real-time monitoring method based on user behavior, wherein the step of determining whether the user's behavior attribute is a violation based on the behavior level of the behavior attribute includes:
  确定所述用户的行为属性对应的行为等级; Determine the behavior level corresponding to the user's behavioral attributes;
  当所述用户的行为属性对应的行为等级高于预设等级时,则确定所述用户的所述行为属性属于违规行为。 When the behavior level corresponding to the user's behavior attribute is higher than the preset level, it is determined that the user's behavior attribute is a violation.​
  此外,为实现上述目的,本发明还提供一种隔离监控系统,其中,所述隔离监控系统包括: In addition, to achieve the above objectives, the present invention also provides an isolation monitoring system, wherein the isolation monitoring system includes:
  门磁模块、摄像头模块、信标传感器和隔离平台; Door sensor module, camera module, beacon sensor and isolation platform;
  所述门磁模块用于检测开门状态; The door sensor module is used to detect the door opening status;
  所述摄像头模块当所述门磁模块检测到开门状态时,对目标区域进行拍摄并上传 拍摄内容; When the door sensor module detects the door-opening state, the camera module photographs the target area and uploads the photographed content;
  所述信标传感器用于扫描预设范围内是否存在信标; The beacon sensor is used to scan whether there is a beacon within the preset range;
  所述隔离平台用于根据所述拍摄内容中的用户行为和持续时间确定在活动区域内用户的行为属性;还用于根据所述行为属性的行为等级,判断所述用户的所述行为属性 是否属于违规行为;还用于若所述用户的行为属于违规行为,则实时触发上报告警操作并提示所述用户。 The isolation platform is used to determine the behavior attributes of the user in the activity area based on the user behavior and duration in the shooting content; and is also used to determine whether the behavior attributes of the user are based on the behavior level of the behavior attributes. It is a violation; it is also used to trigger an alarm reporting operation in real time and prompt the user if the user's behavior is a violation.​
  此外,为实现上述目的,本发明还提供一种隔离平台,其中,所述隔离平台包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的基于用户行为的实时监控程序,所述基于用户行为的实时监控程序被所述处理器执行时实现如上所述的基于用户行 为的实时监控方法的步骤。 In addition, to achieve the above object, the present invention also provides an isolation platform, wherein the isolation platform includes: a memory, a processor, and a real-time user behavior-based system stored in the memory and capable of running on the processor. Monitoring program, when the real-time monitoring program based on user behavior is executed by the processor, the steps of the real-time monitoring method based on user behavior as described above are implemented.​
  此外,为实现上述目的,本发明还提供一种计算机可读存储介质,其中,所述计算机可读存储介质存储有基于用户行为的实时监控程序,所述基于用户行为的实时监控程序 被处理器执行时实现如上所述的基于用户行为的实时监控方法的步骤。In addition, to achieve the above object, the present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a real-time monitoring program based on user behavior, and the real-time monitoring program based on user behavior is processed by the processor. When executed, the steps of implementing the real-time monitoring method based on user behavior as described above are executed.
  本发明中,当所述门磁模块检测到开门状态时,接收所述摄像头模块拍摄目标区 域并上传的拍摄内容;根据所述拍摄内容中的用户行为和持续时间确定在活动区域内用户的行为属性,所述活动区域包括所述目标区域;根据所述行为属性的行为等级,判断所述用 户的所述行为属性是否属于违规行为;若所述用户的行为属于违规行为,则实时触发上报 告警操作并提示所述用户。本发明实时监控隔离人员的行为,当被隔离人员存在不符合规 定的行为时,可以实时上报,以及时阻止被隔离人员的违规行为可能导致的传播后果,提高 隔离的监控强度并减少隔离成本。 In the present invention, when the door sensor module detects the door-opening state, the camera module receives the shooting content of the target area and uploads it; and determines the user's behavior in the active area based on the user behavior and duration in the shooting content. attribute, the activity area includes the target area; according to the behavior level of the behavior attribute, it is judged whether the behavior attribute of the user is a violation; if the user's behavior is a violation, a report is triggered in real time alarm operation and prompt the user. The invention monitors the behavior of quarantined personnel in real time. When the quarantined personnel have behaviors that do not meet the regulations, it can be reported in real time to promptly prevent the consequences of possible transmission of the quarantined personnel's illegal behavior, improve the intensity of quarantine monitoring and reduce the isolation cost.​
附图说明Description of drawings
图1是本发明基于用户行为的实时监控方法的较佳实施例的流程图; Figure 1 is a flow chart of a preferred embodiment of the real-time monitoring method based on user behavior of the present invention;
 图2是本发明基于用户行为的实时监控方法的较佳实施例中隔离人员违规离家场 景的示意图; Figure 2 is a schematic diagram of a scenario in which quarantined personnel leave home in violation of regulations in a preferred embodiment of the real-time monitoring method based on user behavior of the present invention;
 图3是本发明基于用户行为的实时监控方法的较佳实施例中隔离人员正常扔垃圾 或者取餐场景的示意图; Figure 3 is a schematic diagram of a scene where quarantined personnel normally throw away garbage or take meals in a preferred embodiment of the real-time monitoring method based on user behavior of the present invention;
 图4是本发明基于用户行为的实时监控方法的较佳实施例中隔离人员开门与非工 作人员交谈场景的示意图; Figure 4 is a schematic diagram of the scene where isolated personnel open the door and talk to non-staff in the preferred embodiment of the real-time monitoring method based on user behavior of the present invention;
 图5是本发明基于用户行为的实时监控方法的较佳实施例中过道人员正常路过场 景的示意图; Figure 5 is a schematic diagram of the normal passing scene of aisle personnel in a preferred embodiment of the real-time monitoring method based on user behavior of the present invention;
 图6是本发明基于用户行为的实时监控方法的较佳实施例中工作人员上门给隔离 人员采样场景的示意图; Figure 6 is a schematic diagram of the scene where staff come to sample isolated personnel in a preferred embodiment of the real-time monitoring method based on user behavior of the present invention;
 图7是本发明隔离监控系统的较佳实施例的原理示意图; Figure 7 is a schematic diagram of the principle of a preferred embodiment of the isolation monitoring system of the present invention;
 图8为本发明隔离平台的较佳实施例的运行环境示意图。 Figure 8 is a schematic diagram of the operating environment of the preferred embodiment of the isolation platform of the present invention.​
具体实施方式Detailed ways
为使本发明的目的、技术方案及优点更加清楚、明确,以下参照附图并举实施例对本发明进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。 In order to make the purpose, technical solutions and advantages of the present invention clearer and clearer, the present invention will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described here are only used to explain the present invention and are not intended to limit the present invention.​
 如图1所示,本发明较佳实施例所述的基于用户行为的实时监控方法应用于隔离 监控系统,所述隔离监控系统包括门磁模块和摄像头模块(如图7所示,所述隔离监控系统还包括隔离平台和信标传感器),所述摄像头模块与所述门磁模块通信连接,例如所述门磁 模块通过433无线通信协议与所述摄像头模块进行通信。 As shown in Figure 1, the real-time monitoring method based on user behavior according to the preferred embodiment of the present invention is applied to an isolation monitoring system. The isolation monitoring system includes a door sensor module and a camera module (as shown in Figure 7, the isolation monitoring system The monitoring system also includes an isolation platform and a beacon sensor), and the camera module is communicatively connected with the door sensor module. For example, the door sensor module communicates with the camera module through the 433 wireless communication protocol.​
 如图1所示,所述基于用户行为的实时监控方法包括以下步骤: As shown in Figure 1, the real-time monitoring method based on user behavior includes the following steps:
 步骤S10、当所述门磁模块检测到开门状态时,接收所述摄像头模块拍摄目标区域并上传的拍摄内容。 Step S10: When the door sensor module detects the door-opening state, the camera module receives the shooting content of the target area and uploads it.​
 具体地,本发明中,所述隔离监控系统包括门磁模块和摄像头模块,可以应用于某些特定场景下对居家隔离人员的监控或者其他对人员需临时监控的场景。在隔离过程中, 用户可能会打开房门出去,进而会有以下几种情况:1、用户违规离家;2、用户正常扔垃圾/ 取餐;3、用户开门与非工作人员交流;4、工作人员上门进行核酸采样。因此对其中不符合规定的情况,如何及时发现进而制止,是隔离过程中需要考虑的问题。 Specifically, in the present invention, the isolation monitoring system includes a door sensor module and a camera module, which can be applied to the monitoring of home isolation personnel in certain specific scenarios or other scenarios where temporary monitoring of personnel is required. During the isolation process, the user may open the door and go out, which may lead to the following situations: 1. The user leaves home in violation of regulations; 2. The user normally throws away garbage/picks up food; 3. The user opens the door to communicate with non-staff; 4. Staff come to your door to take nucleic acid sampling. Therefore, how to detect and stop situations that do not meet the regulations in a timely manner is an issue that needs to be considered during the isolation process.​
 本发明中,基于人工智能深度学习技术,并结合门磁和信标传感器数据的融合,能够准确判断出住户的行为并减少误报率。具体地,所述摄像头模块与所述门磁模块相互协作,所述摄像头模块实时监控目标区域中用户的行为,所述门磁模块用于感知房门是否打 开,实际应用中,为节省存储空间或者节约摄像头用电,可采用所述门磁模块触发所述摄像 头模块启动的方式,即当所述门磁模块检测到处于开门状态时,则触发所述摄像头模块开 启拍摄,当所述门磁模块检测到处于关门状态超过预设时长后,则触发所述摄像头模块停 止拍摄。 In this invention, based on artificial intelligence deep learning technology and the fusion of door magnet and beacon sensor data, the behavior of residents can be accurately judged and the false alarm rate can be reduced. Specifically, the camera module and the door sensor module cooperate with each other. The camera module monitors the user's behavior in the target area in real time. The door sensor module is used to sense whether the door is open. In practical applications, in order to save storage space Or to save the power of the camera, the door sensor module can be used to trigger the startup of the camera module. That is, when the door sensor module detects that the door is open, the camera module is triggered to start shooting. When the door sensor module After the module detects that the door is closed for a preset period of time, it triggers the camera module to stop shooting.​
 需要说明的是,为了解决续航的问题,因为隔离可能达3周,而客户出于安装、拆卸、接电便捷的考虑,希望摄像头不要长期有线供电,最好电池供电,所述摄像头模块的主 控CPU处于关机状态。所述门磁模块和所述摄像头模块的MCU模块通过本地433无线协议连 接,相对现有技术中,门磁模块将开关门状态发送给隔离平台,再由隔离平台处理后对摄像 头模块进行指示的方式,可以降低系统的时延,因为如果门磁打开后,先通过公网无线协议 比如NB‑IoT或者4G等通知隔离平台,再由隔离平台下发命令给摄像头拍摄视频画面的周期会很长,可能高达5‑10秒,无法对居家隔离实现有效的管控,因此本发明采用本地无线协议,可以理解的是,除了433协议,其他的本地无线协议也可以应用到本发明,比如蓝牙等。 当所述门磁模块触发开门时,所述门磁模块的MCU会将所述摄像头模块的主控CPU唤醒,从 而对现场进行视频拍摄并通过4G无线网络上传到隔离平台,直连的方式响应度更高。 It should be noted that in order to solve the problem of battery life, because the isolation may last for 3 weeks, and for the convenience of installation, disassembly, and power connection, customers hope that the camera will not be wired for long-term power supply, and it is best to be battery-powered. The main part of the camera module Control CPU is in shutdown state. The door sensor module and the MCU module of the camera module are connected through the local 433 wireless protocol. Compared with the existing technology, the door sensor module sends the door opening and closing status to the isolation platform, and then the isolation platform processes and instructs the camera module. This method can reduce the system delay, because if the door sensor is opened, the isolation platform is first notified through public network wireless protocols such as NB‑IoT or 4G, and then the isolation platform issues commands to the camera to capture video footage. The cycle will be very long. , may be as high as 5-10 seconds, which cannot effectively control home isolation. Therefore, the present invention adopts a local wireless protocol. It is understandable that in addition to the 433 protocol, other local wireless protocols can also be applied to the present invention, such as Bluetooth, etc. When the door sensor module triggers the door opening, the MCU of the door sensor module will wake up the main control CPU of the camera module, thereby taking video of the scene and uploading it to the isolation platform through the 4G wireless network, and responding in a direct connection. degree is higher.​
 门磁除了通过本地433协议和摄像头通信以外,可以根据客户需求在433协议基础 上,增加NB‑IoT模块,这样门磁本身也可以通过NB‑IoT直接和平台进行通信。增加NB‑IoT, 是因为433只是单向的协议,就是门磁只能把数据推给摄像头,那么当门磁没电的时候,摄像头无法反向判断门磁是否连接,或者是否开闭。同时,隔离平台也无法主动调看摄像头的监控画面,只能被动的等门磁触发的时候,才能看到摄像头画面,因为当摄像头在休眠时, 摄像头的4G模块也是休眠的,隔离平台无法通过4G和休眠的摄像头进行通信。那么在门磁上增加NB‑IoT模块之后,就可以解决这两个问题,一方面可以通过隔离平台直接获取门磁 的电量状态/与摄像头连接状态/开闭状态,另一方面也可以通过隔离平台给门磁下发命 令,调用433协议启动摄像头拍摄视频上传,隔离平台可以主动查看现场视频画面。 In addition to communicating with the camera through the local 433 protocol, the door sensor can also add an NB-IoT module based on the 433 protocol according to customer needs, so that the door sensor itself can also directly communicate with the platform through NB-IoT. NB‑IoT is added because 433 is only a one-way protocol, that is, the door sensor can only push data to the camera. When the door sensor is out of power, the camera cannot reversely determine whether the door sensor is connected or whether it is open or closed. At the same time, the isolation platform cannot actively view the camera's monitoring screen. It can only passively wait for the door sensor to be triggered, because when the camera is sleeping, the 4G module of the camera is also sleeping, and the isolation platform cannot pass. 4G communicates with the dormant camera. Then adding the NB‑IoT module to the door sensor can solve these two problems. On the one hand, the power status/connection status with the camera/opening and closing status of the door sensor can be directly obtained through the isolation platform. On the other hand, it can also be obtained through the isolation platform. The platform issues a command to the door sensor and calls the 433 protocol to start the camera to capture and upload the video. The isolation platform can actively view the live video footage.​
 即,当所述门磁模块检测到开门状态时,可通过所述摄像头模块对目标区域进行 拍摄并上传拍摄内容。 That is, when the door sensor module detects the door-opening state, the target area can be photographed through the camera module and the photographed content can be uploaded.​
步骤S20、根据所述拍摄内容中的用户行为和持续时间确定在活动区域内用户的行为属性,所述活动区域包括所述目标区域。 Step S20: Determine the user's behavior attributes in the activity area according to the user behavior and duration in the photographed content, and the activity area includes the target area.​
 具体地,接收到所述摄像头模块上传的拍摄内容后,所述隔离平台会对上传的视 频数据进行视频解码和AI分析,AI分析主要是基于深度学习的计算机视觉算法,可以识别出现场是否有人出现在视频画面内,或者说视频画面的警戒范围内,术语也称ROI(region of interest,感兴趣区域),ROI的区域可以在管理平台进行绘制和调整。隔离平台中支持对各个隔离点位已部署好的摄像头画面,在线上绘制ROI警戒区域,这个ROI警戒区域在隔 离平台上可以通过拖拉视频窗口中的一个不规则多边形来进行定义,ROI警戒区域通常绘 制在住户门外离家的必经区域(但离住户门框有10‑30cm距离),当隔离员出现在所绘制的 ROI警戒区域内,才触发离家告警,如果隔离人员没有进入到ROI警戒区域,那么住户可能只 是探出身子拿外卖或者丢垃圾,无须触发离家告警。 Specifically, after receiving the shooting content uploaded by the camera module, the isolation platform will perform video decoding and AI analysis on the uploaded video data. AI analysis is mainly a computer vision algorithm based on deep learning, which can identify whether there are people at the scene. Appearing within the video screen, or within the warning range of the video screen, the term is also called ROI (region of interest, region of interest). The ROI area can be drawn and adjusted on the management platform. The isolation platform supports the deployment of camera images at each isolation point, and the ROI warning area is drawn online. This ROI warning area can be defined on the isolation platform by dragging an irregular polygon in the video window. The ROI warning area is usually Draw the area that must be passed outside the resident's door to leave home (but 10-30cm away from the resident's door frame). When the quarantined person appears in the drawn ROI warning area, the leaving home alarm will be triggered. If the quarantined person does not enter the ROI warning area area, then residents may just lean out to get takeout or throw away garbage without triggering the leaving alarm.​
 因此基于ROI警戒区域,可以根据所述拍摄内容确定在活动区域内所述用户的行为属性,其中,所述目标区域包含于所述活动区域(即所述活动区域包括所述目标区域),具体地,根据所述拍摄内容确定在所述活动区域内所述用户的行为属性包括:根据所述拍摄 内容确定所述用户在各活动区域的用户行为和对应的持续时间;根据所述用户在各活动区 域的用户行为和对应的持续时间,确定所述用户的行为属性。 Therefore, based on the ROI warning area, the behavioral attributes of the user in the activity area can be determined according to the shooting content, wherein the target area is included in the activity area (that is, the activity area includes the target area), specifically Determining the behavioral attributes of the user in the activity area according to the photographed content includes: determining the user behavior and corresponding duration of the user in each activity area according to the photographed content; determining the user's behavior in each activity area according to the photographed content; The user behavior in the activity area and the corresponding duration determine the user's behavior attributes.​
 例如,若所述用户在所述目标区域内且所述目标区域内存在第三人;判断所述第三人是否为工作人员;若所述第三人不是所述工作人员,则确定所述用户的行为属性为社 交行为;若所述第三人是所述工作人员,则确定所述用户的行为属性为检测相关行为;若所 述用户在第一活动区域且在所述第一活动区域的持续时间超过第一预设值,则确定所述用 户的行为属性为离家行为,所述第一活动区域为非合规区域。 For example, if the user is in the target area and there is a third person in the target area; determine whether the third person is a staff member; if the third person is not the staff member, determine whether the third person is a staff member; The user's behavior attribute is social behavior; if the third person is the staff member, it is determined that the user's behavior attribute is detection-related behavior; if the user is in the first activity area and is in the first activity area The duration exceeds the first preset value, then it is determined that the user's behavior attribute is the behavior of leaving home, and the first activity area is a non-compliant area.​
 其中,判断所述第三人是否为工作人员包括:基于图像分析方法判断所述第三人的服装是否满足所述工作人员的着装要求;若满足,则确定所述第三人为所述工作人员。 Wherein, determining whether the third person is a staff member includes: determining whether the clothing of the third person meets the dress requirements of the staff member based on an image analysis method; if so, determining that the third party is the staff member. .​
 实际应用中,所述隔离监控系统还包括信标传感器,则所述判断所述第三人是否 为工作人员还可以包括:通过所述信标传感器扫描预设范围内是否存在信标;若存在所述 信标,则确定所述第三人为所述工作人员,并将所述信标的标识信息上传至隔离平台。 In practical applications, if the isolation monitoring system further includes a beacon sensor, then determining whether the third person is a staff member may also include: scanning whether there is a beacon within the preset range through the beacon sensor; if there is The beacon determines that the third party is the staff member, and uploads the identification information of the beacon to the isolation platform.​
 本发明中,当所述门磁模块检测到门被打开时,而AI算法在视频画面或者ROI警戒 区域中没有识别到人,那么人可能并没有出门,或者只是出门取餐/丢垃圾,并没有进入ROI 警戒区域,那么隔离平台只会产生一个私自开门的异常记录。因为隔离平台支持分类分级 告警和自定义联动策略,比如将私自开门异常定义为三级告警,并且只在隔离平台上告警 和做视频和截图存证记录,不需要联动短信/电话/邮件通知相关人员,也就不会触发误报, 只是有记录。而当门磁没被打开时,外面经过的路人也不会触发误报。当门磁被打开了,而 且识别到有人在ROI警戒区域,那么这个时候有3种可能,第一,隔离人员开门和其他非工作 人员交谈,应当马上告警;第二,隔离人员擅自离家,应当马上告警;第三,工作人员上门核 酸采样,只需要视频记录,不需要联动短信/电话/邮件告警。因此,这种情况下,只要不是检 测到工作人员上门核酸,都会产生违规离家告警。对判断是否为工作人员的方式,本发明中 可以结合信标和信标传感器的数据来做判断,在实际应用中,信标传感器可以为工牌。 In the present invention, when the door sensor module detects that the door is opened, and the AI algorithm does not recognize the person in the video picture or ROI warning area, then the person may not have gone out, or may have just gone out to get food/throw away garbage, and Without entering the ROI warning area, the isolation platform will only generate an abnormal record of opening the door privately. Because the isolation platform supports classified and hierarchical alarms and customized linkage strategies, for example, the abnormality of opening the door privately is defined as a third-level alarm, and only the alarm and video and screenshot recording are made on the isolation platform, and there is no need to link SMS/phone/email notifications. personnel, it will not trigger false alarms, it will just be recorded. And when the door sensor is not opened, passers-by outside will not trigger false alarms. When the door sensor is opened and someone is recognized in the ROI warning area, there are three possibilities at this time. First, if the quarantined personnel open the door and talk to other non-staff members, an alarm should be alerted immediately; secondly, if the quarantined personnel leave home without authorization, An alarm should be issued immediately; thirdly, when staff come to take nucleic acid samples, they only need video recording and do not need to be linked to SMS/phone/email alarms. Therefore, in this case, as long as the nucleic acid of the staff visiting the door is not detected, an illegal leaving home alarm will be generated. As for the method of judging whether it is a worker, the present invention can combine the data of the beacon and the beacon sensor to make the judgment. In practical applications, the beacon sensor can be a work badge.​
 其中,所谓信标和工牌,信标中有一个蓝牙模块,会不断的通过蓝牙广播自己的id 等信息,工牌上也有一个蓝牙模块,可以扫描附近的蓝牙。由于一个工牌可以扫描多个信 标,这样虽然每个隔离点位要安装一个信标,但工牌只需要社区工作人员、防疫人员或者物业人员有一个工牌就可以,因为往往一个工作人员管理一个区域内的多个隔离点位。当工 牌扫描到信标,而且判断信号强度在1‑2m以内(可以自定义调整距离),那么工牌就会通过 4G把该信标的信息上传到隔离平台,隔离平台就可以判断信标所在的隔离点位有工作人员上门,这种情况往往工作人员是给住户做核酸采样。隔离平台支持录入隔离周期(如7天、14 天、21天)以及隔离采样周期(如一天一测、三天两测、1/3/7测、2/4/6测等等,也可以自定义 选择),当某一天过了零点,工牌都没有上报过该隔离点位信标的信息,然而这一天根据核 酸策略又需要给住户做核酸时,隔离平台就会触发一个未及时核酸采样的告警。 Among them, the so-called beacon and work badge. The beacon has a Bluetooth module that continuously broadcasts its own ID and other information through Bluetooth. The work badge also has a Bluetooth module that can scan nearby Bluetooth. Since one work badge can scan multiple beacons, although one beacon must be installed at each isolation point, the work badge only requires community workers, epidemic prevention personnel or property personnel to have one badge, because often a staff member Manage multiple isolation points in an area. When the work badge scans the beacon and determines that the signal strength is within 1-2m (the distance can be customized), the work badge will upload the beacon information to the isolation platform through 4G, and the isolation platform can determine the location of the beacon. There are staff visiting the isolation points. In this case, the staff often do nucleic acid sampling for the residents. The isolation platform supports inputting the isolation period (such as 7 days, 14 days, 21 days) and isolation sampling period (such as one test a day, two tests in three days, 1/3/7 test, 2/4/6 test, etc.), and you can also Custom selection), when it is past midnight on a certain day, the work card has not reported the information of the isolation point beacon. However, on this day, according to the nucleic acid policy, nucleic acid needs to be done for residents, the isolation platform will trigger an untimely nucleic acid sampling alarm.​
 本发明中,信标是一个广播蓝牙信号的设备,安装于住户门口。工作人员上门或者 测核酸,会佩戴一个4G(cat 1)+蓝牙工牌,该工牌会扫描4G信号,当扫描到特定标识的信标 时,会通过4G(cat 1)上报数据给到隔离平台,这样可以从后台判断该住户有工作人员上 门/测核酸,即便开门也不会产生一级“违规离家”告警。当然隔离平台也会生成一条开门的 视频记录,方便后续查看。同时隔离平台也会记录一条“核酸上门采样”的记录,因为工作人员在部署居家隔离摄像头时,会通过小程序记录需要的居家隔离采样日期,如果住户没有被按时采样,那么隔离平台也会根据检测到的核酸采样记录,生成“未按时核酸采样”告警, 并进行告警提示。 In the present invention, the beacon is a device that broadcasts Bluetooth signals and is installed at the door of a household. When staff come to the door or take nucleic acid tests, they will wear a 4G (cat 1) + Bluetooth badge. The badge will scan the 4G signal. When a beacon with a specific logo is scanned, the data will be reported to the quarantine through 4G (cat 1). Platform, so that it can be determined from the background that the resident has staff coming to the door to perform a nucleic acid test, and even if the door is opened, a first-level "violation of leaving home" alarm will not be generated. Of course, the isolation platform will also generate a video record of the door opening for subsequent viewing. At the same time, the isolation platform will also record a record of "nucleic acid door-to-door sampling" because when staff deploy home isolation cameras, they will record the required home isolation sampling date through the mini program. If the resident is not sampled on time, the isolation platform will also The detected nucleic acid sampling records are generated, and an alarm of "nucleic acid sampling not on time" is generated, and an alarm prompt is given.​
 步骤S30、根据所述行为属性的行为等级,判断所述用户的所述行为属性是否属于违规行为。 Step S30: Based on the behavior level of the behavior attribute, determine whether the user's behavior attribute is a violation.​
 具体地,在确定了用户的行为属性后,根据所述用户的行为属性判断是否为违规行为,具体地,根据所述用户的行为属性确定对应的行为等级;当所述用户的行为属性对应的行为等级高于预设等级时,则确定属于违规行为。 Specifically, after the user's behavior attributes are determined, whether it is a violation is determined based on the user's behavior attributes. Specifically, the corresponding behavior level is determined based on the user's behavior attributes; when the user's behavior attributes correspond to When the behavior level is higher than the preset level, it is determined to be a violation.​
 步骤S40、若所述用户的行为属于违规行为,则实时触发上报告警操作并提示所述用户。 Step S40: If the user's behavior is a violation, trigger an alarm reporting operation in real time and prompt the user.​
 例如,若用户的行为属性确定对应的行为等级为三级,而预设等级为一级,则高于该预设等级时被认为是违规行为,则触发上报告警操作并提示所述用户;以便工作人员及 时采取措施,从而降低疾病传播风险,实现隔离人员智能监测。 For example, if the user's behavior attribute determines that the corresponding behavior level is level three, and the preset level is level one, then a behavior higher than the preset level is considered a violation, and an alarm reporting operation is triggered and the user is prompted; This allows staff to take timely measures to reduce the risk of disease transmission and enable intelligent monitoring of quarantined personnel.​
 如图2‑图6所示,针对图2‑图6中的五个场景,通过本发明提供的监控方法可以实时监控到所述用户的各种行为,针对其中的违规行为,进行上传告警。 As shown in Figure 2-Figure 6, for the five scenarios in Figure 2-Figure 6, various behaviors of the user can be monitored in real time through the monitoring method provided by the present invention, and alarms can be uploaded for violations.​
 如图2所示,表示住户(隔离人员)违规离家的场景,当检测到住户(隔离人员)违规 离家时,进行视频/截图告警,或者联动短信/电话告警。 As shown in Figure 2, it represents the scene where residents (persons in quarantine) leave home in violation of regulations. When it is detected that residents (persons in quarantine) leave home in violation of regulations, a video/screenshot alarm will be issued, or a linked text message/telephone alarm will be issued.​
 如图3所示,表示住户(隔离人员)正常扔垃圾/取餐的场景,当检测到住户(隔离人 员)正常扔垃圾/取餐时,只会产生一个私自开门的异常记录,不联动告警。 As shown in Figure 3, it represents a scenario in which residents (quarantine personnel) normally throw away garbage/take meals. When it is detected that residents (quarantine personnel) normally throw away garbage/take meals, only an abnormal record of opening the door privately will be generated, and no linkage alarm will be generated. .​
 如图4所示,表示住户(隔离人员)开门与非工作人员交谈的场景,当检测到住户 (隔离人员)开门与非工作人员交谈时,进行视频/截图告警,或者联动短信/电话告警。 As shown in Figure 4, it represents a scene in which residents (isolated personnel) open the door and talk to non-staff. When it is detected that residents (isolated personnel) open the door and talk to non-staff, a video/screenshot alarm will be issued, or a linked text message/phone alarm will be issued.​
 如图5所示,表示过道人员正常路过的场景,这属于正常现象,隔离平台不会生成 任何记录和告警,即避免触发误报。 As shown in Figure 5, it represents a scenario where people in the aisle are passing by normally. This is a normal phenomenon. The isolation platform will not generate any records or alarms, which avoids triggering false alarms.​
 如图6所示,表示核酸上门采样的场景,当检测到工作人员(医护人员)核酸上门采 样时,隔离平台不作异常和告警,只记录核酸采样信息。 As shown in Figure 6, it represents the scene of door-to-door nucleic acid sampling. When it is detected that a staff member (medical staff) comes to collect nucleic acid, the isolation platform will not generate an abnormality or alarm, and only record the nucleic acid sampling information.​
 进一步地,如图7所示,本发明还相应提供了一种隔离监控系统,其中,所述隔离监 控系统包括: Further, as shown in Figure 7, the present invention also provides an isolation monitoring system, wherein the isolation monitoring system includes:
 门磁模块51、摄像头模块52、信标传感器53和隔离平台54; Door sensor module 51, camera module 52, beacon sensor 53 and isolation platform 54;
 所述门磁模块51用于检测开门状态;The door sensor module 51 is used to detect the door opening status;
 所述摄像头模块52当所述门磁模块51检测到开门状态时,对目标区域进行拍摄并 上传拍摄内容; When the door sensor module 51 detects the door-opening state, the camera module 52 photographs the target area and uploads the photographed content;
 所述信标传感器53用于扫描预设范围内是否存在信标; The beacon sensor 53 is used to scan whether there is a beacon within the preset range;
 所述隔离平台54用于根据所述拍摄内容中的用户行为和持续时间确定在活动区 域内用户的行为属性;还用于根据所述行为属性的行为等级,判断所述用户的所述行为属性是否属于违规行为;还用于若所述用户的行为属于违规行为,则实时触发上报告警操作并提示所述用户。 The isolation platform 54 is used to determine the behavior attributes of the user in the activity area based on the user behavior and duration in the shooting content; and is also used to determine the behavior attributes of the user based on the behavior level of the behavior attributes. Whether it is a violation; it is also used to trigger an alarm reporting operation in real time and prompt the user if the user's behavior is a violation.​
 进一步地,如图8所示,基于上述基于用户行为的实时监控方法和系统,本发明还相应提供了一种隔离平台,所述隔离平台包括处理器10、存储器20及显示器30。图8仅示出了隔离平台的部分组件,但是应理解的是,并不要求实施所有示出的组件,可以替代的实施更多或者更少的组件。 Further, as shown in Figure 8, based on the above-mentioned real-time monitoring method and system based on user behavior, the present invention also provides an isolation platform. The isolation platform includes a processor 10, a memory 20 and a display 30. FIG. 8 only shows some components of the isolation platform, but it should be understood that implementation of all the components shown is not required, and more or fewer components may be implemented instead.​
 所述存储器20在一些实施例中可以是所述隔离平台的内部存储单元,例如隔离平台的硬盘或内存。所述存储器20在另一些实施例中也可以是所述隔离平台的外部存储设备,例如所述隔离平台上配备的插接式硬盘,智能存储卡(Smart Media Card , SMC),安全 数字(Secure Digital , SD)卡,闪存卡(Flash Card)等。进一步地,所述存储器20还可以既 包括所述隔离平台的内部存储单元也包括外部存储设备。所述存储器20用于存储安装于所 述隔离平台的应用软件及各类数据,例如所述安装隔离平台的程序代码等。所述存储器20 还可以用于暂时地存储已经输出或者将要输出的数据。在一实施例中,存储器20上存储有 基于用户行为的实时监控程序40,该基于用户行为的实时监控程序40可被处理器10所执 行,从而实现本申请中基于用户行为的实时监控方法。 The memory 20 may be an internal storage unit of the isolation platform in some embodiments, such as a hard disk or memory of the isolation platform. In other embodiments, the memory 20 may also be an external storage device of the isolation platform, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), or a secure digital (Secure) device equipped on the isolation platform. Digital, SD) card, Flash Card, etc. Further, the memory 20 may also include both an internal storage unit of the isolation platform and an external storage device. The memory 20 is used to store application software and various data installed on the isolation platform, such as program codes for installing the isolation platform, etc. The memory 20 can also be used to temporarily store data that has been output or is to be output. In one embodiment, a real-time monitoring program 40 based on user behavior is stored on the memory 20, and the real-time monitoring program 40 based on user behavior can be executed by the processor 10, thereby realizing the real-time monitoring method based on user behavior in this application.​
 所述处理器10在一些实施例中可以是一中央处理器(Central Processing Unit , CPU),微处理器或其他数据处理芯片,用于运行所述存储器20中存储的程序代码或处理数据,例如执行所述基于用户行为的实时监控方法等。 In some embodiments, the processor 10 may be a central processing unit (CPU), a microprocessor or other data processing chip, used to run program codes or process data stored in the memory 20, for example Execute the real-time monitoring method based on user behavior, etc.​
 所述显示器30在一些实施例中可以是LED显示器、液晶显示器、触控式液晶显示器 以及OLED(Organic Light‑Emitting Diode,有机发光二极管)触摸器等。所述显示器30用 于显示在所述隔离平台的信息以及用于显示可视化的用户界面。所述隔离平台的部件10‑30通过系统总线相互通信。 In some embodiments, the display 30 may be an LED display, a liquid crystal display, a touch-controlled liquid crystal display, an OLED (Organic Light-Emitting Diode, organic light-emitting diode) touch device, etc. The display 30 is used to display information on the isolation platform and to display a visual user interface. The components 10-30 of the isolation platform communicate with each other via a system bus.​
 在一实施例中,当处理器10执行所述存储器20中基于用户行为的实时监控程序40 时实现以下步骤: In one embodiment, when the processor 10 executes the real-time monitoring program 40 based on user behavior in the memory 20, the following steps are implemented:
 当所述门磁模块检测到开门状态时,接收所述摄像头模块拍摄目标区域并上传的拍摄内容; When the door sensor module detects the door-opening state, it receives the shooting content of the target area captured by the camera module and uploaded;
 根据所述拍摄内容中的用户行为和持续时间确定在活动区域内用户的行为属性, 所述活动区域包括所述目标区域; Determine the user's behavior attributes in the activity area according to the user behavior and duration in the shooting content, and the activity area includes the target area;
 根据所述行为属性的行为等级,判断所述用户的所述行为属性是否属于违规行为; Based on the behavior level of the behavior attribute, determine whether the user's behavior attribute is a violation;
 若所述用户的行为属于违规行为,则实时触发上报告警操作并提示所述用户。 If the user's behavior is a violation, an alarm reporting operation will be triggered in real time and the user will be prompted.​
 其中,所述根据所述拍摄内容中的用户行为和持续时间确定在活动区域内用户的行为属性,具体包括: Wherein, the behavioral attributes of the user in the activity area are determined based on the user behavior and duration in the photographed content, specifically including:
 根据所述拍摄内容确定所述用户在各活动区域的用户行为和对应的持续时间; Determine the user's user behavior and corresponding duration in each activity area based on the shooting content;
 根据所述用户在各活动区域的用户行为和对应的持续时间,确定所述用户的行为 属性。 Based on the user's user behavior in each activity area and the corresponding duration, the user's behavior attributes are determined.​
 其中,所述根据所述用户在各活动区域的用户行为和对应的持续时间,确定所述 用户的行为属性,具体包括: Wherein, the behavioral attributes of the user are determined based on the user's user behavior in each activity area and the corresponding duration, specifically including:
 若所述用户在所述目标区域内且所述目标区域内存在第三人,则判断所述第三人 是否为工作人员; If the user is in the target area and there is a third person in the target area, determine whether the third person is a staff member;
 若所述第三人不是所述工作人员,则确定所述用户的行为属性为社交行为; If the third person is not the staff member, it is determined that the user's behavior attribute is social behavior;
 若所述第三人是所述工作人员,则确定所述用户的行为属性为检测相关行为; If the third person is the staff member, determine the user’s behavioral attributes to detect relevant behaviors;
 若所述用户在第一活动区域且在所述第一活动区域的持续时间超过第一预设值, 则确定所述用户的行为属性为离家行为; If the user is in the first activity area and the duration in the first activity area exceeds the first preset value, it is determined that the behavior attribute of the user is the behavior of leaving home;
 其中,所述第一活动区域为非合规区域。 Among them, the first activity area is a non-compliant area.​
 其中,所述判断所述第三人是否为工作人员,具体包括: Among them, the judgment of whether the third person is a staff member specifically includes:
 基于图像分析判断所述第三人的服装是否满足所述工作人员的着装要求; Determine whether the clothing of the third person meets the dress requirements of the staff based on image analysis;
 若满足,则确定所述第三人为所述工作人员。 If satisfied, the third party is determined to be the staff member.​
 其中,所述隔离监控系统还包括信标传感器; Among them, the isolation monitoring system also includes a beacon sensor;
 所述判断所述第三人是否为工作人员,具体包括: The above-mentioned judgment on whether the third party is a staff member includes:
 基于所述信标传感器扫描预设范围内是否存在信标; Based on the beacon sensor, scan whether there is a beacon within the preset range;
 若存在所述信标,则确定所述第三人为所述工作人员,并将所述信标的标识信息上传至隔离平台。 If the beacon exists, the third party is determined to be the staff member, and the identification information of the beacon is uploaded to the isolation platform.​
 其中,所述基于用户行为的实时监控方法还包括: Among them, the real-time monitoring method based on user behavior also includes:
 接收所述工作人员对所述用户的采样时间,以根据所述用户的采样时间和预设采 样周期确定下一次采样时间节点; Receive the sampling time of the user from the staff to determine the next sampling time node based on the user's sampling time and the preset sampling period;
 若当前时刻达到所述下一次采样时间节点,且所述信标传感器未扫描到所述信 标,生成采样异常信息并下发以进行告警,所述采样异常信息包括所述用户的具体地址信息。 If the current time reaches the next sampling time node and the beacon sensor does not scan the beacon, sampling exception information is generated and sent for alarm. The sampling exception information includes the specific address information of the user. .​
 其中,所述根据所述行为属性的行为等级,判断所述用户的所述行为属性是否属于违规行为,具体包括: Wherein, judging whether the user's behavioral attributes are illegal behaviors based on the behavior level of the behavioral attributes, specifically includes:
 确定所述用户的行为属性对应的行为等级; Determine the behavior level corresponding to the user's behavioral attributes;
 当所述用户的行为属性对应的行为等级高于预设等级时,则确定所述用户的所述行为属性属于违规行为。 When the behavior level corresponding to the user's behavior attribute is higher than the preset level, it is determined that the user's behavior attribute is a violation.​
 本发明还提供一种计算机可读存储介质,其中,所述计算机可读存储介质存储有 基于用户行为的实时监控程序,所述基于用户行为的实时监控程序被处理器执行时实现如 上所述的基于用户行为的实时监控方法的步骤。 The present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a real-time monitoring program based on user behavior, and when the real-time monitoring program based on user behavior is executed by the processor, the above-mentioned methods are implemented. Steps of real-time monitoring method based on user behavior.​
 综上所述,本发明提供一种基于用户行为的实时监控方法及相关设备,所述基于用户行为的实时监控方法应用于隔离监控系统,所述隔离监控系统包括门磁模块和摄像头模块,所述摄像头模块与所述门磁模块通信连接,所述方法包括:当所述门磁模块检测到开门状态时,接收所述摄像头模块拍摄目标区域并上传的拍摄内容;根据所述拍摄内容中的用户行为和持续时间确定在活动区域内用户的行为属性,所述活动区域包括所述目标区 域;根据所述行为属性的行为等级,判断所述用户的所述行为属性是否属于违规行为;若所述用户的行为属于违规行为,则实时触发上报告警操作并提示所述用户。本发明实时监控 隔离人员的行为,当被隔离人员存在不符合规定的行为时,可以实时上报,以及时阻止被隔离人员的违规行为可能导致的传播后果,提高隔离的监控强度并减少隔离成本。 In summary, the present invention provides a real-time monitoring method based on user behavior and related equipment. The real-time monitoring method based on user behavior is applied to an isolation monitoring system. The isolation monitoring system includes a door sensor module and a camera module. The camera module is communicatively connected to the door sensor module, and the method includes: when the door sensor module detects the door-opening state, receiving the shooting content of the target area photographed by the camera module and uploaded; according to the shooting content The user's behavior and duration determine the user's behavior attributes in the activity area, which includes the target area; based on the behavior level of the behavior attributes, it is judged whether the user's behavior attributes are illegal behaviors; if If the user's behavior is a violation, the reporting alarm operation will be triggered in real time and the user will be prompted. The invention monitors the behavior of quarantined personnel in real time. When the quarantined personnel have behaviors that do not meet the regulations, it can be reported in real time to promptly prevent the consequences of possible transmission of the quarantined personnel's illegal behavior, improve the intensity of quarantine monitoring and reduce the cost of quarantine.​
 需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排 他性的包含,从而使得包括一系列要素的过程、方法、物品或者隔离平台不仅包括那些要 素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者隔离 平台所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排 除在包括该要素的过程、方法、物品或者隔离平台中还存在另外的相同要素。 It should be noted that, as used herein, the terms "comprises," "comprises" or any other variation thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or isolation platform that includes a list of elements includes not only those elements , but also includes other elements not expressly listed or inherent to the process, method, article or isolation platform. Without further limitation, an element qualified by the statement "comprises a..." does not exclude the presence of additional identical elements in the process, method, article or isolation platform that includes the element.​
 当然,本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程, 是可以通过计算机程序来指令相关硬件(如处理器,控制器等)来完成,所述的程序可存储 于一计算机可读取的计算机可读存储介质中,所述程序在执行时可包括如上述各方法实施 例的流程。其中所述的计算机可读存储介质可为存储器、磁碟、光盘等。 Of course, those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing relevant hardware (such as processors, controllers, etc.) through computer programs, and the programs can be stored in a computer. In a computer-readable computer-readable storage medium, when executed, the program may include the processes of the above method embodiments. The computer-readable storage medium may be a memory, a magnetic disk, an optical disk, etc.​
 应当理解的是,本发明的应用不限于上述的举例,对本领域普通技术人员来说,可 以根据上述说明加以改进或变换,所有这些改进和变换都应属于本发明所附权利要求的保护范围。 It should be understood that the application of the present invention is not limited to the above examples. For those of ordinary skill in the art, improvements or changes can be made based on the above description. All these improvements and changes should fall within the protection scope of the appended claims of the present invention.​

Claims (5)

  1. 一种基于用户行为的实时监控方法,其特征在于,所述基于用户行为的实时监控方 法应用于隔离监控系统,所述隔离监控系统包括门磁模块和摄像头模块,所述摄像头模块 与所述门磁模块通信连接,所述基于用户行为的实时监控方法包括:A real-time monitoring method based on user behavior, characterized in that the real-time monitoring method based on user behavior is applied to an isolation monitoring system. The isolation monitoring system includes a door sensor module and a camera module. The camera module is connected to the door sensor module. Magnetic module communication connection, the real-time monitoring method based on user behavior includes:
          当所述门磁模块检测到开门状态时,接收所述摄像头模块拍摄目标区域并上传的拍摄 内容;When the door sensor module detects the door-opening state, it receives the shooting content of the target area captured by the camera module and uploaded;
          当所述门磁模块检测到处于开门状态时,则触发所述摄像头模块开启拍摄,当所述门磁模块检测到处于关门状态超过预设时长后,则触发所述摄像头模块停止拍摄;When the door sensor module detects that the door is open, it triggers the camera module to start shooting; when the door sensor module detects that the door is closed for more than the preset time, it triggers the camera module to stop shooting;
          根据所述拍摄内容中的用户行为和持续时间确定在活动区域内用户的行为属性,所述活动区域包括所述目标区域;Determine the user's behavioral attributes in the activity area based on the user behavior and duration in the shooting content, and the activity area includes the target area;
          所述根据所述拍摄内容中的用户行为和持续时间确定在活动区域内用户的行为属性,具体包括: The behavioral attributes of the user in the activity area are determined based on the user behavior and duration in the shooting content, specifically including:
          根据所述拍摄内容确定所述用户在各活动区域的用户行为和对应的持续时间; Determine the user's user behavior and corresponding duration in each activity area based on the shooting content;
          根据所述用户在各活动区域的用户行为和对应的持续时间,确定所述用户的行为属性; Determine the behavioral attributes of the user based on the user's behavior in each activity area and the corresponding duration;
          所述根据所述用户在各活动区域的用户行为和对应的持续时间,确定所述用户的行为属性,具体包括:Determining the behavioral attributes of the user based on the user's user behavior in each activity area and the corresponding duration, specifically including:
          若所述用户在所述目标区域内且所述目标区域内存在第三人,则判断所述第三人是否 为工作人员; If the user is in the target area and there is a third person in the target area, determine whether the third person is a staff member;
          若所述第三人不是所述工作人员,则确定所述用户的行为属性为社交行为;If the third person is not the staff member, it is determined that the behavioral attribute of the user is social behavior;
          若所述第三人是所述工作人员,则确定所述用户的行为属性为检测相关行为; If the third person is the staff member, determine the user's behavioral attributes to detect relevant behaviors;
          若所述用户在第一活动区域且在所述第一活动区域的持续时间超过第一预设值,则确定所述用户的行为属性为离家行为; If the user is in the first activity area and the duration in the first activity area exceeds the first preset value, it is determined that the behavior attribute of the user is the behavior of leaving home;
          其中,所述第一活动区域为非合规区域; ​ Among them, the first activity area is a non-compliant area;
          所述隔离监控系统还包括信标传感器 ,所述信标传感器用于扫描预设范围内是否存在信标; The isolation monitoring system also includes a beacon sensor, which is used to scan whether there is a beacon within a preset range;
          所述判断所述第三人是否为工作人员,具体包括: The above-mentioned judgment on whether the third party mentioned is a staff member includes:
          基于图像分析判断所述第三人的服装是否满足所述工作人员的着装要求; Determine whether the third person’s clothing meets the dress requirements of the staff based on image analysis;
          若满足,则确定所述第三人为所述工作人员; If satisfied, the third party is determined to be the staff member;
          或者所述判断所述第三人是否为工作人员,具体包括: Or the judgment as to whether the third party mentioned is a staff member, specifically including:
          基于所述信标传感器扫描预设范围内是否存在信标; Based on the beacon sensor, scan whether there is a beacon within the preset range;
          若存在所述信标,则确定所述第三人为所述工作人员,并将所述信标的标识信息上传至隔离平台; If the beacon exists, determine that the third party is the staff member, and upload the identification information of the beacon to the isolation platform;
          所述隔离平台支持分类分级告警和自定义联动策略; The isolation platform supports classified and hierarchical alarms and customized linkage strategies;
         根据所述行为属性的行为等级,判断所述用户的所述行为属性是否属于违规行为; Based on the behavior level of the behavior attribute, determine whether the user's behavior attribute is a violation;
         所述根据所述行为属性的行为等级,判断所述用户的所述行为属性是否属于违规行为,具体包括: Determining whether the behavioral attributes of the user are violations based on the behavior level of the behavioral attributes, specifically including:
         确定所述用户的行为属性对应的行为等级; Determine the behavior level corresponding to the user's behavioral attributes;
         当所述用户的行为属性对应的行为等级高于预设等级时,则确定所述用户的所述行为 属性属于违规行为;When the behavior level corresponding to the user's behavior attribute is higher than the preset level, it is determined that the user's behavior attribute is a violation;
         若所述用户的行为属性属于违规行为,则实时触发上报告警操作并提示所述用户; If the user's behavioral attributes are illegal, the reporting alarm operation will be triggered in real time and the user will be prompted;
         将所述用户的所述行为属性分为五大场景,并制定相应措施如下: Divide the behavioral attributes of the user into five major scenarios, and formulate corresponding measures as follows:
         当检测到隔离人员违规离家时,进行视频/截图告警,或者联动短信/电话告警; When it is detected that quarantined personnel leave home in violation of regulations, a video/screenshot alarm will be issued, or a linked SMS/telephone alarm will be issued;
         当检测到隔离人员正常扔垃圾/取餐时,只产生一个私自开门的异常记录,不联动告 警; When it is detected that the quarantined personnel normally throw away garbage/take meals, only an abnormal record of opening the door privately will be generated, and no alarm will be linked;
         当检测到住户隔离人员开门与非工作人员交谈时,进行视频/截图告警,或者联动短信/电话告警; When it is detected that residents in isolation open the door to talk to non-staff, a video/screenshot alarm will be issued, or a linked text message/phone alarm will be issued;
         当检测到过道人员正常路过时,属正常现象,不生成任何记录和告警,避免触发误报; When it is detected that people in the aisle are passing by normally, it is a normal phenomenon and no records or alarms will be generated to avoid triggering false alarms;
         当检测到工作人员核酸上门采样时,隔离平台不作异常和告警,只记录核酸采样信息 。When it is detected that a staff member comes to take nucleic acid samples, the isolation platform will not generate any abnormalities or alarms, and will only record the nucleic acid sampling information.
  2. .根据权利要求1所述的基于用户行为的实时监控方法,其特征在于,所述基于用户行 为的实时监控方法还包括: . The real-time monitoring method based on user behavior according to claim 1, characterized in that the real-time monitoring method based on user behavior further includes:
          接收所述工作人员对所述用户的采样时间,以根据所述用户的采样时间和预设采样周 期确定下一次采样时间节点; Receive the sampling time of the user from the staff to determine the next sampling time node based on the user's sampling time and the preset sampling period;
          若当前时刻达到所述下一次采样时间节点,且所述信标传感器未扫描到所述信标,生 成采样异常信息并下发以进行告警,所述采样异常信息包括所述用户的具体地址信息。If the current time reaches the next sampling time node and the beacon sensor does not scan the beacon, sampling exception information is generated and sent for alarm. The sampling exception information includes the specific address information of the user. .
  3. 一种隔离监控系统,其特征在于,所述隔离监控系统包括: An isolation monitoring system, characterized in that the isolation monitoring system includes:
          门磁模块、摄像头模块、信标传感器和隔离平台; Door sensor module, camera module, beacon sensor and isolation platform;
          所述门磁模块用于检测开门状态; The door sensor module is used to detect the door opening status;
          所述摄像头模块当所述门磁模块检测到开门状态时,对目标区域进行拍摄并上传拍摄内容; When the door sensor module detects the door opening state, the camera module takes photos of the target area and uploads the shooting content;
          当所述门磁模块检测到处于开门状态时,则触发所述摄像头模块开启拍摄,当所述门磁模块检测到处于关门状态超过预设时长后,则触发所述摄像头模块停止拍摄; When the door sensor module detects that the door is open, it triggers the camera module to start shooting; when the door sensor module detects that the door is closed for more than the preset time, it triggers the camera module to stop shooting;
          所述隔离平台根据所述拍摄内容确定用户在各活动区域的用户行为和对应的持续时间; The isolation platform determines the user's user behavior in each activity area and the corresponding duration based on the shooting content;
          所述隔离平台根据所述用户在各活动区域的用户行为和对应的持续时间,确定所述用 户的行为属性; The isolation platform determines the behavioral attributes of the user based on the user's behavior in each activity area and the corresponding duration;
         所述活动区域包括所述目标区域; The activity area includes the target area;
         若所述用户在所述目标区域内且所述目标区域内存在第三人,则所述隔离平台判断所述第三人是否为工作人员; If the user is in the target area and there is a third person in the target area, the isolation platform determines whether the third person is a staff member;
         若所述第三人不是所述工作人员,则所述隔离平台确定所述用户的行为属性为社交行为; If the third person is not the staff member, the isolation platform determines that the user's behavioral attribute is social behavior;
         若所述第三人是所述工作人员,则所述隔离平台确定所述用户的行为属性为检测相关行为; If the third person is the staff member, the isolation platform determines that the user's behavioral attributes are detection-related behaviors;
         若所述用户在第一活动区域且在所述第一活动区域的持续时间超过第一预设值,则所 述隔离平台确定所述用户的行为属性为离家行为; If the user is in the first activity area and the duration in the first activity area exceeds the first preset value, the isolation platform determines that the user's behavior attribute is leaving home behavior;
         其中,所述第一活动区域为非合规区域; ​ Among them, the first activity area is a non-compliant area;
         所述信标传感器用于扫描预设范围内是否存在信标; The beacon sensor is used to scan whether there is a beacon within the preset range;
         所述隔离平台判断所述第三人是否为工作人员,具体包括: The isolation platform determines whether the third person is a staff member, including:
         基于图像分析判断所述第三人的服装是否满足所述工作人员的着装要求;Determine whether the third person’s clothing meets the dress requirements of the staff based on image analysis;
        若满足,则确定所述第三人为所述工作人员; If satisfied, the third party is determined to be the staff member;
        或者所述隔离平台判断所述第三人是否为工作人员,具体包括: Or the isolation platform determines whether the third person is a staff member, specifically including:
        基于所述信标传感器扫描预设范围内是否存在信标; Based on the beacon sensor, scan whether there is a beacon within the preset range;
        若存在所述信标,则确定所述第三人为所述工作人员,并将所述信标的标识信息上传至隔离平台; If the beacon exists, determine that the third party is the staff member, and upload the identification information of the beacon to the isolation platform;
       所述隔离平台支持分类分级告警和自定义联动策略; The isolation platform supports classified and hierarchical alarms and customized linkage strategies;
       所述隔离平台用于根据所述行为属性的行为等级,The isolation platform is used for behavioral levels based on the behavioral attributes,
       判断所述用户的所述行为属性是否 属于违规行为; Determine whether the behavioral attributes of the user are violations;
       所述根据所述行为属性的行为等级,判断所述用户的所述行为属性是否属于违规行 为,具体包括: Determining whether the user's behavior attributes are illegal behaviors based on the behavior level of the behavior attributes, specifically including:
        确定所述用户的行为属性对应的行为等级;Determine the behavior level corresponding to the user's behavioral attributes;
        当所述用户的行为属性对应的行为等级高于预设等级时,则确定所述用户的所述行为属性属于违规行为; When the behavior level corresponding to the user's behavior attribute is higher than the preset level, it is determined that the user's behavior attribute is a violation;
        所述隔离平台还用于若所述用户的行为属性属于违规行为,则实时触发上报告警操作并提示所述用户; The isolation platform is also used to trigger an alarm reporting operation in real time and prompt the user if the user's behavioral attributes are illegal;
        所述隔离平台将所述用户的所述行为属性分为五大场景,并制定相应措施如下: The isolation platform divides the behavioral attributes of the user into five major scenarios, and formulates corresponding measures as follows:
         当检测到隔离人员违规离家时,进行视频/截图告警,或者联动短信/电话告警; When it is detected that quarantined personnel leave home in violation of regulations, a video/screenshot alarm will be issued, or a linked SMS/telephone alarm will be issued;
         当检测到隔离人员正常扔垃圾/取餐时,只产生一个私自开门的异常记录,不联动告警; When it is detected that the quarantined personnel normally throw away garbage/take meals, only an abnormal record of opening the door privately will be generated, and no alarm will be linked;
         当检测到住户隔离人员开门与非工作人员交谈时,进行视频/截图告警,或者联动短信/电话告警; When it is detected that residents in isolation open the door to talk to non-staff, a video/screenshot alarm will be issued, or a linked text message/phone alarm will be issued;
         当检测到过道人员正常路过时,属正常现象,不生成任何记录和告警,避免触发误报; When it is detected that people in the aisle are passing by normally, it is a normal phenomenon and no records or alarms will be generated to avoid triggering false alarms;
         当检测到工作人员核酸上门采样时,隔离平台不作异常和告警,只记录核酸采样信息。When it is detected that a staff member comes to take nucleic acid samples, the isolation platform will not generate any abnormalities or alarms, and will only record the nucleic acid sampling information.
  4. 一种隔离平台,其特征在于,所述隔离平台包括:存储器、处理器及存储在所述存储 器上并可在所述处理器上运行的基于用户行为的实时监控程序,所述基于用户行为的实时 监控程序被所述处理器执行时实现如权利要求1‑2任一项所述的基于用户行为的实时监控 方法的步骤。An isolation platform, characterized in that the isolation platform includes: a memory, a processor, and a real-time monitoring program based on user behavior that is stored in the memory and can be run on the processor. When the real-time monitoring program is executed by the processor, the steps of the real-time monitoring method based on user behavior as described in any one of claims 1-2 are implemented.
  5. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质存储有基于用户 行为的实时监控程序,所述基于用户行为的实时监控程序被处理器执行时实现如权利要求 1‑2任一项所述的基于用户行为的实时监控方法的步骤。A computer-readable storage medium, characterized in that the computer-readable storage medium stores a real-time monitoring program based on user behavior, and when the real-time monitoring program based on user behavior is executed by a processor, it implements claims 1-2 The steps of the real-time monitoring method based on user behavior described in any one of the above.
PCT/CN2023/098459 2022-08-04 2023-06-06 Real-time monitoring method based on user behavior, and related device WO2024027330A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
ZA2023/11634A ZA202311634B (en) 2022-08-04 2023-12-19 A real-time monitoring method based on user behavior and related device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210934568.5A CN115065812B (en) 2022-08-04 2022-08-04 Real-time monitoring method based on user behavior and related equipment
CN202210934568.5 2022-08-04

Publications (1)

Publication Number Publication Date
WO2024027330A1 true WO2024027330A1 (en) 2024-02-08

Family

ID=83207317

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/098459 WO2024027330A1 (en) 2022-08-04 2023-06-06 Real-time monitoring method based on user behavior, and related device

Country Status (3)

Country Link
CN (1) CN115065812B (en)
WO (1) WO2024027330A1 (en)
ZA (1) ZA202311634B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115065812B (en) * 2022-08-04 2022-12-16 深圳震有科技股份有限公司 Real-time monitoring method based on user behavior and related equipment

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN205810038U (en) * 2016-07-01 2016-12-14 合肥智贤智能化科技有限公司 A kind of bidirectional gate magnetic warning system
CN109918989A (en) * 2019-01-08 2019-06-21 平安科技(深圳)有限公司 The recognition methods of personage's behavior type, device, medium and equipment in monitored picture
CN110718067A (en) * 2019-09-23 2020-01-21 浙江大华技术股份有限公司 Violation behavior warning method and related device
KR20210091005A (en) * 2020-01-13 2021-07-21 한국전자통신연구원 Workers and Visitor management system and method for preventing the spread of livestock epidemic
CN113537009A (en) * 2021-06-30 2021-10-22 上海晶赞融宣科技有限公司 Household isolation supervision system
CN114466169A (en) * 2022-02-21 2022-05-10 东莞市派能佛电子科技有限公司 Monitoring system of fire door magnet and camera
CN114567863A (en) * 2022-03-03 2022-05-31 国网江苏省电力有限公司建设分公司 River iron tower engineering management system is striden to electric power superelevation based on thing networking
CN115065812A (en) * 2022-08-04 2022-09-16 深圳震有科技股份有限公司 Real-time monitoring method based on user behavior and related equipment

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105354900A (en) * 2015-10-23 2016-02-24 移康智能科技(上海)有限公司 Intelligent door lock snapshot method and system thereof
CN107742387A (en) * 2017-10-31 2018-02-27 梁志远 A kind of method that intelligent lamp control is combined with anti-theft alarm
US20220188718A1 (en) * 2020-12-15 2022-06-16 Caterpillar Inc. Advanced behavior-based safety notification systems and methods
CN113794819A (en) * 2021-09-03 2021-12-14 云从科技集团股份有限公司 Intelligent management method, system, device and medium for epidemic prevention place
CN216668062U (en) * 2022-01-24 2022-06-03 北京云量互动科技有限公司 Intelligent vertical refrigerator based on target identification technology

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN205810038U (en) * 2016-07-01 2016-12-14 合肥智贤智能化科技有限公司 A kind of bidirectional gate magnetic warning system
CN109918989A (en) * 2019-01-08 2019-06-21 平安科技(深圳)有限公司 The recognition methods of personage's behavior type, device, medium and equipment in monitored picture
CN110718067A (en) * 2019-09-23 2020-01-21 浙江大华技术股份有限公司 Violation behavior warning method and related device
KR20210091005A (en) * 2020-01-13 2021-07-21 한국전자통신연구원 Workers and Visitor management system and method for preventing the spread of livestock epidemic
CN113537009A (en) * 2021-06-30 2021-10-22 上海晶赞融宣科技有限公司 Household isolation supervision system
CN114466169A (en) * 2022-02-21 2022-05-10 东莞市派能佛电子科技有限公司 Monitoring system of fire door magnet and camera
CN114567863A (en) * 2022-03-03 2022-05-31 国网江苏省电力有限公司建设分公司 River iron tower engineering management system is striden to electric power superelevation based on thing networking
CN115065812A (en) * 2022-08-04 2022-09-16 深圳震有科技股份有限公司 Real-time monitoring method based on user behavior and related equipment

Also Published As

Publication number Publication date
CN115065812A (en) 2022-09-16
CN115065812B (en) 2022-12-16
ZA202311634B (en) 2024-03-27

Similar Documents

Publication Publication Date Title
US10665089B1 (en) Alarm probability
US9386281B2 (en) Image surveillance and reporting technology
AU2019295856B2 (en) Object tracking using disparate monitoring systems
KR101990803B1 (en) PROTECTION SYSTEM FOR VULNERABLE CLASSES USING Internet Of Things AND METHOD THEREFOR
CN205508055U (en) Door and window security protection system based on thing networking
US11754986B2 (en) Systems and methods for evaluating sensor data of internet-of-things (IoT) devices and responsively controlling control devices
CN106056833A (en) Safety monitoring method, device, system and monitoring system
WO2016150045A1 (en) Housebreaking alarm method and device
CN105989683A (en) Enhanced residence security system
WO2024027330A1 (en) Real-time monitoring method based on user behavior, and related device
US20220215725A1 (en) Integrated doorbell devices
WO2018039961A1 (en) Smart household security system on basis of internet of things
US11647968B2 (en) Door access control system with body temperature detection function
US20220293278A1 (en) Connected contact tracing
JP2019066452A (en) Resident absence/presence management system and absence/presence determination terminal and computer program used therein
WO2023280273A1 (en) Control method and system
CN113537009A (en) Household isolation supervision system
CN108898781A (en) A kind of intelligent fire Internet of things system based on public cloud
US11200793B2 (en) Notifications for camera tampering
CN113538827A (en) Intelligent home monitoring system and method
TWI712919B (en) Smart intercom system and method for using thereof
TW202238416A (en) Intelligent electric eye system for epidemic prevention including a sensing module providing a sensing object and a response module
CN117456440A (en) Monitoring intelligent analysis method, system, storage medium and electronic equipment
JP2019133265A (en) Use reservation system, use reservation apparatus, use reservation method and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23849040

Country of ref document: EP

Kind code of ref document: A1