WO2021164644A1 - 违规事件检测方法及装置、电子设备和存储介质 - Google Patents
违规事件检测方法及装置、电子设备和存储介质 Download PDFInfo
- Publication number
- WO2021164644A1 WO2021164644A1 PCT/CN2021/076201 CN2021076201W WO2021164644A1 WO 2021164644 A1 WO2021164644 A1 WO 2021164644A1 CN 2021076201 W CN2021076201 W CN 2021076201W WO 2021164644 A1 WO2021164644 A1 WO 2021164644A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- detection
- processed video
- violation event
- detection result
- processed
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
- G08B13/19613—Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion
- G08B13/19615—Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion wherein said pattern is defined by the user
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
- G08B21/24—Reminder alarms, e.g. anti-loss alarms
Definitions
- the present disclosure relates to the field of computer technology, and in particular to a method and device for detecting a violation event, electronic equipment, and a storage medium.
- the embodiments of the present disclosure provide a method and device for detecting a violation event, an electronic device, and a storage medium.
- a violation event method including: performing detection processing on a to-be-processed video frame of a to-be-processed video stream according to a preset detection mode, to obtain a detection result of the to-be-processed video stream; In a case where the detection result of the to-be-processed video stream is a violation event, a warning message is generated according to a preset warning mode and the detection result.
- the to-be-processed video frame can be detected according to the preset detection mode, the detection result of the to-be-processed video stream can be obtained, and the warning information can be generated according to the preset warning mode, thereby achieving Automatically detect and alert violations in real time, reduce labor costs, and improve the efficiency of detection and warning of violations.
- performing detection processing on the to-be-processed video frames of the to-be-processed video stream to obtain the detection result of the to-be-processed video stream includes: setting the detection mode to the first In the case of a detection mode, the detection processing is performed on the to-be-processed video frame extracted at the current moment to obtain the first detection result at the current moment; in the case that the first detection result is the first violation event, the first preset The multiple to-be-processed video frames extracted in the time period are subjected to detection processing, and the second detection results of the multiple to-be-processed video frames are respectively obtained, wherein the first preset time period starts from the current moment Time period, the first violation event is any type of violation event; when the second detection result is that the number of to-be-processed video frames for the first violation event is greater than or equal to the preset number threshold, all The detection result of the to-be-processed video stream is determined to be the first violation
- the subsequent to-be-processed video frames can be confirmed multiple times, so as to reduce the probability of false detection.
- performing detection processing on the to-be-processed video frames of the to-be-processed video stream to obtain the detection result of the to-be-processed video stream includes: setting the detection mode to the first In the case of the second detection mode, the detection processing is performed on the to-be-processed video frame extracted at the current moment to obtain the detection result of the to-be-processed video stream.
- performing detection processing on the to-be-processed video frame of the to-be-processed video stream to obtain the detection result of the to-be-processed video stream includes: determining the face area of the target object in the to-be-processed video frame And/or the human body region; performing behavior detection processing on the human face region and/or human body region to obtain the detection result.
- performing detection processing on the to-be-processed video frames of the to-be-processed video stream to obtain the detection result of the to-be-processed video stream includes: performing motion detection processing on the to-be-processed video frames extracted at multiple times; Obtain the area where the moving target object is located; perform detection processing on the area where the moving target object is located to obtain the detection result.
- performing detection processing on the to-be-processed video frame of the to-be-processed video stream to obtain the detection result of the to-be-processed video stream includes: performing detection processing on the definition of the to-be-processed video frame to obtain the detection result.
- generating a warning message according to a preset warning mode and the detection result includes: setting in the warning mode In the case of the first warning mode, the warning information corresponding to the second violation event is generated according to the first detection result corresponding to the second violation event, and the warning information corresponding to the second violation event is blocked within the second preset time period. 2. Warning information corresponding to the violation event, where the second violation event is any type of violation event.
- generating a warning message according to a preset warning mode and the detection result includes: setting in the warning mode In the case of the second warning mode, the warning information corresponding to the second violation event is generated according to the detection result corresponding to the second violation event, where the second violation event is any type of violation event.
- the strength of the warning can be increased, and the offenders can be urged to correct the violation as soon as possible.
- the method further includes: performing frame extraction processing on the to-be-processed video stream according to a preset frequency to obtain the to-be-processed video frame.
- a device for detecting a violation event including: a first obtaining module configured to perform detection processing on a to-be-processed video frame of a to-be-processed video stream according to a preset detection mode to obtain the The detection result of the to-be-processed video stream; a generating module configured to generate warning information according to a preset warning mode and the detection result when the detection result of the to-be-processed video stream is a violation event.
- the first obtaining module is configured to perform detection processing on the to-be-processed video frame extracted at the current time when the detection mode is set to the first detection mode to obtain the current time A first detection result; in the case that the first detection result is a first violation event, perform detection processing on a plurality of to-be-processed video frames extracted within a first preset time period, and obtain the plurality of to-be-processed videos respectively
- the second detection result of the frame wherein the first preset time period is a time period starting from the current moment, the first violation event is any kind of violation event; in the second detection If the result is that the number of to-be-processed video frames of the first violation event is greater than or equal to the preset number threshold, the detection result of the to-be-processed video stream is determined as the first violation event.
- the first obtaining module is configured to perform detection processing on the to-be-processed video frame extracted at the current moment when the detection mode is set to the second detection mode to obtain the to-be-processed video frame. Process the detection results of the video stream.
- the first obtaining module is configured to determine the face area and/or the human body area of the target object in the to-be-processed video frame; Perform behavior detection processing to obtain the detection result.
- the first obtaining module is configured to perform motion detection processing on the to-be-processed video frames extracted at multiple times to obtain the area where the moving target object is located; and to determine the area where the moving target object is located. Perform detection processing to obtain the detection result.
- the first obtaining module is configured to perform detection processing on the definition of the to-be-processed video frame to obtain the detection result.
- the generating module is configured to generate the first warning mode according to the first detection result corresponding to the second violation event when the warning mode is set to the first warning mode. 2. Warning information corresponding to the violation event, and shielding the warning information corresponding to the second violation event within a second preset time period, where the second violation event is any type of violation event.
- the generating module is configured to generate the second violation event according to the detection result corresponding to the second violation event when the warning mode is set to the second warning mode.
- the device further includes: a second obtaining module configured to perform frame extraction processing on the video stream to be processed according to a preset frequency to obtain the video frame to be processed.
- an electronic device including: a processor; a memory for storing executable instructions of the processor; wherein the processor is configured to execute the above-mentioned violation event detection method.
- a computer-readable storage medium having computer program instructions stored thereon, and when the computer program instructions are executed by a processor, the above-mentioned violation event detection method is implemented.
- the computer program product includes program instructions that, when executed by a processor, implement the above-mentioned violation event detection method.
- a computer program including computer-readable code, and when the computer-readable code is executed in an electronic device, a processor in the electronic device executes for realizing the present disclosure.
- the above-mentioned violation event detection method is implemented.
- Fig. 1 shows a flowchart of a method for detecting a violation event according to an embodiment of the present disclosure
- Fig. 2 shows a schematic diagram 1 of the application of the method for detecting a violation event according to an embodiment of the present disclosure
- FIG. 3 shows a second schematic diagram of the application of the method for detecting a violation event according to an embodiment of the present disclosure
- FIG. 4 shows a third schematic diagram of application of the method for detecting a violation event according to an embodiment of the present disclosure
- FIG. 5 shows a fourth schematic diagram of application of the method for detecting a violation event according to an embodiment of the present disclosure
- Fig. 6 shows a block diagram of a device for detecting a violation event according to an embodiment of the present disclosure
- Fig. 7 shows a block diagram of an electronic device according to an embodiment of the present disclosure
- Fig. 8 shows another block diagram of an electronic device according to an embodiment of the present disclosure.
- Fig. 1 shows a flow chart of a method for detecting a violation event according to an embodiment of the present disclosure. As shown in Fig. 1, the method includes:
- step S11 perform behavior detection processing on the to-be-processed video frames of the to-be-processed video stream according to a preset detection mode, to obtain a behavior detection result of the to-be-processed video stream;
- step S12 when the behavior detection result of the to-be-processed video stream is a violation behavior, a warning message is generated according to a preset warning mode and the behavior detection result.
- the video frame to be processed can be detected according to the preset detection mode, the detection result of the video stream to be processed can be obtained, and the warning information can be generated according to the preset warning mode, thereby realizing automatic Real-time detection and warning of violations, reducing labor costs, and improving the efficiency of detection and warning of violations.
- the violation event detection method may be executed by a terminal device or other processing equipment, where the terminal device may be a user equipment (UE), a mobile device, a user terminal, a terminal, a cellular phone , Cordless phones, Personal Digital Assistant (PDA), handheld devices, computing devices, in-vehicle devices, wearable devices, etc.
- UE user equipment
- PDA Personal Digital Assistant
- Other processing equipment can be servers or cloud servers.
- the violation event detection method may be implemented by a processor invoking a computer-readable instruction stored in a memory.
- the violation event detection method can be used to monitor the behavior of the target object in the surveillance video (the video stream to be processed) (for example, the violation operation behavior, the violation wearing behavior, etc.) or the violation target object ( For example, people who enter illegally, rats entering the kitchen, etc.) are detected, and violations are warned, so as to reduce the occurrence of violations and improve the efficiency of supervision.
- the violation event detection method can be used to perform behavior detection processing on target objects in surveillance videos of kitchens, canteens, food processing plants, catering companies and other places, so as to warn employees of violations, thereby providing employment The consciousness of personnel improves food safety and food quality.
- the violation event detection method can be executed by a front-end detection device, and the detection mode and warning mode of the front-end detection device can be set by the back-end service device.
- the detection mode and warning mode of the front-end detection device can be set through instructions sent by the back-end service device. Or, you can directly set the detection mode and warning mode of the front-end detection device.
- an instruction receiving device for example, buttons, touch screen, remote control, etc.
- the preset mode may be solidified in the front-end detection equipment.
- the present disclosure does not limit the setting methods of the detection mode and the warning mode.
- the preset detection mode may include a first detection mode and/or a second detection mode
- the first detection mode may include, for example, the following detection strategy: for the first time after a violation event is detected in a video frame to be processed , The violation event may not be determined immediately, but continue to detect multiple subsequent video frames to be processed. After multiple violation events are determined in the multiple pending video frames, the detection result of the video stream to be detected can be determined as Violation incidents can reduce false alarms of violation incidents.
- the second detection mode may include, for example, the following detection strategy: immediately after the violation event is detected, the behavior detection result of the to-be-processed video stream is generated, without the need for multiple confirmations of subsequent to-be-processed video frames.
- the preset warning mode may include a first warning mode and/or a second warning mode
- the first warning mode may include, for example, the following warning strategy: after a violation event is detected for the first time, a warning message is generated , And no longer generate warning messages for the same violation event within a preset time period, avoiding repeated warnings for the same violation event.
- the second warning mode may include, for example, the following warning strategy: every time a violation event is detected, a warning message is generated.
- the front-end detection device can detect the to-be-processed video frame of the video stream to be processed according to the preset detection mode. If the detection result is a violation event, the front-end detection The device can generate warning messages according to the preset warning mode.
- the front-end detection device may detect the to-be-processed video frame of the to-be-processed video stream according to a preset detection mode.
- the front-end detection device may perform frame-by-frame detection on each video frame of the to-be-processed video stream, or may first perform frame extraction processing on the to-be-processed video stream and detect the extracted video frames.
- the method further includes: performing frame extraction processing on the to-be-processed video stream according to a preset frequency to obtain the to-be-processed video frame.
- the front-end detection device may perform frame extraction processing on the video stream to be processed.
- a video frame may be extracted every 3 seconds, that is, a video frame to be processed may be acquired every 3 seconds.
- the preset frequency can be adaptively adjusted according to the detection mode, and can also be adaptively adjusted according to the type of the detected violation event.
- the preset frequency in the first detection mode may be lower than the preset frequency in the second detection mode.
- the preset frequency for detecting video clarity may be lower than the preset frequency for detecting violations.
- the embodiment of the present disclosure does not limit the preset frequency.
- the front-end detection device may perform detection processing on the to-be-processed video frame according to a preset detection mode. For example, in the first detection mode, after the front-end detection device detects a violation event in a video frame to be processed for the first time, it may not immediately determine the violation event, but continue to detect multiple subsequent video frames to be processed, that is, in multiple video frames. After multiple violation events are determined in a video frame to be processed, the detection result of the video stream to be detected can be determined as a violation event, which can reduce false alarms of violation events. For example, in scenes such as canteens, kitchens, etc., violations may include staff not wearing hats, masks, shirtless, smoking, etc. The detection mode (ie, the first detection mode) of violations can be reduced after multiple confirmations. False alarms caused by workers accidentally taking off their masks or hats (for example, wiping sweat).
- step S11 may include: when the detection mode is set to the first detection mode, performing detection processing on the to-be-processed video frame extracted at the current moment to obtain the first detection result at the current moment
- the multiple to-be-processed video frames extracted within the first preset time period are detected and processed, and the second of the multiple to-be-processed video frames are obtained respectively
- the detection result wherein the first preset time period is a time period starting from the current moment, the first violation event is any kind of violation event; and the second detection result is the first
- the detection result of the to-be-processed video stream is determined as the first violation event.
- the detection mode of the front-end application device can be set to the first detection mode through the back-end service device, or the detection mode can be directly set to the first detection mode at the front-end application device.
- the front-end application device can perform detection processing on the to-be-processed video frame in the first detection mode.
- the front-end application device may detect the to-be-processed video frames extracted from the to-be-processed video stream at a preset frequency (for example, 3 seconds/time) one by one, and obtain the detection result of each to-be-processed video frame, For example, the front-end application device may perform detection processing on the to-be-processed video frame extracted at the current time t to obtain the first detection result at the current time t.
- a preset frequency for example, 3 seconds/time
- the front-end detection device detects that the first detection result at the current time t is the first violation event (that is, the target object in the to-be-processed video frame extracted at the current time t may be performing a violation), but because There may be misdetection (for example, the worker accidentally removes a mask or hat and other actions (for example, wiping sweat) and is detected, which is not a real violation).
- the front-end detection device can detect multiple actions after the current time t. The video frame is detected and processed to determine the violation event multiple times.
- detection processing may be performed on multiple to-be-processed video frames extracted within the first preset time period, and the second detection results of the multiple to-be-processed video frames may be obtained respectively.
- the first preset time period is a time period starting from the current time t, for example, from the current time t to the time period t+A (the duration is A), at the first preset time Within a segment, multiple frame extractions can be performed on the video stream to be processed to obtain multiple video frames to be processed. For example, if the duration A is 5 minutes and the preset frequency of frame drawing is 3 seconds/time, then 100 video frames can be extracted in the first preset time period.
- the front-end detection device may perform detection processing on the 100 to-be-processed video frames one by one, and obtain the second detection result of the 100 to-be-processed video frames.
- the second detection result of the to-be-processed video frames extracted within the first preset time period may be counted to determine the number of to-be-processed video frames whose second detection result is the first violation event ; If the number is greater than the preset number threshold, the violation event can be confirmed, and the probability of false detection of the first violation event can be reduced by confirming multiple video frames to be processed. In some optional examples, if the detection result is that the number of first violation events is greater than or equal to 50 (the preset number threshold) in the above-mentioned 100 video frames to be processed, the violation events can be confirmed.
- the preset number threshold is not limited.
- the time threshold may not be set, and a preset number of to-be-processed video frames may be continuously extracted from the next frame drawing. For example, 100 video frames to be processed may be extracted, and the second detection result in these video frames to be processed may be determined to be the number of the first violation event. If the number is greater than or equal to the preset number threshold, the first violation event may be determined.
- the embodiments of the present disclosure do not limit the number of extracted video frames to be processed.
- the subsequent to-be-processed video frames can be confirmed multiple times, so as to reduce the probability of false detection.
- step S11 may include: in the case that the detection mode is set to the second detection mode, performing detection processing on the to-be-processed video frame extracted at the current moment to obtain the image of the to-be-processed video stream Test results.
- the detection mode of the front-end application device can be set to the second detection mode through the back-end service device, or the detection mode can be directly set to the second detection mode at the front-end application device.
- the front-end application device can perform detection processing on the video frame to be processed in the second detection mode.
- the front-end detection device may immediately generate the behavior detection result of the video stream to be processed after detecting the violation event. For example, when detecting a video frame to be processed, if it is detected that a target object in a to-be-processed video frame is performing a violation, it can be immediately confirmed that the target object in the to-be-processed video stream is performing a violation, that is, the target object in the to-be-processed video stream is The detection result of processing the video stream is confirmed as a violation event, and there is no need to confirm multiple subsequent video frames to be processed, which can improve the sensitivity of detection.
- the front-end detection device may detect one or more preset violation events.
- the violation event can be set. For example, if the front-end detection device is used to detect the pending video frames of surveillance videos in public places (for example, shopping malls, schools, offices, office buildings, etc.), the violation events can be set as smoking, playing with mobile phones, etc.
- Violations can be set as non-wearing behaviors such as no hats, masks, gloves, shirts, etc., as well as sanitation violations such as pests and rats.
- the embodiments of the present disclosure do not limit the types of violations.
- the front-end detection device may use different behavior detection methods to detect various violation events.
- performing detection processing on the to-be-processed video frame of the to-be-processed video stream to obtain the detection result of the to-be-processed video stream includes: determining the face area and/or human body of the target object in the to-be-processed video frame Region; performing behavior detection processing on the face region and/or human body region to obtain the behavior detection result.
- the front-end detection device can use methods such as convolutional neural networks to detect the face area and/or human body area of the target object in the to-be-processed video frame, so that the face area and/or human body area can be detected. Perform behavior detection processing.
- the face area of the target object may be detected, so as to detect whether the target object wears a hat or a mask.
- the face area and/or the human body area of the target object can be detected, so that it can be detected whether the target object is compliant. For example, whether the staff is shirtless, whether they wear work clothes, etc.
- the human body area of the target object can be detected, and whether the target object smokes can be determined according to the action of the target object in the human body area and whether there is smoke in the human body area, and further, the target can be detected The face area of the object to determine the identity information of the target object.
- the embodiment of the present disclosure does not limit the behavior detection method.
- the front-end detection device may use the to-be-processed video frames extracted at multiple times to detect the presence of rats or pests and other violations that affect sanitary conditions.
- performing behavior detection processing on the to-be-processed video frames of the to-be-processed video stream to obtain the behavior detection result of the to-be-processed video stream includes: performing motion detection processing on the to-be-processed video frames extracted at multiple times to obtain the motion The area where the target object is located; the detection processing is performed on the area where the moving target object is located to obtain the detection result.
- the front-end detection device can determine whether the to-be-processed video frame includes mice, mice, and other objects by comparing target objects in multiple to-be-processed video frames under poor light conditions (for example, at night).
- Target objects such as pests. For example, at night, there is no staff in the kitchen and other objects are still. If a certain target object is detected in a certain video frame, but there is no such target object in another video frame, the target object may be a mouse, Moving target objects such as pests can improve the accuracy of detecting moving target objects under poor light conditions or under the hardware conditions of visible light cameras or infrared light cameras. Further, further detection processing can be performed on the area where the target object is located to determine whether the target object is a violation target object.
- a mouse can be set as a target object that violates regulations, and a bird that flies over a window captured by a camera can be set as a target object that does not violate regulations.
- the detection result can be determined as a violation event.
- the front-end detection device can use multiple time-extracted video frames to be processed to detect the clarity of the video to be processed, for example, the camera is blurred by pollution caused by oil, dust, etc., or due to focus adjustment. The image is blurred and so on.
- performing detection processing on the to-be-processed video frames of the to-be-processed video stream to obtain the detection result of the to-be-processed video stream includes: performing detection processing on the definition of the to-be-processed video frame to obtain the detection result.
- the clarity of the extracted video frame to be processed may be detected. For example, indicators such as texture clarity can be detected. If the indicator of the to-be-processed video frame is lower than the indicator threshold, or the indicator of multiple to-be-processed video frames is lower than the indicator threshold in the first preset time period, the detection can be determined The result is a violation event, that is, the camera is contaminated or the focus is adjusted incorrectly.
- the violation event may also include multiple events.
- students whispering in class, cheating in the examination room and other violations the embodiment of the present disclosure does not limit the types of violations.
- the foregoing behavior detection processing may be executed in parallel, and one or more of the detection processing may be selectively executed.
- the behavior detection processing can be performed in parallel to detect whether the target object does not wear a hat, a mask, a glove, a shirtless, and other illegal wear behaviors, as well as detection of pests, mice, etc.
- the detection and processing of sanitary violations, and the various detection and processing do not interfere with each other.
- the detection processing can also be set as required. For example, during the daytime, there is no need to perform event detection processing for detecting sanitary violations such as pests and rats, and the detection processing can be temporarily closed.
- the embodiment of the present disclosure does not limit the type of detection processing.
- warning information corresponding to the violation event may be generated according to a preset warning mode.
- the warning mode can be set through the back-end service device, or it can be directly set at the front-end detection device. The embodiment of the present disclosure does not limit the setting method of the warning mode.
- the front-end detection device may be set to the first detection mode, and step S12 may include: when the warning mode is set to the first warning mode Next, generate warning information corresponding to the second violation event according to the first detection result corresponding to the second violation event, and block the warning information corresponding to the second violation event within a second preset time period , Wherein the second violation event is any type of violation event.
- the second preset time period may be a time period starting at the time t1 when the second violation event is first detected (for example, taking t1 as the starting time and a time period of 30 minutes). Section, the embodiment of the present disclosure does not limit the duration of the second preset time period).
- the warning mode can be set to the first warning mode. If a second violation event is detected in this warning mode, only one warning message will be generated for the second violation event within the second preset time period. During the time period, if multiple second violation events are repeatedly detected, the repeated warning information can be shielded, and the second violation event will be warned only once. After the second preset time period ends, if the second violation event is detected again, the warning message can be generated again, and the second preset time period starts again, and so on.
- Step S12 may include: when the warning mode is set to the second warning mode, generating warning information corresponding to the second violation event according to the detection result corresponding to the second violation event, wherein the second violation event A violation event is any kind of violation event.
- warning information in the second warning mode, as long as a violation event is detected, warning information can be generated for the violation event, regardless of whether the warning information is duplicated with the previous warning information.
- the strength of the warning can be increased, and the offenders can be urged to correct the violations as soon as possible.
- the front-end detection device can also customize which warning messages are generated.
- the front-end detection equipment has carried out behavior detection processing to detect violations of wearing behaviors such as no hats, masks, gloves, shirts, etc., but the front-end detection equipment can selectively generate one or more violation events. Warning message.
- the front-end detection device detects that the target object is not wearing a hat, a mask, or gloves, but when generating warning information, it may only generate warning information that the target object is not wearing a mask.
- the embodiments of the present disclosure do not impose restrictions on violation events.
- the front-end detection device may also display the warning information or send it to the back-end service module to display the warning information through the back-end service module.
- front-end detection equipment can be connected with display equipment or audio equipment, etc., and warning information can be sent to the display device, displayed through the user interface (UI) display interface, or sent to the audio device to play and correspond to the warning information Voice information.
- the front-end detection device may send the warning information to the back-end service module, and the back-end service module may display the warning information.
- the back-end service module may display the warning information through a UI display interface or audio equipment.
- the embodiment of the present disclosure does not limit the display mode of the warning information.
- the to-be-processed video frame can be detected according to a preset detection mode, and after the first-infringement event’s to-be-processed video frame is detected for the first time, subsequent to-be-processed video frames are performed multiple times Confirmation can improve the accuracy of detection, reduce the probability of false detection, and can generate warning messages according to the preset warning mode, shield repeated warning messages in the second time period, reduce warning message redundancy, and improve alarm efficiency.
- Fig. 2 shows a schematic diagram 1 of the application of the method for detecting violation events according to an embodiment of the present disclosure.
- a surveillance camera can capture dining places (for example, restaurants, kitchens, canteens, food processing plants, etc.) or medical and health places (For example, hospitals, pharmacies, laboratories, operating rooms, etc.) surveillance video.
- the front-end detection equipment can detect whether there are violations of the staff in the video between 7:00-23:00.
- Frame extraction can be performed on the video.
- the frame extraction frequency can be 3 seconds/time, and the extracted video frames to be processed can be detected.
- the front-end detection equipment can be used to detect and process violations of wearing hats, masks, shirts, etc., and turn off the event detection process for nocturnal objects such as rats. If a violation event is detected, a warning message can also be selectively generated. For example, warning information is only generated for violations of not wearing a mask, and warning information may not be generated for violations of not wearing a hat and shirtless.
- Fig. 3 shows a schematic diagram of the second application of the method for detecting a violation event according to an embodiment of the present disclosure.
- the detection mode of the front-end detection device can be set to the first detection mode, and the warning mode of the front-end detection device can be set This is the first warning mode.
- the front-end detection equipment can detect the extracted video frames to be processed between 7:00-23:00, and detect whether the staff is wearing hats, masks, shirts, etc. Violation, if the violation is detected in the to-be-processed video frame for the first time at time t, in order to reduce the probability of false alarms, the extraction can be performed within the first preset time period (for example, within 5 minutes from time t) The 100 video frames of the same violation are detected separately. If the number of video frames to be processed with the same violation is less than the preset number threshold (for example, 60), it can be considered that the staff did not conduct the violation.
- the preset number threshold for example, 60
- the violation is detected When the number of to-be-processed video frames with the same violation is greater than or equal to the preset number threshold (for example, 60), it can be considered that the staff has committed the violation, and at the end of the first preset time period, the The warning message corresponding to the violation. For example, a warning message related to not wearing a mask can be generated.
- the preset number threshold for example, 60
- the second preset time period for example, 30 minutes
- the second preset time period for example, 30 minutes
- the second preset time period for example, 30 minutes
- Fig. 4 shows the third application schematic diagram of the method for detecting violation events according to an embodiment of the present disclosure.
- the back-end service device can set the detection mode and warning mode of multiple front-end detection devices, and the front-end detection devices can be multiple The video streams collected by two cameras are processed for violation event detection.
- the back-end service equipment may include a public cloud platform, and the public cloud service may be invoked through a router/gateway to set up the front-end detection equipment.
- Fig. 5 shows the fourth application schematic diagram of the method for detecting violation events according to an embodiment of the present disclosure.
- the back-end service device may include a client application management platform, and the client application management platform may use the , API) Set the detection mode and warning mode of the front-end detection equipment, and can also set parameters such as frame rate.
- the present disclosure does not limit the setting method of the front-end detection device.
- the violation event detection method can be used in the violation detection of school canteens, and the behavior detection method can be used to achieve continuous monitoring of the sanitary conditions of canteens, kitchens, etc., to ensure the diet of teachers and students Safety.
- the detection method for violations can be used in the detection of violations in catering companies.
- the kitchen sewers of catering companies are the worst-hit areas of rodents, and companies often reduce the source of customers due to rodent problems.
- the detection methods for violations can be greatly improved. The accuracy of rat detection and recognition under visible light or infrared light, and can detect irregularities in the kitchen area where the staff is located, and improve the sanitary condition.
- the detection method for violations can be used in the detection of violations in food processing plants.
- the labor intensity of the food processing plants is high, and the staff will take off their hats or masks because of sweating, etc., which may cause false alarms.
- Event detection methods can effectively reduce false alarms and improve warning efficiency.
- the violation detection method can also be used in hospitals, pharmacies, pharmaceutical factories and other places with high hygiene requirements, or used in office buildings, factories, schools and other places to detect whether staff or students have violations such as playing mobile phones. Or detect whether students cheat on exams and other violations.
- the embodiment of the present disclosure does not limit the application field of the violation event detection method.
- the embodiment of the present disclosure also provides a violation event detection device, electronic equipment, computer-readable storage medium, and a program. All of the above can be used to implement any violation event detection method provided by the embodiments of the present disclosure, and the corresponding technical solutions and descriptions are as follows: Refer to the corresponding records in the method section, and details are not described in this embodiment.
- the writing order of the steps does not mean a strict execution order but constitutes any limitation on the implementation process.
- the specific execution order of each step should be based on its function and possibility.
- the inner logic is determined.
- the device includes: a first obtaining module 11 configured to perform detection processing on the to-be-processed video frames of the to-be-processed video stream according to a preset detection mode , Obtain the detection result of the to-be-processed video stream; the generating module 12 is configured to generate warning information according to the preset warning mode and the detection result when the detection result of the to-be-processed video stream is a violation event .
- the first obtaining module 11 is configured to perform detection processing on the to-be-processed video frame extracted at the current time when the detection mode is set to the first detection mode to obtain the current time
- the first detection result is the first violation event
- the second detection result of the video frame wherein the first preset time period is a time period starting from the current moment, the first violation event is any kind of violation event; in the second If the detection result is that the number of to-be-processed video frames of the first violation event is greater than or equal to the preset number threshold, the detection result of the to-be-processed video stream is determined as the first violation event.
- the first obtaining module 11 is configured to perform detection processing on the to-be-processed video frame extracted at the current moment when the detection mode is set to the second detection mode to obtain the The detection result of the video stream to be processed.
- the first obtaining module 11 is configured to determine the face area and/or the human body area of the target object in the to-be-processed video frame; The area performs behavior detection processing to obtain the detection result.
- the first obtaining module 11 is configured to perform motion detection processing on the to-be-processed video frames extracted at multiple times to obtain the area where the moving target object is located; The detection process is performed on the area to obtain the detection result.
- the first obtaining module 11 is configured to perform detection processing on the definition of the video frame to be processed to obtain the detection result.
- the generating module 12 is configured to generate a data corresponding to the first warning mode according to the first detection result corresponding to the second violation event when the warning mode is set to the first warning mode. Warning information corresponding to the second violation event, and shielding the warning information corresponding to the second violation event within a second preset time period, where the second violation event is any type of violation event.
- the generating module 12 is configured to generate the second warning mode according to the detection result corresponding to the second violation event when the warning mode is set to the second warning mode.
- the device further includes: a second obtaining module configured to perform frame extraction processing on the video stream to be processed according to a preset frequency to obtain the video frame to be processed.
- the functions or modules contained in the device provided in the embodiments of the present disclosure can be used to execute the methods described in the above method embodiments.
- the functions or modules contained in the device provided in the embodiments of the present disclosure can be used to execute the methods described in the above method embodiments.
- brevity, here No longer refer to the description of the above method embodiments.
- the embodiment of the present disclosure also proposes a computer-readable storage medium on which computer program instructions are stored, and the computer program instructions implement the above-mentioned method when executed by a processor.
- the computer-readable storage medium may be a non-volatile or volatile computer-readable storage medium.
- An embodiment of the present disclosure also provides an electronic device, including: a processor; a memory for storing executable instructions of the processor; wherein the processor is configured as the above-mentioned method.
- the electronic device can be provided as a terminal, server or other form of device.
- Fig. 7 is a block diagram showing an electronic device 800 according to an exemplary embodiment.
- the electronic device 800 may be a terminal such as a mobile phone, a computer, a digital broadcasting terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, and a personal digital assistant.
- the electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, and a sensor component 814 And the communication component 816.
- the processing component 802 generally controls the overall operations of the electronic device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations.
- the processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the foregoing method.
- the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components.
- the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.
- the memory 804 is configured to store various types of data to support operations in the electronic device 800. Examples of these data include instructions for any application or method operating on the electronic device 800, contact data, phone book data, messages, pictures, videos, and the like.
- the memory 804 can be implemented by any type of volatile or non-volatile storage device or their combination, such as static random access memory (Static Random Access Memory, SRAM), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory). Programmable Read-Only Memory, EEPROM, Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (Read Only Memory) , ROM), magnetic memory, flash memory, magnetic disk or optical disk.
- SRAM static random access memory
- EPROM Erasable Programmable Read-Only Memory
- PROM Programmable Read-Only Memory
- Read Only Memory Read Only Memory
- the power supply component 806 provides power for various components of the electronic device 800.
- the power supply component 806 may include a power management system, one or more power supplies, and other components associated with the generation, management, and distribution of power for the electronic device 800.
- the multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user.
- the screen may include a liquid crystal display (Liquid Crystal Display, LCD) and a touch panel (Touch Panel, TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user.
- the touch panel includes one or more touch sensors to sense touch, sliding, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure related to the touch or slide operation.
- the multimedia component 808 includes a front camera and/or a rear camera. When the electronic device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.
- the audio component 810 is configured to output and/or input audio signals.
- the audio component 810 includes a microphone (Microphone, MIC).
- the microphone is configured to receive an external audio signal.
- the received audio signal may be further stored in the memory 804 or transmitted via the communication component 816.
- the audio component 810 further includes a speaker for outputting audio signals.
- the I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module.
- the above-mentioned peripheral interface module may be a keyboard, a click wheel, a button, and the like. These buttons may include, but are not limited to: home button, volume button, start button, and lock button.
- the sensor component 814 includes one or more sensors for providing the electronic device 800 with various aspects of state evaluation.
- the sensor component 814 can detect the on/off status of the electronic device 800 and the relative positioning of the components.
- the component is the display and the keypad of the electronic device 800.
- the sensor component 814 can also detect the electronic device 800 or the electronic device 800.
- the position of the component changes, the presence or absence of contact between the user and the electronic device 800, the orientation or acceleration/deceleration of the electronic device 800, and the temperature change of the electronic device 800.
- the sensor component 814 may include a proximity sensor configured to detect the presence of nearby objects when there is no physical contact.
- the sensor component 814 may also include a light sensor, such as a Complementary Metal-Oxide Semiconductor (CMOS) or Charge Coupled Device (CCD) image sensor for use in imaging applications.
- CMOS Complementary Metal-Oxide Semiconductor
- CCD Charge Coupled Device
- the sensor component 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
- the communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices.
- the electronic device 800 can access a wireless network based on a communication standard, such as WiFi, 2G, or 3G, or a combination thereof.
- the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel.
- the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communication.
- NFC Near Field Communication
- the NFC module can be based on radio frequency identification (RFID) technology, infrared data association (Infrared Data Association, IrDA) technology, ultra wideband (Ultra WideBand, UWB) technology, Bluetooth (BlueTooth, BT) technology and other technologies to fulfill.
- RFID radio frequency identification
- IrDA infrared Data Association
- UWB ultra wideband
- Bluetooth Bluetooth, BT
- the electronic device 800 may be used by one or more application specific integrated circuits (Application Specific Integrated Circuit, ASIC), digital signal processor (Digital Signal Processor, DSP), digital signal processing device (DSPD), Programmable logic device (Programmable Logic Device, PLD), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), controller, microcontroller, microprocessor or other electronic components are implemented to implement the above methods.
- ASIC Application Specific Integrated Circuit
- DSP Digital Signal Processor
- DSPD digital signal processing device
- PLD Programmable logic device
- Field-Programmable Gate Array Field-Programmable Gate Array
- controller microcontroller, microprocessor or other electronic components
- a non-volatile computer-readable storage medium such as the memory 804 including computer program instructions, which can be executed by the processor 820 of the electronic device 800 to complete the foregoing method.
- Fig. 8 is a block diagram showing an electronic device 1900 according to an exemplary embodiment.
- the electronic device 1900 may be provided as a server.
- the electronic device 1900 includes a processing component 1922, which further includes one or more processors, and a memory resource represented by a memory 1932, for storing instructions executable by the processing component 1922, such as application programs.
- the application program stored in the memory 1932 may include one or more modules each corresponding to a set of instructions.
- the processing component 1922 is configured to execute instructions to perform the above-described methods.
- the electronic device 1900 may also include a power supply component 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to the network, and an input output (I/O) interface 1958 .
- the electronic device 1900 can operate based on an operating system stored in the memory 1932, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM or the like.
- a non-volatile computer-readable storage medium is also provided, such as the memory 1932 including computer program instructions, which can be executed by the processing component 1922 of the electronic device 1900 to complete the foregoing method.
- a computer program including computer-readable code, and when the computer-readable code runs in an electronic device, the processor in the electronic device executes the implementation of the present disclosure.
- the present disclosure may be a system, method and/or computer program product.
- the computer program product may include a computer-readable storage medium loaded with computer-readable program instructions for enabling a processor to implement various aspects of the present disclosure.
- the computer-readable storage medium may be a tangible device that can hold and store instructions used by the instruction execution device.
- the computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing.
- Computer-readable storage media include: portable computer disks, hard disks, random access memory (Random Access Memory, RAM), read-only memory (Read Only Memory, ROM), erasable Type programmable read-only memory (EPROM or flash memory), static random access memory (Static Random Access Memory, SRAM), portable compact disc read-only memory (CD-ROM), digital multi-function disk ( DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards on which instructions are stored or raised structures in the grooves, and any suitable combination of the above.
- RAM Random Access Memory
- ROM read-only memory
- EPROM or flash memory erasable Type programmable read-only memory
- SRAM static random access memory
- CD-ROM compact disc read-only memory
- DVD digital multi-function disk
- memory sticks floppy disks
- mechanical encoding devices such as punch cards on which instructions are stored or raised structures in the grooves, and any suitable combination of the above.
- the computer-readable storage medium used here is not interpreted as the instantaneous signal itself, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (for example, light pulses through fiber optic cables), or through wires Transmission of electrical signals.
- the computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to various computing/processing devices, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and/or a wireless network.
- the network may include copper transmission cables, optical fiber transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers.
- the network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network, and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing/processing device .
- the computer program instructions used to perform the operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or in one or more programming languages.
- Source code or object code written in any combination, the programming language includes object-oriented programming languages such as Smalltalk, C++, etc., and conventional procedural programming languages such as "C" language or similar programming languages.
- Computer-readable program instructions can be executed entirely on the user's computer, partly on the user's computer, executed as a stand-alone software package, partly on the user's computer and partly executed on a remote computer, or entirely on the remote computer or server implement.
- the remote computer can be connected to the user's computer through any kind of network-including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (for example, using an Internet service provider to connect to the user's computer) connect).
- LAN local area network
- WAN wide area network
- an electronic circuit such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), can be customized by using the status information of the computer-readable program instructions.
- the computer-readable program instructions are executed to realize various aspects of the present disclosure.
- These computer-readable program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine that makes these instructions when executed by the processor of the computer or other programmable data processing device , A device that implements the functions/actions specified in one or more blocks in the flowcharts and/or block diagrams is produced. It is also possible to store these computer-readable program instructions in a computer-readable storage medium. These instructions make computers, programmable data processing apparatuses, and/or other devices work in a specific manner, so that the computer-readable medium storing the instructions includes An article of manufacture, which includes instructions for implementing various aspects of the functions/actions specified in one or more blocks in the flowcharts and/or block diagrams.
- each block in the flowchart or block diagram may represent a module, program segment, or part of an instruction, and the module, program segment, or part of an instruction contains one or more components for realizing the specified logical function.
- Executable instructions may also occur in a different order from the order marked in the drawings. For example, two consecutive blocks can actually be executed substantially in parallel, or they can sometimes be executed in the reverse order, depending on the functions involved.
- each block in the block diagram and/or flowchart, and the combination of the blocks in the block diagram and/or flowchart can be implemented by a dedicated hardware-based system that performs the specified functions or actions Or it can be realized by a combination of dedicated hardware and computer instructions.
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Emergency Management (AREA)
- Business, Economics & Management (AREA)
- General Health & Medical Sciences (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Image Analysis (AREA)
- Closed-Circuit Television Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Burglar Alarm Systems (AREA)
- Emergency Alarm Devices (AREA)
- Alarm Systems (AREA)
Abstract
Description
Claims (21)
- 一种违规事件检测方法,所述方法包括:根据预设的检测模式,对待处理视频流的待处理视频帧进行检测处理,获得所述待处理视频流的检测结果;在所述待处理视频流的检测结果为违规事件的情况下,根据预设的警告模式以及所述检测结果,生成警告信息。
- 根据权利要求1所述的方法,其中,所述根据预设的检测模式,对待处理视频流的待处理视频帧进行检测处理,获得所述待处理视频流的检测结果,包括:在所述检测模式设置为第一检测模式的情况下,对当前时刻抽取的待处理视频帧进行检测处理,获得当前时刻的第一检测结果;在所述第一检测结果为第一违规事件的情况下,对第一预设时间段内抽取的多个待处理视频帧进行检测处理,分别获得所述多个待处理视频帧的第二检测结果,其中,所述第一预设时间段为以所述当前时刻为起始时刻的时间段,所述第一违规事件为任意一种违规事件;在所述第二检测结果为第一违规事件的待处理视频帧的数量大于或等于预设数量阈值的情况下,将所述待处理视频流的检测结果确定为第一违规事件。
- 根据权利要求1所述的方法,其中,所述根据预设的检测模式,对待处理视频流的待处理视频帧进行检测处理,获得所述待处理视频流的检测结果,包括:在所述检测模式设置为第二检测模式的情况下,对当前时刻抽取的待处理视频帧进行检测处理,获得所述待处理视频流的检测结果。
- 根据权利要求1-3中任一项所述的方法,其中,所述对待处理视频流的待处理视频帧进行检测处理,获得所述待处理视频流的检测结果,包括:在所述待处理视频帧中确定目标对象的人脸区域和/或人体区域;对所述人脸区域和/或人体区域进行行为检测处理,获得所述检测结果。
- 根据权利要求1-3中任一项所述的方法,其中,所述对待处理视频流的待处理视频帧进行检测处理,获得所述待处理视频流的检测结果,包括:对多个时刻抽取的待处理视频帧进行运动检测处理,获得运动的目标对象所在区域;对所述运动的目标对象所在区域进行检测处理,获得所述检测结果。
- 根据权利要求1-3任一项所述的方法,其中,所述对待处理视频流的待处理视频帧进行检测处理,获得所述待处理视频流的检测结果,包括:对待处理视频帧的清晰度进行检测处理,获得所述检测结果。
- 根据权利要求1-6任一项所述的方法,其中,在所述待处理视频流的检测结果 为违规事件的情况下,根据预设的警告模式以及所述检测结果,生成警告信息,包括:在所述警告模式设置为第一警告模式的情况下,根据与第二违规事件对应的第一个检测结果,生成与所述第二违规事件对应的警告信息,并在第二预设时间段内屏蔽与所述第二违规事件对应的警告信息,其中,所述第二违规事件为任意一种违规事件。
- 根据权利要求1-6任一项所述的方法,其中,在所述待处理视频流的检测结果为违规事件的情况下,根据预设的警告模式以及所述检测结果,生成警告信息,包括:在所述警告模式设置为第二警告模式的情况下,根据与第二违规事件的对应的检测结果,生成与所述第二违规事件对应的警告信息,其中,所述第二违规事件为任意一种违规事件。
- 根据权利要求1-8任一项所述的方法,其中,所述方法还包括:根据预设频率对待处理视频流进行抽帧处理,获得待处理视频帧。
- 一种违规事件检测装置,所述装置包括:第一获得模块,配置为根据预设的检测模式,对待处理视频流的待处理视频帧进行检测处理,获得所述待处理视频流的检测结果;生成模块,配置为在所述待处理视频流的检测结果为违规事件的情况下,根据预设的警告模式以及所述检测结果,生成警告信息。
- 根据权利要求10所述的装置,其中,所述第一获得模块,配置为在所述检测模式设置为第一检测模式的情况下,对当前时刻抽取的待处理视频帧进行检测处理,获得当前时刻的第一检测结果;在所述第一检测结果为第一违规事件的情况下,对第一预设时间段内抽取的多个待处理视频帧进行检测处理,分别获得所述多个待处理视频帧的第二检测结果,其中,所述第一预设时间段为以所述当前时刻为起始时刻的时间段,所述第一违规事件为任意一种违规事件;在所述第二检测结果为第一违规事件的待处理视频帧的数量大于或等于预设数量阈值的情况下,将所述待处理视频流的检测结果确定为第一违规事件。
- 根据权利要求10所述的装置,其中,所述第一获得模块,配置为在所述检测模式设置为第二检测模式的情况下,对当前时刻抽取的待处理视频帧进行检测处理,获得所述待处理视频流的检测结果。
- 根据权利要求10-12任一项所述的装置,其中,所述第一获得模块,配置为在所述待处理视频帧中确定目标对象的人脸区域和/或人体区域;对所述人脸区域和/或人体区域进行行为检测处理,获得所述检测结果。
- 根据权利要求10-12任一项所述的装置,其中,所述第一获得模块,配置为对多个时刻抽取的待处理视频帧进行运动检测处理,获得运动的目标对象所在区域;对所述运动的目标对象所在区域进行检测处理,获得所述检测结果。
- 根据权利要求10-12任一项所述的装置,其中,所述第一获得模块,配置为对待处理视频帧的清晰度进行检测处理,获得所述检测结果。
- 根据权利要求10-15任一项所述的装置,其中,所述生成模块,配置为在所述警告模式设置为第一警告模式的情况下,根据与第二违规事件对应的第一个检测结果,生成与所述第二违规事件对应的警告信息,并在第二预设时间段内屏蔽与所述第二违规事件对应的警告信息,其中,所述第二违规事件为任意一种违规事件。
- 根据权利要求10-15任一项所述的装置,其中,所述生成模块,配置为在所述警告模式设置为第二警告模式的情况下,根据与第二违规事件的对应的检测结果,生成与所述第二违规事件对应的警告信息,其中,所述第二违规事件为任意一种违规事件。
- 根据权利要求10-17任一项所述的装置,其中,所述装置还包括第二获得模块,配置为根据预设频率对待处理视频流进行抽帧处理,获得待处理视频帧。
- 一种电子设备,包括:处理器;用于存储处理器可执行指令的存储器;其中,所述处理器被配置为:执行权利要求1至9中任意一项所述的方法。
- 一种计算机可读存储介质,其上存储有计算机程序指令,所述计算机程序指令被处理器执行时实现权利要求1至9中任意一项所述的方法。
- 一种计算机程序,包括计算机可读代码,当所述计算机可读代码在电子设备中运行时,所述电子设备中的处理器执行用于实现权利要求1至9中任意一项所述的违规事件检测方法。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2021562343A JP2022529300A (ja) | 2020-02-18 | 2021-02-09 | 違反イベント検出方法及び装置、電子デバイス並びに記憶媒体 |
KR1020217036108A KR20210148313A (ko) | 2020-02-18 | 2021-02-09 | 위반 이벤트 검출 방법 및 장치, 전자 기기 및 저장 매체 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010098904.8A CN111310665A (zh) | 2020-02-18 | 2020-02-18 | 违规事件检测方法及装置、电子设备和存储介质 |
CN202010098904.8 | 2020-02-18 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021164644A1 true WO2021164644A1 (zh) | 2021-08-26 |
Family
ID=71145068
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2021/076201 WO2021164644A1 (zh) | 2020-02-18 | 2021-02-09 | 违规事件检测方法及装置、电子设备和存储介质 |
Country Status (5)
Country | Link |
---|---|
JP (1) | JP2022529300A (zh) |
KR (1) | KR20210148313A (zh) |
CN (1) | CN111310665A (zh) |
TW (1) | TW202133034A (zh) |
WO (1) | WO2021164644A1 (zh) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113762169A (zh) * | 2021-09-09 | 2021-12-07 | 北京市商汤科技开发有限公司 | 人流量统计方法及装置、电子设备和存储介质 |
CN113780213A (zh) * | 2021-09-16 | 2021-12-10 | 上海西井信息科技有限公司 | 基于监控进行行人识别的方法、系统、设备及存储介质 |
CN114155612A (zh) * | 2022-02-10 | 2022-03-08 | 深圳爱莫科技有限公司 | 餐饮人员不规范行为模型训练方法、检测方法及处理设备 |
CN114554110A (zh) * | 2022-01-25 | 2022-05-27 | 北京百度网讯科技有限公司 | 视频生成方法、装置、电子设备和存储介质 |
CN114999172A (zh) * | 2022-05-24 | 2022-09-02 | 浙江大华技术股份有限公司 | 事件处理方法、装置、存储介质及电子装置 |
Families Citing this family (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111310665A (zh) * | 2020-02-18 | 2020-06-19 | 深圳市商汤科技有限公司 | 违规事件检测方法及装置、电子设备和存储介质 |
CN112084882A (zh) * | 2020-08-18 | 2020-12-15 | 深圳英飞拓科技股份有限公司 | 一种行为检测方法、装置及计算机可读存储介质 |
CN112216073B (zh) * | 2020-10-12 | 2022-05-03 | 浙江大华技术股份有限公司 | 一种梯子违规操作告警方法及装置 |
CN112163123A (zh) * | 2020-11-10 | 2021-01-01 | 中国科学院长春光学精密机械与物理研究所 | 一种事件提取方法、装置、电子设备及存储介质 |
CN114513625A (zh) * | 2020-11-16 | 2022-05-17 | 中国石油化工股份有限公司 | 存储器、罐区泄漏的安全联锁方法、装置及设备 |
CN112434612A (zh) * | 2020-11-25 | 2021-03-02 | 创新奇智(上海)科技有限公司 | 吸烟检测方法、装置、电子设备及计算机可读存储介质 |
CN112464898A (zh) * | 2020-12-15 | 2021-03-09 | 北京市商汤科技开发有限公司 | 事件检测方法及装置、电子设备和存储介质 |
CN112866808B (zh) * | 2020-12-31 | 2022-09-06 | 北京市商汤科技开发有限公司 | 一种视频处理方法、装置、电子设备及存储介质 |
CN112988337A (zh) * | 2021-03-01 | 2021-06-18 | 创新奇智(上海)科技有限公司 | 任务处理系统、方法、装置、电子设备、存储介质 |
CN113011290A (zh) * | 2021-03-03 | 2021-06-22 | 上海商汤智能科技有限公司 | 事件检测方法及装置、电子设备和存储介质 |
CN113095178A (zh) * | 2021-03-30 | 2021-07-09 | 北京大米科技有限公司 | 不良信息检测方法、系统、电子设备和可读存储介质 |
CN113179423A (zh) * | 2021-04-23 | 2021-07-27 | 深圳市商汤科技有限公司 | 事件的检测输出方法及装置、电子设备和存储介质 |
CN113076566B (zh) * | 2021-04-26 | 2024-02-27 | 深圳市三旺通信股份有限公司 | 显示内容检测方法、设备、计算机程序产品及存储介质 |
CN113705370B (zh) * | 2021-08-09 | 2023-06-30 | 百度在线网络技术(北京)有限公司 | 直播间违规行为的检测方法及装置、电子设备和存储介质 |
CN115914512A (zh) * | 2022-09-30 | 2023-04-04 | 广州安思创信息技术有限公司 | 直播截图方法、装置、设备及存储介质 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107920223A (zh) * | 2016-10-08 | 2018-04-17 | 杭州海康威视数字技术股份有限公司 | 一种对象行为检测方法及装置 |
CN109063612A (zh) * | 2018-07-19 | 2018-12-21 | 中智城信息技术有限公司 | 城市智能红线管理方法及机器可读存储介质 |
CN110647819A (zh) * | 2019-08-28 | 2020-01-03 | 中国矿业大学 | 一种井下人员跨越皮带异常行为检测方法及装置 |
CN110728815A (zh) * | 2019-10-25 | 2020-01-24 | 深圳市商汤科技有限公司 | 基于视频分析的预警方法及装置、电子设备和存储介质 |
CN111310665A (zh) * | 2020-02-18 | 2020-06-19 | 深圳市商汤科技有限公司 | 违规事件检测方法及装置、电子设备和存储介质 |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4087600B2 (ja) * | 2001-12-13 | 2008-05-21 | セコム株式会社 | 画像監視装置 |
JP2010067169A (ja) * | 2008-09-12 | 2010-03-25 | Ntt Comware Corp | 通信システム及び方法とそのプログラム |
CN102081844A (zh) * | 2011-01-25 | 2011-06-01 | 华中科技大学 | 一种交通视频行为分析与报警服务器 |
US9179096B2 (en) * | 2013-10-11 | 2015-11-03 | Fuji Xerox Co., Ltd. | Systems and methods for real-time efficient navigation of video streams |
EP3340104B1 (en) * | 2016-12-21 | 2023-11-29 | Axis AB | A method for generating alerts in a video surveillance system |
CN108810616B (zh) * | 2018-05-31 | 2019-06-14 | 广州虎牙信息科技有限公司 | 目标定位方法、视频显示方法、装置、设备和存储介质 |
-
2020
- 2020-02-18 CN CN202010098904.8A patent/CN111310665A/zh active Pending
-
2021
- 2021-02-09 KR KR1020217036108A patent/KR20210148313A/ko active Search and Examination
- 2021-02-09 JP JP2021562343A patent/JP2022529300A/ja active Pending
- 2021-02-09 WO PCT/CN2021/076201 patent/WO2021164644A1/zh active Application Filing
- 2021-02-17 TW TW110105336A patent/TW202133034A/zh unknown
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107920223A (zh) * | 2016-10-08 | 2018-04-17 | 杭州海康威视数字技术股份有限公司 | 一种对象行为检测方法及装置 |
CN109063612A (zh) * | 2018-07-19 | 2018-12-21 | 中智城信息技术有限公司 | 城市智能红线管理方法及机器可读存储介质 |
CN110647819A (zh) * | 2019-08-28 | 2020-01-03 | 中国矿业大学 | 一种井下人员跨越皮带异常行为检测方法及装置 |
CN110728815A (zh) * | 2019-10-25 | 2020-01-24 | 深圳市商汤科技有限公司 | 基于视频分析的预警方法及装置、电子设备和存储介质 |
CN111310665A (zh) * | 2020-02-18 | 2020-06-19 | 深圳市商汤科技有限公司 | 违规事件检测方法及装置、电子设备和存储介质 |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113762169A (zh) * | 2021-09-09 | 2021-12-07 | 北京市商汤科技开发有限公司 | 人流量统计方法及装置、电子设备和存储介质 |
CN113780213A (zh) * | 2021-09-16 | 2021-12-10 | 上海西井信息科技有限公司 | 基于监控进行行人识别的方法、系统、设备及存储介质 |
CN113780213B (zh) * | 2021-09-16 | 2024-02-02 | 上海西井科技股份有限公司 | 基于监控进行行人识别的方法、系统、设备及存储介质 |
CN114554110A (zh) * | 2022-01-25 | 2022-05-27 | 北京百度网讯科技有限公司 | 视频生成方法、装置、电子设备和存储介质 |
CN114554110B (zh) * | 2022-01-25 | 2023-12-29 | 北京百度网讯科技有限公司 | 视频生成方法、装置、电子设备和存储介质 |
CN114155612A (zh) * | 2022-02-10 | 2022-03-08 | 深圳爱莫科技有限公司 | 餐饮人员不规范行为模型训练方法、检测方法及处理设备 |
CN114999172A (zh) * | 2022-05-24 | 2022-09-02 | 浙江大华技术股份有限公司 | 事件处理方法、装置、存储介质及电子装置 |
Also Published As
Publication number | Publication date |
---|---|
JP2022529300A (ja) | 2022-06-20 |
KR20210148313A (ko) | 2021-12-07 |
TW202133034A (zh) | 2021-09-01 |
CN111310665A (zh) | 2020-06-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2021164644A1 (zh) | 违规事件检测方法及装置、电子设备和存储介质 | |
US9691256B2 (en) | Method and device for presenting prompt information that recommends removing contents from garbage container | |
JP6466958B2 (ja) | 端末異常の処理方法、端末異常の処理装置、電子装置、プログラム、及び記録媒体 | |
KR101852284B1 (ko) | 경보 방법 및 장치 | |
US9934673B2 (en) | Method and device for processing abnormality notification from a smart device | |
CN109040824A (zh) | 视频处理方法、装置、电子设备和可读存储介质 | |
WO2022183661A1 (zh) | 事件检测方法、装置、电子设备、存储介质及程序产品 | |
TW202134940A (zh) | 監測方法、電子設備和儲存介質 | |
US20170178289A1 (en) | Method, device and computer-readable storage medium for video display | |
US10509540B2 (en) | Method and device for displaying a message | |
US20180025229A1 (en) | Method, Apparatus, and Storage Medium for Detecting and Outputting Image | |
WO2020062969A1 (zh) | 动作识别方法及装置、驾驶员状态分析方法及装置 | |
US10309673B2 (en) | Air anomaly alarming method, device and storage medium | |
WO2018228422A1 (zh) | 一种发出预警信息的方法、装置及系统 | |
CN109951476B (zh) | 基于时序的攻击预测方法、装置及存储介质 | |
US10354678B2 (en) | Method and device for collecting sounds corresponding to surveillance images | |
TW202113670A (zh) | 一種圖像處理方法、電子設備和儲存介質 | |
CN106303961A (zh) | 自动报警方法及设备 | |
CN110728815A (zh) | 基于视频分析的预警方法及装置、电子设备和存储介质 | |
CN105847763A (zh) | 监控方法及装置 | |
CN110807393A (zh) | 基于视频分析的预警方法及装置、电子设备和存储介质 | |
CN112633184A (zh) | 告警方法及装置、电子设备和存储介质 | |
CN107734303B (zh) | 视频标识方法及装置 | |
CN111353454A (zh) | 一种数据处理方法、装置和电子设备 | |
CN113011291A (zh) | 事件检测方法及装置、电子设备和存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21757178 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2021562343 Country of ref document: JP Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 20217036108 Country of ref document: KR Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 24.01.2023) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21757178 Country of ref document: EP Kind code of ref document: A1 |