CN116561829A - Safety protection method, device, equipment and storage medium of display equipment - Google Patents
Safety protection method, device, equipment and storage medium of display equipment Download PDFInfo
- Publication number
- CN116561829A CN116561829A CN202310806985.6A CN202310806985A CN116561829A CN 116561829 A CN116561829 A CN 116561829A CN 202310806985 A CN202310806985 A CN 202310806985A CN 116561829 A CN116561829 A CN 116561829A
- Authority
- CN
- China
- Prior art keywords
- person
- video
- determining
- display device
- detection result
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- 238000001514 detection method Methods 0.000 claims abstract description 167
- 230000006399 behavior Effects 0.000 claims description 99
- 238000005070 sampling Methods 0.000 claims description 43
- 238000000605 extraction Methods 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 11
- 238000004590 computer program Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000006978 adaptation Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/70—Protecting specific internal or peripheral components, in which the protection of a component leads to protection of the entire computer
- G06F21/82—Protecting input, output or interconnection devices
- G06F21/84—Protecting input, output or interconnection devices output devices, e.g. displays or monitors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Computer Security & Cryptography (AREA)
- Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Health & Medical Sciences (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Human Computer Interaction (AREA)
- Alarm Systems (AREA)
Abstract
The embodiment of the application provides a safety protection method, device and equipment of display equipment and a storage medium. The method comprises the following steps: determining target display equipment to be detected and a camera device corresponding to the target display equipment; performing object recognition processing on video frames acquired by the camera device until a target object is recognized in first video frames acquired by the camera device, wherein the first video acquired by the camera device comprises first video frames; and performing behavior detection processing on the target object in the first video to obtain a safety detection result of the target display device, and performing safety protection operation on the display device when the safety detection result indicates that the content displayed by the display device has leakage risk. According to the method, the risk of leakage of the content displayed by the display device is reduced.
Description
Technical Field
The embodiment of the application relates to the technical field of information security, in particular to a security protection method, device and equipment of display equipment and a storage medium.
Background
Office equipment typically stores internal corporate files or confidential files. In an office area, after a user leaves a workstation, a display device displays a currently opened company internal file or confidential file, and the risk of file leakage may exist.
In the related art, after a user leaves a station, screen locking software or a tool of an office computer is used for performing screen-off processing on display equipment. However, when the user forgets to turn off the screen of the display device, the display device may display an internal file or a confidential file currently browsed by the user, and there is a risk of disclosure of the file. As can be seen from the above, when the display device is not off-screen, the content of the file displayed by the display device is at risk of leakage.
Disclosure of Invention
The embodiment of the application provides a safety protection method, device and equipment for display equipment and a storage medium, which are used for reducing the risk that content displayed by the display equipment is leaked.
In a first aspect, an embodiment of the present application provides a method for protecting security of a display device, where the method includes:
determining target display equipment to be detected and a camera device corresponding to the target display equipment;
performing object recognition processing on the video frames acquired by the camera device until a target object is recognized in the first video frames acquired by the camera device, wherein the first video acquired by the camera device comprises the first video frames;
And performing behavior detection processing on the target object in the first video to obtain a safety detection result of the target display device, and performing safety protection operation on the display device when the safety detection result indicates that the content displayed by the display device has leakage risk.
In a possible implementation manner, performing behavior detection processing on the target object in the first video to obtain a security detection result of the target display device, where the security detection result includes:
performing object recognition processing on the first video to obtain at least one target object;
acquiring an object type of each target object, wherein the object type is a person type or a camera equipment type;
and performing behavior detection processing on the target object in the first video according to the object type of the at least one target object to obtain a security detection result of the target display device.
In one possible implementation, the at least one target object includes at least one character therein; according to the object type of the at least one target object, performing behavior detection processing on the target object in the first video to obtain a security detection result of the target display device, including:
Judging whether a non-registered object corresponding to the target display device exists in the at least one target object;
if yes, determining a plurality of second video frames in the first video according to a first sampling rate, determining the portrait characteristic of each person in each second video frame, and determining the safety detection result according to the portrait characteristic of each person in each second video frame, wherein the portrait characteristic comprises the face orientation of the person, the type of handheld equipment of the person and the target behavior of the person, and the first sampling rate is greater than or equal to a preset sampling rate;
if not, determining the safety detection result as the detection safety.
In one possible implementation, for any one second video frame; determining the portrait characteristics of each person in the second video frame includes:
performing person identification processing on the second video frame through a preset model so as to determine at least one person in the second video frame;
and carrying out behavior feature extraction processing on the at least one person through the preset model to obtain the portrait feature of each person in the second video frame.
In one possible implementation, determining the security detection result according to the portrait characteristic of each person in each second video frame includes:
Determining at least one person in the plurality of images;
for any person, determining a behavior detection result of the person according to the portrait features of the person in the plurality of second video frames, wherein the behavior detection result is used for indicating whether the person has preset behaviors or not;
and determining the safety detection result according to the behavior detection result of each person.
In one possible embodiment, determining the safety detection result according to the behavior detection result of each person includes:
if the behavior detection results of the at least one person respectively indicate that the person does not have preset behaviors, determining that the safety detection results are detection safety;
and if the behavior detection result of the person in the at least one person indicates that the preset behavior exists in the person, determining that the safety detection result is unsafe.
In one possible implementation manner, the at least one target object includes at least one third party camera device and no person; according to the object type of the at least one target object, performing behavior detection processing on the target object in the first video to obtain a security detection result of the target display device, including:
Determining a plurality of second video frames in the first video according to a first sampling rate;
determining shooting directions and direction duration of the third-party camera equipment according to the plurality of second video frames;
if the shooting direction is a preset direction and the duration of the direction is longer than or equal to a preset duration, determining that the safety detection result is unsafe;
and if the shooting direction is not the preset direction or the direction duration is smaller than the preset duration, determining that the safety detection result is the detection safety.
In one possible implementation manner, the object recognition processing is performed on the video frames acquired by the image capturing device, including:
extracting video frames from the video acquired by the camera device according to a second sampling rate, wherein the second sampling rate is smaller than a preset sampling rate;
and carrying out object recognition processing on the video frames extracted from the video.
In one possible implementation, determining a target display device to be detected includes:
determining operation information of a plurality of to-be-selected display devices, wherein the operation information comprises an identifier of a currently operated application program and a content type currently displayed by the to-be-selected display devices;
And determining the target display equipment in the plurality of display equipment to be selected according to the operation information.
In a possible implementation manner, according to the operation information, determining the target display device in the plurality of candidate display devices includes:
and aiming at any one display device to be selected, if the application program currently operated by the display device to be selected is a preset application program or the content type currently displayed by the display device to be selected is a preset type, determining the display device to be selected as the target display device.
In a second aspect, embodiments of the present application provide a safety protection device for a display apparatus, where the safety protection device includes a determining module, an obtaining module, a behavior detecting module, and a protection module, where,
the determining module is used for determining target display equipment to be detected and a camera device corresponding to the target display equipment;
the acquisition module is used for carrying out object recognition processing on the video frames acquired by the camera device until a target object is recognized in the first video frames acquired by the camera device, and acquiring a first video acquired by the camera device, wherein the first video comprises the first video frames;
The behavior detection module is used for performing behavior detection processing on the target object in the first video to obtain a safety detection result of the target display device;
the protection module is used for carrying out safety protection operation on the display equipment when the safety detection result indicates that the content displayed by the display equipment has leakage risk.
In one possible implementation manner, the behavior detection module is specifically configured to:
performing object recognition processing on the first video to obtain at least one target object;
acquiring an object type of each target object, wherein the object type is a person type or a camera equipment type;
and performing behavior detection processing on the target object in the first video according to the object type of the at least one target object to obtain a security detection result of the target display device.
In one possible implementation manner, the behavior detection module is specifically configured to:
the at least one target object comprises at least one person, and whether a non-registered object corresponding to the target display device exists in the at least one target object is judged;
if yes, determining a plurality of second video frames in the first video according to a first sampling rate, determining the portrait characteristic of each person in each second video frame, and determining the safety detection result according to the portrait characteristic of each person in each second video frame, wherein the portrait characteristic comprises the face orientation of the person, the type of handheld equipment of the person and the target behavior of the person, and the first sampling rate is greater than or equal to a preset sampling rate;
If not, determining the safety detection result as the detection safety.
In one possible implementation manner, the behavior detection module is specifically configured to:
performing person identification processing on the second video frame through a preset model so as to determine at least one person in the second video frame;
and carrying out behavior feature extraction processing on the at least one person through the preset model to obtain the portrait feature of each person in the second video frame.
In one possible implementation manner, the behavior detection module is specifically configured to:
determining at least one person in the plurality of images;
for any person, determining a behavior detection result of the person according to the portrait features of the person in the plurality of second video frames, wherein the behavior detection result is used for indicating whether the person has preset behaviors or not;
and determining the safety detection result according to the behavior detection result of each person.
In one possible implementation manner, the behavior detection module is specifically configured to:
if the behavior detection results of the at least one person respectively indicate that the person does not have preset behaviors, determining that the safety detection results are detection safety;
And if the behavior detection result of the person in the at least one person indicates that the preset behavior exists in the person, determining that the safety detection result is unsafe.
In one possible implementation manner, the behavior detection module is specifically configured to:
the at least one target object comprises at least one third party camera device and does not comprise a person, and a plurality of second video frames are determined in the first video according to a first sampling rate;
determining shooting directions and direction duration of the third-party camera equipment according to the plurality of second video frames;
if the shooting direction is a preset direction and the duration of the direction is longer than or equal to a preset duration, determining that the safety detection result is unsafe;
and if the shooting direction is not the preset direction or the direction duration is smaller than the preset duration, determining that the safety detection result is the detection safety.
In one possible implementation manner, the acquiring module is specifically configured to:
extracting video frames from the video acquired by the camera device according to a second sampling rate, wherein the second sampling rate is smaller than a preset sampling rate;
And carrying out object recognition processing on the video frames extracted from the video.
In one possible implementation manner, the determining module is specifically configured to:
determining operation information of a plurality of to-be-selected display devices, wherein the operation information comprises an identifier of a currently operated application program and a content type currently displayed by the to-be-selected display devices;
and determining the target display equipment in the plurality of display equipment to be selected according to the operation information.
In one possible implementation manner, the determining module is specifically configured to:
and aiming at any one display device to be selected, if the application program currently operated by the display device to be selected is a preset application program or the content type currently displayed by the display device to be selected is a preset type, determining the display device to be selected as the target display device.
In a third aspect, embodiments of the present application provide a safety shield apparatus, including: a processor and a memory communicatively coupled to the processor;
the memory stores computer-executable instructions;
the processor executes computer-executable instructions stored in the memory to implement the method of any one of the first aspects.
In a fourth aspect, the present application provides a computer-readable storage medium having stored therein computer-executable instructions for performing the method of any of the first aspects when executed by a processor.
In a fifth aspect, the present application provides a computer program product comprising a computer program which, when executed by a computer, implements the method according to any of the first aspects.
According to the safety protection method, the device, the equipment and the storage medium of the display equipment, through the video frames collected by the camera device corresponding to the target display equipment, object identification processing is carried out on the video frames, and the first video frames of the target objects are obtained through identification, so that the first video is obtained, the first video comprises the first video frames, behavior detection processing is carried out on the target objects in the first video, the safety detection result of the target display equipment is obtained, and when the safety detection result indicates that leakage risk exists in the content displayed by the display equipment, safety protection operation is carried out on the display equipment, and the effect that leakage risk exists in the content displayed by the display equipment is reduced is achieved.
Drawings
Fig. 1 is a schematic diagram of an application scenario provided in an embodiment of the present application;
fig. 2 is a flow chart of a method for protecting safety of a display device according to an embodiment of the present application;
fig. 3 is a schematic flow chart of determining a security detection result according to an embodiment of the present application;
FIG. 4 is a schematic diagram of determining a plurality of second video frames according to an embodiment of the present application;
FIG. 5 is a flowchart illustrating another method for determining a security detection result according to an embodiment of the present disclosure;
fig. 6 is a schematic structural diagram of a safety protection device of a display apparatus according to an embodiment of the present application;
fig. 7 is a schematic hardware structure of the safety protection device provided in the present application.
Detailed Description
For ease of explanation of understanding the present application, a scenario to which the present application is applied will be first explained with reference to fig. 1.
Fig. 1 is a schematic diagram of an application scenario provided in an embodiment of the present application. Referring to fig. 1, the camera includes a safety protection device, a camera device, and a display device. Wherein the image pickup means is arranged near the display device, for example, the image pickup means may be arranged above the display device. The camera device can acquire video and send the video to the safety protection equipment. The safety protection device can determine whether the display content of the display device has leakage risk according to the received video.
In the related art, when a user forgets to turn off the screen of the display device, the display device displays an internal file or a confidential file currently browsed by the user, and there is a risk of disclosure of the file.
In the method, when the safety detection is required to be carried out on the target display equipment, the object identification processing can be carried out on the video frames acquired by the corresponding camera device, when the target object is identified, the behavior detection processing is carried out on the video acquired by the camera device, whether the leakage risk exists in the content displayed by the display equipment is determined, and safety protection is carried out on the display equipment when the leakage risk exists in the content displayed by the display equipment is determined, so that the leakage probability of the content displayed by the display equipment is reduced, and the safety of the display equipment is improved.
Fig. 2 is a flow chart of a method for protecting safety of a display device according to an embodiment of the present application. Referring to fig. 2, the method may include:
s201, determining target display equipment to be detected and an imaging device corresponding to the target display equipment.
The execution body of the embodiment of the application may be a safety protection device, or may be a safety protection device of a display device in the safety protection device. The safety protection device of the display device can be realized by software, or can be realized by a combination of software and hardware. The security protection device may be a terminal device, a server, etc.
The display device may be a display screen of a computer, a display screen of a business system, etc.
The safety protection device can be a host of the display device or other devices.
The camera device is used for acquiring videos, and a preset corresponding relation is arranged between the camera device and the display equipment. The image pickup device is arranged near the display device so that the image pickup device can acquire video in the space in front of the display device. For example, the image pickup device may be provided on the top of the display apparatus or on the front side of the display apparatus, with the lens orientation of the image pickup device being identical to the orientation of the display apparatus.
The target display device may be determined by: determining operation information of a plurality of display devices to be selected, and determining a target display device in the plurality of display devices to be selected according to the operation information. The running information comprises an identification of the currently running application program and a content type currently displayed by the display equipment to be selected.
The display device to be selected may be a display device that is currently on screen and that is not on screen.
The content type may be a document type, a program page type, a web page type, an entertainment type, a desktop type, or the like.
And aiming at any one display device to be selected, if the application program currently operated by the display device to be selected is a preset application program or the content type currently displayed by the display device to be selected is a preset type, determining the display device to be selected as a target display device.
The preset application program can be an application program with higher confidentiality degree. The preset application may be manually preset. For example, the preset application program may be an office software program, an office communication program, a private chat program, or the like.
The preset type may be a type with a higher degree of confidentiality. The preset type may be manually preset. For example, the preset type may be a document type, a program page type, or the like.
S202, performing object recognition processing on the video frames acquired by the camera device until a target object is recognized in the first video frames acquired by the camera device, and acquiring the first video acquired by the camera device.
The target object may be a person or an image capturing apparatus.
The object recognition processing can be performed on the video frames acquired by the camera device in the following manner: and extracting video frames from the video acquired by the camera device according to the second sampling rate, and performing object recognition processing on the video frames extracted from the video. Wherein the second sampling rate is less than the preset sampling rate. Before a target object appears before the target display device is determined, video frames are extracted from videos acquired by the camera device at a lower sampling rate, and object recognition processing is performed. Because the sampling rate is lower, the number of video frames required for object identification processing of the safety protection equipment is also smaller, and the energy consumption of the safety protection equipment is saved.
The second sampling rate may be one frame per second, i.e., one video frame is sampled every second in the video. In the actual application process, the second sampling rate may be set according to the actual situation.
Among the plurality of video frames extracted from the video, the first video frame is the first video frame including the target object.
Wherein the first video comprises a first video frame.
The first video may be determined by: and determining a starting frame of the first video and a video duration of the first video, and determining the first video according to the starting frame and the video duration.
The start frame may be a first video frame. Alternatively, the start frame may be an nth frame preceding the first video frame, N being an integer greater than or equal to 1. When the second sampling rate is low, the target object may have appeared before the target display device before the first video frame, and therefore, if the nth frame before the first video frame is set as the start frame, omission of the video frame in which the target object exists can be avoided.
The video duration may be a preset duration. Or, the video duration may be a duration of the target object existing before the target display device, so that it may be ensured that the target object exists in the first video for performing behavior detection, and thus, invalid detection is avoided.
S203, performing behavior detection processing on the target object in the first video to obtain a security detection result of the target display device.
The security detection result is used for indicating whether the content displayed by the target display device has leakage risk or not.
The security detection result may be determined by: performing object recognition processing on the first video to obtain at least one target object; and obtaining the object type of each target object, and performing behavior detection processing on the target object in the first video according to the object type of at least one target object to obtain a safety detection result of the target display device. The object type is a person type or an image capturing apparatus type.
The security risks brought by different types of target objects to the target display device are different, for example, if the target object is a person, the person may look at the target display device, or extract and record the content displayed by the target display device, or shoot the content displayed by the target display device. If the target object is an image capturing apparatus, the image capturing apparatus may capture content displayed by the target display apparatus. Therefore, the safety detection result of the target display device can be more accurately determined and obtained by performing behavior detection according to the object type of the target object.
S204, when the safety detection result indicates that the content displayed by the display device has leakage risk, carrying out safety protection operation on the display device.
Alternatively, the security operations may include a lock screen operation. The safeguarding operations may also include at least one other operation of:
storing the first video;
sending a first video to preset equipment;
and sending prompt information to preset equipment, wherein the prompt information is used for prompting that the content displayed by the display equipment has leakage risk.
Assuming the security device is not the host of the display device, the security device may send a screen lock instruction to the host of the display device to cause the host to control the display device to lock the screen.
The preset device may be a mobile phone of a user (a user using a display device), a management device of an administrator, or the like.
According to the safety protection method provided by the embodiment of the application, according to the video frames acquired by the camera device corresponding to the target detection equipment, object identification processing is carried out on the video frames, a first video capable of identifying a target object in the camera device is obtained, behavior detection processing is carried out on the target object according to different object types of the target object in the first video, a safety detection result of the display equipment is obtained, and safety protection is carried out when the safety detection result indicates that the content displayed by the display equipment is at risk. The method can rapidly distinguish whether the content displayed by the display equipment has leakage risk or not, and timely carry out safety protection so as to avoid the leakage risk of the content displayed by the display equipment.
In the actual application process, after the first video is obtained, object identification processing can be performed on the first video to obtain at least one target object, wherein the at least one target object comprises a person and/or a third party camera device. When the objects included in the at least one target object are different, a process of determining a security detection result of the target display device is also different. The following is a description of the embodiments of fig. 3 and 5.
Fig. 3 is a flowchart illustrating a process of determining a security detection result according to an embodiment of the present application. In the embodiment shown in fig. 3, at least one character is included in at least one target object. Referring to fig. 3, the method may include:
s301, judging whether a non-registered object corresponding to the target display device exists in at least one target object.
If not, S302 is performed.
If yes, S303 is executed.
The registration object corresponding to the target display device may be preset, and the other objects than the registration object are non-registration objects. The registration object may be a preset character, for example, a owner of the display device, a manager with higher authority, or the like.
The registered object has authority to view the content displayed by the display device, and the leakage risk is not caused to the content displayed by the display device.
S302, determining the safety detection result as detection safety.
S303, determining a plurality of second video frames in the first video according to the first sampling rate.
The first sampling rate is greater than or equal to a preset sampling rate. When the target object exists before the target display device is determined, a plurality of second video frames are determined in the first video at a higher sampling rate, so that the number of the determined second video frames is larger. The second video frames are used for behavior detection, so that the accuracy of behavior detection results obtained by determining according to a plurality of second video frames is higher.
Next, a description will be given of determining a plurality of second video frames with reference to fig. 4.
Fig. 4 is a schematic diagram of determining a plurality of second video frames according to an embodiment of the present application. As shown in fig. 4, includes a first set of video and a second set of video frames.
Referring to fig. 4, the first video is sampled according to the first sampling rate, and a second video frame set is determined, where the second video frame set includes a plurality of second video frames.
S304, performing person identification processing on the second video frame through a preset model so as to determine at least one person in the second video frame.
S305, performing behavior feature extraction processing on at least one person through a preset model to obtain the portrait feature of each person in the second video frame.
The portrait features comprise the face orientation of the person, the type of handheld equipment of the person and the target behavior of the person.
For example, the target behavior may include viewing the screen, picking up content in the recording screen, shooting content in the screen with a handheld device, walking, talking, and so forth.
S306, determining a safety detection result according to the portrait characteristic of each person in each second video frame.
The security detection result may be determined by: for any person, determining a behavior detection result of the person according to the portrait features of the person in the plurality of second video frames, wherein the behavior detection result is used for indicating whether the person has preset behaviors or not; if the behavior detection result of at least one person indicates that the person does not have the preset behavior, determining that the safety detection result is detection safety; if the behavior detection result of the person in the at least one person indicates that the preset behavior exists in the person, the safety detection result is determined to be unsafe.
The preset behavior may be a behavior of recording or viewing the display device, for example, the preset behavior may be photographing, recording a video of the display device using a camera, viewing the display device, and the like.
In the embodiment of fig. 3, when the object type of the target object in the first video is a person type, it is necessary to determine whether the target object is a non-registered object, and if so, determining that the security detection result is detection security; if the equipment is a non-registered object, sampling the first video to obtain a plurality of second video frames, performing character recognition processing and behavior feature extraction processing on the second video frames to obtain the portrait features of each character, and determining a safety detection result according to the portrait features. By means of the behavior characteristics and the face characteristics of the non-registered objects, whether the non-registered objects can cause leakage risk of content displayed by the display device or not can be determined, and accuracy of safety detection of the display device is improved.
Fig. 5 is a schematic flow chart of another method for determining a security detection result according to an embodiment of the present application. In the embodiment shown in fig. 5, at least one target object includes therein no person and at least one third-party image pickup apparatus. Referring to fig. 5, the method may include:
s501, determining a plurality of second video frames in the first video according to a first sampling rate.
It should be noted that, the execution process of S501 may refer to S303, and will not be described herein.
S502, determining shooting directions and direction duration time of the third-party shooting equipment according to the plurality of second video frames.
The plurality of second video frames may be processed by a preset model to determine a shooting orientation and an orientation duration of the third party image capturing apparatus.
The shooting direction is opposite to the target display screen, deviated from the target display screen (may also include a deviated angle), or deviated from the target display screen.
Alternatively, if the shooting direction of the third party shooting device is changed, the duration of the direction of the third party shooting device in each shooting direction may be determined.
S503, determining a safety detection result according to the shooting direction and the direction duration of the third-party shooting equipment.
If the shooting direction is a preset direction and the direction duration is longer than or equal to the preset duration, determining that the safety detection result is unsafe; if the shooting direction is not the preset direction or the direction duration is smaller than the preset duration, determining that the safety detection result is detection safety.
The preset orientation is the orientation facing the display device or the orientation of the display device can be shot. The preset duration may be 2 seconds or 5 seconds.
In the embodiment of fig. 5, when the object type of the target object in the first video is the image capturing apparatus type, the security detection result may be determined according to the shooting orientation and the orientation duration of the third party image capturing apparatus. The accuracy of the safety detection of the display device is improved.
Fig. 6 is a schematic structural diagram of a safety protection device of a display device according to an embodiment of the present application. Referring to fig. 6, the safety guard 10 of the display device includes a determination module 11, an acquisition module 12, a behavior detection module 13, and a guard module 14, wherein,
the determining module 11 is configured to determine a target display device to be detected and a camera corresponding to the target display device;
the acquiring module 12 is configured to perform object recognition processing on a video frame acquired by the image capturing device, until a target object is identified in a first video frame acquired by the image capturing device, where the first video includes the first video frame;
the behavior detection module 13 is configured to perform behavior detection processing on a target object in the first video, so as to obtain a security detection result of the target display device;
the protection module 14 is configured to perform a security protection operation on the display device when the security detection result indicates that there is a risk of leakage of the content displayed by the display device.
The safety protection device for a display device provided in this embodiment may be used to execute the safety protection method for a display device in the above method embodiment, and its implementation principle and technical effects are similar, and are not described here again.
In one possible implementation, the behavior detection module 13 is specifically configured to:
performing object recognition processing on the first video to obtain at least one target object;
acquiring an object type of each target object, wherein the object type is a person type or a camera equipment type;
and performing behavior detection processing on the target object in the first video according to the object type of the at least one target object to obtain a security detection result of the target display device.
In one possible implementation, the behavior detection module 13 is specifically configured to:
the at least one target object comprises at least one person, and whether a non-registered object corresponding to the target display device exists in the at least one target object is judged;
if yes, determining a plurality of second video frames in the first video according to a first sampling rate, determining the portrait characteristic of each person in each second video frame, and determining the safety detection result according to the portrait characteristic of each person in each second video frame, wherein the portrait characteristic comprises the face orientation of the person, the type of handheld equipment of the person and the target behavior of the person, and the first sampling rate is greater than or equal to a preset sampling rate;
If not, determining the safety detection result as the detection safety.
In one possible implementation, the behavior detection module 13 is specifically configured to:
performing person identification processing on the second video frame through a preset model so as to determine at least one person in the second video frame;
and carrying out behavior feature extraction processing on the at least one person through the preset model to obtain the portrait feature of each person in the second video frame.
In one possible implementation, the behavior detection module 13 is specifically configured to:
determining at least one person in the plurality of images;
for any person, determining a behavior detection result of the person according to the portrait features of the person in the plurality of second video frames, wherein the behavior detection result is used for indicating whether the person has preset behaviors or not;
and determining the safety detection result according to the behavior detection result of each person.
In one possible implementation, the behavior detection module 13 is specifically configured to:
if the behavior detection results of the at least one person respectively indicate that the person does not have preset behaviors, determining that the safety detection results are detection safety;
And if the behavior detection result of the person in the at least one person indicates that the preset behavior exists in the person, determining that the safety detection result is unsafe.
In one possible implementation, the behavior detection module 13 is specifically configured to:
the at least one target object comprises at least one third party camera device and does not comprise a person, and a plurality of second video frames are determined in the first video according to a first sampling rate;
determining shooting directions and direction duration of the third-party camera equipment according to the plurality of second video frames;
if the shooting direction is a preset direction and the duration of the direction is longer than or equal to a preset duration, determining that the safety detection result is unsafe;
and if the shooting direction is not the preset direction or the direction duration is smaller than the preset duration, determining that the safety detection result is the detection safety.
In one possible implementation, the obtaining module 12 is specifically configured to:
extracting video frames from the video acquired by the camera device according to a second sampling rate, wherein the second sampling rate is smaller than a preset sampling rate;
And carrying out object recognition processing on the video frames extracted from the video.
In a possible embodiment, the determining module 11 is specifically configured to:
determining operation information of a plurality of to-be-selected display devices, wherein the operation information comprises an identifier of a currently operated application program and a content type currently displayed by the to-be-selected display devices;
and determining the target display equipment in the plurality of display equipment to be selected according to the operation information.
In a possible embodiment, the determining module 11 is specifically configured to:
and aiming at any one display device to be selected, if the application program currently operated by the display device to be selected is a preset application program or the content type currently displayed by the display device to be selected is a preset type, determining the display device to be selected as the target display device.
The safety protection device for a display device provided in this embodiment may be used to execute the safety protection method for a display device in the above method embodiment, and its implementation principle and technical effects are similar, and are not described here again.
Fig. 7 is a schematic hardware structure of the safety protection device provided in the present application. Referring to fig. 7, the safety shield apparatus 20 may include: a processor 21 and a memory 22, wherein the processor 21 and the memory 22 may communicate; illustratively, the processor 21 and the memory 22 are in communication via a communication bus 23, said memory 22 for storing computer-executable instructions, said processor 21 for invoking the computer-executable instructions in the memory for performing the method as shown in any of the method embodiments described above.
Optionally, safety shield apparatus 20 may also include a communication interface, which may include a transmitter and/or a receiver.
Embodiments of the present application provide a computer-readable storage medium having stored therein computer-executable instructions, which when executed by a processor, are configured to implement the methods described in the foregoing embodiments.
Embodiments of the present application provide a computer program product comprising a computer program which, when executed by a computer, implements the method described in the above embodiments.
All or part of the steps for implementing the method embodiments described above may be performed by hardware associated with program instructions. The foregoing program may be stored in a readable memory. The program, when executed, performs steps including the method embodiments described above; and the aforementioned memory (storage medium) includes: read-only memory (ROM), RAM, flash memory, hard disk, solid state disk, magnetic tape, floppy disk, optical disk, and any combination thereof.
Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processing unit of a general purpose computer, special purpose computer, embedded processor, or other programmable terminal device to produce a machine, such that the instructions, which execute via the processing unit of the computer or other programmable terminal device, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable terminal device to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various modifications and variations can be made to the embodiments of the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the embodiments of the present application fall within the scope of the claims and the equivalents thereof, the present application is intended to encompass such modifications and variations.
In the present application, the term "include" and variations thereof may refer to non-limiting inclusion; the term "or" and variations thereof may refer to "and/or". The terms "first," "second," and the like in this application are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. In the present application, "plurality" means two or more. "and/or", describes an association relationship of an association object, and indicates that there may be three relationships, for example, a and/or B, and may indicate: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the disclosed invention. This application is intended to cover any variations, uses, or adaptations of the application following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the application pertains.
Claims (13)
1. A method for safeguarding a display device, comprising:
determining target display equipment to be detected and a camera device corresponding to the target display equipment;
performing object recognition processing on the video frames acquired by the camera device until a target object is recognized in the first video frames acquired by the camera device, wherein the first video acquired by the camera device comprises the first video frames;
and performing behavior detection processing on the target object in the first video to obtain a safety detection result of the target display device, and performing safety protection operation on the display device when the safety detection result indicates that the content displayed by the display device has leakage risk.
2. The method according to claim 1, wherein performing behavior detection processing on the target object in the first video to obtain a security detection result of the target display device, includes:
performing object recognition processing on the first video to obtain at least one target object;
acquiring an object type of each target object, wherein the object type is a person type or a camera equipment type;
and performing behavior detection processing on the target object in the first video according to the object type of the at least one target object to obtain a security detection result of the target display device.
3. The method of claim 2, wherein the at least one target object comprises at least one character; according to the object type of the at least one target object, performing behavior detection processing on the target object in the first video to obtain a security detection result of the target display device, including:
judging whether a non-registered object corresponding to the target display device exists in the at least one target object;
if yes, determining a plurality of second video frames in the first video according to a first sampling rate, determining the portrait characteristic of each person in each second video frame, and determining the safety detection result according to the portrait characteristic of each person in each second video frame, wherein the portrait characteristic comprises the face orientation of the person, the type of handheld equipment of the person and the target behavior of the person, and the first sampling rate is greater than or equal to a preset sampling rate;
If not, determining the safety detection result as the detection safety.
4. A method according to claim 3, wherein for any one second video frame; determining the portrait characteristics of each person in the second video frame includes:
performing person identification processing on the second video frame through a preset model so as to determine at least one person in the second video frame;
and carrying out behavior feature extraction processing on the at least one person through the preset model to obtain the portrait feature of each person in the second video frame.
5. The method of claim 3, wherein determining the security detection result based on the portrait characteristics of each person in each second video frame comprises:
determining at least one person in the plurality of images;
for any person, determining a behavior detection result of the person according to the portrait features of the person in the plurality of second video frames, wherein the behavior detection result is used for indicating whether the person has preset behaviors or not;
and determining the safety detection result according to the behavior detection result of each person.
6. The method of claim 5, wherein determining the security test results based on the behavior test results for each person comprises:
If the behavior detection results of the at least one person respectively indicate that the person does not have preset behaviors, determining that the safety detection results are detection safety;
and if the behavior detection result of the person in the at least one person indicates that the preset behavior exists in the person, determining that the safety detection result is unsafe.
7. The method according to claim 2, wherein the at least one target object includes therein at least one third party image capturing apparatus excluding a person; according to the object type of the at least one target object, performing behavior detection processing on the target object in the first video to obtain a security detection result of the target display device, including:
determining a plurality of second video frames in the first video according to a first sampling rate;
determining shooting directions and direction duration of the third-party camera equipment according to the plurality of second video frames;
if the shooting direction is a preset direction and the duration of the direction is longer than or equal to a preset duration, determining that the safety detection result is unsafe;
and if the shooting direction is not the preset direction or the direction duration is smaller than the preset duration, determining that the safety detection result is the detection safety.
8. The method according to any one of claims 1 to 7, wherein performing object recognition processing on the video frames acquired by the image capturing apparatus includes:
extracting video frames from the video acquired by the camera device according to a second sampling rate, wherein the second sampling rate is smaller than a preset sampling rate;
and carrying out object recognition processing on the video frames extracted from the video.
9. The method according to any one of claims 1-7, wherein determining the target display device to be detected comprises:
determining operation information of a plurality of to-be-selected display devices, wherein the operation information comprises an identifier of a currently operated application program and a content type currently displayed by the to-be-selected display devices;
and determining the target display equipment in the plurality of display equipment to be selected according to the operation information.
10. The method of claim 9, wherein determining the target display device among the plurality of candidate display devices according to the operation information comprises:
and aiming at any one display device to be selected, if the application program currently operated by the display device to be selected is a preset application program or the content type currently displayed by the display device to be selected is a preset type, determining the display device to be selected as the target display device.
11. A safety protection device of display equipment is characterized by comprising a determining module, an acquiring module, a behavior detecting module and a protection module, wherein,
the determining module is used for determining target display equipment to be detected and a camera device corresponding to the target display equipment;
the acquisition module is used for carrying out object recognition processing on the video frames acquired by the camera device until a target object is recognized in the first video frames acquired by the camera device, and acquiring a first video acquired by the camera device, wherein the first video comprises the first video frames;
the behavior detection module is used for performing behavior detection processing on the target object in the first video to obtain a safety detection result of the target display device;
the protection module is used for carrying out safety protection operation on the display equipment when the safety detection result indicates that the content displayed by the display equipment has leakage risk.
12. A safety shield apparatus, comprising: a processor and a memory communicatively coupled to the processor;
the memory stores computer-executable instructions;
The processor executes computer-executable instructions stored in the memory to implement the method of any one of claims 1 to 10.
13. A computer readable storage medium having stored therein computer executable instructions which when executed by a processor are adapted to carry out the method of any one of claims 1 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310806985.6A CN116561829B (en) | 2023-07-04 | 2023-07-04 | Safety protection method, device, equipment and storage medium of display equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310806985.6A CN116561829B (en) | 2023-07-04 | 2023-07-04 | Safety protection method, device, equipment and storage medium of display equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116561829A true CN116561829A (en) | 2023-08-08 |
| CN116561829B CN116561829B (en) | 2024-04-02 |
Family
ID=87486456
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310806985.6A Active CN116561829B (en) | 2023-07-04 | 2023-07-04 | Safety protection method, device, equipment and storage medium of display equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116561829B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111597593A (en) * | 2020-05-29 | 2020-08-28 | 上海辰珅科技有限公司 | Anti-peeping identification method and system and display device |
| JP2021026442A (en) * | 2019-08-02 | 2021-02-22 | コニカミノルタ株式会社 | Information processing device, system, information processing method, and program |
| CN114564098A (en) * | 2022-02-22 | 2022-05-31 | 广州思涵信息科技有限公司 | Computer screen display control system and method based on computer vision recognition technology |
| CN116361761A (en) * | 2021-12-27 | 2023-06-30 | Oppo广东移动通信有限公司 | Information shielding method, information shielding device and electronic equipment |
-
2023
- 2023-07-04 CN CN202310806985.6A patent/CN116561829B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2021026442A (en) * | 2019-08-02 | 2021-02-22 | コニカミノルタ株式会社 | Information processing device, system, information processing method, and program |
| CN111597593A (en) * | 2020-05-29 | 2020-08-28 | 上海辰珅科技有限公司 | Anti-peeping identification method and system and display device |
| CN116361761A (en) * | 2021-12-27 | 2023-06-30 | Oppo广东移动通信有限公司 | Information shielding method, information shielding device and electronic equipment |
| CN114564098A (en) * | 2022-02-22 | 2022-05-31 | 广州思涵信息科技有限公司 | Computer screen display control system and method based on computer vision recognition technology |
Non-Patent Citations (1)
| Title |
|---|
| 孙霖 等: "人脸识别中视频回放假冒攻击的实时检测方法", 电路与系统学报, vol. 15, no. 2, 15 April 2010 (2010-04-15), pages 39 - 45 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116561829B (en) | 2024-04-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110955912B (en) | Privacy protection method, device, equipment and storage medium based on image recognition | |
| CN109002786B (en) | Face detection method, face detection equipment and computer-readable storage medium | |
| KR102313554B1 (en) | Personal Information De-identification Method and System | |
| CN108040230B (en) | Monitoring method and device for protecting privacy | |
| CN104573440A (en) | Data viewing method and device | |
| CN107786487B (en) | Information authentication processing method, system and related equipment | |
| CN110619239A (en) | Application interface processing method and device, storage medium and terminal | |
| CN112036238A (en) | Face data processing method and device, electronic equipment and storage medium | |
| CN113077354B (en) | Insurance application verification method and device for electronic equipment | |
| US20200026866A1 (en) | Method and device for covering private data | |
| CN116561829B (en) | Safety protection method, device, equipment and storage medium of display equipment | |
| CN117037270A (en) | Screen anti-shooting system and method based on image processing | |
| CN111832458A (en) | Anti-theft method and system | |
| WO2023024473A1 (en) | Living body detection method and apparatus, and electronic device, computer-readable storage medium and computer program product | |
| CN110163164B (en) | Fingerprint detection method and device | |
| CN108063665B (en) | Communication method and terminal device | |
| KR101925799B1 (en) | Computer program for preventing information spill displayed on display device and security service using the same | |
| JP5353147B2 (en) | Face matching system | |
| CN113222809B (en) | Picture processing method and device for realizing privacy protection | |
| CN110135204A (en) | Data guard method and device | |
| CN115359539A (en) | Office place information security detection method, device, equipment and storage medium | |
| CN114417397A (en) | Behavior portrait construction method and device, storage medium and computer equipment | |
| CN116522417B (en) | Security detection method, device, equipment and storage medium for display equipment | |
| KR20100013100A (en) | Apparatus for protecting image | |
| KR20190100844A (en) | Computer program for preventing information spill displayed on display device and security service using the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |