CN109040654B - Method and device for identifying external shooting equipment and storage medium - Google Patents

Method and device for identifying external shooting equipment and storage medium Download PDF

Info

Publication number
CN109040654B
CN109040654B CN201810951669.7A CN201810951669A CN109040654B CN 109040654 B CN109040654 B CN 109040654B CN 201810951669 A CN201810951669 A CN 201810951669A CN 109040654 B CN109040654 B CN 109040654B
Authority
CN
China
Prior art keywords
image
shooting
external
scene
media data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810951669.7A
Other languages
Chinese (zh)
Other versions
CN109040654A (en
Inventor
尚德建
胡小鹏
顾振华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Keda Technology Co Ltd
Original Assignee
Suzhou Keda Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Keda Technology Co Ltd filed Critical Suzhou Keda Technology Co Ltd
Priority to CN201810951669.7A priority Critical patent/CN109040654B/en
Publication of CN109040654A publication Critical patent/CN109040654A/en
Application granted granted Critical
Publication of CN109040654B publication Critical patent/CN109040654B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/35Categorising the entire scene, e.g. birthday party or wedding scene
    • G06V20/36Indoor scenes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects

Abstract

The application relates to an identification method, a device and a storage medium of an external shooting device, belonging to the technical field of computers, wherein the method comprises the following steps: acquiring a scene image of a target playing scene; determining whether the scene image includes a device image of an external photographing device; generating a detection result notification when it is determined that the scene image includes the device image; sending the detection result notification to a media management system; the problem that the target media data is not high in safety because external shooting equipment cannot be prevented from shooting the target media data when information such as watermarks and copyrights is added to the target media data can be solved; the terminal acquires the scene image of the target playing scene to identify whether the target playing scene comprises the external shooting equipment, so that the external shooting equipment can be identified, and the safety of the target media data is improved.

Description

Method and device for identifying external shooting equipment and storage medium
Technical Field
The application relates to an identification method and device of external shooting equipment and a storage medium, and belongs to the technical field of computers.
Background
In order to avoid the problem of information loss in the conference process, the conference participants can use the shooting equipment to shoot the conference process. However, some conference content during the conference may have a high privacy level and may not be allowed to be transmitted, and thus, there is a need to protect the conference content involved during the conference.
Currently, the methods for protecting conference content include: and adding information such as watermark and copyright to the shot target media data, and identifying the copyright owner of the target media data through the information, thereby prompting that conference participants can not carry out operation such as reprinting and external transmission on the target media data.
However, during the conference, the conference participants may use an external shooting device to shoot the conference content, and at this time, the security of the shot target media data cannot be guaranteed. Therefore, how to identify the external photographing apparatus that is photographing the conference content during the conference is an urgent problem to be solved. The external photographing apparatus refers to a photographing apparatus that is not authorized by the owner of the target media data.
Disclosure of Invention
The application provides an identification method and device of an external shooting device and a storage medium, which can solve the problem that the target media data is not high in safety because the external shooting device cannot be prevented from shooting the target media data when only information such as watermarks and copyrights are added to the target media data. The application provides the following technical scheme:
in a first aspect, a method for identifying an external shooting device is provided, where the method is used in a terminal having an image capturing function, and the method includes:
acquiring a scene image of a target playing scene, wherein the target playing scene is a spatial scene for playing target media data;
determining whether the scene image includes a device image of an external photographing device, the external photographing device being a photographing device that is not authorized by an owner of the target media data;
generating a detection result notification when it is determined that the scene image includes the device image;
and sending the detection result notification to a media management system, wherein the detection result notification is used for the media management system to process the target media data.
Optionally, the determining whether the scene image includes a device image of an external photographing device includes:
matching the scene image with a template image of the external shooting device;
when the matched scene image comprises the template image, determining that the scene image comprises the equipment image;
determining that the scene image does not include the device image when the matching result shows that the scene image does not include the template image.
Optionally, when the scene image includes the device image, the method further includes:
acquiring a target position of the equipment image in the scene image;
and determining the shooting probability of the external shooting equipment for shooting the target media data according to the target position, wherein the detection result notification comprises the shooting probability.
Optionally, the determining, according to the target position, a shooting probability that the external shooting device shoots the target media data includes:
determining that the shooting probability is greater than or equal to a first probability value when the target position is within a first preset range of the scene image;
when the target position is within a second preset range of the scene image, determining that the shooting probability is greater than a second probability value and smaller than the first probability value;
when the target position is within a third preset range of the scene image, determining that the shooting probability is smaller than or equal to the second probability value.
Optionally, when the scene image includes the device image, the method further includes:
identifying whether an element image of the external photographing apparatus when photographing the target media data is included in the scene image;
triggering execution of the step of generating a detection result notification when the scene image includes the elemental image.
Alternatively, the elemental image includes at least one of a flash blinking image, a power lamp blinking image, and a shooting posture image.
In a second aspect, a method for identifying an external camera is provided, which is used in a media management system, and includes:
acquiring a detection result notification sent by a terminal, wherein the detection result notification is generated when the terminal determines that a scene image of a target playing scene comprises an equipment image of external shooting equipment; the target playing scene is a space scene for playing the target media data; the external shooting device is a shooting device which is not authorized by the owner of the target media data;
acquiring the shooting permission of the target media data;
and processing the detection result notification according to the shooting authority.
Optionally, the processing the detection result notification according to the shooting authority includes:
the shooting permission indicates that the target media data is allowed to be shot by the external shooting equipment, and the detection result notification is ignored;
alternatively, the first and second electrodes may be,
the shooting authority indicates that the target media data is forbidden to be shot by the external shooting equipment, and a playing terminal is controlled to output an external shooting prompt; or, controlling the playing terminal to stop playing the target media data;
the playing terminal is used for playing the target media data, and the external shooting prompt is used for prompting that at least one external shooting device shoots the target media data.
In a third aspect, an apparatus for recognizing an external camera is provided, where the apparatus is used in a terminal having an image capturing function, and the apparatus includes:
the system comprises an image acquisition module, a data processing module and a data processing module, wherein the image acquisition module is used for acquiring a scene image of a target playing scene, and the target playing scene is a space scene for playing target media data;
an image determining module, configured to determine whether the scene image includes a device image of an external capturing device, where the external capturing device is a capturing device that is not authorized by an owner of the target media data;
a notification generation module configured to generate a detection result notification when it is determined that the scene image includes the device image;
and the notification sending module is used for sending the detection result notification to a media management system, and the detection result notification is used for the media management system to process the target media data.
Optionally, the image determining module is configured to:
matching the scene image with a template image of the external shooting device;
when the matched scene image comprises the template image, determining that the scene image comprises the equipment image;
determining that the scene image does not include the device image when the matching result shows that the scene image does not include the template image.
Optionally, when the scene image includes the device image, the apparatus further includes:
the position acquisition module is used for acquiring the target position of the equipment image in the scene image;
and the probability determining module is used for determining the shooting probability of the external shooting equipment for shooting the target media data according to the target position, and the detection result notice comprises the shooting probability.
Optionally, the probability determination module is configured to:
determining that the shooting probability is greater than or equal to a first probability value when the target position is within a first preset range of the scene image;
when the target position is within a second preset range of the scene image, determining that the shooting probability is greater than a second probability value and smaller than the first probability value;
when the target position is within a third preset range of the scene image, determining that the shooting probability is smaller than or equal to the second probability value.
Optionally, when the scene image includes the device image, the apparatus further includes:
the element identification module is used for identifying whether the element image of the external shooting device when the target media data is shot is included in the scene image;
the notification generation module is further configured to execute the step of generating the detection result notification when the scene image includes the element image.
Alternatively, the elemental image includes at least one of a flash blinking image, a power lamp blinking image, and a shooting posture image.
In a fourth aspect, an apparatus for recognizing an external camera is provided, which is used in a media management system, and includes:
the notification acquisition module is used for acquiring a detection result notification sent by a terminal, wherein the detection result notification is generated when the terminal determines that a scene image of a target playing scene comprises an equipment image of external shooting equipment; the target playing scene is a space scene for playing the target media data; the external shooting device is a shooting device which is not authorized by the owner of the target media data;
the authority acquisition module is used for acquiring the shooting authority of the target media data;
and the notification processing module is used for processing the detection result notification according to the shooting authority.
Optionally, the notification processing module is configured to:
the shooting permission indicates that the target media data is allowed to be shot by the external shooting equipment, and the detection result notification is ignored;
alternatively, the first and second electrodes may be,
the shooting authority indicates that the target media data is forbidden to be shot by the external shooting equipment, and a playing terminal is controlled to output an external shooting prompt; or, controlling the playing terminal to stop playing the target media data;
the playing terminal is used for playing the target media data, and the external shooting prompt is used for prompting that at least one external shooting device shoots the target media data.
In a fifth aspect, an apparatus for recognizing an external photographing device is provided, the apparatus including a processor and a memory; the memory stores therein a program that is loaded and executed by the processor to implement the identification method of the external photographing apparatus according to the first aspect; alternatively, it is performed to realize the identification method of the external photographing apparatus according to the second aspect.
A sixth aspect provides a computer-readable storage medium having a program stored therein, the program being loaded and executed by the processor to implement the method of identifying an external photographing apparatus according to the first aspect; alternatively, it is performed to realize the identification method of the external photographing apparatus according to the second aspect.
The beneficial effect of this application lies in: acquiring a scene image of a target playing scene by using a terminal with an image acquisition function; determining whether the scene image includes a device image of an external photographing device; generating a detection result notification when it is determined that the scene image includes the device image; sending a detection result notification to the media management system, wherein the detection result notification is used for the media management system to process the target media data; the problem that the target media data is not high in safety because external shooting equipment cannot be prevented from shooting the target media data when information such as watermarks and copyrights is added to the target media data can be solved; the terminal acquires the scene image of the target playing scene to identify whether the target playing scene comprises the external shooting equipment, so that the external shooting equipment can be identified, and the safety of the target media data is improved.
The foregoing description is only an overview of the technical solutions of the present application, and in order to make the technical solutions of the present application more clear and clear, and to implement the technical solutions according to the content of the description, the following detailed description is made with reference to the preferred embodiments of the present application and the accompanying drawings.
Drawings
Fig. 1 is a schematic structural diagram of an identification system of an external photographing apparatus according to an embodiment of the present application;
fig. 2 is a schematic structural diagram of a split terminal according to an embodiment of the present application;
FIG. 3 is a schematic structural diagram of an integrated terminal provided in an embodiment of the present application;
fig. 4 is a flowchart of an identification method of an external photographing apparatus according to an embodiment of the present application;
fig. 5 is a flowchart of an identification method of an external photographing apparatus according to another embodiment of the present application;
fig. 6 is a flowchart of an identification method of an external photographing apparatus according to another embodiment of the present application;
fig. 7 is a block diagram of an identification apparatus of an external photographing device according to an embodiment of the present application;
fig. 8 is a block diagram of an identification apparatus of an external photographing device according to an embodiment of the present application;
fig. 9 is a block diagram of an identification apparatus of an external photographing device according to an embodiment of the present application.
Detailed Description
The following detailed description of embodiments of the present application will be described in conjunction with the accompanying drawings and examples. The following examples are intended to illustrate the present application but are not intended to limit the scope of the present application.
Optionally, the identification method of the external shooting device provided by the application may be applied to a video conference scene, a live-action conference scene, a voice conference scene, or a conference release scene, where multiple people participate in sharing target media data.
In the following, several terms referred to in the present application are explained.
Target playing scene: refers to a spatial scene for playing target media data, such as: the conference room in the live-action conference, the space in which the conference terminal is located in the video conference or the voice conference, the release meeting site and the like.
An external photographing device: refers to a photographing apparatus that is not authorized by the owner of the target media data. Alternatively, the owner of the target media data may be an organization or a person having a management right on the target media data, such as a conference initiator, a copyright owner of the target media data, and the like, and the type of the owner of the target media data is not limited in the present application. The external shooting device may be an electronic device with a shooting function, such as a mobile phone, a video recorder, a camera, a wearable device, a personal computer, or a tablet computer, and the device type of the external shooting device is not limited in the present application.
Fig. 1 is a schematic structural diagram of an identification system of an external photographing apparatus according to an embodiment of the present application, and as shown in fig. 1, the system at least includes: a terminal 110, a playback device 120, and a media management system 130.
The playing device 120 has a function of displaying the target media data, the playing device 120 may be an electronic device such as a mobile phone, a personal computer, a desktop computer, a wearable device, a projector, and the like, and the playing device 120 is configured to play the target media data through the display component.
Optionally, the playing device 120 plays the target media data through the control of the media management system 130, such as: in a video conference scenario, the playing device 120 is a video conference terminal, and the media management system 130 is a video conference server, at this time, the playing device 120 enters a video conference through the media management system 130, and acquires target media data through the media management system 130.
Optionally, the playback device 120 is provided in a different device than the media management system 130; alternatively, the playback device 120 is provided in the same device as the media management system 130.
When the playback device 120 and the media management system 130 are disposed in different devices, the media management system 130 may be a server that provides a media playback service for the playback device 120, such as: a video conference server; when the playback device 120 is disposed in the same device as the media management system 130, the media management system 130 may be a processing component in the playback device 120 for controlling playback of the target media data, such as: a processor, etc.
The terminal 110 has an image capturing function such as: the terminal 110 is provided with a camera, and image acquisition is realized through the camera. The terminal 110 may be a mobile phone, a video recorder, a camera, a wearable device, a personal computer, a tablet computer, or the like, which also has a communication function.
Optionally, in this embodiment, the terminal 110 is configured to acquire a scene image of a target playing scene; determining whether the scene image includes a device image of an external photographing device; generating a detection result notification when it is determined that the scene image includes the device image; and sending the detection result notice to the media management system, wherein the detection result notice is used for the media management system to process the target media data.
Optionally, the image capturing component in the terminal 110 is disposed outside the terminal 110 as an independent device, and the terminal 110 may be disposed in a different device from the playing device 120, referring to the split terminal shown in fig. 2, the split terminal includes a terminal 210, an image capturing component 220 disposed outside the terminal 210, and a playing device 230, wherein the terminal 210, the image capturing component 220, and the playing device 230 are electronic devices independent of each other, and optionally, the terminal 210 and the playing device 230 establish a communication connection, and a communication connection is established between the image capturing component 220 and the terminal 210.
Alternatively, the image capturing component in the terminal 110 is disposed inside the terminal 110, and the terminal 110 may be disposed in the same device as the playing device 120, referring to the integrated terminal shown in fig. 3, which includes the image capturing component 310 and the playing device 320 (display), wherein the image capturing component 310 and the playing device 320 are both disposed in the integrated terminal. Of course, the all-in-one terminal may also include other components, such as: the supporting component, the communication component, the processing component, etc. are not described in detail herein.
Alternatively, the image capturing component in the terminal 110 is disposed outside the terminal 110 as a separate device, and the terminal 110 and the playing device 120 are disposed in the same device.
Alternatively, the image capturing component in the terminal 110 is disposed inside the terminal 110, and the terminal 110 and the playing device 120 are disposed in different devices.
The setting mode of the image acquisition assembly of the terminal and the setting mode of the playing equipment are not limited.
The terminal 110 is communicatively coupled to the media management system 130 by wire or wirelessly.
The media management system 130 is configured to obtain a detection result notification sent by the terminal 110; acquiring shooting permission of target media data; and processing the detection result notification according to the shooting authority.
Optionally, the target playback scene in which the playback device 120 plays the target media data further includes at least one external capture device.
In the present application, the target media data may be at least one of video data, audio data, picture data, and text data. Such as: the target media data is uncompressed red, green, blue, RGB (red, green, blue, RGB) data, brightness, Chroma, concentration (Luma, Chroma, YUV) data, compressed Joint Photographic Experts Group (Joint Photographic Experts Group) JPEG-formatted data, and the like, and the data type of the target media data is not limited in the present application.
Fig. 4 is a flowchart of an identification method of an external photographing apparatus according to an embodiment of the present application, and this embodiment is described by taking an example in which the method is applied to the identification system of the external photographing apparatus shown in fig. 1. The method at least comprises the following steps:
step 401, the terminal collects a scene image of a target playing scene.
The terminal has an image acquisition function. The target play scene refers to a spatial scene for playing the target media data.
The terminal acquires scene images of a target playing scene through an image acquisition assembly, wherein the number of the scene images can be one; alternatively, there may be a plurality of images, and the number of scene images is not limited in this embodiment.
Optionally, the terminal may acquire the scene image every preset time; or acquiring a scene image when an acquisition instruction is received; or, collecting a scene image when detecting an optical signal with a brightness value higher than a preset brightness value; the embodiment does not limit the timing of acquiring the scene image by the terminal.
In step 402, the terminal determines whether the scene image includes a device image of an external photographing device.
The external photographing device refers to a photographing device that is not authorized by the owner of the target media data.
Optionally, the terminal matches the scene image with a template image of an external shooting device; when the matched scene image comprises the template image, determining that the scene image comprises the device image, and executing step 403; when the matched scene image does not include the template image, it is determined that the scene image does not include the device image, and step 401 is executed again or the flow ends.
The template image of the external photographing apparatus is pre-stored in the terminal. The template image is composed of features of the externally captured image, such as: the mobile phone is characterized in that the edge area of the rectangular block comprises a shooting small hole, the middle area of the rectangular block comprises a circular area, and the outside of the circular area is connected with the rectangular block.
Alternatively, the template image may be a two-dimensional image; alternatively, the image may be a Three-dimensional (3D) image, or may be a more multidimensional image, which is not limited in this embodiment.
Optionally, when the terminal matches the scene image with the template image of the external shooting device, the scene image may be divided into a plurality of rectangular blocks; matching the image content in each rectangular block with the template image; when the matching degree between the image content and the template image is greater than a preset value, determining that the scene image comprises an equipment image; and when the matching degrees between the image contents in all the rectangular blocks and the template images are less than or equal to a preset value, determining that the scene image does not comprise the device image.
The preset values are pre-stored in the terminal, and the preset values may be 80%, 90%, 98%, and the like, and the value of the preset value is not limited in this embodiment.
On the other hand, whether the scene image includes the device image of the external shooting device may also be determined in an artificial intelligence recognition manner, which specifically may be: by collecting samples containing device images of various types of external shooting devices, a neural network model which can be used for identifying the device images of the external shooting devices is trained, and the device images in the scene images are identified by using the model.
In step 403, the terminal generates a detection result notification when determining that the scene image includes the device image.
The detection result notification is used for the media management system to process the target media data.
The detection result notification may include a detection result in which the terminal determines that the scene image includes the device image. Optionally, the detection result notification may further include a device type of the external shooting device corresponding to the device image, such as: and when the terminal matches the image content identical to the template image of the mobile phone in the scene image, carrying the device type 'mobile phone' in the detection result notification.
In step 404, the terminal sends a notification of the detection result to the media management system.
The media management system is used for controlling the playing equipment to play the target media data.
Step 405, the media management system obtains a detection result notification sent by the terminal.
The detection result notification is generated when the terminal determines that the scene image of the target playing scene includes the device image of the external shooting device.
In step 406, the media management system obtains the shooting right of the target media data.
Optionally, the shooting authority includes an authority for allowing shooting and an authority for forbidding shooting, and of course, the shooting authority may be further divided, for example: the shooting permission prohibition is divided into a weak prohibition permission and a strong prohibition permission, and the setting mode of the shooting permission is not limited in the embodiment.
Step 407, the media management system processes the detection result notification according to the shooting authority.
Illustratively, the shooting right indicates that the target media data is allowed to be shot by the external shooting device, and the media management system ignores the detection result notification; or the shooting authority indicates that the target media data is forbidden to be shot by the external shooting equipment, and the media management system controls the playing terminal to output an external shooting prompt; or the media management system controls the playing terminal to stop playing the target media data. Such as: when the shooting authority is the weak forbidding authority, the media management system controls the playing terminal to output an external shooting prompt; and when the shooting right is a strong forbidding right, the media management system controls the playing terminal to stop playing the target media data.
When the media management system controls the play terminal to output the external shooting prompt, the play terminal can play the external shooting prompt on the top of the target media data in a rolling mode (in a bullet screen mode); alternatively, the external shooting prompt may be continuously displayed at the bottom of the target media data, and the display mode of the external shooting prompt is not limited in this embodiment.
The external photographing prompt is used for prompting that at least one external photographing device exists for photographing the target media data. Optionally, the external photographing prompt includes a device type of the external photographing device photographing the target media data.
In summary, in the identification method of the external shooting device provided by this embodiment, a terminal with an image capture function is used to capture a scene image of a target playing scene; determining whether the scene image includes a device image of an external photographing device; generating a detection result notification when it is determined that the scene image includes the device image; sending a detection result notification to the media management system, wherein the detection result notification is used for the media management system to process the target media data; the problem that the target media data is not high in safety because external shooting equipment cannot be prevented from shooting the target media data when information such as watermarks and copyrights is added to the target media data can be solved; the terminal acquires the scene image of the target playing scene to identify whether the target playing scene comprises the external shooting equipment, so that the external shooting equipment can be identified, and the safety of the target media data is improved.
Alternatively, since the external photographing apparatus may not photograph the target media data when the external photographing apparatus is included in the scene image, in order to improve the accuracy of the terminal in identifying the external photographing apparatus that photographs the target media data, referring to fig. 5, the identification method of the external photographing apparatus provided by the present application further includes the following steps, based on the above-described embodiment, as an alternative step to step 403,
step 501, when the scene image comprises the device image, the terminal acquires a target position of the device image in the scene image.
And 502, the terminal determines the shooting probability of shooting the target media data by the external shooting equipment according to the target position.
At this time, the detection result notification includes the shooting probability.
The method comprises the steps of determining that the shooting probability is larger than or equal to a first probability value when a target position is within a first preset range of a scene image; when the target position is within a second preset range of the scene image, determining that the shooting probability is greater than a second probability value and smaller than a first probability value; and when the target position is within a third preset range of the scene image, determining that the shooting probability is less than or equal to a second probability value.
The first preset range, the second preset range and the third preset range are determined according to the position relation between the terminal and the playing position of the target media data. Taking the target playing scene directly in front of the playing position of the target media data as an example, at this time, the shooting probability of the external shooting device located in the middle of the target playing scene is relatively high, so the first preset range may be a center region obtained by dividing the scene image into three parts from the center to the edge, the third preset range is an edge region after the division, and the second preset range is a region between the center region and the edge region.
The first probability value is greater than the second probability value, illustratively, the first probability value and the second probability value may be represented by percentages, such as: the first probability value is 90% and the second probability value is 60%; alternatively, it can be represented by a probability scale, such as: the first probability value is level 2, the second probability value is level 1 (the larger the number of levels is, the higher the corresponding probability is), and the present embodiment does not limit the representation and values of the first probability value and the second probability value.
Of course, the terminal may also divide the scene image into more regions, such as: 4 zones, 5 zones, etc.; or, divided into fewer regions, such as: 2 regions, the present embodiment does not limit the dividing manner and the number of the divided scene images.
Step 503, generating a detection result notification according to the shooting probability.
Optionally, the terminal generates a detection result notification when determining that the scene image includes the device image, and carries the shooting probability in the detection result notification; or the terminal generates a detection result notification when the scene image is determined to comprise the equipment image and the shooting probability is greater than the second probability value, and carries the shooting probability in the detection result notification; or the terminal generates a detection result notification when the scene image is determined to comprise the device image and the shooting probability is greater than or equal to the first probability value, and carries the shooting probability in the detection result notification.
In summary, according to the identification method of the external photographing apparatus provided by this embodiment, since the external photographing apparatus needs to be able to photograph the target media data at the specified position when the external photographing apparatus is used to photograph the target media data, by determining the photographing probability of the external photographing apparatus photographing the target media data according to the target position of the apparatus image in the scene image, the accuracy of the terminal identifying the external photographing apparatus that is photographing the target media data can be improved.
Alternatively, since some photographing elements are required when photographing the target media data using the external photographing apparatus, such as: therefore, in order to improve the accuracy of the terminal in identifying the external photographing device for photographing the target media data, referring to fig. 6, the method for identifying the external photographing device provided by the present application further includes the following steps, based on the above-mentioned embodiments, as an alternative step to step 403,
step 601, when the scene image comprises the device image, the terminal identifies whether the scene image comprises an element image of the external shooting device when shooting the target media data.
The elemental image refers to an imaging element required by the external imaging device when imaging the target media data. Illustratively, the elemental image includes, but is not limited to, at least one of the following:
at least one of a flash blinking image, a power lamp blinking image, and a shooting posture image.
Optionally, the corresponding elemental images of different types of external photographing devices are different, such as: the element images corresponding to the video recorder comprise a power lamp flickering image and a shooting posture image; the elemental images corresponding to the camera include a flash blinking image and a shooting posture image.
Wherein the flash flashing image or the power lamp flashing image can be determined according to at least two scene images. Such as: and determining that the two images are flash flickering images or power supply lamp flickering images when the luminance in the (i, j) th pixel of the nth scene image is x, the luminance in the (i, j) th pixel of the (n + 1) th scene image is y, and the x is different from the y, and the pixel content of the (i, j) th pixel of the (n + 1) th scene image is the same as the pixel content of the (i, j) th pixel of the nth scene image. Wherein n, i and j are positive integers.
The shooting posture image is determined according to the posture when the target media data is shot using an external shooting device, such as: a posture when the user photographs the target media data (such as arm flat or arm forming a diamond shape), a posture when the tripod photographs the target media data, and the like.
In step 602, the terminal generates a detection result notification when the scene image includes the element image.
When the scene image includes the elemental image, the probability that the target playback scene includes the target media data captured by the external capturing device is high, and therefore, the detection result notification is generated.
In summary, the method for identifying an external shooting device provided by this embodiment needs some shooting elements when the external shooting device is used to shoot target media data, such as: shooting elements such as flash, power lamp flash, shooting posture and the like, so that whether the element image of the external shooting device when shooting the target media data is included in the scene image is identified; generating a detection result notification when the scene image includes the element image; the accuracy of the terminal identifying the external photographing device photographing the target media data can be improved.
Fig. 7 is a block diagram of an identification apparatus for an external camera according to an embodiment of the present application, and the present application is described by taking an example in which the apparatus is applied to the terminal 110 in the identification system for an external camera shown in fig. 1. The device at least comprises the following modules: an image acquisition module 710, an image determination module 720, a notification generation module 730, and a notification transmission module 740.
An image collecting module 710, configured to collect a scene image of a target playing scene, where the target playing scene is a spatial scene used for playing target media data;
an image determining module 720, configured to determine whether the scene image includes a device image of an external capturing device, where the external capturing device is a capturing device that is not authorized by an owner of the target media data;
a notification generation module 730, configured to generate a detection result notification when it is determined that the scene image includes the device image;
a notification sending module 740, configured to send the detection result notification to a media management system, where the detection result notification is used for the media management system to process the target media data.
Optionally, the image determining module 720 is configured to:
matching the scene image with a template image of the external shooting device;
when the matched scene image comprises the template image, determining that the scene image comprises the equipment image;
determining that the scene image does not include the device image when the matching result shows that the scene image does not include the template image.
Optionally, when the scene image includes the device image, the apparatus further includes: the device comprises a position acquisition module and a probability determination module.
The position acquisition module is used for acquiring the target position of the equipment image in the scene image;
and the probability determining module is used for determining the shooting probability of the external shooting equipment for shooting the target media data according to the target position, and the detection result notice comprises the shooting probability.
Optionally, the probability determination module is configured to:
determining that the shooting probability is greater than or equal to a first probability value when the target position is within a first preset range of the scene image;
when the target position is within a second preset range of the scene image, determining that the shooting probability is greater than a second probability value and smaller than the first probability value;
when the target position is within a third preset range of the scene image, determining that the shooting probability is smaller than or equal to the second probability value.
Optionally, when the scene image includes the device image, the apparatus further includes: and an element identification module.
The element identification module is used for identifying whether the element image of the external shooting device when the target media data is shot is included in the scene image;
the notification generation module 730 is further configured to execute the step of generating the detection result notification when the scene image includes the element image.
Alternatively, the elemental image includes at least one of a flash blinking image, a power lamp blinking image, and a shooting posture image.
For relevant details reference is made to the above-described method embodiments.
Fig. 8 is a block diagram of an identification apparatus for an external camera according to an embodiment of the present application, and the present embodiment is described by taking an example in which the apparatus is applied to the media management system 130 in the identification system for an external camera shown in fig. 1. The device at least comprises the following modules: a notification acquisition module 810, a permission acquisition module 820, and a notification processing module 830.
A notification obtaining module 810, configured to obtain a detection result notification sent by a terminal, where the detection result notification is generated when the terminal determines that a scene image of a target playing scene includes an apparatus image of an external shooting apparatus; the target playing scene is a space scene for playing the target media data; the external shooting device is a shooting device which is not authorized by the owner of the target media data;
a permission obtaining module 820, configured to obtain a shooting permission of the target media data;
and a notification processing module 830, configured to process the detection result notification according to the shooting permission.
Optionally, the notification processing module 830 is configured to:
the shooting permission indicates that the target media data is allowed to be shot by the external shooting equipment, and the detection result notification is ignored;
alternatively, the first and second electrodes may be,
the shooting authority indicates that the target media data is forbidden to be shot by the external shooting equipment, and a playing terminal is controlled to output an external shooting prompt; or, controlling the playing terminal to stop playing the target media data;
the playing terminal is used for playing the target media data, and the external shooting prompt is used for prompting that at least one external shooting device shoots the target media data.
It should be noted that: the identification apparatus for an external imaging device provided in the above embodiments is only illustrated by the division of the above functional modules when identifying the external imaging device, and in practical applications, the above functions may be distributed by different functional modules according to needs, that is, the internal structure of the identification apparatus for an external imaging device may be divided into different functional modules to complete all or part of the above described functions. In addition, the identification apparatus of the external photographing device provided by the above embodiment and the identification method embodiment of the external photographing device belong to the same concept, and specific implementation processes thereof are detailed in the method embodiment and are not described herein again.
Fig. 9 is a block diagram of an identification apparatus of an external photographing device according to an embodiment of the present application, which may be the terminal 110 in the identification system of the external photographing device shown in fig. 1; alternatively, the media management system 130 may be used in the recognition system of the external photographing apparatus shown in fig. 1. The apparatus comprises at least a processor 901 and a memory 902.
Processor 901 may include one or more processing cores such as: 4 core processors, 9 core processors, etc. The processor 901 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 901 may also include a main processor and a coprocessor, where the main processor is a processor for Processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 901 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the display screen. In some embodiments, the processor 901 may further include an AI (Artificial Intelligence) processor for processing computing operations related to machine learning.
Memory 902 may include one or more computer-readable storage media, which may be non-transitory. The memory 902 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in the memory 902 is used to store at least one instruction for execution by the processor 901 to implement the method for identifying an external photographing apparatus provided by the method embodiments in the present application.
In some embodiments, the identification means of the external photographing apparatus may further include: a peripheral interface and at least one peripheral. The processor 901, memory 902 and peripheral interfaces may be connected by buses or signal lines. Each peripheral may be connected to the peripheral interface via a bus, signal line, or circuit board. Illustratively, peripheral devices include, but are not limited to: radio frequency circuit, touch display screen, audio circuit, power supply, etc.
Of course, the identification device of the external shooting device may also include fewer or more components, which is not limited in this embodiment.
Optionally, the present application further provides a computer-readable storage medium, in which a program is stored, and the program is loaded and executed by a processor to implement the identification method of the external shooting device of the above-mentioned method embodiment.
Optionally, the present application further provides a computer product, which includes a computer-readable storage medium, in which a program is stored, and the program is loaded and executed by a processor to implement the method for identifying an external shooting device according to the above method embodiment.
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (9)

1. An identification method of an external shooting device, which is used in a terminal with an image acquisition function, comprises the following steps:
acquiring a scene image of a target playing scene, wherein the target playing scene is a spatial scene for playing target media data;
determining whether the scene image includes a device image of an external photographing device, the external photographing device being a photographing device that is not authorized by an owner of the target media data;
when the scene image is determined to comprise the equipment image, acquiring a target position of the equipment image in the scene image;
determining the shooting probability of the external shooting equipment for shooting the target media data according to the target position;
generating a detection result notification including the shooting probability;
and sending the detection result notification to a media management system, wherein the detection result notification is used for the media management system to process the target media data.
2. The method of claim 1, wherein the determining whether the scene image comprises a device image of an external capture device comprises:
matching the scene image with a template image of the external shooting device;
when the matched scene image comprises the template image, determining that the scene image comprises the equipment image;
determining that the scene image does not include the device image when the matching result shows that the scene image does not include the template image.
3. The method of claim 1, wherein determining the shooting probability of the external shooting device shooting the target media data according to the target position comprises:
determining that the shooting probability is greater than or equal to a first probability value when the target position is within a first preset range of the scene image;
when the target position is within a second preset range of the scene image, determining that the shooting probability is greater than a second probability value and smaller than the first probability value;
when the target position is within a third preset range of the scene image, determining that the shooting probability is smaller than or equal to the second probability value.
4. The method of claim 1, wherein when the scene image comprises the device image, the method further comprises:
identifying whether an element image of the external photographing apparatus when photographing the target media data is included in the scene image;
triggering execution of the step of generating a detection result notification when the scene image includes the elemental image.
5. The method according to claim 4, wherein the elemental image includes at least one of a flash blinking image, a power lamp blinking image, and a shooting posture image.
6. An identification method of an external photographing apparatus, which is used in a media management system, the method comprising:
the method comprises the steps of obtaining a detection result notice sent by a terminal, wherein the detection result notice is that when the terminal determines that a scene image of a target playing scene comprises an equipment image of an external shooting equipment, the terminal obtains a target position of the equipment image in the scene image; determining the shooting probability of the external shooting equipment for shooting the target media data according to the target position; the target playing scene is a space scene for playing the target media data; the external shooting device is a shooting device which is not authorized by the owner of the target media data;
acquiring the shooting permission of the target media data;
and processing the detection result notification according to the shooting authority.
7. The method of claim 6, wherein the processing the detection result notification according to the shooting authority comprises:
when the shooting permission indicates that the target media data is allowed to be shot by the external shooting equipment, ignoring the detection result notification;
alternatively, the first and second electrodes may be,
when the shooting authority indicates that the target media data is forbidden to be shot by the external shooting equipment, controlling a playing terminal to output an external shooting prompt; or, controlling the playing terminal to stop playing the target media data;
the playing terminal is used for playing the target media data, and the external shooting prompt is used for prompting that at least one external shooting device shoots the target media data.
8. An identification apparatus of an external photographing device, the apparatus comprising a processor and a memory; the memory has stored therein a program that is loaded and executed by the processor to implement the identification method of the external photographing apparatus according to any one of claims 1 to 5; or to implement the method of identification of an external camera device according to claim 6 or 7.
9. A computer-readable storage medium, characterized in that the storage medium stores therein a program for implementing the identification method of the external photographing apparatus according to any one of claims 1 to 5 when the program is executed by a processor; or to implement the method of identification of an external camera device according to claim 6 or 7.
CN201810951669.7A 2018-08-21 2018-08-21 Method and device for identifying external shooting equipment and storage medium Active CN109040654B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810951669.7A CN109040654B (en) 2018-08-21 2018-08-21 Method and device for identifying external shooting equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810951669.7A CN109040654B (en) 2018-08-21 2018-08-21 Method and device for identifying external shooting equipment and storage medium

Publications (2)

Publication Number Publication Date
CN109040654A CN109040654A (en) 2018-12-18
CN109040654B true CN109040654B (en) 2021-03-30

Family

ID=64626456

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810951669.7A Active CN109040654B (en) 2018-08-21 2018-08-21 Method and device for identifying external shooting equipment and storage medium

Country Status (1)

Country Link
CN (1) CN109040654B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111723615B (en) * 2019-03-20 2023-08-08 杭州海康威视数字技术股份有限公司 Method and device for judging matching of detected objects in detected object image
CN110533889B (en) * 2019-08-30 2021-08-13 中国电子科技网络信息安全有限公司 Sensitive area electronic equipment monitoring and positioning device and method
CN112672057B (en) * 2020-12-25 2022-07-15 维沃移动通信有限公司 Shooting method and device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004191083A (en) * 2002-12-09 2004-07-08 Mitsubishi Electric Corp Person detection device
US8306265B2 (en) * 2009-01-12 2012-11-06 Eastman Kodak Company Detection of animate or inanimate objects
CN104933392A (en) * 2014-03-19 2015-09-23 通用汽车环球科技运作有限责任公司 Probabilistic people tracking using multi-view integration

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6771349B2 (en) * 2000-09-27 2004-08-03 David H. Sitrick Anti-piracy protection system and methodology
US6742901B2 (en) * 2001-05-16 2004-06-01 Sony Corporation Imaging prevention method and system
GB0211612D0 (en) * 2002-05-21 2002-07-03 Eastman Kodak Co A method and system for the prevention of copyright piracy
GB2400514B (en) * 2003-04-11 2006-07-26 Hewlett Packard Development Co Image capture method
JP4196337B2 (en) * 2003-07-28 2008-12-17 日本ビクター株式会社 Video camera anti-voyeurism prevention system
US20050232580A1 (en) * 2004-03-11 2005-10-20 Interdigital Technology Corporation Control of device operation within an area
US20070013778A1 (en) * 2005-07-01 2007-01-18 Peter Will Movie antipirating
US20070103552A1 (en) * 2005-11-10 2007-05-10 Georgia Tech Research Corporation Systems and methods for disabling recording features of cameras
JP4963875B2 (en) * 2006-05-31 2012-06-27 セコム株式会社 Peeping detection device and peeping detection system
JP5031284B2 (en) * 2006-07-14 2012-09-19 綜合警備保障株式会社 Voyeur camera detection device, voyeur camera detection system, and voyeur camera detection method
JP4941286B2 (en) * 2007-02-28 2012-05-30 株式会社Jvcケンウッド Imaging device and playback device
JP5040440B2 (en) * 2007-05-23 2012-10-03 ソニー株式会社 Imaging prevention apparatus and imaging prevention method
CN102204238B (en) * 2008-09-02 2014-03-26 瑞士联邦理工大学,洛桑(Epfl) Image annotation on portable devices
US20120293606A1 (en) * 2011-05-20 2012-11-22 Microsoft Corporation Techniques and system for automatic video conference camera feed selection based on room events
US20130192451A1 (en) * 2011-06-20 2013-08-01 Steven Gregory Scott Anti-sniper targeting and detection system
US20140250447A1 (en) * 2013-03-04 2014-09-04 United Video Properties, Inc. Systems and methods for providing a private viewing experience
JPWO2015170409A1 (en) * 2014-05-09 2017-04-20 日立マクセル株式会社 Imaging apparatus and imaging system
EP2981063B1 (en) * 2014-07-31 2020-03-04 Samsung Electronics Co., Ltd Method of modifying image including photographing restricted element, and device for performing the method
CN107547831A (en) * 2016-06-27 2018-01-05 张兰 High in the clouds high-definition image processing platform
CN106101622A (en) * 2016-06-27 2016-11-09 秦艳 A kind of big data-storage system
CN107547844A (en) * 2016-06-27 2018-01-05 秦艳 A kind of big data storage system
CN107146252A (en) * 2017-04-28 2017-09-08 深圳齐心集团股份有限公司 A kind of big data image processing apparatus
CN107911551B (en) * 2017-11-16 2018-08-14 广州汇图计算机信息技术有限公司 Intelligent mobile phone platform based on action recognition
CN108234741A (en) * 2017-11-16 2018-06-29 吴英 Intelligent mobile phone control method based on action recognition
CN108226953B (en) * 2017-12-19 2020-08-11 中国人民解放军战略支援部队航天工程大学 Pinhole camera detection method and device based on double-beam alternate emission
CN108182396B (en) * 2017-12-25 2022-06-28 中国电子科技集团公司电子科学研究院 Method and device for automatically identifying photographing behavior
CN110287862B (en) * 2019-06-21 2021-04-06 西安电子科技大学 Anti-candid detection method based on deep learning
CN111523384A (en) * 2020-03-19 2020-08-11 浙江省北大信息技术高等研究院 Vision-based conference anti-candid method and device, storage medium and terminal

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004191083A (en) * 2002-12-09 2004-07-08 Mitsubishi Electric Corp Person detection device
US8306265B2 (en) * 2009-01-12 2012-11-06 Eastman Kodak Company Detection of animate or inanimate objects
CN104933392A (en) * 2014-03-19 2015-09-23 通用汽车环球科技运作有限责任公司 Probabilistic people tracking using multi-view integration

Also Published As

Publication number Publication date
CN109040654A (en) 2018-12-18

Similar Documents

Publication Publication Date Title
JP6401865B2 (en) Photo sharing method, apparatus, program, and recording medium
EP3236414B1 (en) Securing image data detected by an electronic device
WO2018173792A1 (en) Control device, control method, program, and electronic apparatus system
CN109120863B (en) Shooting method, shooting device, storage medium and mobile terminal
CN109040654B (en) Method and device for identifying external shooting equipment and storage medium
US20150244916A1 (en) Electronic device and control method of the same
WO2021036991A1 (en) High dynamic range video generation method and device
CN105554372B (en) Shooting method and device
CN111523384A (en) Vision-based conference anti-candid method and device, storage medium and terminal
US10728510B2 (en) Dynamic chroma key for video background replacement
CN108495032B (en) Image processing method, image processing device, storage medium and electronic equipment
CN102792672A (en) Electronic apparatus, imaging device, image reproduction method, image reproduction program, recording medium that has recorded image reproduction program, and image reproduction device
CN104796610A (en) Mobile terminal and camera sharing method, device and system thereof
CN106060391B (en) Processing method and device for working mode of camera and electronic equipment
US11102401B2 (en) Image device corresponding to depth information/panoramic image and related image system thereof
CN108769738A (en) Method for processing video frequency, device, computer equipment and storage medium
US20150036020A1 (en) Method for sharing original photos along with final processed image
CN109145878B (en) Image extraction method and device
CN108600644B (en) Photographing method and device and wearable device
JP2010092092A (en) Image processing apparatus and image processing method
CN105306797B (en) A kind of user terminal and image capturing method
CN107292261B (en) Photographing method and mobile terminal thereof
US10051192B1 (en) System and apparatus for adjusting luminance levels of multiple channels of panoramic video signals
US10148874B1 (en) Method and system for generating panoramic photographs and videos
CN114429484A (en) Image processing method and device, intelligent equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant