CN110502974A - A kind of methods of exhibiting of video image, device, equipment and readable storage medium storing program for executing - Google Patents
A kind of methods of exhibiting of video image, device, equipment and readable storage medium storing program for executing Download PDFInfo
- Publication number
- CN110502974A CN110502974A CN201910605252.XA CN201910605252A CN110502974A CN 110502974 A CN110502974 A CN 110502974A CN 201910605252 A CN201910605252 A CN 201910605252A CN 110502974 A CN110502974 A CN 110502974A
- Authority
- CN
- China
- Prior art keywords
- video image
- target video
- private
- characteristic value
- scene
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 230000001747 exhibiting effect Effects 0.000 title abstract 2
- 238000012545 processing Methods 0.000 claims abstract description 85
- 201000011243 gastrointestinal stromal tumor Diseases 0.000 claims description 21
- 238000004590 computer program Methods 0.000 claims description 9
- 230000004927 fusion Effects 0.000 claims description 9
- 230000001960 triggered effect Effects 0.000 claims description 7
- 238000013528 artificial neural network Methods 0.000 claims description 5
- 238000004422 calculation algorithm Methods 0.000 claims description 5
- 238000013145 classification model Methods 0.000 claims description 5
- 238000012549 training Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 15
- 230000005540 biological transmission Effects 0.000 description 9
- 238000004364 calculation method Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 7
- 238000004891 communication Methods 0.000 description 6
- 241001270131 Agaricus moelleri Species 0.000 description 4
- 230000002093 peripheral effect Effects 0.000 description 4
- 239000013598 vector Substances 0.000 description 4
- 238000010606 normalization Methods 0.000 description 3
- 239000000835 fiber Substances 0.000 description 2
- 230000014509 gene expression Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000001902 propagating effect Effects 0.000 description 2
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 229910052802 copper Inorganic materials 0.000 description 1
- 239000010949 copper Substances 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012706 support-vector machine Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/77—Retouching; Inpainting; Scratch removal
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- Image Processing (AREA)
Abstract
The present invention provides a kind of methods of exhibiting of video image, device, computer equipment and computer readable storage medium, which includes: to obtain the target video image comprising current scene locating for user；According to target video image determine user locating for current scene whether be secret scene；In the case where current scene is secret scene, privacy processing is carried out to target video image, the video image that obtains that treated；Show treated video image.In this way, can protect the privacy of user, other participants of video calling either video conference is avoided to see secret object present in itself local environment or current scene.
Description
Technical Field
The present invention relates to the field of displaying video images, and more particularly, to a method and apparatus for displaying video images, a computer device, and a computer-readable storage medium.
Background
An audio/video conference system refers to a system device for simultaneously carrying out conferences by transmitting audio, video and file data among individuals or groups in two or more different places through a transmission line and multimedia devices to realize real-time and interactive communication. The use of a video conference is somewhat like a telephone, and in addition to seeing people talking to you and making language communication, also can see their expressions and actions, so that people in different places can communicate as if they were in the same room.
The audio and video conference system comprises a software audio and video conference system and a hardware audio and video conference system, and transmits sound, images and file data to each other, so as to achieve real-time and interactive communication and complete the conference purpose.
For video-call systems in particular scenarios, such as in security authentication, or in scenarios where confidential financial credit accepted transactions are being negotiated, the user may not want to see the background in the video.
Disclosure of Invention
It is an object of the present invention to provide a new solution for presenting video images.
According to a first aspect of the present invention, there is provided a method for displaying a video image, comprising:
step S110, acquiring a target video image containing a current scene where a user is located;
step S120, determining whether the current scene where the user is located is a private scene or not according to the target video image;
step S130, under the condition that the current scene is a private scene, carrying out privacy processing on the target video image to obtain a processed video image;
step S140, displaying the processed video image.
Optionally, step S110 further includes:
responding to an externally triggered video acquisition request, and starting a camera to acquire a video image;
and taking at least one frame in the acquired video image as the target video image.
Optionally, step S120 further includes:
inputting the target video image into an object recognition model obtained by utilizing deep neural network training in advance, and detecting an object contained in the target video image;
judging whether the object is a preset private object, if so, then:
and judging the current scene as a private scene.
Optionally, step S120 further includes:
acquiring a GIST characteristic value, an LBP characteristic value and an HSV characteristic value of the target video image;
normalizing the GIST characteristic value, the LBP characteristic value and the HSV characteristic value;
fusing the normalized GIST characteristic value, LBP characteristic value and HSV characteristic value to obtain a fused characteristic value;
bringing the fusion characteristic value into a pre-stored classification model, and outputting the type of the current scene;
determining whether the current scene is a private scene.
Optionally, the manner of performing privacy processing on the background of the target video image includes any one or more of the following:
replacing the background with a preset reference image;
carrying out fuzzy processing or removing processing on the background in the target video image;
and carrying out fuzzy processing or removing processing on a private object contained in the target video image.
Optionally, the method of performing privacy processing on the background of the target video image includes performing fuzzy processing on a private object included in the video image;
the step S130 further includes:
extracting a private object contained in the target video image;
determining the position of the private object in the target video image as a private position area;
and carrying out fuzzy processing on the private position area according to a preset fuzzy processing algorithm to obtain the processed video image.
According to a second aspect of the present invention, there is provided a video image presentation apparatus comprising:
the image acquisition module is used for acquiring a target video image containing a current scene where a user is located;
the privacy determining module is used for determining whether the current scene where the user is located is a private scene or not according to the target video image;
the privacy processing module is used for carrying out privacy processing on the target video image under the condition that the current scene is a private scene to obtain a processed video image;
and the image display module is used for displaying the processed video image.
Optionally, the image obtaining module is further configured to:
responding to an externally triggered video acquisition request, and starting a camera to acquire a video image;
and taking the acquired at least one frame of image as the target video image containing the current scene where the user is located.
Optionally, the privacy determining module is further configured to:
inputting the target video image into an object recognition model obtained by utilizing deep neural network training in advance, and detecting an object contained in the target video image;
judging whether the object is a preset private object, if so, then:
and judging the current scene as a private scene.
Optionally, the privacy determining module is further configured to:
acquiring a GIST characteristic value, an LBP characteristic value and an HSV characteristic value of the target video image;
normalizing the GIST characteristic value, the LBP characteristic value and the HSV characteristic value;
fusing the normalized GIST characteristic value, LBP characteristic value and HSV characteristic value to obtain a fused characteristic value;
bringing the fusion characteristic value into a pre-stored classification model, and outputting the type of the current scene;
determining whether the current scene is a private scene.
Optionally, the manner of performing privacy processing on the background of the target video image includes any one or more of the following:
replacing the background with a preset reference image;
carrying out fuzzy processing or removing processing on the background in the target video image;
and carrying out fuzzy processing or removing processing on a private object contained in the target video image.
Optionally, the method of performing privacy processing on the background of the target video image includes performing fuzzy processing on a private object included in the video image;
the privacy processing module is further configured to:
extracting a private object contained in the target video image;
determining the position of the private object in the target video image as a private position area;
and carrying out fuzzy processing on the private position area according to a preset fuzzy processing algorithm to obtain the processed video image.
According to a third aspect of the present invention, there is provided a computer device comprising:
a display device according to the second aspect of the invention; or,
a memory and a processor, the memory having stored therein computer readable instructions which, when executed by the processor, cause the processor to perform the steps of the presentation method according to the first aspect of the invention.
According to a fourth aspect of the present invention, there is provided a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the presentation method of the first aspect of the present invention.
The method has the advantages that the privacy of the user can be protected, and the situation that other participants of a video call or a video conference see the environment where the participants are located or a privacy object existing in the current scene can be avoided. Moreover, the background of the target video image can be beautified, and the aesthetic feeling of the video picture is improved. In addition, in the case of limited transmission rate bandwidth, only important part can be transmitted, and background information is ignored to reduce occupied bandwidth.
Other features of the present invention and advantages thereof will become apparent from the following detailed description of exemplary embodiments thereof, which proceeds with reference to the accompanying drawings.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description, serve to explain the principles of the invention.
Fig. 1 is a block diagram showing an example of a hardware configuration of an electronic apparatus that can be used to implement an embodiment of the present invention.
Fig. 2 shows a flowchart of one example of a method for presenting a video image according to an embodiment of the present invention.
Fig. 3 shows a flowchart of one example of a presentation method of a video image according to an embodiment of the present invention.
Fig. 4 shows a flowchart of one example of a presentation method of a video image according to an embodiment of the present invention.
Fig. 5 shows a block schematic diagram of one example of a presentation method of a video image of an embodiment of the present invention.
Fig. 6 shows a block schematic diagram of an example of a presentation apparatus of video images of an embodiment of the invention.
FIG. 7 shows a block schematic diagram of one example of an electronic device of an embodiment of the invention.
Detailed Description
Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, the numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present invention unless specifically stated otherwise.
The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.
Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.
In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.
< hardware configuration >
As shown in fig. 1, the electronic device 1000 may be, for example, a computer. In another example, the electronic device 1000 may be as shown in fig. 1, including a processor 1010, a memory 1020, an interface device 1030, a communication device 1040, a display device 1050, an input device 1060, a speaker 1070, a microphone 1080, and so forth. The processor 1010 may be, for example, a central processing unit CPU, a microprocessor MCU, or the like. The memory 1020 includes, for example, a ROM (read only memory), a RAM (random access memory), a nonvolatile memory such as a hard disk, and the like. The interface device 1030 includes, for example, a USB interface, a serial interface, and the like. The communication device 1040 can perform wired or wireless communication, for example. The display device 1050 is, for example, a liquid crystal display panel. The input device 1060 may include, for example, a touch screen, a keyboard, and the like.
The electronic device 1000 shown in fig. 1 is merely illustrative and is in no way intended to limit the present invention, its application, or uses.
In an embodiment of the present invention, the memory 1020 of the electronic device 1000 is configured to store instructions for controlling the processor 1010 to operate so as to execute any one of the video image displaying methods provided by the embodiment of the present invention.
It should be understood by those skilled in the art that although a plurality of devices are shown in fig. 1 for the electronic apparatus 1000, the present invention may only relate to some of the devices, for example, the electronic apparatus 1000 only relates to the processor 1010 and the storage 1020, etc. The skilled person can design the instructions according to the disclosed solution. How the instructions control the operation of the processor is well known in the art and will not be described in detail herein.
The general concept of the embodiment of the invention is to provide a technical scheme for displaying video images, and the technical scheme is that a target video image containing a current scene where a user is located is obtained, and under the condition that the current scene is determined to be a private scene according to the target video image, the target video image is subjected to private processing, and the processed video image is obtained for displaying, so that the privacy of the user can be protected, and the situation that other participants of a video call or a video conference see the environment where the user is located or a private object existing in the current scene is avoided. Moreover, the background of the target video image can be beautified, and the aesthetic feeling of the video picture is improved. In addition, in the case of limited transmission rate bandwidth, only important part can be transmitted, and background information is ignored to reduce occupied bandwidth.
< method >
In this embodiment, a method for displaying a video image is provided, which is implemented by an electronic device.
The electronic device may be any electronic product having a processor and a memory, and may be, for example, a desktop computer, a notebook computer, a mobile phone, a tablet computer, and the like. In one example, the electronic device may be the electronic device 1000 shown in FIG. 1. Specifically, the electronic device of this embodiment may be a video image sending device in an audio/video conference system.
The method for displaying the video image, as shown in fig. 2, includes: steps S110-S140.
Step S110, a target video image containing the current scene where the user is located is obtained.
In one embodiment, the step S110 may further include:
and step S111, responding to an externally triggered video acquisition request, and starting a camera to acquire a video image.
The video capture request may be triggered when a user opens a video call or a video conference. The camera collects video images according to a set collection frequency in the whole video call or video conference process.
And step S112, taking at least one frame in the collected video image as a target video image.
Specifically, each collected frame of video image may be used as a target video image; the first frame in the collected video image can be used as a target video image; or taking a key frame in the collected video image as a target video image; or selecting one frame of image from the video images as the target video image according to the set sampling frequency.
In one embodiment, the display method of the present invention is executed according to a set period when a camera is turned on to capture a video image.
And step S120, determining whether the current scene where the user is located is a private scene or not according to the target video image.
The private scene may be a preset scene type.
In one embodiment, the step S120 may further include steps S121 a-S123 a as shown in FIG. 3:
in step S121a, the target video image is input to an object recognition model trained in advance using a deep neural network, and an object included in the target video image is detected.
By the object recognition model, the object included in the input target video image can be recognized.
The object in this embodiment may be a specific real object, and may include, for example, an office table, a computer, an office doorplate, a dining table, a sofa, a bed, a wardrobe, a building, and the like, and may also be a number, an icon, and the like.
Step S122a, judging whether the object is a preset private object, if so, executing step S123 a; and if not, not performing privacy processing on the target video image.
In step S123a, it is determined that the current scene is a private scene.
For example, in the case where the private object includes a desk, if the desk is included in the target video image, it may be determined that the current scene where the user is located is a private scene.
For another example, the private object may be an arbitrary number, a setting icon, or the like. Then, if the number "123" is included in the target video image, it can be determined that the current scene where the user is located is a private scene.
In another embodiment, the step S120 may further include steps S121b to S125b as shown in fig. 4:
step S121b, obtain the GIST, LBP, and HSV feature values of the target video image.
GIST features are a bio-heuristic feature that itself simulates the bio-visual system. GIST features are shape information obtained after filtering an image through a multi-scale multi-directional GABOR filter bank. The GABOR filter bank is widely used in image processing, and the main purpose is to extract contour details of different scales and different directions of an image. For example, the number of dimensions may be 5, and the number of directions may be 8.
And sequentially convolving the target video image with the 40 GABOR kernels to obtain 40 processed images. Specifically, the target video image may be converted into a frequency domain, and after the frequency domain is multiplied by the GABOR kernel in sequence, the result may be converted back into a time domain to obtain the contour information.
Dividing each processed image into b × b small blocks, and calculating the gray average value of each small block to obtain 40 × b gray average values, wherein a vector formed by 40 × b energy values is a GIST characteristic value with dimension of 40 × b; wherein b has a value of 3 or 4.
The method for extracting the LBP characteristic value of the image comprises the following steps:
setting a calculation window of 3 pixels and 3 pixels;
adding a calculation window to a target video image, comparing whether pixel values of peripheral points of the calculation window are larger than a pixel value of a central point, if so, setting pixel points of the peripheral points to be 1, otherwise, setting the pixel values to be 0, sequentially arranging the pixel values of 8 peripheral points to obtain an 8-bit unsigned binary number, and taking the unsigned binary number as a new pixel value of the central point. The order of taking the pixel values of 8 surrounding points can be clockwise by taking the point at the upper left corner of the calculation window as a starting point, or clockwise or anticlockwise by taking other surrounding points as starting points, but no matter what order is taken for value combination to obtain 8-bit binary numbers, the value taking order in each calculation window traversing the whole target video image is only required to be consistent.
And traversing the whole target video image by using the calculation window to obtain a new pixel value of each non-edge pixel point in the target video image, and setting the new pixel value of each edge pixel point to a certain value, for example, to 0, so as to obtain the image after LBP (local binary pattern) processing. The edge pixel points refer to pixel points on four edges of the image, and the non-edge pixel points refer to pixel points in the image except the pixel points on the four edges.
Dividing the target video image subjected to LBP processing into c × c small blocks, and respectively calculating a gray level histogram of each small block, wherein the gray level in the gray level histogram is represented by 64 orders, so that the number of pixel points distributed on 64 gray levels in each small block is obtained; and sequentially arranging the pixel points distributed on the 64 gray scales of the c x c small blocks to finally obtain the LBP characteristic value of c x 64 dimensions, wherein the value of c is 2 or 3. The invention does not adopt the traditional global histogram but extracts the local area histogram of 4 x 4 of the LBP image, and in order to accelerate the calculation, does not adopt 256 gray scales, and adopts 64 gray scales.
The method for extracting the HSV characteristic value of the image comprises the following steps:
and calculating H, S, V value of each pixel point according to R, G, B value of each pixel point of the image.
Dividing the image into e × e small blocks, and respectively calculating a color histogram of each small block, wherein colors in the color histogram are represented by 90 levels, so that the number of pixel points distributed on 90 color levels in each small block is obtained; and sequentially arranging the pixel points distributed on the e × e small blocks of 90 gray scales to finally obtain the HSV characteristic value of e × 90 dimensions. Wherein e has a value of 2 or 3.
Step S122b, normalize the GIST characteristic value, the LBP characteristic value, and the HSV characteristic value.
Normalizing each eigenvalue, taking distance normalization of GIST eigenvalue as an example, obtaining a GIST eigenvalue vector containing 40 × 4 — 640 elements by the method, and letting (a) be1，a2，a3，…，a640)，The normalized GIST eigenvalue vector is (a)1/SG，a2/SG，a3/SG，…，a640/SG,). After normalization, each element in the three eigenvalue vectors is within the same certain numerical range, for example, the normalized eigenvalue elements are all between 0 and 1, so as to facilitate subsequent fusion.
And S123b, fusing the normalized GIST characteristic value, LBP characteristic value and HSV characteristic value to obtain a fusion characteristic value.
And arranging the three feature values of the same image after normalization according to a certain sequence to obtain a fusion feature. If the normalized GSIT characteristic value of a certain image is (a)1/SG，a2/SG，a3/SG，…，a640/SG) Normalized LBP characteristic value is (b)1/SL，b2/SL，b3/SL，…，b256/SL) The normalized HSV characteristic value is (c)1/SH，c2/SH，c3/SH，…，c360/SH) Wherein the fusion characteristic value is (a)1/SG，a2/SG，a3/SG，…，a640/SG，b1/SL，b2/SL，b3/SL，…，b256/SL，c1/SH，c2/SH，c3/SH，…，c360/SH)。
And step S124b, substituting the fusion characteristic value into a pre-stored classification model, and outputting the type of the current scene.
In a preferred embodiment of the present invention, the classifier is an SVM classifier (support vector machine). The method is a two-class classifier, a basic model of the two-class classifier is defined as a linear classifier with the maximum positive asking in a feature space, the learning idea is the positive asking maximization, and the method can be finally converted into the solution of a convex quadratic programming problem.
Step S125b, it is determined whether the current scene is a private scene.
Specifically, the scene type corresponding to the private scene may be stored in advance. Then, in the case that the scene type corresponding to the private scene includes the type of the current scene, it may be determined that the current scene is the private scene.
The privacy scenario in embodiments of the present invention may be, for example, but not limited to, a secure authentication scenario, or a scenario of a trade in which a confidential financial credit is negotiated.
And step S130, carrying out privacy processing on the target video image under the condition that the current scene is a private scene to obtain a processed video image.
In an embodiment of the present invention, the way of privacy processing the background of the target video image includes any one or more of the following:
replacing the background with a preset reference image;
carrying out fuzzy processing or removing processing on the background in the target video image;
and carrying out fuzzy processing or removing processing on the private objects contained in the target video image.
In the embodiment where the way of performing the privacy processing on the background of the target video image includes performing the blurring processing on the private object included in the target video image, the step S130 may further include steps S131 to S133 shown in fig. 5:
step S131, a private object included in the target video image is extracted.
Step S132, determining the position of the private object in the target video image as a private position area.
And step S133, performing fuzzy processing on the private position area according to a preset fuzzy processing algorithm to obtain a processed video image.
The way of blurring the private location area may include: and (3) printing a mosaic on the private position or adding a specific pattern such as a filled color block to cover the private object contained in the target video image, so that the aim of performing fuzzy processing on the private object contained in the target video image is fulfilled. And after the fuzzy processing is carried out on the private object contained in the target video image, a processed video image is obtained.
In the embodiment that the manner of performing privacy processing on the background of the target video image includes performing blurring processing on the background in the target video image, the specific manner of performing blurring processing on the background in the target video image may refer to the foregoing manner of performing blurring processing on a private object included in the target video image, and details are not repeated here.
In an embodiment where the manner of performing privacy processing on the background of the target video image includes removing a private object included in the target video image, the specific steps may include: extracting a private object contained in a target video image; determining the position of a private object in a target video image as a private position area; and removing the private position area in the target image to obtain a processed video image.
In an embodiment that the manner of performing the privacy processing on the background of the target video image includes performing removal processing on the background in the target video image, the specific manner of performing the removal processing on the background in the target video image may refer to the foregoing manner of performing removal processing on the private object included in the target video image, and details are not described here again.
In an embodiment where the way of privacy processing the background of the target video image includes replacing the background with a preset reference image, specifically, the way may be to perform privacy processing on the background of the target video image
Step S140, displaying the processed video image.
Specifically, the processed video image may be displayed on the electronic device executing the embodiment of the present invention, or the electronic device executing the embodiment of the present invention may send the processed video image to another electronic device participating in a video call or a video conference for displaying.
In the embodiment of the invention, the target video image containing the current scene of the user is obtained, and under the condition that the current scene is determined to be the private scene according to the target video image, the target video image is subjected to private processing to obtain the processed video image for displaying, so that the privacy of the user can be protected, and the situation that other participants of a video call or a video conference see the environment of the user or a private object existing in the current scene is avoided. Moreover, the background of the target video image can be beautified, and the aesthetic feeling of the video picture is improved. In addition, in the case of limited transmission rate bandwidth, only important part can be transmitted, and background information is ignored to reduce occupied bandwidth.
< apparatus >
In the present embodiment, a video image presentation apparatus 600 corresponding to the above method is provided.
Fig. 6 is a block diagram illustrating an implementation structure of a video image display apparatus 600 according to the present invention. As shown in fig. 6, the apparatus 600 for presenting video images includes an image obtaining module 610, a privacy determining module 620, a privacy processing module 630 and an image presenting module 640. The image obtaining module 610 is configured to obtain a target video image including a current scene where a user is located; the privacy determining module 620 is configured to determine whether a current scene where the user is located is a private scene according to the target video image; the privacy processing module 630 is configured to, when the current scene is a private scene, perform privacy processing on the target video image to obtain a processed video image; the image display module 640 is used for displaying the processed video image.
In one embodiment, the image acquisition module 610 may be further configured to:
responding to an externally triggered video acquisition request, and starting a camera to acquire a video image;
and taking the acquired at least one frame of image as a target video image containing the current scene where the user is located.
In one embodiment, the privacy determination module 620 may be further configured to:
inputting a target video image into an object recognition model obtained by utilizing deep neural network training in advance, and detecting an object contained in the target video image;
judging whether the object is a preset private object, if so, then:
and judging the current scene as a private scene.
In another embodiment, the privacy determination module 620 may be further configured to:
acquiring a GIST characteristic value, an LBP characteristic value and an HSV characteristic value of a target video image;
normalizing the GIST characteristic value, the LBP characteristic value and the HSV characteristic value;
fusing the normalized GIST characteristic value, LBP characteristic value and HSV characteristic value to obtain a fused characteristic value;
the fusion characteristic value is brought into a pre-stored classification model, and the type of the current scene is output;
it is determined whether the current scene is a private scene.
In one embodiment, the way of privacy processing the background of the target video image comprises any one or more of the following:
replacing the background with a preset reference image;
carrying out fuzzy processing or removing processing on the background in the target video image;
and carrying out fuzzy processing or removing processing on the private objects contained in the target video image.
In an embodiment where the way of performing privacy processing on the background of the target video image includes performing blur processing on a private object included in the video image, the privacy processing module 630 may be further configured to:
extracting a private object contained in a target video image;
determining the position of a private object in a target video image as a private position area;
and carrying out fuzzy processing on the private position area according to a preset fuzzy processing algorithm to obtain a processed video image.
It will be appreciated by those skilled in the art that the presentation apparatus 600 of video images may be implemented in various ways. For example, presentation device 600 of video images may be implemented by an instruction configuration processor. For example, instructions may be stored in ROM and read from ROM into a programmable device when the device is started to implement presentation apparatus 600 of video images. For example, the video image presentation apparatus 600 may be cured into a dedicated device (e.g., ASIC). The presentation apparatus 600 of video images may be divided into units independent of each other or may be implemented by combining them together. The presentation apparatus 600 of video images may be implemented by one of the various implementations described above, or may be implemented by a combination of two or more of the various implementations described above.
In this embodiment, the video image display apparatus 600 may have various implementation forms, for example, the video image display apparatus 600 may be any functional module running in a software product or an application providing a connection service, or a peripheral insert, a plug-in, a patch, etc. of the software product or the application, and may also be the software product or the application itself.
< electronic apparatus >
The invention also provides the electronic equipment. In one aspect, the electronic device may include the aforementioned video image presentation apparatus 600.
On the other hand, the electronic device may further include a processor 710 and a memory 720 as shown in fig. 7, where the memory 720 stores computer-readable instructions, and the computer-readable instructions, when executed by the processor 710, cause the processor 710 to perform the steps of the method for displaying a video image described in this embodiment.
According to the electronic equipment provided by the embodiment of the invention, the target video image containing the current scene where the user is located is obtained, and under the condition that the current scene is determined to be the private scene according to the target video image, the target video image is subjected to privacy processing to obtain the processed video image for displaying, so that the privacy of the user can be protected, and the situation that other participants of a video call or a video conference see the environment where the user is located or a private object existing in the current scene is avoided. Moreover, the background of the target video image can be beautified, and the aesthetic feeling of the video picture is improved. In addition, in the case of limited transmission rate bandwidth, only important part can be transmitted, and background information is ignored to reduce occupied bandwidth.
< computer-readable Medium >
In the present embodiment, a computer-readable storage medium is provided, on which a computer program is stored, which, when being executed by a processor, implements the steps of the method for presenting video images described in the present embodiment.
The present invention may be a system, method and/or computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied therewith for causing a processor to implement various aspects of the present invention.
The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.
The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.
The computer program instructions for carrying out operations of the present invention may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, aspects of the present invention are implemented by personalizing an electronic circuit, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA), with state information of computer-readable program instructions, which can execute the computer-readable program instructions.
Aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.
These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, by software, and by a combination of software and hardware are equivalent.
Having described embodiments of the present invention, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen in order to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the invention is defined by the appended claims.
Claims (10)
1. A method for displaying a video image, comprising:
step S110, acquiring a target video image containing a current scene where a user is located;
step S120, determining whether the current scene where the user is located is a private scene or not according to the target video image;
step S130, under the condition that the current scene is a private scene, carrying out privacy processing on the target video image to obtain a processed video image;
step S140, displaying the processed video image.
2. The method as claimed in claim 1, wherein step S110 further comprises:
responding to an externally triggered video acquisition request, and starting a camera to acquire a video image;
and taking at least one frame in the acquired video image as the target video image.
3. The method as claimed in claim 1, wherein step S120 further comprises:
inputting the target video image into an object recognition model obtained by utilizing deep neural network training in advance, and detecting an object contained in the target video image;
judging whether the object is a preset private object, if so, then:
and judging the current scene as a private scene.
4. The method as claimed in claim 1, wherein step S120 further comprises:
acquiring a GIST characteristic value, an LBP characteristic value and an HSV characteristic value of the target video image;
normalizing the GIST characteristic value, the LBP characteristic value and the HSV characteristic value;
fusing the normalized GIST characteristic value, LBP characteristic value and HSV characteristic value to obtain a fused characteristic value;
bringing the fusion characteristic value into a pre-stored classification model, and outputting the type of the current scene;
determining whether the current scene is a private scene.
5. A presentation method according to claim 1, wherein the means for privacy processing the background of the target video image comprises any one or more of:
replacing the background with a preset reference image;
carrying out fuzzy processing or removing processing on the background in the target video image;
and carrying out fuzzy processing or removing processing on a private object contained in the target video image.
6. The exhibition method of claim 5, wherein the way of privacy processing the background of the target video image comprises blurring the private object contained in the video image;
the step S130 further includes:
extracting a private object contained in the target video image;
determining the position of the private object in the target video image as a private position area;
and carrying out fuzzy processing on the private position area according to a preset fuzzy processing algorithm to obtain the processed video image.
7. A video image presentation apparatus, comprising:
the image acquisition module is used for acquiring a target video image containing a current scene where a user is located;
the privacy determining module is used for determining whether the current scene where the user is located is a private scene or not according to the target video image;
the privacy processing module is used for carrying out privacy processing on the target video image under the condition that the current scene is a private scene to obtain a processed video image;
and the image display module is used for displaying the processed video image.
8. The display apparatus as claimed in claim 7, wherein the image acquisition module is further configured to:
responding to an externally triggered video acquisition request, and starting a camera to acquire a video image;
and taking the acquired at least one frame of image as the target video image containing the current scene where the user is located.
9. A computer device, comprising:
a display device according to claim 7 or 8; or,
a memory and a processor, the memory having stored therein computer readable instructions which, when executed by the processor, cause the processor to perform the steps of the presentation method according to any one of claims 1-6.
10. A computer-readable storage medium having stored thereon a computer program, characterized in that: the computer program realizing the steps of the presentation method as claimed in any one of claims 1-6 when executed by a processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910605252.XA CN110502974A (en) | 2019-07-05 | 2019-07-05 | A kind of methods of exhibiting of video image, device, equipment and readable storage medium storing program for executing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910605252.XA CN110502974A (en) | 2019-07-05 | 2019-07-05 | A kind of methods of exhibiting of video image, device, equipment and readable storage medium storing program for executing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110502974A true CN110502974A (en) | 2019-11-26 |
Family
ID=68585343
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910605252.XA Pending CN110502974A (en) | 2019-07-05 | 2019-07-05 | A kind of methods of exhibiting of video image, device, equipment and readable storage medium storing program for executing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110502974A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111601063A (en) * | 2020-04-29 | 2020-08-28 | 维沃移动通信有限公司 | Video processing method and electronic equipment |
| CN111885339A (en) * | 2020-07-01 | 2020-11-03 | 海尔优家智能科技（北京）有限公司 | Privacy processing method and device, computer-readable storage medium and electronic medium |
| CN112182648A (en) * | 2020-09-18 | 2021-01-05 | 支付宝(杭州)信息技术有限公司 | Privacy image and face privacy processing method, device and equipment |
| CN112312201A (en) * | 2020-04-09 | 2021-02-02 | 北京沃东天骏信息技术有限公司 | Method, system, device and storage medium for video transition |
| CN112689093A (en) * | 2020-12-24 | 2021-04-20 | 深圳创维－Rgb电子有限公司 | Intelligent device privacy protection method, intelligent device and storage medium |
| CN113473068A (en) * | 2021-07-14 | 2021-10-01 | 中国联合网络通信集团有限公司 | Conference access method, device, server and storage medium |
| CN114245058A (en) * | 2021-12-17 | 2022-03-25 | 黄冈师范学院 | Computer camera privacy protection method |
| CN115499703A (en) * | 2021-12-13 | 2022-12-20 | 中兴通讯股份有限公司 | Image processing method, device, equipment and storage medium |
| CN116915938A (en) * | 2023-09-11 | 2023-10-20 | 北京蓝耘科技股份有限公司 | Cloud computing method with high security |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140176663A1 (en) * | 2012-12-20 | 2014-06-26 | Microsoft Corporation | Privacy camera |
| CN107623817A (en) * | 2017-09-11 | 2018-01-23 | 广东欧珀移动通信有限公司 | video background processing method, device and mobile terminal |
| CN109274919A (en) * | 2017-07-18 | 2019-01-25 | 福州瑞芯微电子股份有限公司 | Method for secret protection, system, video call terminal and system in video calling |
-
2019
- 2019-07-05 CN CN201910605252.XA patent/CN110502974A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140176663A1 (en) * | 2012-12-20 | 2014-06-26 | Microsoft Corporation | Privacy camera |
| CN109274919A (en) * | 2017-07-18 | 2019-01-25 | 福州瑞芯微电子股份有限公司 | Method for secret protection, system, video call terminal and system in video calling |
| CN107623817A (en) * | 2017-09-11 | 2018-01-23 | 广东欧珀移动通信有限公司 | video background processing method, device and mobile terminal |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112312201A (en) * | 2020-04-09 | 2021-02-02 | 北京沃东天骏信息技术有限公司 | Method, system, device and storage medium for video transition |
| CN112312201B (en) * | 2020-04-09 | 2023-04-07 | 北京沃东天骏信息技术有限公司 | Method, system, device and storage medium for video transition |
| CN111601063B (en) * | 2020-04-29 | 2021-12-14 | 维沃移动通信有限公司 | Video processing method and electronic equipment |
| CN111601063A (en) * | 2020-04-29 | 2020-08-28 | 维沃移动通信有限公司 | Video processing method and electronic equipment |
| CN111885339A (en) * | 2020-07-01 | 2020-11-03 | 海尔优家智能科技（北京）有限公司 | Privacy processing method and device, computer-readable storage medium and electronic medium |
| CN112182648A (en) * | 2020-09-18 | 2021-01-05 | 支付宝(杭州)信息技术有限公司 | Privacy image and face privacy processing method, device and equipment |
| CN112689093A (en) * | 2020-12-24 | 2021-04-20 | 深圳创维－Rgb电子有限公司 | Intelligent device privacy protection method, intelligent device and storage medium |
| CN112689093B (en) * | 2020-12-24 | 2022-06-10 | 深圳创维－Rgb电子有限公司 | Intelligent device privacy protection method, intelligent device and storage medium |
| CN113473068A (en) * | 2021-07-14 | 2021-10-01 | 中国联合网络通信集团有限公司 | Conference access method, device, server and storage medium |
| CN115499703A (en) * | 2021-12-13 | 2022-12-20 | 中兴通讯股份有限公司 | Image processing method, device, equipment and storage medium |
| CN114245058A (en) * | 2021-12-17 | 2022-03-25 | 黄冈师范学院 | Computer camera privacy protection method |
| CN116915938A (en) * | 2023-09-11 | 2023-10-20 | 北京蓝耘科技股份有限公司 | Cloud computing method with high security |
| CN116915938B (en) * | 2023-09-11 | 2023-11-21 | 北京蓝耘科技股份有限公司 | Cloud computing method with high security |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110502974A (en) | A kind of methods of exhibiting of video image, device, equipment and readable storage medium storing program for executing | |
| CN109977847B (en) | Image generation method and device, electronic equipment and storage medium | |
| US10699103B2 (en) | Living body detecting method and apparatus, device and storage medium | |
| US10832069B2 (en) | Living body detection method, electronic device and computer readable medium | |
| CN106682632B (en) | Method and device for processing face image | |
| CN111814520A (en) | Skin type detection method, skin type grade classification method, and skin type detection device | |
| US11004179B2 (en) | Image blurring methods and apparatuses, storage media, and electronic devices | |
| CN109145970B (en) | Image-based question and answer processing method and device, electronic equipment and storage medium | |
| US11367310B2 (en) | Method and apparatus for identity verification, electronic device, computer program, and storage medium | |
| US12008167B2 (en) | Action recognition method and device for target object, and electronic apparatus | |
| CN111986076A (en) | Image processing method and device, interactive display device and electronic equipment | |
| CN111179159B (en) | Method and device for eliminating target image in video, electronic equipment and storage medium | |
| US10810462B2 (en) | Object detection with adaptive channel features | |
| US20200184098A1 (en) | Systems and Methods for Secure Obfuscation of Sensitive Information in Images | |
| CN113688729B (en) | Behavior recognition method and device, electronic equipment and storage medium | |
| CN112149732A (en) | Image protection method and device, electronic equipment and storage medium | |
| CN113111782A (en) | Video monitoring method and device based on salient object detection | |
| CN108470131B (en) | Method and device for generating prompt message | |
| CN112967180A (en) | Training method for generating countermeasure network, and image style conversion method and device | |
| CN113822798B (en) | Method and device for training generation countermeasure network, electronic equipment and storage medium | |
| Alelaiwi et al. | Steerable pyramid transform and local binary pattern based robust face recognition for e-health secured login | |
| CN111274447A (en) | Target expression generation method, device, medium and electronic equipment based on video | |
| CN113642359B (en) | Face image generation method and device, electronic equipment and storage medium | |
| CN112804245A (en) | Data transmission optimization method, device and system suitable for video transmission | |
| CN111062279B (en) | Photo processing method and photo processing device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |