CN116012237A

CN116012237A - Method and device for determining image shielding area, storage medium and electronic device

Info

Publication number: CN116012237A
Application number: CN202211608283.9A
Authority: CN
Inventors: 豆红雷; 王健彪; 杨斌
Original assignee: Hangzhou Huacheng Software Technology Co Ltd
Current assignee: Hangzhou Huacheng Software Technology Co Ltd
Priority date: 2022-12-14
Filing date: 2022-12-14
Publication date: 2023-04-25

Abstract

The application discloses a method and a device for determining an image shielding area, a storage medium and an electronic device, wherein the method comprises the following steps: acquiring a first shooting image shot by target shooting equipment on a target scene, and carrying out shielding treatment on a first image area in the first shooting image to obtain a first shielding image, wherein the first image area corresponds to a first scene area in the target scene; determining the number of objects of the target type currently staying in the first image area according to the first shooting image or the first shielding image to obtain a first target number; expanding the first image area as the shielding area to the second image area when the first target number is greater than or equal to a first preset threshold corresponding to the first image area; and carrying out shielding processing on a second image area in the second shooting image to obtain a second shielding image, wherein the second shooting image is obtained by shooting a target scene by the target shooting device after shooting to obtain the first shooting image.

Description

Method and device for determining image shielding area, storage medium and electronic device

Technical Field

The present invention relates to the field of image processing, and in particular, to a method and apparatus for determining an image occlusion area, a storage medium, and an electronic apparatus.

Background

Shooting devices such as cameras are widely used in many occasions such as on roads, in various public places, in home environments, etc. with visual, accurate and timely information acquisition and rich information content. Meanwhile, in order to shade some areas unsuitable for shooting, a shielding frame can be arranged on the shot image for shielding.

In the related art, a default shielding region is generally adopted to perform shielding processing on a shot image, related personnel check the shielding effect, the shielding region is adjusted based on the checking result, and the adjusted shielding region is used for performing shielding processing on a subsequent shot image. However, in the above-described method of manually determining the image occlusion region, manual operation is required for newly adding/modifying the occlusion region, and the manual operation is time-consuming and labor-consuming, which results in a problem of poor timeliness of adjustment of the occlusion region.

Disclosure of Invention

The embodiment of the application provides a method and a device for determining an image shielding area, a storage medium and an electronic device, and aims to at least solve the problem that timeliness of shielding area adjustment is poor due to time and labor consumption of manual operation in the method for determining the image shielding area in the related technology.

According to an aspect of an embodiment of the present application, there is provided a method for determining an image occlusion area, including: acquiring a first shooting image shot by target shooting equipment on a target scene, and carrying out shielding treatment on a first image area in the first shooting image to obtain a first shielding image, wherein the first image area corresponds to a first scene area in the target scene; determining the number of objects of the target type currently staying in the first image area according to the first shooting image or the first shielding image to obtain a first target number; expanding the first image area as an occlusion area to a second image area when the first target number is greater than or equal to a first preset threshold corresponding to the first image area; and carrying out shielding processing on the second image area in a second shooting image to obtain a second shielding image, wherein the second shooting image is a shooting image obtained by shooting the target scene by the target shooting device after shooting to obtain the first shooting image.

According to another aspect of the embodiments of the present application, there is also provided a device for determining an image occlusion area, including: the first execution unit is used for acquiring a first shooting image shot by target shooting equipment on a target scene, and carrying out shielding treatment on a first image area in the first shooting image to obtain a first shielding image, wherein the first image area corresponds to a first scene area in the target scene; the first determining unit is used for determining the number of the objects of the target type currently staying in the first image area according to the first shooting image or the first shielding image to obtain a first target number; a first enlarging unit configured to enlarge, when the first target number is greater than or equal to a first preset threshold corresponding to the first image area, the first image area as an occlusion area to a second image area; and the first shielding unit is used for shielding the second image area in a second shooting image to obtain a second shielding image, wherein the second shooting image is a shooting image obtained by shooting the target scene by the target shooting equipment after the first shooting image is obtained by shooting.

In an exemplary embodiment, the acquisition unit includes: the first determination unit includes: a first execution module configured to identify, in the first captured image, an object of the target type located in the first image area, and determine the number of identified objects of the target type located in the first image area as the first target number; or a second execution module, configured to identify, in the first captured image, the object of the target type entering the first image area, and determine the number of the identified objects of the target type entering the first image area as a first number; identifying objects of the target type that leave the first image area in the first captured image, and determining the number of the identified objects of the target type that leave the first image area as a second number; acquiring the number of objects of the target type which stay in the first scene area before the first shot image is shot, so as to acquire a third number; the first target number is determined to be equal to (the third number + the first number-the second number).

In one exemplary embodiment, the first execution module includes: a first determining sub-module for determining a first display area of the first object in the first image area in case that the first object of the target type is identified in the first photographed image; a second determining sub-module, configured to determine that the first object is located in the first image area if there is a partial overlap between the first display area and the first image area or the first display area is located inside the first image area.

In an exemplary embodiment, the first determining unit includes: a third execution module, configured to identify, in the first occlusion image, an object of the target type entering the first image area, and determine, as a first number, the number of identified objects of the target type entering the first image area; a fourth execution module for identifying objects of the target type leaving the first image area in the first occlusion image, determining the number of identified objects of the target type leaving the first image area as a second number; a first acquisition module, configured to acquire the number of objects of the target type that stay in the first scene area before the first captured image is captured, to obtain a third number; a determining module for determining the first target number to be equal to (the third number + the first number-the second number).

In one exemplary embodiment, the first expansion unit includes: and the first expansion module is used for expanding the first image area serving as the shielding area to the second image area, wherein the first image area is positioned inside the second image area, or part of edges of the first image area are overlapped with part of edges of the second image area.

In one exemplary embodiment, the first expansion unit includes: a second enlarging module for enlarging the first image area as an occlusion area to a first candidate image area; the second acquisition module is used for acquiring a first group of shooting images, wherein the first group of shooting images are a group of shooting images obtained by shooting the target scene by the target shooting equipment within a first preset time length after the first shooting images are obtained by shooting; a fifth execution module configured to identify, in each of the first set of captured images, an object of the target type that enters the first candidate image area, and determine a number of the identified objects of the target type that enter the first candidate image area as a fourth number; a sixth execution module configured to identify, in each of the first set of captured images, an object of the target type that leaves the first candidate image area, and determine a number of the identified objects of the target type that leave the first candidate image area as a fifth number; and the judging module is used for judging whether the first candidate image area is determined to be the second image area according to the fourth number and/or the fifth number.

In an exemplary embodiment, the determining module includes: a third determining submodule, configured to determine the first candidate image area as the second image area if the fourth number is less than or equal to a second preset threshold, where the second preset threshold is equal to 0, or equal to 1, or a positive integer greater than or equal to 2, or the second preset threshold is positively correlated with the first predetermined duration; or a fourth determining submodule, configured to determine the first candidate image area as the second image area if the fifth number is less than or equal to a third preset threshold, where the third preset threshold is equal to 0, or equal to 1, or a positive integer greater than or equal to 2, or the third preset threshold is positively correlated with the first predetermined duration; or a fifth determining submodule, configured to determine the first candidate image area as the second image area if the fourth number is less than or equal to the second preset threshold and the fifth number is less than or equal to the third preset threshold.

In an exemplary embodiment, the apparatus further comprises: a second enlarging unit configured to enlarge the first image area as a blocking area to a second candidate image area if it is determined that the first candidate image area is not determined as the second image area after determining whether to determine the first candidate image area as the second image area based on the fourth number and/or the fifth number; an acquisition unit configured to acquire a second group of captured images, where the second group of captured images is a group of captured images obtained by the target capturing device capturing the target scene within a second predetermined period of time after capturing the first captured image, and the second group of captured images is the same as or partially different from or completely different from the first group of captured images; a second execution unit configured to identify, in each of the second group of captured images, the object of the target type entering the second candidate image area, and determine the number of the identified objects of the target type entering the second candidate image area as a sixth number; a third execution unit configured to identify, in each of the second group of captured images, an object of the target type that leaves the second candidate image area, and determine the number of the identified objects of the target type that leaves the second candidate image area as a seventh number; and the judging unit is used for judging whether the second candidate image area is determined to be the second image area according to the sixth number and/or the seventh number.

In an exemplary embodiment, the apparatus further comprises: a second determining unit configured to determine, from the first captured image, a number of objects of the target type that move from the first image area to a third image area in the first captured image, resulting in a second target number; a third determining unit, configured to determine, when the second target number is greater than or equal to a fourth preset threshold corresponding to the third image area, the third image area as a newly added occlusion area; and the second shielding unit is used for shielding the third image area in a third shooting image to obtain a third shielding image, wherein the third shooting image is a shooting image obtained by shooting the target scene by the target shooting device after the first shooting image is obtained by shooting.

According to still another aspect of the embodiments of the present application, there is also provided a computer-readable storage medium having a computer program stored therein, wherein the computer program is configured to perform the above-described method of determining an image occlusion area when run.

According to still another aspect of the embodiments of the present application, there is further provided an electronic device including a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor executes the method for determining the image occlusion area by using the computer program.

In the embodiment of the application, a mode of automatically adjusting the area of an occlusion area based on the number of objects of a target type in a shot image is adopted, a first shot image shot by target shooting equipment on a target scene is obtained, occlusion processing is carried out on a first image area in the first shot image, and a first occlusion image is obtained, wherein the first image area corresponds to a first scene area in the target scene; determining the number of objects of the target type currently staying in the first image area according to the first shooting image or the first shielding image to obtain a first target number; expanding the first image area as the shielding area to the second image area when the first target number is greater than or equal to a first preset threshold corresponding to the first image area; and carrying out shielding treatment on a second image area in the second shot image to obtain a second shielding image, wherein the second shot image is a shot image obtained by shooting a target scene by target shooting equipment after shooting to obtain the first shot image, and when the number of objects of the target type currently remained in the shot image is recognized to reach the preset number, expanding the image area serving as the shielding area, and carrying out image shielding on the subsequent shot image by using the expanded image area.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required to be used in the description of the embodiments or the prior art will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.

FIG. 1 is a schematic diagram of a hardware environment of an alternative method of determining an image occlusion region according to an embodiment of the present application;

FIG. 2 is a flow chart of an alternative method of determining an image occlusion region according to an embodiment of the present application;

FIG. 3 is a schematic diagram of a hardware environment of another alternative method of determining an image occlusion region according to an embodiment of the present application;

FIG. 4 is a schematic diagram of an alternative method of determining an image occlusion region according to an embodiment of the present application;

FIG. 5 is a schematic illustration of another alternative method of determining an image occlusion region according to an embodiment of the present application;

FIG. 6 is a schematic diagram of yet another alternative method of determining an image occlusion region according to an embodiment of the present application;

FIG. 7 is a schematic illustration of yet another alternative method of determining an image occlusion region according to an embodiment of the present application;

FIG. 8 is a schematic diagram of yet another alternative method of determining an image occlusion region according to an embodiment of the present application;

FIG. 9 is a schematic diagram of yet another alternative method of determining an image occlusion region according to an embodiment of the present application;

FIG. 10 is a schematic illustration of yet another alternative method of determining an image occlusion region according to an embodiment of the present application;

FIG. 11 is a schematic illustration of yet another alternative method of determining an image occlusion region according to an embodiment of the present application;

FIG. 12 is a schematic illustration of yet another alternative method of determining an image occlusion region according to an embodiment of the present application;

FIG. 13 is a flow chart of another alternative method of determining an image occlusion region according to an embodiment of the present application;

FIG. 14 is a block diagram of an alternative image occlusion region determination device in accordance with an embodiment of the present application;

fig. 15 is a block diagram of an alternative electronic device according to an embodiment of the present application.

Detailed Description

In order to make the present application solution better understood by those skilled in the art, the following description will be made in detail and with reference to the accompanying drawings in the embodiments of the present application, it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, shall fall within the scope of the present application.

It should be noted that the terms "first," "second," and the like in the description and claims of the present application and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that embodiments of the present application described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

According to one aspect of the embodiments of the present application, a method for determining an image occlusion region is provided. Alternatively, in the present embodiment, the above-described method of determining the image occlusion area may be applied to a hardware environment including the photographing apparatus 102 and the server 104 as shown in fig. 1. As shown in fig. 1, the server 104 is connected to the photographing apparatus 102 through a network, and may be used to provide services (such as application services, etc.) to the photographing apparatus 102 or clients installed on the photographing apparatus, and a database may be provided on the server or independent of the server, for providing data storage services to the server 104.

The network may include, but is not limited to, at least one of: wired network, wireless network. The wired network may include, but is not limited to, at least one of: a wide area network, a metropolitan area network, a local area network, and the wireless network may include, but is not limited to, at least one of: WIFI (Wireless Fidelity ), bluetooth. The photographing apparatus 102 may not be limited to a camera or the like.

The method for determining the image occlusion area in the embodiment of the present application may be performed by the server 104, may be performed by the photographing device 102, or may be performed by both the server 104 and the photographing device 102. The method for determining the image occlusion area performed by the photographing apparatus 102 according to the embodiment of the present application may be performed by a client installed thereon.

Taking the example of the method for determining the image occlusion area in the present embodiment performed by the photographing apparatus 102, fig. 2 is a schematic flow diagram of an alternative method for determining the image occlusion area according to the embodiment of the present application, and as shown in fig. 2, the flow of the method may include the following steps:

step S202, a first shooting image obtained by shooting a target scene by target shooting equipment is obtained, and a first image area in the first shooting image is subjected to shielding processing to obtain a first shielding image, wherein the first image area corresponds to a first scene area in the target scene.

The method of determining the image blocking area in the present embodiment can be applied to a scene in which blocking processing is performed on an image area in a captured image captured by a capturing apparatus installed in a specified occasion. The designated occasion may be on a road, various public places, a home environment, or the like, the photographed image photographed by the photographing apparatus may be transferred to the server in real time after the shielding process is performed on the photographing apparatus, or the photographed image photographed by the photographing apparatus may be transferred to the server in real time, and the shielding process is performed on the photographing apparatus by the server.

The method for determining the image occlusion area in this embodiment may be applied to various networking environments, for example, as shown in fig. 3, the method may be suitable for displaying on a front-end management client device, for example, a WEB (World Wide WEB) client/man-machine client of NVR (Network Video Recorder )/VMS (Video Management Server, video management server), and also suitable for a mobile client to manage a device accessed to the cloud, where the mobile client may be a mobile phone APP (Application); nor to the camera's own clients, such as, for example, WEB clients, where IPC (Internet Protocol Camera) in fig. 3 is a webcam. Occlusion regions may be set for the camera on the client device or on the camera itself client.

During some video shots (e.g., security detection within a public area), the specified information is identified by a code masking process. Therefore, the worry of most people on personal information leakage can be reduced, and the daily public monitoring safety can be ensured. The information in the area can be protected by the area covering, and the information in the area is covered, which usually covers the actions, behaviors and the like of the movable objects in the area.

Taking a network camera as an example, currently, when the network camera performs area occlusion on a captured image, a user usually manually sets an occlusion frame in a screen of the captured image (may be a video image). As shown in fig. 4, PM1 is a set shadow frame, and by setting this shadow frame to black or white, mosaic or substitute picture in a live picture, the effect of region occlusion is achieved.

The manual arrangement of the occlusion area is as follows: receiving a video acquisition request, wherein the video acquisition request carries identity information of a video requester; acquiring shielding configuration about a video requester, performing first shielding on an original video based on the shielding configuration to obtain a first shielding video, and providing the first shielding video for the video requester; a view record is stored that includes a first occlusion video and identity information of a video requestor associated with the first occlusion video.

For the above image blocking mode, the user can only see his video information, while other objects are blocked. That is, the management user should know the rights processing configuration of each user, that is, what areas or targets are preset in the video to be viewed, and what can be viewed. At the same time, the user himself/herself is not looking at which people he/she is configuring, and is also aware of what is actually occluded. Therefore, the actual operation of manually setting and modifying the shielding area is very complicated, the user operation is not timely, and the newly added/modified shielding area is insufficient, if the newly added or modified shielding area is to be determined, the history record needs to be queried with time and labor consumption, and in addition, the shielding area is not timely.

In order to at least partially solve the above technical problems, in this embodiment, when it is identified that the number of objects of a target type currently remaining in a captured image reaches a preset number, an image area serving as a blocking area is enlarged, and the image area after the enlargement is used to perform image blocking on a subsequent captured image.

For a target shooting device (for example, a video camera) installed at a designated location, a first shooting image obtained by shooting a target scene (corresponding to the designated location) by the target shooting device may be acquired, and a first image area in the first shooting image is subjected to shielding processing to obtain a first shielding image, where the first image area corresponds to a first scene area in the target scene, and may be determined according to a preset area parameter of the shielding area, an object of a target type cannot be identified in the first image area in the first shielding image, and the first shielding image may be an image obtained by setting the first image area in the first shooting image to black or white, and setting the first image area in the first shooting image to mosaic or a substituted picture.

Here, the shielding region may be set in various manners, for example, may be set by at least two region vertex coordinates (for example, a lower left corner vertex coordinate and an upper right corner vertex coordinate, or an upper left corner vertex coordinate and a lower right corner vertex coordinate), and may be set by one region vertex coordinate (for example, a lower left corner vertex coordinate) and a region size (for example, a length and a width of a region), or may be set in other manners, which is not limited in this embodiment.

Step S204, determining the number of objects of the target type currently staying in the first image area according to the first shooting image or the first shielding image, and obtaining a first target number.

In order to determine whether the current occlusion region is set appropriately, the first captured image or the object of the object type within the first occlusion image may be detected, thereby determining the number of objects of the object type currently remaining in the first image region, resulting in a first object pair.

For example, the moving object entering the video picture (i.e., the photographed image) may be analyzed, and may not be limited to the analysis of the face, clothing, gait, etc., so that the target objects (i.e., the target type of objects) entering the occlusion area are counted, thereby obtaining the number of target objects (i.e., the target type of objects) entering the occlusion area.

In step S206, in the case where the first target number is greater than or equal to the first preset threshold corresponding to the first image area, the first image area as the occlusion area is enlarged to the second image area.

In order to facilitate the determination of whether the occlusion region needs to be modified, a corresponding threshold value of the number of occlusion regions needing to be enlarged can be set for the occlusion regions with different sizes in advance. And for the first image area, the threshold value of the number of the shielding areas which are corresponding to the first image area and need to be enlarged is a first preset threshold value. If the first target number is greater than or equal to a first preset threshold corresponding to the first image region, the first image region as the occlusion region may be enlarged to the second image region.

There are various ways of expanding the first image area to the second image area, for example, the area expansion operation may be performed on the first image area according to a preset area expansion parameter to obtain the second image area, for example, the area expansion operation may be performed on the first image area based on the object distribution of the object of the target type in the first captured image (for example, the object of the target type around the first image area) to obtain the second image area, or other area expansion ways may be adopted, which are not limited in this embodiment.

Optionally, a corresponding threshold value for the number of the shielding areas needing to be reduced may be set for shielding areas with different sizes in advance. And for the first image area, the threshold value of the quantity of the shielding areas which are required to be reduced and correspond to the first image area is a fifth preset threshold value. If the first target number is less than or equal to a fifth preset threshold corresponding to the first image area, the first image area as an occlusion area may be reduced to a fourth image area. Here, the reduction of the occlusion region is a reduction of the occlusion region after expansion, and the reduction can be made to the original occlusion region size, that is, the initial region size, at the minimum.

Here, through analyzing the movable range of the target object entering the shielding area, the shielding area is timely increased when too many target objects in the shielding area are not shielded, and the shielding area is increased in real time, so that the object information of the target object in the shielding area can be effectively protected.

Alternatively, an edge region of the first image region may be provided, and the edge region may be a zone region (may be referred to as an early warning region), where the zone region refers to a region surrounding the periphery of the shielding region. For example, as shown in fig. 5, the area outside the occlusion area PM1 and inside the broken line is a zone area. The target object entering the occlusion area can be analyzed, and the number n of people is the number of people entering the occlusion area minus the number of people leaving the occlusion area. If N reaches a certain number N, the movable objects in the shielding area are obviously displayed in the zone area at the edge of the shielding area. Referring to fig. 5, when the number of persons entering the area PM1 reaches N, the zone area always has a moving object screen, that is, the zone area always has a moving object screen (that is, a screen in which a moving object is present, for example, a screen change interval of less than 5 seconds), it can be considered that the saturation threshold of the occlusion area (that is, the number of persons saturation threshold) is reached.

Here, the zone area is not fixed, and is divided according to actual conditions, and N may be referred to as a saturation target number. The different occlusion regions have their own corresponding saturated target numbers (e.g., the first image region corresponds to a first predetermined threshold). And if the number of people entering a certain shielding area exceeds N, the user can be informed of timely focusing treatment, and shielding area adjustment can be performed in the mode in the embodiment.

In step S208, a second image area in the second shot image is subjected to shielding processing to obtain a second shielding image, where the second shot image is a shot image obtained by shooting the target scene by the target shooting device after shooting to obtain the first shot image.

For a shot image obtained by shooting a target scene by the target shooting device after shooting the first shot image, for example, a second shot image, a second image area in the second shot image may be subjected to shielding processing to obtain a second shielding image. The second photographed image is one or more photographed images photographed by the target photographing apparatus for the target scene after photographing the first photographed image.

The second image region in the second captured image may be masked in various ways, for example, the second image region may be set to black or white, a mosaic, or a substitute picture, so as to achieve the effect of region masking, and the first image region in the first captured image may be masked in the same way as or different from the second image region in the second captured image.

In the scene with the reduced occlusion region, the occlusion processing may be performed on the fourth image region in the second captured image to obtain a fourth occlusion image. In addition, the second shot image or the second occlusion image may be processed in a similar manner to the first shot image or the first occlusion image, to determine whether the occlusion area needs to be enlarged or reduced, which has already been described, and will not be described again.

Through the steps, a first shooting image obtained by shooting a target scene by target shooting equipment is obtained, and a first image area in the first shooting image is subjected to shielding treatment to obtain a first shielding image, wherein the first image area corresponds to a first scene area in the target scene; determining the number of objects of the target type currently staying in the first image area according to the first shooting image or the first shielding image to obtain a first target number; expanding the first image area as the shielding area to the second image area when the first target number is greater than or equal to a first preset threshold corresponding to the first image area; and carrying out shielding treatment on a second image area in the second shot image to obtain a second shielding image, wherein the second shot image is a shot image obtained by shooting a target scene by target shooting equipment after the first shot image is obtained, so that the problem that the timeliness of shielding area adjustment is poor due to time and labor consumption of manual operation in the method for determining the image shielding area in the related technology is solved, and the timeliness of shielding area adjustment is improved.

In one exemplary embodiment, the number of objects of the target type currently remaining in the first image region may be determined in a number of ways. As an alternative embodiment, determining the number of objects of the object type currently staying in the first image area according to the first captured image or the first occlusion image, to obtain the first target number, includes:

s11, identifying objects of the target type located in the first image area in the first shot image, and determining the number of the identified objects of the target type located in the first image area as a first target number.

The identification of the object type may be performed directly on the first photographed image or the first image area of the first photographed image to identify the object of the object type located in the first image area, and the number of the identified object of the object type located in the first image area may be determined as the first target number.

As another alternative embodiment, determining the number of objects of the object type currently staying in the first image area according to the first captured image or the first occlusion image, to obtain the first target number, includes:

s12, identifying objects of the target type entering the first image area in the first shooting image, and determining the number of the identified objects of the target type entering the first image area as a first number;

S13, identifying objects of the target type leaving the first image area in the first shooting image, and determining the number of the identified objects of the target type leaving the first image area as a second number;

s14, acquiring the number of objects of the target type which stay in the first scene area before the first shooting image is obtained by shooting, and obtaining a third number;

s15, the first target number is determined to be equal to (third number+first number-second number).

The object of the target type within the first image area is not stationary but movable. In this regard, the target object entering the occlusion region may be analyzed, the object of the target type entering the first image region may be identified in the first captured image, and the number of the identified objects of the target type entering the first image region may be determined as the first number; identifying objects of the object type leaving the first image area in the first captured image, and determining the number of the identified objects of the object type leaving the first image area as a second number.

Here, the object of the target type entering and leaving the first image area may be with respect to the object of the target type within the image area corresponding to the first scene area (i.e., the reference image area) in the captured image captured by the target capturing device for the target scene before the first captured image is captured. The object of the object type entering the first image area may be an object of the object type appearing within the first image area of the first photographed image and not appearing within the reference image area, and the object of the object type leaving the first image area may be an object of the object type not appearing within the first image area of the first photographed image and appearing within the reference image area.

Furthermore, the number of objects of the object type that remained in the first scene area before the first captured image was captured may be also acquired, resulting in a third number, where the third number may be the number of objects of the object type that appear in the reference image area. After the first number, the second number, and the third number are obtained, a value obtained by subtracting the second number from the sum of the first number and the third number may be determined as the first target number.

By means of the method and the device, the flexibility of information acquisition can be improved based on the fact that the number of objects of the target type currently staying in the first image area is determined in different manners according to the use requirement.

In one exemplary embodiment, identifying in a first captured image an object of a target type located in a first image region includes:

s21, in the case that a first object of a target type is identified in the first shooting image, determining a first display area of the first object in a first image area;

s22, when the first display area partially overlaps the first image area or the first display area is located inside the first image area, it is determined that the first object is located in the first image area.

In the present embodiment, when identifying an object of a target type located in the first image area, an object of a target type within the first captured image may be first identified; then, it is determined whether the object of the identified target type is located in the first image area based on the positional relationship of the display area in which the object of the identified target type is located and the first image area.

If a first object of a target type is identified in the first photographed image, a first display area of the first object in the first image area may be determined, and a positional relationship of the first display area and the first image area may be determined, where the first display area may be a display frame containing the first object, for example, a rectangular frame.

The first display area may have various positional relationships with the first image area, for example, non-overlapping, partially overlapping, and the first display area is located inside the first image area. If there is a partial overlap of the first display area with the first image area or the first display area is located inside the first image area, it may be determined that the first object is located in the first image area. Alternatively, it may be determined that the object of the target type is located in the first image area as long as the display area (e.g., the first display area) of the object of the target type (e.g., the first object) at least partially overlaps the first image area, or the overlapping ratio reaches a set ratio threshold.

It should be noted that, the number of the objects of the target type currently staying in the first image area is determined according to the first shot image, so that the situation that the objects of the target type cannot be identified due to the fact that the part of the objects of the target type is located outside the first image area can be avoided, and the accuracy of object identification is improved. In addition, it may be determined that the object of the target type is located in the first image area only when the display area of the object of the target type is located inside the first image area, so as to ensure convenience in object recognition.

According to the embodiment, the target object in the shielding area is determined by identifying the display area where the target object is located in the shot image and based on the position relation between the display area where the target object is located and the shielding area, so that the accuracy of object identification is improved.

In one exemplary embodiment, determining the number of objects of the object type currently staying in the first image area according to the first captured image or the first occlusion image, to obtain the first target number, includes:

s31, identifying objects of the target type entering the first image area in the first shielding image, and determining the number of the identified objects of the target type entering the first image area as a first number;

S32, identifying objects of the target type leaving the first image area in the first shielding image, and determining the number of the identified objects of the target type leaving the first image area as a second number;

s33, acquiring the number of objects of the target type which stay in the first scene area before the first shooting image is obtained by shooting, and obtaining a third number;

s34, the first target number is determined to be equal to (third number+first number-second number).

The object of the target type within the first image area is not stationary but movable. In this regard, the target objects entering the occlusion region may be analyzed, the object of the target type entering the first image region may be identified in the first occlusion image, and the number of identified objects of the target type entering the first image region may be determined as the first number; identifying objects of the object type leaving the first image area in the first occlusion image, and determining the number of the identified objects of the object type leaving the first image area as a second number.

Here, the object of the target type entering and leaving the first image area may be relative to the object of the target type within the image area (i.e., the reference image area) as the occlusion area in the captured image of the target scene captured by the target capturing device before the first captured image is captured. The object of the object type entering the first image area may be an object of the object type that does not appear near the first image area of the first occlusion image but appears near the reference image area, and the object of the object type leaving the first image area may be an object of the object type that appears near the first image area of the first occlusion image and does not appear near the reference image area.

Furthermore, the number of objects of the object type that remained in the first scene area before the first captured image was captured may be also obtained, resulting in a third number, where the third number may be the number of objects of the object type within the reference image area. After the first number, the second number, and the third number are obtained, a value obtained by subtracting the second number from the sum of the first number and the third number may be determined as the first target number.

According to the method and the device for obtaining the information, the number of the target objects in the shielding area is determined by carrying out target identification on the shielding image obtained through shielding processing, so that the information safety is ensured, and meanwhile, the accuracy of information acquisition is improved.

In one exemplary embodiment, expanding a first image region as an occlusion region to a second image region includes:

and S41, expanding the first image area serving as the shielding area to a second image area, wherein the first image area is positioned in the second image area, or part of edges of the first image area are overlapped with part of edges of the second image area, or the first image area is partially overlapped with the second image area.

In this embodiment, when the image area is enlarged, the area size of the first image area may be enlarged according to a preset parameter, thereby enlarging the first image area as the shielding area to the second image area. For example, the first image area may be controlled to expand outwardly in at least one direction according to preset parameters, where the preset parameters may be an expanded size, an expanded ratio, or the like. In this case, the first image region may be located inside the second image region (e.g., four sides of the first image region are each extended outward), or a partial side of the first image region overlaps a partial side of the second image region (e.g., a designated side of the first image region is extended outward, the designated side may be one side, two sides, three sides, or the like).

For example, the occlusion region PM1 may be enlarged in a manner of enlarging the region size, and the resulting occlusion region after enlargement may be as shown by the broken line in fig. 6.

In addition to enlarging the area size of the first image area, the area position of the image area may be adjusted, for example, the enlarged image area is controlled to move in a preset direction, thereby obtaining the second image area. The preset direction here may be any direction. In this case, the first image region and the second image region may partially overlap.

For example, the occlusion region PM1 may be expanded in such a manner that the expanded region size is combined with the region movement, and the resulting occlusion region after expansion may be as shown by the broken line in fig. 7.

By the embodiment, the flexibility of area expansion can be improved by expanding the shielding area in a mode of expanding the area size or in a mode of expanding the area size and combining the movement of the area.

s51, expanding a first image area serving as a shielding area to a first candidate image area;

s52, acquiring a first group of shooting images, wherein the first group of shooting images are a group of shooting images obtained by shooting a target scene by target shooting equipment within a first preset time length after the first shooting images are obtained by shooting;

s53, identifying objects of the target type entering the first candidate image area in each of the first group of shot images, and determining the number of the identified objects of the target type entering the first candidate image area as a fourth number;

s54, identifying objects of the target type leaving the first candidate image area in each of the first group of shot images, and determining the number of the identified objects of the target type leaving the first candidate image area as a fifth number;

And S55, judging whether the first candidate image area is determined to be the second image area according to the fourth number and/or the fifth number.

After the primary occlusion region is enlarged, the region size, region position, etc. of the enlarged occlusion region may not meet the requirements for object occlusion. In order to improve the accuracy of the region occlusion, the occlusion region may be first expanded one or more times, and then, by detecting the occlusion effect of the expanded occlusion region, it is determined whether the expanded occlusion region may be regarded as a new occlusion region based on the detected occlusion effect of the expanded occlusion region.

For the first image area as the occlusion area, the first candidate image area may be enlarged, and the manner of enlarging is similar to that in the foregoing embodiment, which is not described herein. Meanwhile, the photographing apparatus may further acquire a first group of photographing images, which is a group of photographing images obtained by photographing the target scene by the target photographing apparatus within a first predetermined time period after photographing the first photographing images, and may include one or more photographing images, may be photographing images adjacent to the first photographing images, may be photographing images not adjacent to the first photographing images, and may be continuous multiple photographing images.

For each of the first set of captured images, objects of the target type entering the first candidate image area may be identified, respectively, and the number of identified objects of the target type entering the first candidate image area may be determined as a fourth number. The manner of identifying the object of the target type entering the first candidate image area is similar to that in the previous embodiment, and will not be described here. Here, the fourth number may be the number of objects of the target type entering the first candidate image area within the first preset time period.

Meanwhile, objects of the target type leaving the first candidate image area may be respectively identified in the respective photographed images of the first group of photographed images, and the number of the identified objects of the target type leaving the first candidate image area may be determined as the fifth number. The manner of identifying the object of the target type leaving the first candidate image area is similar to that of the previous embodiment, and will not be described here. Here, the fifth number may be the number of objects of the target type leaving the first candidate image area within the first preset time period.

Based on the fourth number and/or the fifth number, it may be determined whether the first candidate image area is determined as the second image area. For example, whether to determine the first candidate image area as the second image area may be determined based on whether the fourth number reaches the set number threshold. For another example, it may be determined whether to determine the first candidate image area as the second image area based on whether the fifth number reaches the set number threshold. For another example, it is determined whether the first candidate image area is determined as the second image area by determining whether both reach the set number threshold, respectively.

Here, the determination criterion for determining the first candidate image area as the second image area may be: the determined number (e.g., the fourth number or the fifth number) is less than or equal to the set number threshold, at which time, the first candidate image region may be determined to be the second image region, indicating that the first candidate image region meets the requirement for object occlusion. Otherwise, the occlusion region may be readjusted, or a prompt message may be sent to the designated device to prompt manual configuration of the occlusion region.

Alternatively, the first candidate image area may be a preset image area, for example, it may be the foregoing early warning area. According to the number of people entering and the real-time activity condition, a shielding picture of the zone area can be drawn. The zone range is adjustable. If N target objects enter the shielding area, the external motion detection of the zone area is obviously reduced. If the occlusion area needs to be enlarged, the zone area can be changed into the enlarged occlusion area. A zone1 (pre-warning zone 1) is also provided outside the zone. The area range of the zone1 area may be set based on pictures such as no motion detection event in 5 seconds intervals, or no continuous human shape or face in the zone area. As shown in fig. 8, the zone region becomes an enlarged occlusion region (the enlarged occlusion region is the original occlusion region and zone region), and the zone1 region becomes a new warning region. Because the zone area is enlarged to be a shielding area, the movement detection of the zone1 area can be obviously reduced. If more dynamic checks of zone1 still occur, it is considered to continue expanding zone.

The early warning area is not completely surrounded by the shielding area, but can be one side or a plurality of sides, and the boundary of the early warning area is not fixed from the boundary of the shielding area. As shown in fig. 9, zone regions are only the upper and right sides of PM1, and zone1 is only the left and lower sides of the occlusion region containing zone regions. For example, a certain talkback area is a shielding area, and because a certain number of people in a certain talkback is more, a movable seat is added, and the seat is arranged on a certain side of the shielding area, so that a target object with more activities can exist outside the shielding area, and an early warning area can be arranged on the certain side.

According to the embodiment, the accuracy of area shielding can be improved by detecting the shielding effect of the expanded shielding area and determining whether to take the expanded shielding area as a new shielding area or not based on the detected shielding effect.

In an exemplary embodiment, determining whether to determine the first candidate image area as the second image area according to the fourth number and/or the fifth number comprises:

s61, determining the first candidate image area as a second image area under the condition that the fourth number is smaller than or equal to a second preset threshold value, wherein the second preset threshold value is equal to 0, or equal to 1, or a positive integer larger than or equal to 2, or the second preset threshold value is positively correlated with the first preset duration; or alternatively

S62, determining the first candidate image area as the second image area under the condition that the fifth number is smaller than or equal to a third preset threshold value, wherein the third preset threshold value is equal to 0, or equal to 1, or a positive integer larger than or equal to 2, or the third preset threshold value is positively correlated with the first preset duration; or alternatively

S63, determining the first candidate image area as the second image area in the case that the fourth number is less than or equal to the second preset threshold value and the fifth number is less than or equal to the third preset threshold value.

In this embodiment, the manner of determining whether to determine the first candidate image area as the second image area may be multiple according to the fourth number and/or the fifth number, and the manner adopted may be determined based on actual needs.

As an alternative embodiment, it may be determined whether the first candidate image area is determined as the second image area according to the fourth number: and determining the first candidate image area as the second image area in the case that the fourth number is smaller than or equal to the second preset threshold value. Here, the second preset threshold may be a fixed value, for example, the second preset threshold may be equal to 0, 1, or a positive integer greater than or equal to 2. The second preset threshold may also be a variable value, for example, the second preset threshold is positively correlated with the first predetermined time period, and the longer the first preset time period, the greater the second preset threshold.

As another alternative embodiment, it may be determined whether to determine the first candidate image area as the second image area according to the fifth number: and determining the first candidate image area as the second image area in the case that the fifth number is smaller than or equal to the third preset threshold value. Here, the third preset threshold may be a fixed value, for example, the third preset threshold may be equal to 0, 1, or a positive integer greater than or equal to 2. The third preset threshold may also be a variable value, for example, the third preset threshold is positively correlated with the first predetermined time period, and the longer the first preset time period, the greater the third preset threshold.

As yet another alternative embodiment, it may be determined whether to determine the first candidate image area as the second image area according to the fourth number and the fifth number: and determining the first candidate image area as the second image area in the case that the fourth number is less than or equal to the second preset threshold value and the fifth number is less than or equal to the third preset threshold value. The setting manners of the second preset threshold and the third preset threshold are similar to those described above, and will not be described here.

According to the embodiment, the quantity threshold values are set in different modes, so that different application scenes can be met, the applicability of the shielding region adjustment mode is improved, and the flexibility of shielding region setting is improved.

In an exemplary embodiment, after determining whether to determine the first candidate image area as the second image area according to the fourth number and/or the fifth number, the method further includes:

s71 of expanding the first image area as the occlusion area to the second candidate image area when it is determined that the first candidate image area is not determined to be the second image area;

s72, acquiring a second group of shooting images, wherein the second group of shooting images are a group of shooting images obtained by shooting a target scene by the target shooting equipment within a second preset time period after the first shooting image is obtained, and the second group of shooting images are the same as or partially different from or completely different from the first group of shooting images;

s73, identifying objects of the target type entering the second candidate image area in each shot image in the second group of shot images, and determining the number of the identified objects of the target type entering the second candidate image area as a sixth number;

s74, identifying objects of the target type leaving the second candidate image area in each of the second group of shot images, and determining the number of the identified objects of the target type leaving the second candidate image area as a seventh number;

And S75, judging whether the second candidate image area is determined to be the second image area according to the sixth number and/or the seventh number.

In this embodiment, when it is determined that the first candidate image area is not determined to be the second image area, the enlarging operation may be performed again on the first image area as the shielding area to obtain the second candidate image area, where the second candidate image area and the first candidate image area may be different image areas, and the manner of enlarging the first image area to the second candidate image area is similar to the foregoing, and will not be described herein.

In obtaining the second candidate image area, a group of captured images, i.e., a second group of captured images, obtained by the target capturing device capturing the target scene for a second predetermined period of time after capturing the first captured image may be obtained in a similar manner to that in the foregoing embodiment. The first preset duration and the second preset duration may be the same, partially the same, or completely different, and correspondingly, the second set of captured images may be the same, partially the same, or completely different from the first set of captured images.

For the second group of captured images, the number of objects of the target type that enter the second candidate image area (i.e., the sixth number) and the number of objects of the target type that leave the second candidate image area (i.e., the seventh number) may be identified in a similar manner to the foregoing embodiment, and it may be determined whether to determine the second candidate image area as the second image area in a similar manner to the foregoing embodiment. Has been described and will not be described in detail herein.

According to the embodiment, the expanding operation is performed on the shielding area again, the shielding effect of the expanded shielding area is detected, whether the expanded shielding area is used as a new shielding area is determined based on the detected shielding effect, manual participation can be reduced, and meanwhile the success rate of shielding area adjustment is improved.

In an exemplary embodiment, the above method further comprises:

s81, determining the number of objects of the target type moving from the first image area to a third image area in the first shooting image according to the first shooting image, and obtaining a second target number;

s82, determining the third image area as a newly added shielding area when the second target number is larger than or equal to a fourth preset threshold value corresponding to the third image area;

s83, performing shielding processing on a third image area in a third shooting image to obtain a third shielding image, wherein the third shooting image is a shooting image obtained by shooting a target scene by a target shooting device after shooting to obtain the first shooting image.

Because the target object in the shielding area is usually active, the target object in the shielding area may move to other positions (e.g. communicate with other people) in the picture, that is, the active area of the target object to be shielded drifts, if the original shielding area is adopted, the target object cannot be accurately determined for shielding, and the comprehensiveness of information shielding is reduced.

For example, a target object within an occlusion region moves to other locations in the picture in communication with things, i.e., the target object to be occluded drifts. The currently fixed occlusion area is not able to meet the current occlusion needs. As shown in fig. 10, PM1 is an occlusion area set by the user, zone1 is an active area in which the target object is enlarged, and PM2 is a position to which the active target object is transferred.

In this embodiment, in order to be able to adjust the occlusion region in time, so as to protect the object information of the target object, the number of objects of the target type that move from the first image region to the third image region in the first captured image may be determined according to the first captured image, and the second target number may be obtained. The third image area may be a predetermined fixed area or an area determined based on a position where the object of the target type moving out of the first image area is located.

If the second target number is greater than or equal to a fourth preset threshold corresponding to the third image area, it indicates that a large number of objects of the target type have moved to the third image area, and the third image area needs to be blocked to block the objects of the target type in the third image area, so that the third image area can be determined as a newly added blocking area. In this case, the third image area in the third captured image may be subjected to the shielding process to obtain a third shielded image, the third captured image being a captured image obtained by capturing the target scene by the target capturing device after capturing the first captured image.

Here, the image area adjustment may be performed in a similar manner to that in the foregoing embodiment for any of the image areas as the blocking area. Meanwhile, the image area as the occlusion area may be newly added based on the movement situation of the object of the target type. Further, in the case of reducing the image area, if the area size of the reduced image area is less than or equal to the preset size threshold, the image area may be deleted.

Optionally, for the scene where the early warning area is set, since the characteristics of the target objects (such as faces, clothes, gaits, etc.) have been analyzed, if a certain number of target objects enter the shielding area and leave the shielding area again, and the leaving shielding area is not within the early warning range (i.e. the range of the early warning area), the moving track and the stay position of the target objects are analyzed.

If at least 2 movable target objects leave (move out of the early warning area) from the shielding area and the early warning area, namely, at least 2 target objects walk to a certain place to stay at the same time or sequentially, the area shielding is carried out on the stay area temporarily. In order to fully ensure the integrity of object information shielding, shielding processing can be performed even when 1 target object stays somewhere in a non-shielding area.

If the target object moves, the shielding area can also be controlled to move along with the target object until the target object leaves the picture or enters the shielding area. The target object may leave the occlusion region and aggregate in another region, i.e., the occluded target object drifts (also known as the occlusion region drifts). If the target object completely leaves from the occlusion region to some other region in the picture and this occurs multiple times later, it can be understood that the occlusion region completely drifts. In this case, the occlusion region can be newly added/changed and fixed. The user may be notified to confirm when the occlusion region is newly added/changed and fixed.

Optionally, the newly added shielding area shields the target object leaving the shielding area by analyzing the activity rule of the target object in the original shielding area in the scene area. According to the actual situation, the newly added shielding area can be dynamic or fixed, can be preset according to the activity characteristics of the target object, can effectively protect the movable target object in the original shielding area, increases the shielding protection range, can also recommend the newly added shielding area to the user, and improves the man-machine interaction efficiency.

Here, the newly added shielding region may be dynamically set, or may be fixedly set. As shown in fig. 11, the plurality of target objects are moved away from the occlusion area PM1 to the PM3 position, and PM3 may be set as a dynamic occlusion area. If there is often a regular movement of the target object from the occlusion area PM1 to PM2, PM2 may be set to a fixed occlusion area.

The method and the device can analyze the activity area and the time period of the target object which are generated outside the shielding area set by the user in the last period of time, then fuse the activity heat map of the target object in the non-shielding area to generate a recommended shielding area, improve the accuracy and the instantaneity of information shielding, and manually adjust the shielding area according to the shielding area recommended by the device.

In addition, since the characteristics of the face and the like of the target object are analyzed, the shielding region may be preset according to the object characteristics of the target object in the PM 1. For example, referring to fig. 11, the target objects 1 and 2 prefer to go out of the occlusion area to the position of PM2, and therefore, when the target objects 1 and 2 are found to leave PM1, the occlusion area may be drawn at the position of PM2 first.

If the user does not set outside the shielding area, the stored video data are original data when the target object coming out of the shielding area is shielded by default, and only the user with operation authority can view the original data. That is, the authorized user can view the original video data, and the unauthorized ordinary user cannot see the original data which is not blocked.

Optionally, the newly added shielding area can be managed, and the information of the target object in the shielding area can be effectively protected without affecting the original service by performing authority management on the stored data in the newly added shielding area. For example, according to the authority rule preset by the management (admin) user, the management user and the authorized user can perform the viewing authority of the newly added area outside the occlusion area. For non-authorized users, the target object cannot be observed, i.e., the target object is either obscured or hidden. The occlusion process may take a variety of forms, including but not limited to filling the occlusion area with a mosaic or blurring.

To achieve a sufficiently hidden target, the background picture of the previous frame in which the video of the target object appears may be replaced with the target object. When a common user plays/downloads video, the target object cannot be seen, and the target object is blocked by a newly added blocking area or replaced by a background frame. As shown in fig. 12, the recording process does not modify the original target recording data, and thus, the object information of the target object is protected and the original data is not lost. The management user can set the newly added occlusion region video original data not to be reserved, and any user cannot view the original data.

According to the method and the device for information shielding, the shielding area is newly added based on the moving condition of the object of the target type, so that the comprehensiveness and timeliness of information shielding can be improved, meanwhile, the shielding area can be flexibly adjusted without participation of a user, and the flexibility of shielding area adjustment is improved.

The method for determining the image occlusion area in the embodiment of the present application is explained below with reference to an alternative example. In this alternative example, the photographing apparatus is a camera, the occasion where the camera is installed is a conference room, the scene using the camera is a conference, and the image area as the shielding area includes a preset, fixed shielding area, that is, PM1 in fig. 4.

In the related art, the set shielding area is subjected to shielding treatment, the actual target objects moving in the area are shielded, if the shielding area is smaller, the number of the target objects to be shielded is larger, the problem of no shielding is caused, and if the shielding area is larger, the acquisition of other information is influenced. In this regard, the present optional example provides a processing scheme for image occlusion based on an occlusion region, which analyzes the capacity of a target object that can move in the occlusion region, and analyzes the movement condition of the target object that moves in the occlusion region in a non-occlusion region, so as to timely enlarge the occlusion region or newly increase the occlusion region, and effectively process the occlusion region according to the actual condition and time of the target object, thereby timely and effectively protecting the information security of the target object.

In connection with fig. 13, the flow of the method for determining the image occlusion region in this alternative example may include the following steps:

step S1302, acquiring a shot image obtained by shooting a target scene by a camera, and performing shielding processing on a shielding region in the shot image to obtain a shielding image.

In step S1304, the number of target objects currently staying in the occlusion area is determined from the captured image or the occlusion image.

In step S1306, when the number of target objects in the occlusion area is greater than or equal to the preset threshold, the occlusion area is enlarged.

Here, according to the activity condition of the target object and the current area size of the shielding area, reasonable shielding area expansion is performed, so that the information safety of the target object in the shielding area is ensured, the shielding area is expanded in time, and the object information can be protected in time.

In step S1308, when one or more target objects in the occlusion region move into a scene region other than the occlusion region, the newly added occlusion region occludes the target object that moved out of the occlusion region.

For moving target objects in the shielding area to be transferred to other non-shielding areas of the picture, the targets in the shielding area drift, and then the shielding area needs to be newly added so as to effectively protect the object information of the target objects in the original shielding area. When the target object in the shielding area drifts, the shielding area is newly added in time, so that the information safety of the target object can be effectively protected in time.

In addition, the activity rule of the target object can be analyzed, and the suggested shielding area is pushed to the user, so that the shielding area is set more reasonably.

By the optional example, by enlarging/adding the shielding area, managing the viewing authority of the image picture in the shielding area and managing the target object to be shielded, only the authorized user can view the original data while the original data of the target object in the newly added shielding area is not damaged, the target object moving in the original shielding area can be effectively protected, and the original data cannot be lost.

It should be noted that, for simplicity of description, the foregoing method embodiments are all expressed as a series of action combinations, but it should be understood by those skilled in the art that the present application is not limited by the order of actions described, as some steps may be performed in other order or simultaneously in accordance with the present application. Further, those skilled in the art will also appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily required in the present application.

From the description of the above embodiments, it will be clear to a person skilled in the art that the method according to the above embodiments may be implemented by means of software plus the necessary general hardware platform, but of course also by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (such as ROM (Read-Only Memory)/RAM (Random Access Memory), magnetic disk, optical disk), including instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method of the embodiments of the present application.

According to another aspect of the embodiments of the present application, there is also provided an apparatus for implementing the above method for determining an image occlusion area. Fig. 14 is a block diagram of an alternative apparatus for determining an image occlusion area according to an embodiment of the present application, and as shown in fig. 14, the apparatus may include:

a first execution unit 1402, configured to obtain a first captured image obtained by capturing a target scene by a target capturing device, and perform occlusion processing on a first image area in the first captured image, to obtain a first occlusion image, where the first image area corresponds to a first scene area in the target scene;

a first determining unit 1404, coupled to the first executing unit 1402, for determining, according to the first captured image or the first occlusion image, a number of objects of a target type currently staying in the first image area, to obtain a first target number;

a first expanding unit 1406 connected to the first determining unit 1404, and configured to determine, according to the first captured image or the first occlusion image, the number of objects of the object type currently staying in the first image area, to obtain a first target number;

a first shielding unit 1408, connected to the first expansion unit 1406, is configured to perform shielding processing on a second image area in a second captured image to obtain a second shielding image, where the second captured image is a captured image obtained by capturing a target scene by the target capturing device after capturing the first captured image.

It should be noted that, the first execution unit 1402 in this embodiment may be used to execute the above-mentioned step S202, the first determination unit 1404 in this embodiment may be used to execute the above-mentioned step S204, the first expansion unit 1406 in this embodiment may be used to execute the above-mentioned step S206, and the first shielding unit 1408 in this embodiment may be used to execute the above-mentioned step S208.

Through the module, a first shooting image obtained by shooting a target scene by the target shooting equipment is obtained, and a first image area in the first shooting image is subjected to shielding treatment to obtain a first shielding image, wherein the first image area corresponds to a first scene area in the target scene; determining the number of objects of the target type currently staying in the first image area according to the first shooting image or the first shielding image to obtain a first target number; expanding the first image area as the shielding area to the second image area when the first target number is greater than or equal to a first preset threshold corresponding to the first image area; and carrying out shielding treatment on a second image area in the second shot image to obtain a second shielding image, wherein the second shot image is a shot image obtained by shooting a target scene by target shooting equipment after the first shot image is obtained, so that the problem that the timeliness of shielding area adjustment is poor due to time and labor consumption of manual operation in the method for determining the image shielding area in the related technology is solved, and the timeliness of shielding area adjustment is improved.

In one exemplary embodiment, the first determining unit includes:

a first execution module for identifying objects of a target type located in a first image area in a first photographed image, and determining the number of the identified objects of the target type located in the first image area as a first target number; or alternatively

A second execution module for identifying objects of a target type entering the first image area in the first photographed image, and determining the number of the identified objects of the target type entering the first image area as a first number; identifying objects of the target type leaving the first image area in the first photographed image, and determining the number of the identified objects of the target type leaving the first image area as a second number; acquiring the number of objects of a target type which stay in a first scene area before a first shooting image is obtained by shooting, and obtaining a third number; the first target number is determined to be equal to (third number + first number-second number).

In one exemplary embodiment, the first execution module includes:

a first determination submodule for determining a first display area of the first object in the first image area in the case that the first object of the target type is identified in the first photographed image;

And a second determining sub-module for determining that the first object is located in the first image area in a case where there is partial overlap of the first display area with the first image area or the first display area is located inside the first image area.

In one exemplary embodiment, the first determining unit includes:

a third execution module, configured to identify, in the first occlusion image, an object of a target type entering the first image area, and determine, as a first number, a number of identified objects of the target type entering the first image area;

a fourth execution module for identifying objects of the target type leaving the first image area in the first occlusion image, determining the number of the identified objects of the target type leaving the first image area as a second number;

the first acquisition module is used for acquiring the number of objects of the target type which stay in the first scene area before the first shooting image is shot to obtain a third number;

a determining module for determining the first target number to be equal to (third number + first number-second number).

In one exemplary embodiment, the first expansion unit includes:

and the first expansion module is used for expanding the first image area serving as the shielding area to the second image area, wherein the first image area is positioned in the second image area, or part of edges of the first image area are overlapped with part of edges of the second image area, or the first image area is partially overlapped with the second image area.

In one exemplary embodiment, the first expansion unit includes:

a second enlarging module for enlarging the first image area as the shielding area to a first candidate image area;

the second acquisition module is used for acquiring a first group of shooting images, wherein the first group of shooting images are a group of shooting images obtained by shooting a target scene by the target shooting equipment within a first preset time length after the first shooting images are obtained by shooting;

a fifth execution module for identifying objects of the target type entering the first candidate image area in each of the first group of captured images, and determining the number of the identified objects of the target type entering the first candidate image area as a fourth number;

a sixth execution module for identifying objects of the target type leaving the first candidate image area in each of the first group of captured images, determining the number of the identified objects of the target type leaving the first candidate image area as a fifth number;

and the judging module is used for judging whether the first candidate image area is determined to be the second image area according to the fourth number and/or the fifth number.

In one exemplary embodiment, the judging module includes:

A third determining submodule, configured to determine the first candidate image area as a second image area if the fourth number is less than or equal to a second preset threshold, where the second preset threshold is equal to 0, or equal to 1, or a positive integer greater than or equal to 2, or the second preset threshold is positively correlated with the first predetermined duration; or alternatively

A fourth determining submodule, configured to determine the first candidate image area as the second image area if the fifth number is less than or equal to a third preset threshold, where the third preset threshold is equal to 0, or equal to 1, or a positive integer greater than or equal to 2, or the third preset threshold is positively correlated with the first predetermined duration; or alternatively

A fifth determining sub-module, configured to determine the first candidate image area as the second image area if the fourth number is less than or equal to the second preset threshold value and the fifth number is less than or equal to the third preset threshold value.

In an exemplary embodiment, the above apparatus further includes:

a second enlarging unit configured to enlarge, after determining whether or not to determine the first candidate image area as the second image area based on the fourth number and/or the fifth number, the first image area as the occlusion area to the second candidate image area if it is determined that the first candidate image area is not determined as the second image area;

An acquisition unit configured to acquire a second group of captured images, where the second group of captured images is a group of captured images obtained by capturing a target scene by a target capturing device within a second predetermined period of time after capturing the first captured image, and the second group of captured images is the same as or partially different from or completely different from the first group of captured images;

a second execution unit configured to identify, in each of the second group of captured images, an object of a target type entering the second candidate image area, and determine the number of the identified objects of the target type entering the second candidate image area as a sixth number;

a third execution unit configured to identify, in each of the second group of captured images, an object of a target type that leaves the second candidate image area, and determine the number of identified objects of the target type that leaves the second candidate image area as a seventh number;

and a judging unit configured to judge whether to determine the second candidate image area as the second image area according to the sixth number and/or the seventh number.

In an exemplary embodiment, the above apparatus further includes:

a second determining unit configured to determine, from the first captured image, a number of objects of a target type that move from the first image area to a third image area in the first captured image, to obtain a second target number;

A third determining unit, configured to determine the third image area as a newly added occlusion area when the second target number is greater than or equal to a fourth preset threshold corresponding to the third image area;

and the second shielding unit is used for shielding a third image area in a third shooting image to obtain the third shielding image, wherein the third shooting image is a shooting image obtained by shooting a target scene by the target shooting device after the first shooting image is obtained by shooting.

It should be noted that the above modules are the same as examples and application scenarios implemented by the corresponding steps, but are not limited to what is disclosed in the above embodiments. It should be noted that the above modules may be implemented in software or in hardware as part of the apparatus shown in fig. 1, where the hardware environment includes a network environment.

According to yet another aspect of embodiments of the present application, there is also provided a storage medium. Alternatively, in this embodiment, the storage medium may be used to execute a program code for a method for determining an image occlusion area in any of the above embodiments of the present application.

Alternatively, in this embodiment, the storage medium may be located on at least one network device of the plurality of network devices in the network shown in the above embodiment.

Alternatively, in the present embodiment, the storage medium is configured to store program code for performing the steps of:

s1, acquiring a first shooting image shot by target shooting equipment on a target scene, and carrying out shielding treatment on a first image area in the first shooting image to obtain a first shielding image, wherein the first image area corresponds to a first scene area in the target scene;

s2, determining the number of objects of the target type currently staying in a first image area according to the first shooting image or the first shielding image to obtain a first target number;

s3, expanding the first image area serving as the shielding area to a second image area under the condition that the first target number is larger than or equal to a first preset threshold value corresponding to the first image area;

s4, carrying out shielding processing on a second image area in a second shooting image to obtain a second shielding image, wherein the second shooting image is a shooting image obtained by shooting a target scene by a target shooting device after shooting to obtain a first shooting image.

Alternatively, specific examples in the present embodiment may refer to examples described in the above embodiments, which are not described in detail in the present embodiment.

Alternatively, in the present embodiment, the storage medium may include, but is not limited to: various media capable of storing program codes, such as a U disk, ROM, RAM, a mobile hard disk, a magnetic disk or an optical disk.

According to still another aspect of the embodiments of the present application, there is further provided an electronic device for implementing the above method for determining an image occlusion area, where the electronic device may be a server, a terminal, or a combination thereof.

Fig. 15 is a block diagram of an alternative electronic device, according to an embodiment of the present application, including a processor 1502, a communication interface 1504, a memory 1506, and a communication bus 1508, as shown in fig. 15, wherein the processor 1502, the communication interface 1504, and the memory 1506 perform communication with one another via the communication bus 1508, wherein,

a memory 1506 for storing a computer program;

the processor 1506, when executing the computer program stored on the memory 1506, performs the following steps:

Alternatively, in the present embodiment, the communication bus may be a PCI (Peripheral Component Interconnect, peripheral component interconnect standard) bus, or an EISA (Extended Industry Standard Architecture ) bus, or the like. The communication bus may be classified as an address bus, a data bus, a control bus, or the like. For ease of illustration, only one thick line is shown in fig. 15, but not only one bus or one type of bus. The communication interface is used for communication between the electronic device and other equipment.

The memory may include RAM or may include non-volatile memory (non-volatile memory), such as at least one disk memory. Optionally, the memory may also be at least one memory device located remotely from the aforementioned processor.

As an example, the above memory 1506 may include, but is not limited to, the first execution unit 1402, the first determination unit 1404, the first expansion unit 1406, and the first occlusion unit 1408 in the above-described determination device of an image occlusion area. In addition, other module units in the above-mentioned image occlusion region determining apparatus may be further included, but are not limited to, and are not described in detail in this example.

The processor may be a general purpose processor and may include, but is not limited to: CPU (Central Processing Unit ), NP (Network Processor, network processor), etc.; but also DSP (Digital Signal Processing, digital signal processor), ASIC (Application Specific Integrated Circuit ), FPGA (Field-Programmable Gate Array, field programmable gate array) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components.

Alternatively, specific examples in this embodiment may refer to examples described in the foregoing embodiments, and this embodiment is not described herein.

It will be appreciated by those skilled in the art that the structure shown in fig. 15 is only illustrative, and the device implementing the above method for determining the image occlusion area may be a terminal device, and the terminal device may be a smart phone (such as an Android mobile phone, an iOS mobile phone, etc.), a tablet computer, a palm computer, a mobile internet device (Mobile Internet Devices, MID), a PAD, etc. Fig. 15 is not limited to the structure of the electronic device. For example, the electronic device may also include more or fewer components (e.g., network interfaces, display devices, etc.) than shown in fig. 15, or have a different configuration than shown in fig. 15.

Those of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be implemented by a program for instructing a terminal device to execute in association with hardware, the program may be stored in a computer readable storage medium, and the storage medium may include: flash disk, ROM, RAM, magnetic or optical disk, etc.

The foregoing embodiment numbers of the present application are merely for describing, and do not represent advantages or disadvantages of the embodiments.

The integrated units in the above embodiments may be stored in the above-described computer-readable storage medium if implemented in the form of software functional units and sold or used as separate products. Based on such understanding, the technical solution of the present application may be embodied in essence or a part contributing to the prior art or all or part of the technical solution in the form of a software product stored in a storage medium, including several instructions to cause one or more computer devices (which may be personal computers, servers or network devices, etc.) to perform all or part of the steps of the methods described in the various embodiments of the present application.

In the foregoing embodiments of the present application, the descriptions of the embodiments are emphasized, and for a portion of this disclosure that is not described in detail in this embodiment, reference is made to the related descriptions of other embodiments.

In several embodiments provided in the present application, it should be understood that the disclosed client may be implemented in other manners. The above-described embodiments of the apparatus are merely exemplary, and the division of the units, such as the division of the units, is merely a logical function division, and may be implemented in another manner, for example, multiple units or components may be combined or may be integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some interfaces, units or modules, or may be in electrical or other forms.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution provided in the present embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The foregoing is merely a preferred embodiment of the present application and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present application and are intended to be comprehended within the scope of the present application.

Claims

1. A method for determining an image occlusion region, comprising:

acquiring a first shooting image shot by target shooting equipment on a target scene, and carrying out shielding treatment on a first image area in the first shooting image to obtain a first shielding image, wherein the first image area corresponds to a first scene area in the target scene;

determining the number of objects of the target type currently staying in the first image area according to the first shooting image or the first shielding image to obtain a first target number;

Expanding the first image area as an occlusion area to a second image area when the first target number is greater than or equal to a first preset threshold corresponding to the first image area;

and carrying out shielding processing on the second image area in a second shooting image to obtain a second shielding image, wherein the second shooting image is a shooting image obtained by shooting the target scene by the target shooting device after shooting to obtain the first shooting image.

2. The method according to claim 1, wherein determining the number of objects of the object type currently staying in the first image area from the first captured image or the first occlusion image, to obtain the first target number, comprises:

identifying objects of the target type located in the first image area in the first captured image, and determining the number of the identified objects of the target type located in the first image area as the first target number; or alternatively

Identifying objects of the target type entering the first image area in the first shot image, and determining the number of the identified objects of the target type entering the first image area as a first number; identifying objects of the target type that leave the first image area in the first captured image, and determining the number of the identified objects of the target type that leave the first image area as a second number; acquiring the number of objects of the target type which stay in the first scene area before the first shot image is shot, so as to acquire a third number; the first target number is determined to be equal to (the third number + the first number-the second number).

3. The method of claim 2, wherein the identifying the object of the target type located in the first image region in the first captured image comprises:

determining a first display area of the first object in the first image area in the case that the first object of the target type is identified in the first shooting image;

in a case where the first display area partially overlaps the first image area or the first display area is located inside the first image area, it is determined that the first object is located in the first image area.

4. The method according to claim 1, wherein determining the number of objects of the object type currently staying in the first image area from the first captured image or the first occlusion image, to obtain the first target number, comprises:

identifying objects of the target type entering the first image area in the first occlusion image, and determining the number of the identified objects of the target type entering the first image area as a first number;

identifying objects of the target type that leave the first image region in the first occlusion image, determining a number of identified objects of the target type that leave the first image region as a second number;

Acquiring the number of objects of the target type which stay in the first scene area before the first shot image is shot, so as to acquire a third number;

the first target number is determined to be equal to (the third number + the first number-the second number).

5. The method of claim 1, wherein the expanding the first image region as an occlusion region to a second image region comprises:

and expanding the first image area serving as an occlusion area to the second image area, wherein the first image area is positioned in the second image area, or a part of edges of the first image area are overlapped with a part of edges of the second image area, or the first image area is partially overlapped with the second image area.

6. The method of claim 1, wherein the expanding the first image region as an occlusion region to a second image region comprises:

expanding the first image area as an occlusion area to a first candidate image area;

acquiring a first group of shooting images, wherein the first group of shooting images are a group of shooting images obtained by shooting the target scene by the target shooting equipment within a first preset time length after the first shooting images are obtained by shooting;

Identifying objects of the target type entering the first candidate image area in each of the first set of captured images, and determining the number of the identified objects of the target type entering the first candidate image area as a fourth number;

identifying objects of the target type that leave the first candidate image area in each of the first set of captured images, determining a number of identified objects of the target type that leave the first candidate image area as a fifth number;

and judging whether to determine the first candidate image area as the second image area according to the fourth number and/or the fifth number.

7. The method of claim 6, wherein the determining whether to determine the first candidate image area as the second image area based on the fourth number and/or the fifth number comprises:

determining the first candidate image area as the second image area under the condition that the fourth number is smaller than or equal to a second preset threshold value, wherein the second preset threshold value is equal to 0, or equal to 1, or a positive integer greater than or equal to 2, or the second preset threshold value is positively correlated with the first preset duration; or alternatively

Determining the first candidate image area as the second image area when the fifth number is less than or equal to a third preset threshold, wherein the third preset threshold is equal to 0, or equal to 1, or a positive integer greater than or equal to 2, or the third preset threshold is positively correlated with the first preset duration; or alternatively

And determining the first candidate image area as the second image area when the fourth number is less than or equal to the second preset threshold value and the fifth number is less than or equal to the third preset threshold value.

8. The method according to claim 6, wherein after determining whether to determine the first candidate image area as the second image area according to the fourth number and/or the fifth number, the method further comprises:

expanding the first image area as an occlusion area to a second candidate image area in the case that it is determined that the first candidate image area is not determined to be the second image area;

acquiring a second group of shooting images, wherein the second group of shooting images are a group of shooting images obtained by shooting the target scene by the target shooting equipment within a second preset time period after the first shooting image is obtained, and the second group of shooting images are identical to or partially different from or completely different from the first group of shooting images;

Identifying objects of the target type entering the second candidate image area in each of the second set of captured images, determining the number of identified objects of the target type entering the second candidate image area as a sixth number;

identifying objects of the target type that leave the second candidate image area in each of the second set of captured images, determining a number of identified objects of the target type that leave the second candidate image area as a seventh number;

and judging whether to determine the second candidate image area as the second image area according to the sixth number and/or the seventh number.

9. The method according to any one of claims 1 to 8, further comprising:

determining the number of objects of the target type moving from the first image area to a third image area in the first shot image according to the first shot image, and obtaining a second target number;

determining the third image area as a newly added shielding area under the condition that the second target number is larger than or equal to a fourth preset threshold value corresponding to the third image area;

And carrying out shielding processing on the third image area in a third shooting image to obtain a third shielding image, wherein the third shooting image is a shooting image obtained by shooting the target scene by the target shooting device after shooting to obtain the first shooting image.

10. A device for determining an image occlusion area, comprising:

the first execution unit is used for acquiring a first shooting image shot by target shooting equipment on a target scene, and carrying out shielding treatment on a first image area in the first shooting image to obtain a first shielding image, wherein the first image area corresponds to a first scene area in the target scene;

the first determining unit is used for determining the number of the objects of the target type currently staying in the first image area according to the first shooting image or the first shielding image to obtain a first target number;

a first enlarging unit configured to enlarge, when the first target number is greater than or equal to a first preset threshold corresponding to the first image area, the first image area as an occlusion area to a second image area;

And the first shielding unit is used for shielding the second image area in a second shooting image to obtain a second shielding image, wherein the second shooting image is a shooting image obtained by shooting the target scene by the target shooting equipment after the first shooting image is obtained by shooting.

11. A computer-readable storage medium, characterized in that the computer-readable storage medium comprises a stored program, wherein the program when run performs the method of any one of claims 1 to 9.

12. An electronic device comprising a memory and a processor, characterized in that the memory has stored therein a computer program, the processor being arranged to execute the method according to any of claims 1 to 9 by means of the computer program.