CN116668629A - Video monitoring method and device, electronic equipment and storage medium - Google Patents

Abstract

The embodiment of the invention discloses a video monitoring method, a video monitoring device, electronic equipment and a storage medium. Wherein the method comprises the following steps: acquiring a fixed-focus shooting picture obtained by shooting a monitoring object by a fixed-focus shooting device, wherein the shooting coverage range of the fixed-focus shooting picture to the monitoring object is obtained according to shooting device parameters of the fixed-focus shooting device; obtaining a zooming shooting picture obtained by shooting a convex mirror by a zooming shooting device, wherein the reflecting coverage of the convex mirror to the monitored object is added with the shooting coverage of the fixed-focus shooting picture to the monitored object, and the reflecting coverage is larger than or equal to the monitoring coverage of the monitored object; and obtaining a monitoring coverage shooting picture of the monitoring object according to the fixed-focus shooting picture and the zooming shooting picture. According to the technical scheme, the full coverage monitoring of the monitoring range of the high-rise building can be realized, the complete track of the high-altitude parabolic object can be conveniently obtained, and meanwhile, the hardware cost is reduced.

Description

Video monitoring method and device, electronic equipment and storage medium

Technical Field

The present invention relates to the field of image processing technologies, and in particular, to a video monitoring method, a video monitoring device, an electronic device, and a storage medium.

Background

Because the field angle of the shooting device is limited, when the monitored object of the shooting device is a high-rise building, the ratio of the distance between the shooting device and the photographed building to the height of the photographed building can influence the monitoring effect of the shooting device on the photographed building. Depending on the height of the high-rise building, the distance between the camera and the high-rise building is typically adjusted within a certain distance range, for example 15-40m.

However, since the distance between high-rise buildings sometimes cannot satisfy the distance range required by the photographing devices, the related art generally satisfies the monitoring requirement of the full coverage of the high-rise buildings by providing a plurality of photographing devices on the high-rise buildings, but this approach certainly increases the cost. In addition, only a plurality of separated high-rise building monitoring pictures can be obtained through a plurality of shooting devices, and a complete high-altitude parabolic track cannot be obtained, so that the actual requirements are difficult to meet.

Disclosure of Invention

The invention provides a video monitoring method, a video monitoring device, electronic equipment and a storage medium, which are used for realizing full coverage monitoring of a monitoring range of a high-rise building, facilitating the acquisition of a complete track of a high-altitude parabolic object and reducing hardware cost.

According to an aspect of the present invention, there is provided a video monitoring method, the method including:

acquiring a fixed-focus shooting picture obtained by shooting a monitoring object by a fixed-focus shooting device, wherein the shooting coverage range of the fixed-focus shooting picture to the monitoring object is obtained according to shooting device parameters of the fixed-focus shooting device;

obtaining a zooming shooting picture obtained by shooting a convex mirror by a zooming shooting device, wherein the reflecting coverage of the convex mirror to the monitored object is added with the shooting coverage of the fixed-focus shooting picture to the monitored object, and the reflecting coverage is larger than or equal to the monitoring coverage of the monitored object;

and obtaining a monitoring coverage shooting picture of the monitoring object according to the fixed-focus shooting picture and the zooming shooting picture.

According to another aspect of the present invention, there is provided a video monitoring apparatus including:

the fixed-focus shooting picture acquisition module is used for acquiring a fixed-focus shooting picture obtained by shooting a monitoring object by the fixed-focus shooting device, and the shooting coverage range of the fixed-focus shooting picture to the monitoring object is obtained according to shooting device parameters of the fixed-focus shooting device;

the zoom shooting picture acquisition module is used for acquiring a zoom shooting picture obtained by shooting a convex mirror by the zoom shooting device, wherein the reflection coverage of the convex mirror to the monitored object is added with the shooting coverage of the fixed-focus shooting picture to the monitored object, and the reflection coverage of the convex mirror to the monitored object is larger than or equal to the monitoring coverage of the monitored object;

And the monitoring coverage picture determining module is used for obtaining the monitoring coverage picture of the monitoring object according to the fixed-focus shooting picture and the zooming shooting picture.

According to another aspect of the present invention, there is provided a video monitoring electronic device, the electronic device including:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,,

the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the video surveillance method according to any one of the embodiments of the present invention.

According to another aspect of the present invention, there is provided a computer readable storage medium storing computer instructions for causing a processor to execute a video surveillance method according to any one of the embodiments of the present invention.

According to the technical scheme, a fixed-focus shooting picture obtained by shooting a monitoring object by a fixed-focus shooting device is obtained, and the shooting coverage range of the fixed-focus shooting picture to the monitoring object is obtained according to shooting device parameters of the fixed-focus shooting device; obtaining a zooming shooting picture obtained by shooting a convex mirror by a zooming shooting device, wherein the reflecting coverage range of the convex mirror to a monitoring object is added with the shooting coverage range of the fixed-focus shooting picture to the monitoring object, and the reflecting coverage range is larger than or equal to the monitoring coverage range of the monitoring object; and obtaining a monitoring coverage shooting picture of the monitored object according to the fixed-focus shooting picture and the zooming shooting picture. According to the technical scheme, the full-coverage monitoring of the monitoring range of the high-rise building can be realized, the complete track of the high-altitude parabolic object can be conveniently obtained, and meanwhile, the hardware cost is reduced.

It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the invention or to delineate the scope of the invention. Other features of the present invention will become apparent from the description that follows.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a flowchart of a video monitoring method according to a first embodiment of the present invention;

FIG. 2 is a schematic diagram illustrating a dual-lens module camera according to a first embodiment of the present invention;

fig. 3 is a flowchart of a video monitoring method according to a second embodiment of the present invention;

fig. 4 is a schematic structural diagram of a video monitoring device according to a third embodiment of the present invention;

fig. 5 is a schematic structural diagram of an electronic device implementing a video monitoring method according to an embodiment of the present invention.

Detailed Description

In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.

It should be noted that the terms "first," "second," "target," and the like in the description and claims of the present invention and in the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Example 1

Fig. 1 is a flowchart of a video monitoring method according to a first embodiment of the present invention, where the method may be implemented by a video monitoring device, and the video monitoring device may be implemented in hardware and/or software, and the video monitoring device may be configured in an electronic device with data processing capability. As shown in fig. 1, the method includes:

s110, a fixed-focus shooting picture obtained by shooting the monitoring object by the fixed-focus shooting device is obtained, and the shooting coverage range of the fixed-focus shooting picture to the monitoring object is obtained according to the shooting device parameters of the fixed-focus shooting device.

The fixed-focus shooting device may be a shooting device with a fixed focal length. For example, a fixed focus camera may include a fixed focus lens. The monitoring object may refer to a high-rise building having a small building distance. By way of example, assuming that the distance between a certain high-rise building and other high-rise buildings is D and the floor height of the high-rise building is H, when D/H is less than 3/20, the high-rise building can be considered to have a small building distance. The fixed-focus shooting screen may be an image screen shot by a fixed-focus shooting device. Specifically, the shooting coverage of the fixed-focus shooting picture to the monitored object is obtained according to the shooting device parameters of the fixed-focus shooting device. The parameters of the shooting device can include parameters such as installation height, inclination angle, field angle and the like of the fixed-focus shooting device. Wherein the angle of inclination is relative to the horizontal.

In this embodiment, a fixed focus shooting picture obtained by shooting a monitoring object by a fixed focus shooting device is first obtained. Optionally, the determining process of the shooting coverage of the fixed-focus shooting picture to the monitored object includes: determining an inclination angle between a connecting line of the monitoring starting height of the monitoring object and the fixed focus shooting device and a horizontal plane according to the monitoring starting height, the installation height of the fixed focus shooting device and the distance between the fixed focus shooting device and the monitoring object; and determining the coverage height of the fixed-focus shooting device according to the inclination angle, the vertical field angle of the fixed-focus shooting device, the distance between the fixed-focus shooting device and the monitored object and the installation height of the fixed-focus shooting device.

The monitoring start height may be the lowest height within the field of view of the designated focal camera. For example, if the photographing range of the fixed-focus photographing device is 3 floors to 10 floors of the high-rise building, the floor height corresponding to the 3 floors of the high-rise building is monitored as the starting height. The vertical angle of view may be an angle of view in the vertical direction of the designated focus shooting device. The coverage height may be an actual maximum height of a portion of the monitoring object with respect to the horizontal plane that is specified to be able to be photographed in the field of view of the focal photographing device.

It should be noted that, in this embodiment, a dual-lens module camera may be used to simultaneously implement fixed-focus shooting and zoom shooting for the monitored object. The dual-lens module camera comprises a first lens module and a second lens module. Specifically, the first lens module is a fixed focus lens (i.e. a fixed focus shooting device); the second lens module is a zoom lens (i.e. a zoom shooting device) and forms an adjustable inclination angle with the fixed focus lens. The zoom camera may be a camera capable of changing a focal length within a certain range, such as a zoom lens. Fig. 2 is an installation schematic diagram of a dual-lens module camera according to an embodiment of the invention. Wherein H represents the installation height of the fixed focus shooting device, d represents the distance between the fixed focus shooting device and the monitored object, H is the overall height of the monitored object (high-rise building), H0 represents the monitoring starting height, H1 and H2 are the vertical field angles of the fixed focus shooting device and the zooming shooting device respectively, θ is the inclination angle between the connecting line of the monitoring starting height of the monitored object and the fixed focus shooting device and the horizontal plane, and β is the vertical field angle of the fixed focus shooting device.

For example, taking fig. 2 as an example, assume that the installation height H of the fixed-focus camera is 3m, the distance d between the fixed-focus camera and the monitored object is 5m, the total floor of the high-rise building is 31 floors, and the adjacent floor spacing is 2.8m, that is, the total height H of the high-rise building is 2.8x31=86.8m. If the fixed-focus photographing device starts monitoring from the 3 rd layer, that is, the monitoring start height h is 2.8× (3-1) =5.6 m, the inclination angle θ between the line connecting the monitoring start height of the monitored object and the fixed-focus photographing device and the horizontal plane can be determined to be 27.5 degrees by the formula tan θ= (5.6-3)/5. Assuming that the vertical field angle β of the focal photographing device is 56 degrees, θ+β=27.5+56=83.5 degrees can be obtained. Further, it can be determined that the coverage height of the fixed-focus imaging device is 5×tan83.5+3≡ 46.885m.

Through such setting, the scheme can rapidly and accurately determine the shooting coverage range of the fixed-focus shooting picture to the monitoring object.

In this embodiment, optionally, after determining the coverage height of the fixed-focus shooting device, the method further includes: and determining the coverage floor of the fixed-focus shooting device according to the coverage height of the fixed-focus shooting device. Here, the coverage floor may be a floor corresponding to a coverage height of the fixed-focus imaging device.

For example, taking fig. 2 as an example, the coverage height of the fixed-focus camera is about 46.885m, and since the distance between adjacent floors is 2.8m, it can be determined that the coverage floor of the fixed-focus camera is 46.885 ++2.8=16.7 floors. That is, the fixed focus photographing apparatus can completely photograph the entire picture of 16 floors, but can photograph only a partial picture of 17 floors.

S120, obtaining a zooming shooting picture obtained by shooting the convex mirror by the zooming shooting device, wherein the reflecting coverage range of the convex mirror to the monitored object is added with the shooting coverage range of the fixed focus shooting picture to the monitored object, and the reflecting coverage range is larger than or equal to the monitoring coverage range of the monitored object.

Wherein a convex mirror may be used to reflect light. Specifically, the convex mirror is installed on the coaxial line of the zooming shooting device, the zooming shooting device is adjusted to be aligned to the convex mirror, and the image in the reflecting coverage range of the convex mirror to the monitoring object can be shot through the zooming shooting device by utilizing the effect of light reflected by the convex mirror. The reflective coverage of the convex mirror to the monitored object is added with the shooting coverage of the fixed-focus shooting picture to the monitored object, and the reflective coverage of the convex mirror to the monitored object is larger than or equal to the monitoring coverage of the monitored object. The monitoring coverage may be a coverage of a monitored object that can be monitored by the photographing device. It should be noted that the monitoring coverage does not include a range below the monitoring start height of the fixed-focus photographing device, so as to ensure that photographing of the monitoring coverage of the monitoring object can be achieved by the fixed-focus photographing device and the zoom photographing device together. The zoom photographing screen may refer to an image screen photographed by the zoom photographing device. In this embodiment, the shape and size of the convex mirror are not limited, and may be set according to an actual shooting scene. By way of example, a rectangular convex mirror with a length of 8m and a width of 4.5m (aspect ratio 16:9) may be selected.

In this embodiment, optionally, the curvature of the convex mirror matches the horizontal angle of view and the vertical angle of view of the fixed focus camera; the installation height of the convex mirror is higher than the preset height of the monitoring object, and the preset height is the difference between the monitoring initial height and the installation height of the fixed focus shooting device; the distance between the convex mirror and the monitoring object is the same as the distance between the fixed focus shooting device and the monitoring object; the inclination angle of the convex mirror is the same as that of the fixed-focus shooting device.

Wherein the horizontal angle of view may refer to an angle of view in a horizontal direction. The preset height may refer to a difference between the monitoring start height and the installation height of the fixed focus photographing device. Taking fig. 2 as an example, the preset height is h0-h=5.6-3=2.6 m. In this embodiment, the curvature of the convex mirror is required to be matched with the horizontal angle of view and the vertical angle of view of the fixed-focus photographing device, that is, the distance of the reflective coverage of the convex mirror to the monitored object is the same as the distance of the photographing coverage of the fixed-focus photographing picture to the monitored object. For example, h1=h2 in fig. 2. For example, assuming a rectangular convex mirror size of 8m×4.5m (i.e., 8m long and 4.5m wide), the curvature of the convex mirror should have at least a horizontal angle of view and a vertical angle of view that are equivalent to those of a 2.8mm fixed focus camera (e.g., a fixed focus lens). In addition, it is also necessary to ensure that the installation height of the convex mirror is higher than the difference between the monitoring start height of the monitoring object and the installation height of the fixed focus photographing device. Taking fig. 2 as an example, the preset height is 2.6m, and the installation height of the convex mirror is 2.6m higher than the top layer of the high-rise building. Meanwhile, the distance between the center of the convex mirror and the monitoring object is required to be ensured to be the same as the distance between the center of the fixed-focus shooting device and the monitoring object, and the inclination angle of the convex mirror is the same as the inclination angle of the fixed-focus shooting device. Taking fig. 2 as an example, the distance between the convex mirror and the monitoring object and the distance between the fixed focus shooting device and the monitoring object are both 5m, and the inclination angle of the convex mirror is 27.5 degrees.

In this embodiment, parameters of the convex mirror are described taking as an example that a curvature of the convex mirror matches a horizontal angle of view and a vertical angle of view of the fixed focus photographing device, and a height difference of a set height of the convex mirror with respect to a monitored object matches a difference of a monitor start height and an installation height of the fixed focus photographing device. However, in this embodiment, parameters such as curvature, set height, inclination angle, and size of the convex mirror are not limited, and the range of the monitoring object except the shooting coverage of the fixed-focus shooting picture can be covered by the reflection coverage of the convex mirror to the monitoring object.

In this embodiment, optionally, the magnification of the zoom camera is obtained according to the distance between the zoom camera and the convex mirror, the size of the convex mirror, the resolution of the zoom camera, and the minimum focal length of the zoom camera.

Specifically, firstly, determining an image size corresponding to a zooming shooting picture according to the product of the resolution of the zooming shooting device and the pixel size, and then determining a reference ratio according to the ratio of the image size to the size of the convex mirror. Wherein the reference ratio may be used to characterize a quotient of an image distance of the zoom camera divided by a distance between the zoom camera and the convex mirror. Further, the image distance of the zoom camera can be determined according to the product of the reference ratio and the distance between the zoom camera and the convex mirror. Wherein the image distance may be expressed as the product of the minimum focal length and the magnification. Finally, the magnification of the zooming shooting device can be determined according to the ratio of the image distance of the zooming shooting device to the minimum focal length of the zooming shooting device.

Since the convex mirror has a certain inclination angle, it is not possible to ensure that the resolution of a zoom image obtained by using a convex mirror of 8m×4.5m size is exactly 8MP (3840×2160) at the time of actual image capturing. Two solutions to this problem may be employed. One method is to restore the proportion of the monitored object in the zoom shooting picture by the existing image processing algorithm under the condition that the size of the convex mirror is kept unchanged at 8m multiplied by 4.5 m. In another method, when the resolution of the zoom photographing device reaches 8MP, the ideal size of the convex mirror corresponding to the whole zoom photographing picture is occupied by the convex mirror according to the inclination angle of the convex mirror, and then the actual size of the convex mirror is adjusted according to the ideal size of the convex mirror.

S130, obtaining a monitoring coverage shooting picture of the monitored object according to the fixed focus shooting picture and the zooming shooting picture.

The monitoring coverage shooting picture may refer to a shooting picture corresponding to a monitoring coverage of a monitored object. In this embodiment, after the fixed focus shooting picture and the zoom shooting picture are acquired, the monitoring coverage shooting picture of the monitoring object may be obtained according to the fixed focus shooting picture and the zoom shooting picture.

In this embodiment, the coverage area of the fixed focus shooting device for the monitored object is 46.885-5.6= 41.285, and since the distance of the reflective coverage area of the convex mirror for the monitored object is the same as the distance of the shooting coverage area of the fixed focus shooting device for the monitored object in this embodiment, the fixed focus shooting device and the convex mirror cooperate to cover a height 41.285 ×2+5.6= 88.17, which is greater than the height of the monitored object, the full coverage monitoring of the monitored area of the monitored object can be realized.

Optionally, obtaining a monitoring coverage shooting picture of the monitored object according to the fixed focus shooting picture and the zoom shooting picture includes: mirror image processing and distortion correction processing are carried out on the zooming shooting picture, and a target zooming shooting picture is obtained; and performing image stitching on the fixed-focus shooting picture and the target zooming shooting picture to obtain a monitoring coverage shooting picture of the monitored object.

The target zoom-captured image may be a zoom-captured image obtained by performing a mirroring process and a distortion correction process on the zoom-captured image. The mirroring process may include horizontal mirroring, vertical mirroring, and diagonal mirroring, among others.

In this embodiment, after the fixed focus shooting picture and the zoom shooting picture are acquired, mirror image processing is first required to be performed on the zoom shooting picture, and then distortion correction processing is performed on the zoom shooting picture after the mirror image processing, so as to obtain the target zoom shooting picture. In this embodiment, the specific mode of the distortion correction process is not limited, and may be flexibly set according to actual requirements. For example, the distortion correction processing may be performed on the zoom-photographed picture after the mirroring processing by a direct method or an indirect method. At a distance from the convex mirror, when the picture in the convex mirror is observed with another convex mirror of the same parameter, the object of the picture in the other convex mirror is in an undistorted state (multiple debugging distances may be required). According to this principle, as an implementation manner, the distortion parameters of the zoom photographing device may be adjusted according to the parameters of the convex mirror, so that, in the zoom photographing picture output by the zoom photographing device, the picture in the convex mirror is a normal observation image for human eyes, and the picture outside the convex mirror is distorted. In another embodiment, the zoom photographing device outputs the whole image with normal distortion parameters, and after mirroring, the distortion correction is performed on the whole image by using an image post-processing means.

In this embodiment, optionally, the method further includes: and determining distortion correction parameters of the zooming shooting device according to the reflection picture of the convex mirror to the monitoring object, so as to carry out distortion correction processing on the zooming shooting picture according to the distortion correction parameters. The distortion correction parameter may be used as a basis for performing distortion correction processing on the zoom photographed image. When the zoom photographing device photographs a picture reflected by the convex mirror, the generated image distortion includes two parts. Some are distortions generated by the zoom camera itself, and others are distortions caused by the convex mirror reflection. By performing distortion correction processing on the zoom photographing picture according to the distortion correction parameters of the zoom photographing device determined by the convex mirror on the reflected picture of the monitored object, the accuracy of the zoom photographing picture can be further improved.

After the target zoom shooting picture is obtained, the monitoring coverage shooting picture of the monitoring object can be obtained by carrying out image stitching on the fixed focus shooting picture and the target zoom shooting picture. Optionally, performing image stitching on the fixed-focus shooting picture and the target zooming shooting picture, including; determining a picture overlapping area according to the fixed-focus shooting picture and the target zooming shooting picture; performing pixel calibration on the picture overlapping area; and performing image stitching on the fixed focus shooting picture and the target zoom shooting picture after the picture overlapping area is subjected to pixel calibration, so as to obtain a monitoring coverage shooting picture of the monitored object.

The screen overlapping area may be an area where the specified focus shooting screen overlaps with the target zoom shooting screen. It can be understood that if the reflective coverage of the convex mirror to the monitored object and the shooting coverage of the fixed focus shooting picture to the monitored object are larger than the monitored coverage of the monitored object, the picture overlapping may occur.

In this embodiment, in order to avoid the influence of the image overlapping area on the image stitching, when the fixed focus shooting image and the target zoom shooting image are subjected to the image stitching, the image overlapping area may be determined according to the actual image effects of the fixed focus shooting image and the target zoom shooting image, then the image overlapping area is subjected to the pixel calibration, and further the fixed focus shooting image and the target zoom shooting image after the pixel calibration are subjected to the image stitching, so as to obtain the monitoring coverage shooting image of the monitoring object.

By the arrangement, the monitoring coverage shooting picture of the monitoring object can be rapidly and accurately obtained by correcting and splicing the images of the fixed-focus shooting picture and the zoom shooting picture; according to the fixed focus shooting picture after the picture overlapping area is subjected to pixel calibration and the target zoom shooting picture are subjected to image splicing, the influence of the picture overlapping area on the image splicing can be avoided, and therefore the monitoring coverage shooting picture of the monitored object can be obtained more accurately.

According to the technical scheme, a fixed-focus shooting picture obtained by shooting a monitoring object by a fixed-focus shooting device is obtained, and the shooting coverage range of the fixed-focus shooting picture to the monitoring object is obtained according to shooting device parameters of the fixed-focus shooting device; obtaining a zooming shooting picture obtained by shooting a convex mirror by a zooming shooting device, wherein the reflecting coverage range of the convex mirror to a monitoring object is added with the shooting coverage range of the fixed-focus shooting picture to the monitoring object, and the reflecting coverage range is larger than or equal to the monitoring coverage range of the monitoring object; and obtaining a monitoring coverage shooting picture of the monitored object according to the fixed-focus shooting picture and the zooming shooting picture. The technical scheme is particularly suitable for scenes where the building space cannot meet the requirements of high-altitude parabolic recognition arrangement, full-coverage monitoring of a monitoring range of a high-rise building can be achieved, meanwhile, as the convex mirror does not need networking and power supply, all shooting devices can be networked and configured on the ground, certain circuits can allow the dual-lens module cameras to be shared, and hardware cost is reduced.

Example two

Fig. 3 is a flowchart of a video monitoring method according to a second embodiment of the present invention, where the optimization is performed based on the above embodiment. The concrete optimization is as follows: after the fixed focus shooting picture obtained by shooting the monitoring object by the fixed focus shooting device is obtained, the method further comprises the following steps: determining the highest floor in a fixed-focus shooting picture according to the coverage floor of the fixed-focus shooting device; and determining the pixel area of the highest floor, and judging the identification target limiting condition for the pixel area of the highest floor.

As shown in fig. 3, the method of this embodiment specifically includes the following steps:

s210, acquiring a fixed-focus shooting picture obtained by shooting a monitoring object by the fixed-focus shooting device, wherein the shooting coverage range of the fixed-focus shooting picture to the monitoring object is obtained according to shooting device parameters of the fixed-focus shooting device.

S220, determining the highest floor in the fixed-focus shooting picture according to the coverage floor of the fixed-focus shooting device.

In this embodiment, the highest floor in the fixed-focus shooting screen may be determined according to the coverage floor of the fixed-focus shooting device. Specifically, if the coverage floor of the fixed-focus shooting device is an integer, the fixed-focus shooting device can completely shoot a coverage floor picture, and at the moment, the coverage floor of the fixed-focus shooting device is the highest floor in the fixed-focus shooting picture, so that the coverage floor of the fixed-focus shooting device can be directly determined as the highest floor in the fixed-focus shooting picture; if the coverage floor of the fixed-focus shooting device is not an integer, the fixed-focus shooting device can shoot a complete picture of the floor corresponding to the integer part in the coverage floor, and can shoot a part of pictures of the floor obtained after the coverage floor is rounded upwards, and at the moment, the floor after the coverage floor of the fixed-focus shooting device is rounded upwards can be determined to be the highest floor in the fixed-focus shooting picture. For example, assuming that the coverage floor of the focus shooting device is 16.7, that is, the coverage floor is not an integer, 17 obtained by rounding up 16.7 may be determined as the highest floor in the fixed focus shooting screen.

S230, determining the pixel area of the highest floor, and judging the identification target limiting condition for the pixel area of the highest floor.

The recognition target limitation condition may be a limitation condition that can recognize a target, and may be used as a criterion of whether the target at the highest floor can be recognized. Wherein the target may be a high altitude parabolic object. For example, the recognition target limitation condition may be set to 18×18 in the pixel area occupied by the target. It can be understood that if the pixel area of the highest floor meets the recognition target limiting condition, the fixed focus shooting device can recognize the target at the highest floor; conversely, if the pixel area of the highest floor does not meet the recognition target limiting condition, the fixed focus shooting device is indicated to be unable to recognize the target at the highest floor.

In this embodiment, after determining the highest floor in the fixed focus shooting picture, the pixel area of the highest floor may be further determined, and whether the pixel area of the highest floor meets the recognition target constraint condition may be determined. By way of example, assuming that the pixel area of the highest floor is 28×28 and the recognition target restriction condition is 18×18, it can be determined that the pixel area of the highest floor satisfies the recognition target restriction condition, and thus the fixed focus camera can recognize the target at the highest floor.

If the pixel area of the highest floor can satisfy the recognition target limitation condition, the monitoring coverage image of the monitored object is determined continuously according to the method of S240 to S250. If the pixel area of the highest floor cannot meet the recognition target limiting condition, the following two processing modes can be adopted if the pixel area of the highest floor in the focus shooting picture still cannot meet the recognition target limiting condition after the pixel calibration of the picture overlapping area before the image splicing: firstly, a fixed-focus shooting device with a larger vertical field angle is adopted to enlarge the shooting coverage range of the fixed-focus shooting device. Secondly, parameters such as an inclination angle or a curvature of the convex mirror are adjusted to enlarge a reflection coverage range of the convex mirror to the monitoring object, which is not limited in the embodiment.

S240, obtaining a zooming shooting picture obtained by shooting the convex mirror by the zooming shooting device, wherein the reflecting coverage range of the convex mirror to the monitored object is added with the shooting coverage range of the fixed focus shooting picture to the monitored object, and the reflecting coverage range is larger than or equal to the monitoring coverage range of the monitored object.

S250, obtaining a monitoring coverage shooting picture of the monitored object according to the fixed focus shooting picture and the zooming shooting picture.

The specific implementation of S240-S250 may be referred to in the detailed description of S120-S130, and will not be described herein.

According to the technical scheme, after a fixed-focus shooting picture obtained by shooting a monitoring object by the fixed-focus shooting device is obtained, the highest floor in the fixed-focus shooting picture is determined according to the coverage floor of the fixed-focus shooting device; and determining the pixel area of the highest floor, and judging the identification target limiting condition for the pixel area of the highest floor. According to the technical scheme, whether the fixed focus shooting device can identify the target at the highest floor or not can be rapidly and accurately determined by judging the identification target limiting condition on the pixel area of the highest floor.

Example III

Fig. 4 is a schematic structural diagram of a video monitoring device according to a third embodiment of the present invention, where the device may execute the video monitoring method according to any embodiment of the present invention, and the device has functional modules and beneficial effects corresponding to the execution method. As shown in fig. 4, the apparatus includes:

a fixed-focus shooting picture obtaining module 310, configured to obtain a fixed-focus shooting picture obtained by shooting a monitored object by a fixed-focus shooting device, where a shooting coverage area of the fixed-focus shooting picture on the monitored object is obtained according to shooting device parameters of the fixed-focus shooting device;

The zoom shooting picture obtaining module 320 is configured to obtain a zoom shooting picture obtained by shooting a convex mirror by using a zoom shooting device, where a reflection coverage of the convex mirror on the monitored object is added to a shooting coverage of the fixed focus shooting picture on the monitored object, and the reflection coverage is greater than or equal to a monitoring coverage of the monitored object;

the monitoring coverage picture determining module 330 is configured to obtain a monitoring coverage picture of the monitored object according to the fixed focus shooting picture and the zoom shooting picture.

Optionally, the apparatus further includes:

the fixed focus inclination angle determining module is used for determining an inclination angle between a connecting line of the monitoring initial height of the monitoring object and the fixed focus shooting device and a horizontal plane according to the monitoring initial height, the installation height of the fixed focus shooting device and the distance between the fixed focus shooting device and the monitoring object;

and the fixed-focus coverage height determining module is used for determining the coverage height of the fixed-focus shooting device according to the inclination angle, the vertical field angle of the fixed-focus shooting device, the distance between the fixed-focus shooting device and the monitoring object and the installation height of the fixed-focus shooting device.

Optionally, the apparatus further includes:

a fixed focus coverage floor determining module, configured to determine a coverage floor of the fixed focus shooting device according to a coverage height of the fixed focus shooting device after determining the coverage height of the fixed focus shooting device;

the fixed focus highest floor determining module is used for determining the highest floor in the fixed focus shooting picture according to the coverage floor of the fixed focus shooting device after the fixed focus shooting picture obtained by shooting the monitoring object by the fixed focus shooting device is obtained;

and the identification target limiting condition judging module is used for determining the pixel area of the highest floor and judging the identification target limiting condition for the pixel area of the highest floor.

Optionally, the curvature of the convex mirror is matched with the horizontal view angle and the vertical view angle of the fixed-focus shooting device;

the installation height of the convex mirror is higher than the preset height of the monitoring object, and the preset height is the difference between the monitoring initial height and the installation height of the fixed-focus shooting device;

the distance between the convex mirror and the monitoring object is the same as the distance between the fixed focus shooting device and the monitoring object;

The inclination angle of the convex mirror is the same as that of the fixed-focus shooting device.

Optionally, the magnification of the zoom camera is obtained according to a distance between the zoom camera and the convex mirror, a size of the convex mirror, a resolution of the zoom camera, and a minimum focal length of the zoom camera.

Optionally, the monitoring overlay determination module 330 includes:

the target zooming shooting picture determining unit is used for carrying out mirror image processing and distortion correction processing on the zooming shooting picture to obtain a target zooming shooting picture;

and the monitoring coverage picture determining unit is used for carrying out image stitching on the fixed focus shooting picture and the target zooming shooting picture to obtain a monitoring coverage shooting picture of the monitoring object.

Optionally, the apparatus further includes:

and the zoom distortion correction parameter determining module is used for determining the distortion correction parameter of the zoom shooting device according to the reflection picture of the convex mirror to the monitoring object so as to carry out distortion correction processing on the zoom shooting picture according to the distortion correction parameter.

Optionally, the monitoring coverage picture determining unit is configured to:

Determining an image overlapping area according to the fixed-focus shooting image and the target zooming shooting image;

performing pixel calibration on the picture overlapping area;

and performing image stitching on the fixed focus shooting picture and the target zoom shooting picture after the picture overlapping area is subjected to pixel calibration, so as to obtain a monitoring coverage shooting picture of the monitoring object.

The video monitoring device provided by the embodiment of the invention can execute the video monitoring method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.

Example IV

Fig. 5 shows a schematic diagram of the structure of an electronic device 10 that may be used to implement an embodiment of the invention. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. Electronic equipment may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.

As shown in fig. 5, the electronic device 10 includes at least one processor 11, and a memory, such as a Read Only Memory (ROM) 12, a Random Access Memory (RAM) 13, etc., communicatively connected to the at least one processor 11, in which the memory stores a computer program executable by the at least one processor, and the processor 11 may perform various appropriate actions and processes according to the computer program stored in the Read Only Memory (ROM) 12 or the computer program loaded from the storage unit 18 into the Random Access Memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 may also be stored. The processor 11, the ROM 12 and the RAM 13 are connected to each other via a bus 14. An input/output (I/O) interface 15 is also connected to bus 14.

Various components in the electronic device 10 are connected to the I/O interface 15, including: an input unit 16 such as a keyboard, a mouse, etc.; an output unit 17 such as various types of displays, speakers, and the like; a storage unit 18 such as a magnetic disk, an optical disk, or the like; and a communication unit 19 such as a network card, modem, wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.

The processor 11 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, digital Signal Processors (DSPs), and any suitable processor, controller, microcontroller, etc. The processor 11 performs the various methods and processes described above, such as a video surveillance method.

In some embodiments, the video surveillance method may be implemented as a computer program tangibly embodied on a computer-readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 10 via the ROM 12 and/or the communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the video surveillance method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the video monitoring method in any other suitable way (e.g., by means of firmware).

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.

A computer program for carrying out methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be implemented. The computer program may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) through which a user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.

The computing system may include clients and servers. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical hosts and VPS service are overcome.

It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present invention may be performed in parallel, sequentially, or in a different order, so long as the desired results of the technical solution of the present invention are achieved, and the present invention is not limited herein.

The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.

Claims (10)

1. A video monitoring method, comprising:

acquiring a fixed-focus shooting picture obtained by shooting a monitoring object by a fixed-focus shooting device, wherein the shooting coverage range of the fixed-focus shooting picture to the monitoring object is obtained according to shooting device parameters of the fixed-focus shooting device;

obtaining a zooming shooting picture obtained by shooting a convex mirror by a zooming shooting device, wherein the reflecting coverage of the convex mirror to the monitored object is added with the shooting coverage of the fixed-focus shooting picture to the monitored object, and the reflecting coverage is larger than or equal to the monitoring coverage of the monitored object;

And obtaining a monitoring coverage shooting picture of the monitoring object according to the fixed-focus shooting picture and the zooming shooting picture.

2. The method according to claim 1, wherein the determining of the photographing coverage of the monitoring object by the fixed focus photographing screen includes:

determining an inclination angle between a connecting line of the monitoring starting height of the monitoring object and the fixed focus shooting device and a horizontal plane according to the monitoring starting height, the installation height of the fixed focus shooting device and the distance between the fixed focus shooting device and the monitoring object;

and determining the coverage height of the fixed-focus shooting device according to the inclination angle, the vertical field angle of the fixed-focus shooting device, the distance between the fixed-focus shooting device and the monitored object and the installation height of the fixed-focus shooting device.

3. The method of claim 2, further comprising, after determining the height of coverage of the fixed focus camera:

determining a coverage floor of the fixed-focus shooting device according to the coverage height of the fixed-focus shooting device;

after the fixed focus shooting picture obtained by shooting the monitoring object by the fixed focus shooting device is obtained, the method further comprises the following steps:

Determining the highest floor in the fixed-focus shooting picture according to the coverage floor of the fixed-focus shooting device;

and determining the pixel area of the highest floor, and judging the identification target limiting condition for the pixel area of the highest floor.

4. The method of claim 1, wherein the curvature of the convex mirror matches a horizontal angle of view and a vertical angle of view of the fixed focus camera;

the installation height of the convex mirror is higher than the preset height of the monitoring object, and the preset height is the difference between the monitoring initial height and the installation height of the fixed-focus shooting device;

the distance between the convex mirror and the monitoring object is the same as the distance between the fixed focus shooting device and the monitoring object;

the inclination angle of the convex mirror is the same as that of the fixed-focus shooting device.

5. The method of claim 1, wherein the magnification of the zoom camera is derived from a distance between the zoom camera and the convex mirror, a size of the convex mirror, a resolution of the zoom camera, and a minimum focal length of the zoom camera.

6. The method according to claim 1, wherein obtaining a monitoring overlay shot of the monitoring object from the fixed focus shot and the zoom shot comprises:

mirror image processing and distortion correction processing are carried out on the zooming shooting picture, and a target zooming shooting picture is obtained;

and performing image stitching on the fixed-focus shooting picture and the target zooming shooting picture to obtain a monitoring coverage shooting picture of the monitoring object.

7. The method according to claim 6, further comprising:

and determining a distortion correction parameter of the zooming shooting device according to the reflection picture of the convex mirror to the monitoring object, so as to carry out distortion correction processing on the zooming shooting picture according to the distortion correction parameter.

8. A video monitoring device, comprising:

the fixed-focus shooting picture acquisition module is used for acquiring a fixed-focus shooting picture obtained by shooting a monitoring object by the fixed-focus shooting device, and the shooting coverage range of the fixed-focus shooting picture to the monitoring object is obtained according to shooting device parameters of the fixed-focus shooting device;

the zoom shooting picture acquisition module is used for acquiring a zoom shooting picture obtained by shooting a convex mirror by the zoom shooting device, wherein the reflection coverage of the convex mirror to the monitored object is added with the shooting coverage of the fixed-focus shooting picture to the monitored object, and the reflection coverage of the convex mirror to the monitored object is larger than or equal to the monitoring coverage of the monitored object;

And the monitoring coverage picture determining module is used for obtaining the monitoring coverage picture of the monitoring object according to the fixed-focus shooting picture and the zooming shooting picture.

9. A video monitoring electronic device, the electronic device comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,,

the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the video surveillance method of any one of claims 1-7.

10. A computer readable storage medium storing computer instructions for causing a processor to perform the video surveillance method according to any one of claims 1-7.