CN109120883B - Far and near scene-based video monitoring method and device and computer-readable storage medium - Google Patents

Far and near scene-based video monitoring method and device and computer-readable storage medium Download PDF

Info

Publication number
CN109120883B
CN109120883B CN201710481579.1A CN201710481579A CN109120883B CN 109120883 B CN109120883 B CN 109120883B CN 201710481579 A CN201710481579 A CN 201710481579A CN 109120883 B CN109120883 B CN 109120883B
Authority
CN
China
Prior art keywords
video monitoring
distance
short
target object
focus lens
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710481579.1A
Other languages
Chinese (zh)
Other versions
CN109120883A (en
Inventor
万心
徐卓东
�谷川�
李红卫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Hikvision Digital Technology Co Ltd
Original Assignee
Hangzhou Hikvision Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Hikvision Digital Technology Co Ltd filed Critical Hangzhou Hikvision Digital Technology Co Ltd
Priority to CN201710481579.1A priority Critical patent/CN109120883B/en
Publication of CN109120883A publication Critical patent/CN109120883A/en
Application granted granted Critical
Publication of CN109120883B publication Critical patent/CN109120883B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/667Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Lens Barrels (AREA)

Abstract

The invention discloses a far and near scene-based video monitoring method and device and a computer-readable storage medium, and belongs to the technical field of video monitoring. The method comprises the following steps: when the target object is detected, video monitoring on the target object by adopting a long-focus electric lens or a short-focus lens is determined according to the current video monitoring area of the target object. The video monitoring equipment provided by the embodiment of the invention comprises the long-focus electric lens and the short-focus lens at the same time, so that the long-focus electric lens or the short-focus lens can be selected to carry out video monitoring on the target object according to the current video monitoring area of the target object, the flexibility of video monitoring is improved, the problem that the target object is frequently monitored by adopting a single long-focus electric lens in the whole monitoring area is avoided, the zooming times of the expensive long-focus electric lens can be reduced, the service life of the long-focus electric lens is prolonged, and the wide-range popularization and use of the video monitoring equipment are facilitated.

Description

Far and near scene-based video monitoring method and device and computer-readable storage medium
Technical Field
The present invention relates to the field of video surveillance technology, and in particular, to a method and an apparatus for video surveillance based on a distant view and a close view, and a computer-readable storage medium.
Background
Currently, for an outdoor video monitoring scene, a user usually wants a camera to monitor a video at a position several hundred meters or even several kilometers away from the camera, that is, the user wants the camera to monitor a distant view. When the camera performs video monitoring on a long-range view, if a target object to be monitored is in a moving state, for example, the target object gradually moves to the position where the camera is located, and when the distance between the target object and the camera is short, the camera needs to continue video monitoring on the target object in the short-range view.
In the related art, the main implementation manner of simultaneously performing far and near view video monitoring on a target object is as follows: a long-focus electric lens with wide zooming focal length range and wide optical magnification range and a driving control module for controlling the long-focus electric lens are arranged in the camera. When the target object is in the moving process, the driving control module adjusts zooming parameters of the long-focus electric lens, such as a zooming focal length and an optical magnification, according to the distance between the target object and the long-focus electric lens, and controls the long-focus electric lens to zoom according to the adjusted zooming parameters, so that the zoomed long-focus electric lens can continuously perform video monitoring on the target object.
However, the telephoto electric lens used in the process of video monitoring on the target object needs to meet the requirements of a long-distance view and a short-distance view at the same time, so that the telephoto electric lens is expensive in cost and not beneficial to wide-range popularization and use. At present, the maximum times that the long-focus electric lens can zoom is 10 ten thousand, and the service life of the long-focus electric lens is seriously influenced.
Disclosure of Invention
In order to solve the problem of short service life of a telephoto electric lens applied to a far and near view in the related art, the embodiment of the invention provides a far and near view-based video monitoring method. The technical scheme is as follows:
in a first aspect, a method for video surveillance based on a far-near scene is provided, and the method is applied to a video surveillance device, where the video surveillance device includes a long-focus electric lens and a short-focus lens, and the method includes:
when a target object to be monitored is detected, determining the distance between the target object and the video monitoring equipment, and determining a video monitoring area where the target object is located currently according to the distance between the target object and the video monitoring equipment;
when the video monitoring area is a first preset area, performing video monitoring on the target object through the long-focus electric lens, wherein the first preset area is an area, and the distance between the first preset area and the video monitoring equipment is larger than a first preset distance;
and when the video monitoring area is a second preset area, performing video monitoring on the target object through the short-focus lens, wherein the second preset area is an area, the distance between the second preset area and the video monitoring equipment is smaller than a second preset distance, and the second preset distance is smaller than the first preset distance.
Optionally, after determining the video surveillance area where the target object is currently located, the method further includes:
when the video monitoring area is a third preset area, performing video monitoring on the target object through the long-focus electric lens to obtain first video information, wherein the third preset area is an area, and the distance between the third preset area and the video monitoring equipment is not more than the first preset distance and not less than the second preset distance;
performing video monitoring on the target through the short-focus lens to obtain second video information;
and splicing the first video information and the second video information to obtain the video information of the target object.
Optionally, after the video monitoring is performed on the target object through the tele electric lens to obtain the first video information, the method further includes:
determining the distance between the central point of the target object and the central point of the short-focus lens by a laser ranging method to obtain a first distance;
according to the first distance, determining a first rotary displacement from a corresponding relation between a prestored distance and the rotary displacement, wherein the first rotary displacement refers to the displacement of the short-focus lens which needs to be rotated when the target object is positioned at the central point of the visual angle area of the short-focus lens;
determining a second rotary displacement, wherein the second rotary displacement refers to the rotary displacement of the short-focus lens;
if the first rotary displacement is not consistent with the second rotary displacement, controlling the short-focus lens to rotate according to the first rotary displacement and the second rotary displacement;
and after the short-focus lens rotates, triggering the operation of carrying out video monitoring on the target object through the short-focus lens.
Optionally, before determining the first rotational displacement from the correspondence between the pre-stored distance and the rotational displacement according to the first distance, the method further includes:
when a plurality of monitoring points are arranged in the third preset area, determining the distance between each monitoring point in the plurality of monitoring points and the central point of the short-focus lens;
adjusting the rotational displacement of the short-focus lens, and controlling the short-focus lens to rotate according to the adjusted rotational displacement until the monitoring point is positioned at the central point of the visual angle area of the short-focus lens;
and storing the distance between the monitoring point and the central point of the short-focus lens and the current rotated displacement of the short-focus lens in the corresponding relation between the distance and the rotated displacement.
Optionally, the performing video monitoring on the target object through the tele electric lens includes:
determining the distance between the central point of the target object and the central point of the tele electric lens by a laser ranging method to obtain a second distance;
when the zoom parameter of the long-focus electric lens needs to be adjusted according to the second distance, adjusting the zoom parameter of the long-focus electric lens;
and continuously carrying out video monitoring on the target object through the long-focus electric lens after the zooming parameters are adjusted.
Optionally, the performing video monitoring on the target object through the short-focus lens includes:
determining the distance between the central point of the target object and the central point of the short-focus lens by a laser ranging method to obtain a third distance;
when the zoom parameter of the short-focus lens needs to be adjusted according to the third distance, adjusting the zoom parameter of the short-focus lens;
and continuously carrying out video monitoring on the target object through the short-focus lens after the zooming parameters are adjusted.
In a second aspect, a video monitoring apparatus based on a far and near scene is provided, which is applied to a video monitoring device, the video monitoring device includes a long-focus electric lens and a short-focus lens, and the apparatus includes:
the first determining module is used for determining the distance between the target object and the video monitoring equipment when the target object to be monitored is detected, and determining the video monitoring area where the target object is located currently according to the distance between the target object and the video monitoring equipment;
the first video monitoring module is used for carrying out video monitoring on the target object through the long-focus electric lens when the video monitoring area is a first preset area, and the first preset area is an area with a distance from the video monitoring equipment larger than a first preset distance;
and the second video monitoring module is used for carrying out video monitoring on the target object through the short-focus lens when the video monitoring area is a second preset area, the second preset area is an area, the distance between the second preset area and the video monitoring equipment is smaller than a second preset distance, and the second preset distance is smaller than the first preset distance.
Optionally, the apparatus further comprises:
the third video monitoring module is used for carrying out video monitoring on the target object through the long-focus electric lens to obtain first video information when the video monitoring area is a third preset area, and the third preset area is an area, wherein the distance between the third preset area and the video monitoring equipment is not more than the first preset distance and not less than the second preset distance;
the fourth video monitoring module is used for carrying out video monitoring on the target through the short-focus lens to obtain second video information;
and the processing module is used for splicing the first video information and the second video information to obtain the video information of the target object.
Optionally, the apparatus further comprises:
the second determining module is used for determining the distance between the central point of the target object and the central point of the short-focus lens through a laser ranging method to obtain a first distance;
a third determining module, configured to determine, according to the first distance, a first rotational displacement from a correspondence between a pre-stored distance and a rotational displacement, where the first rotational displacement is a displacement that the short-focus lens needs to rotate when the target object is located at a center point of a view angle area of the short-focus lens;
the fourth determining module is used for determining a second rotational displacement, wherein the second rotational displacement refers to the rotational displacement of the short-focus lens;
the control module is used for controlling the short-focus lens to rotate according to the first rotary displacement and the second rotary displacement if the first rotary displacement and the second rotary displacement are not consistent;
and the triggering module is used for triggering the operation of carrying out video monitoring on the target object through the short-focus lens after the short-focus lens rotates.
Optionally, the apparatus further comprises:
a fifth determining module, configured to determine, when a plurality of monitoring points are set in the third preset area, a distance between each of the monitoring points and a center point of the short focus lens;
the adjusting module is used for adjusting the rotational displacement of the short-focus lens and controlling the short-focus lens to rotate according to the adjusted rotational displacement until the monitoring point is positioned at the central point of the visual angle area of the short-focus lens;
and the storage module is used for storing the distance between the monitoring point and the central point of the short-focus lens and the current rotated displacement of the short-focus lens in the corresponding relation between the distance and the rotated displacement.
Optionally, the first video monitoring module includes:
the determining unit is used for determining the distance between the central point of the target object and the central point of the tele electric lens through a laser ranging device to obtain a second distance;
the adjusting unit is used for adjusting the zooming parameters of the long-focus electric lens when the fact that the zooming parameters of the long-focus electric lens need to be adjusted is determined according to the second distance;
and the video monitoring unit is used for continuously carrying out video monitoring on the target object through the long-focus electric lens after the zooming parameters are adjusted.
Optionally, the second video monitoring module includes:
the determining unit is used for determining the distance between the central point of the target object and the central point of the short-focus lens through a laser ranging device to obtain a third distance;
the adjusting unit is used for adjusting the zooming parameters of the short-focus lens when the fact that the zooming parameters of the short-focus lens need to be adjusted is determined according to the third distance;
and the video monitoring unit is used for continuously carrying out video monitoring on the target object through the short-focus lens after the zooming parameters are adjusted.
In a third aspect, a far and near view-based video monitoring apparatus is provided, which includes a processor, a communication interface, a memory and a communication bus;
the processor, the communication interface and the memory complete mutual communication through the communication bus;
the memory is used for storing computer programs;
the processor is configured to execute a program stored on the memory to implement the steps of any of the methods of claims 1-6.
In a fourth aspect, a computer-readable storage medium is provided, having stored therein a computer program which, when executed by a processor, implements the steps of any of the methods of claims 1-6.
The technical scheme provided by the embodiment of the invention has the following beneficial effects:
the video monitoring equipment provided by the embodiment of the invention simultaneously comprises the long-focus electric lens and the short-focus lens, so that when a target object is detected, the long-focus electric lens or the short-focus lens can be determined to be adopted to carry out video monitoring on the target object according to the current video monitoring area of the target object, the long-focus and short-focus double lenses are utilized to cooperate with each other to monitor the target object in multiple areas, the flexibility of video monitoring is improved, the video monitoring on the target object by frequently adopting a single long-focus electric lens in the whole monitoring area is avoided, the zooming times of the expensive long-focus electric lens can be reduced, the service life of the long-focus electric lens is prolonged, and the wide-range popularization and use of the video monitoring equipment are facilitated.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1A is a schematic diagram of a video monitoring apparatus according to an embodiment of the present invention;
fig. 1B is a schematic diagram of a master control structure according to an embodiment of the present invention;
fig. 1C is a schematic diagram of another master control structure provided in the embodiment of the present invention;
fig. 2 is a flowchart of a video monitoring method based on a far-near view according to an embodiment of the present invention;
fig. 3A is a flowchart of another method for monitoring video based on a far-near view according to an embodiment of the present invention;
fig. 3B is a schematic view of distribution of monitoring areas of a video monitoring apparatus according to an embodiment of the present invention;
fig. 4 is a flowchart of another video monitoring method based on a far-near view according to an embodiment of the present invention;
fig. 5A is a block diagram of a video monitoring apparatus based on a far-near view according to an embodiment of the present invention;
FIG. 5B is a block diagram of another video surveillance apparatus based on a far-near view according to an embodiment of the present invention;
fig. 6 is a block diagram of another video monitoring apparatus based on a far-near view according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
Since the video monitoring method based on the distant view provided by the embodiment of the present invention is applied to the video monitoring device, before the video monitoring method based on the distant view provided by the embodiment of the present invention is explained in detail, the video monitoring device provided by the embodiment of the present invention is explained first.
Fig. 1A is a schematic diagram of a video monitoring device 100 according to an embodiment of the present invention, and as shown in fig. 1A, the video monitoring device 100 includes a bolt module 101 and a movement-integrated module 102, and the bolt module 101 and the movement-integrated module 102 communicate with each other in a wired or wireless manner.
The bolt module 101 includes a tele electric lens 1011, a laser module 1012, a main control 1013, a cradle head 1014, and a power module 1015. The tele electric lens 1011, the laser module 1012 and the power module 1015 are respectively connected to the main control module 1013 to form an integral frame, and the cradle head 1014 is connected to the integral frame through the slip ring 1. The tele electric lens 1011 is used to capture video frames of a distant view area. The laser module 1012 is used to determine the distance between the object being measured and the tele motorized lens. The main control 1013 is configured to process a video picture acquired by the tele electric lens 1011 and report the processed video picture to a monitoring center, and the main control 1013 is further configured to determine whether the pan/tilt head 1014 needs to be controlled according to a current situation. The pan and tilt head 1014 is used to control the movement of the bolt module 101. The power module 1015 is used to supply power to the entire video monitoring apparatus 100.
In addition, the core integrated module 102 is a high-definition all-in-one machine which is embedded with a short-focus lens, has a stability-increasing cradle head and can automatically focus in a short-focus range. Referring to fig. 1, the movement-integrated module 102 includes a short-focus lens 1021, a laser module 1022, a main control 1023, and a pan-tilt 1024. The short-focus lens 1021, the laser module 1022 and the pan-tilt 1024 are respectively connected with the main control module 1023. The movement integrated module 102 is connected with the bolt module through a slip ring 2. The short-focus lens 1021 is used for acquiring a video picture of a close-range area, the laser module 1022 is used for determining the distance between an object to be detected and the short-focus lens, the main control 1023 is used for processing the video picture acquired by the short-focus lens 1021 and sending the processed video picture to the gun camera module, and the main control 1023 is further used for determining whether the cradle head 1024 needs to be controlled according to the current situation. The pan/tilt head 1024 is used to control the movement of the movement-integrated module 102.
It should be noted that, the motor used in the pan-tilt 1014 is a stepping motor driving a worm and worm gear, and the motor adopts pulse stepping, so that the precision control is high. The motor used in the holder 1024 is a small brushless direct current motor, the motor has a high starting speed and is suitable for force-receiving operation, and the motor is usually matched with a high-precision position sensor to realize closed-loop precision control. In which position sensors are used to accurately sense the distance between objects, in embodiments of the present invention, the position sensors used in conjunction with the miniature brushless dc motor are horizontal and vertical angle encoders.
In addition, in the embodiment of the present invention, a gyroscope sensor is further installed inside the movement-integrated module 102, and the gyroscope sensor is used for detecting an inclination angle of the short-focus lens, so as to achieve mechanical anti-shake of the short-focus lens.
Specifically, the internal structures of the master 1013 and the master 1023 are described in detail below with reference to fig. 1B and 1C, respectively.
As shown in fig. 1B, the master 1013 includes a MCU1 (microcontrol Unit), two GPUs (Graphics Processing units, image processors), GPU1 and GPU2, an FPGA (Field-Programmable Gate Array), an ARM1(Acorn RISC Machine, processor), a DDR4(Double Data Rate, Double Data synchronous dynamic random access memory), a FLASH (for storing Data and program codes), and a gigabit SWITCH (SWITCH).
The FPGA is connected with an image sensor which is included by the long-focus electric lens 1011, the FPGA is connected with an ARM1 and an MCU1, the MCU1 is connected with a drive control module which is included by the laser module 1012 and the long-focus electric lens 1011 respectively, the ARM1 is connected with a GPU1 and a cloud deck 1014, the FPGA and the ARM1 are both connected with a DDR, and the ARM1 is also connected with a FLASH. The switch is connected to ARM1, and a GPU2 is connected to the switch. External devices, such as a monitoring center or a movement-integrated module 102, are connected to the switch.
Specifically, the basic process of the master control module 1013 shown in fig. 1B in data processing is as follows:
the FPGA is equivalent to a coprocessor and has strong parallel processing capability, so that the FPGA performs algorithm preprocessing on the image sent by the image sensor preliminarily and sends the preprocessed image to the ARM1 so as to improve the data processing speed of the ARM 1. The ARM1 processes the received preprocessed image to obtain an image processed by the ARM1, sends the image processed by the ARM1 to the GPU1, the GPU1 further processes the image processed by the ARM1, such as simple face recognition analysis, and returns the analysis result to the ARM 1. The FPGA and the ARM1 can store the processed data in the DDR in the process of processing the data, and the ARM can also store the specified data in the FLASH.
In addition, according to the image processed by ARM1, ARM1 analyzes the movement of the target object to be monitored currently, determines whether it is necessary to control the rotation of the cradle head 1014, and sends a rotation request to the cradle head 1014 to rotate the cradle head 1014 when it is determined that it is necessary to control the rotation of the cradle head 1014.
When receiving the image data preprocessed by the FPGA, the MCU1 determines whether the zoom parameter of the tele electric lens 1011 needs to be adjusted according to the image data preprocessed by the FPGA and the distance information sent by the laser module 1012, and when the MCU1 determines that the zoom parameter of the tele electric lens 1011 needs to be adjusted, the MCU1 sends the adjusted zoom parameter to the driving control module included in the tele electric lens 1011, and the driving control module performs zooming on the tele electric lens.
It should be noted that the GPU2 has stronger data processing capability than the GPU1, for example, the GPU2 may also perform behavior feature analysis or deep learning. Therefore, after receiving the data processed by ARM1 sent by ARM1, the switch can also send the data processed by ARM1 to GPU2, and the GPU2 further processes the data processed by ARM1 and returns the processing result to the switch. An external device, such as a monitoring center, may retrieve the data from the switch after further processing by GPU 2. That is, the GPU1 is mainly used for performing operations such as face recognition and facial feature information extraction, and the GPU2 is used as an auxiliary of the GPU1, and therefore, the GPU2 has a strong floating point arithmetic capability, and is mainly used for performing operations such as target value line feature analysis and scalable deep learning.
The ARM1 used in the embodiment of the present invention may be an Internet Protocol Camera system on chip (IP Camera SOC) chip dedicated to haisi Hi3519 or other chips, the FPGA may be an XC7a200T device of the artis-7 series of Xilinx corporation or other devices, the MCU may be fuji, untron, Kowa, or the like, the GPU1 may be an MA series of mobilius corporation, and the GPU2 may be an integrated multi-GPU module of Tegra X1 of NVDIA (england).
Finally, it should be noted that the FPGA and the MCU1 may be connected through a Serial Peripheral Interface (SPI), the ARM1 and the GPU1 may be connected through a Universal Serial Bus (USB), and the ARM1 and the pan-tilt 1014 may communicate through a Universal Asynchronous Receiver/Transmitter (UART). Of course, the various parts included in the main control 1013 may also be connected in other manners, and the embodiments of the present invention are not limited in particular, and the above connection manner is only an example.
Referring to fig. 1C, the master 1014 includes a MCU2, a GPU and an ARM 2. Because the movement-integrated module 102 needs less data to process, the FPGA is not arranged inside the movement-integrated module.
Different from the gun camera module, the driving control module and the image sensor which are included in the short-focus lens 1021 are both connected with an ARM2, a GPU3 and an MCU2 are connected to the ARM2, a laser module 1022 is connected to the MCU2, and a cradle head 10124 and a position sensor which is matched with the cradle head 1024 for use are connected with the MCU 2.
Among them, the functions of the GPU3 and the GPU1 are substantially the same, the functions of the MCU2 and the MCU1 are substantially the same, and the functions of the ARM2 and the ARM1 are substantially the same, so the above description about the GPU1, the MCU1, and the ARM1 is basically applicable to the GPU3, the MCU3, and the ARM3 in the master 1023, and will not be described in detail here.
The image sensor of the short focus lens 1021 directly sends the resulting image to the ARM2, where it is processed by the ARM 2. In one aspect, ARM2 sends the processed data to GPU2, and the processed data is further processed by GPU3, such as simple face recognition. On the other hand, the ARM2 sends the processed data to the MCU2, the MCU2 determines whether the movement-integrated module 102 needs to be controlled to rotate by the pan-tilt 1024 according to the distance information sent by the laser module 1022 and the processed data, and sends a rotation request to the pan-tilt 1024 to enable the pan-tilt 1024 to control the movement-integrated module 102 to rotate when it is determined that the movement-integrated module 102 needs to be controlled to rotate by the pan-tilt 1024.
In addition, the MCU2 also determines whether the zoom parameter of the short focus lens 1021 needs to be adjusted according to the distance information and the processed data transmitted by the laser module 1022, and when the MCU2 determines that the zoom parameter of the short focus lens 1021 needs to be adjusted, transmits the adjusted zoom parameter to a driving control module included in the short focus lens 1021, and performs zooming on the short focus lens by the driving control module.
The method for monitoring videos based on far and near views according to the embodiments of the present invention will be further described with reference to the accompanying drawings.
Fig. 2 is a flowchart of a video monitoring method based on a far-near view according to an embodiment of the present invention, where the method is applied to the video monitoring apparatus shown in fig. 1A, and as shown in fig. 2, the method includes the following steps:
in step 201, when a target object to be monitored is detected, a distance between the target object and the video monitoring device is determined, and a video monitoring area where the target object is currently located is determined according to the distance between the target object and the video monitoring device.
In the embodiment of the present invention, since the video monitoring device includes the long-focus electric lens and the short-focus lens, when the target object is detected, the video monitoring area where the target object is currently located needs to be determined first to determine whether to perform video monitoring on the target object through the long-focus electric lens or through the short-focus lens.
In step 202, when the video monitoring area is a first preset area, the telephoto electric lens is used to perform video monitoring on the target object, and the first preset area is an area where a distance between the first preset area and the video monitoring device is greater than a first preset distance.
Because the first preset area is an area with a distance from the video monitoring device greater than a first preset distance, that is, the first preset area belongs to a distant view area, at this time, the target object can be video-monitored through the tele electric lens.
In step 203, when the video monitoring area is a second preset area, the target object is video monitored through the short-focus lens, the second preset area is an area where a distance between the second preset area and the video monitoring device is smaller than a second preset distance, and the second preset distance is smaller than the first preset distance.
The second preset area is an area, the distance between the second preset area and the video monitoring equipment is smaller than the second preset distance, namely the second preset area belongs to a close-range area, at the moment, the target object can be subjected to video monitoring through the short-focus lens, and the target object is prevented from being subjected to video monitoring continuously through the long-focus electric lens in the close-range area.
The video monitoring equipment provided by the embodiment of the invention simultaneously comprises the long-focus electric lens and the short-focus lens, so that when a target object is detected, the long-focus electric lens or the short-focus lens can be determined to be adopted to carry out video monitoring on the target object according to the current video monitoring area of the target object, the long-focus and short-focus double lenses are utilized to cooperate with each other to monitor the target object in multiple areas, the flexibility of video monitoring is improved, the video monitoring on the target object by frequently adopting a single long-focus electric lens in the whole monitoring area is avoided, the zooming times of the expensive long-focus electric lens can be reduced, the service life of the long-focus electric lens is prolonged, and the wide-range popularization and use of the video monitoring equipment are facilitated.
It should be noted that, when the video monitoring device provided by the embodiment of the present invention performs video monitoring on the target object, the video monitoring device mainly includes two processes, one is to set the relevant parameters of the video monitoring device before performing video monitoring on the target object, and the other is to perform video monitoring on the target object based on the set relevant parameters. The following examples will be used to illustrate these two processes, respectively.
Fig. 3A is a flowchart of another far-near view-based video monitoring method according to an embodiment of the present invention, which is applied to the video monitoring apparatus shown in fig. 1A, and this embodiment will be used to explain a process of setting relevant parameters of the video monitoring apparatus, as shown in fig. 3A, the method includes the following steps:
in step 301, monitoring points in a monitoring area of a video monitoring device are determined.
In the embodiment of the invention, the monitoring area of the video monitoring equipment is divided into three preset areas, namely a first preset area, a second preset area and a third preset area. The first preset area is an area, a distance between the first preset area and the video monitoring equipment is greater than a first preset distance, and the first preset area is a distant view area. The second preset area is an area where a distance between the second preset area and the video monitoring device is smaller than a second preset distance, that is, the second area is a close-range area, and the second preset distance is smaller than the first preset distance. The third preset area is an area, the distance between the third preset area and the video monitoring equipment is smaller than the first preset distance and larger than the second preset distance. The first preset distance and the second preset distance are preset distances, and the first preset distance and the second preset distance are related to parameters such as the installation height of the video monitoring equipment and the focal length of the lens. For example, the first predetermined distance may be 1500 meters and the second predetermined distance may be 850 meters.
Therefore, the monitoring points in the monitoring area of the video monitoring device are determined, that is, the monitoring points in the first preset area, the monitoring points in the second preset area, and the monitoring points in the third preset area are determined. Specifically, the monitoring point in each preset area is set by a user, that is, when the video monitoring device receives a monitoring point setting instruction, the monitoring point is determined from the point selected by the user.
For example, fig. 3B is a schematic view of distribution of monitoring areas of a video monitoring apparatus according to an embodiment of the present invention. As shown in fig. 3B, it is assumed that the video monitoring device is installed at a top floor of a high building, at this time, the first preset distance is set to 1500 meters, the second preset distance is set to 800 meters, the first preset area is an area where the distance between the first preset area and the video monitoring device is greater than 1500 meters, the second preset area is an area where the distance between the second preset area and the video monitoring device is less than 800 meters, and the third preset area is an area where the distance between the third preset area and the video monitoring device is not greater than 1500 meters and not less than 800 meters.
In step 302, when a plurality of monitoring points are set in the first preset area, a correspondence between a distance for the tele electric lens and a zoom parameter is determined and stored.
And for each monitoring point in the plurality of monitoring points in the first preset area, determining the distance between the monitoring point and the long-focus electric lens by a laser ranging method, and adjusting the zooming parameters of the long-focus electric lens until the information of the monitoring point can be clearly monitored by the long-focus electric lens at present to obtain the optimal zooming parameters of the monitoring point monitored by the long-focus electric lens. And then, establishing a corresponding relation between the distance of the long-focus electric lens and the zooming parameter in advance, and storing the distance between the monitoring point and the long-focus electric lens and the optimal zooming parameter of the long-focus electric lens for monitoring the monitoring point in the corresponding relation.
The implementation process of determining the distance between the monitoring point and the tele electric lens by the laser ranging method may be as follows: as shown in fig. 1A, the laser module 1012 sends a preset laser pulse signal to a preset marker of a monitoring point, records the sending time, determines the receiving time of the reflected signal when receiving the reflected pulse signal of the preset laser pulse signal, and determines the distance between the monitoring point and the tele electric lens, that is, the distance between the monitoring point and the video monitoring device, according to the difference between the receiving time and the sending time and the propagation speed of light.
It should be noted that, compared with the conventional method of calculating the distance between the monitoring point and the telephoto electric lens through the field angle of the lens, in the embodiment of the present invention, the distance between the monitoring point and the telephoto electric lens is obtained through the laser pulse signal emitted by the laser ranging module, so that the accuracy of the obtained distance between the monitoring point and the telephoto electric lens can be improved.
In addition, the zoom parameters mainly include a zoom focal length and an optical magnification, and for convenience of description, the zoom focal length is denoted by h, and the optical magnification is denoted by v. The multiple monitoring points in the first preset area are respectively marked as a monitoring point A-1, a monitoring point A-2, a monitoring point A-3 and the like, and the distances between the multiple monitoring points and the tele electric lens are respectively A-L1, A-L2, A-L3 and the like. At this time, the correspondence between the distance for the telephoto electric lens and the zoom parameter can be represented by the following table 1:
TABLE 1
Monitoring point Distance between two adjacent plates Zoom parameter
Monitoring point A-1 A-L1 h1、v1
Monitoring point A-2 A-L2 h2、v2
Monitoring Point A-3 A-L3 h3、v3
In step 303, when a plurality of monitoring points are set in the second preset area, a correspondence between the distance for the short focus lens and the zoom parameter is determined and stored.
The implementation of step 303 is substantially the same as that of step 302, and will not be described in detail here.
In step 304, when a plurality of monitoring points are set in the third preset area, a correspondence between a distance and a rotational displacement for the short focus lens is determined and stored.
Specifically, for each of the plurality of monitoring points in the third preset area, a distance between the monitoring point and the center point of the short focus lens is determined. And adjusting the rotation displacement of the short-focus lens, and controlling the short-focus lens to rotate according to the adjusted rotation displacement until the monitoring point is positioned at the central point of the visual angle area of the short-focus lens. And storing the distance between the monitoring point and the central point of the short-focus lens and the current rotated displacement of the short-focus lens in the corresponding relation between the distance and the rotation displacement.
The method for determining the distance between the monitoring point and the center point of the short-focus lens is substantially the same as that in step 302, except that a preset laser pulse signal is sent through the laser module 1022 shown in fig. 1A.
And adjusting the rotational displacement of the short-focus lens, that is, adjusting the rotational displacement of the pan/tilt head 1024 shown in fig. 1A, and controlling the short-focus lens to rotate according to the adjusted rotational displacement, that is, the main control 1023 controls the pan/tilt head 1024 to rotate according to the adjusted rotational displacement.
It should be noted that, in the embodiment of the present invention, the rotational displacement of the short-focus lens is actually equivalent to the rotational displacement of the long-focus electric lens, and the video monitoring device has been set with a relative zero point position when the video monitoring device leaves the factory, that is, a relative zero point position is set at a position of the long-focus electric lens in advance. That is, the rotational displacement of the short focus lens is a displacement between the center point of the short focus lens and the relative zero point position.
As shown in fig. 1A, the displacement between the center point and the relative zero point position of the short-focus lens can be determined by a position sensor used in cooperation with the pan-tilt 1024. Specifically, the position sensor used in cooperation with the pan/tilt head 1024 includes a horizontal position sensor and a vertical position sensor, the horizontal position sensor is used for testing the offset of the pan/tilt head, that is, the offset of the short-focus lens in the horizontal direction relative to the long-focus electric lens, and the vertical position sensor is used for testing the offset of the pan/tilt head, that is, the offset of the short-focus lens in the vertical direction relative to the long-focus electric lens. For the convenience of description later, the offset in the horizontal direction is denoted as H, the offset in the vertical direction is denoted as V, and the rotational displacement of the pan/tilt head at this time may be denoted as (H, V).
Similarly, the plurality of monitoring points in the third preset area are respectively marked as a monitoring point C-1, a monitoring point C-2, a monitoring point C-3 and the like, and the distances between the plurality of monitoring points and the tele electric lens are respectively C-L1, C-L2, C-L3 and the like. At this time, the correspondence between the distance and the rotational displacement for the short focus lens can be represented by the following table 2:
TABLE 2
Monitoring point Distance between two adjacent plates Rotational displacement
Monitoring point C-1 C-L1 (H1,V1)
Monitoring point C-2 C-L2 (H2,V2)
Monitoring point C-3 C-L3 (H2,V2)
In the embodiment of the invention, the relevant parameters aiming at the long-focus electric lens and the short-focus lens are stored in advance, so that the zooming parameters can be obtained and the lens can be controlled to zoom more quickly in the follow-up process by inquiring the corresponding relation, and the quick focusing can be realized. Particularly, in the third preset area, the subsequent video monitoring equipment can improve the relay accuracy of the short-focus lens by quickly inquiring the corresponding relation between the distance and the rotational displacement, so that the time for continuously monitoring the long-focus electric lens is reduced, and the image splicing time is also reduced.
Fig. 4 is a flowchart of another far-near view-based video monitoring method according to an embodiment of the present invention, where the method is applied to the video monitoring apparatus shown in fig. 1A, and the embodiment of the present invention will be used to explain how the video monitoring apparatus performs video monitoring on a target object according to the related parameters stored in fig. 3, as shown in fig. 4, the method includes the following steps:
in step 401, when a target object to be monitored is detected, a distance between the target object and the video monitoring device is determined, and a video monitoring area where the target object is currently located is determined according to the distance between the target object and the video monitoring device.
Specifically, when the video monitoring apparatus 100 shown in fig. 1A performs video monitoring, the gun camera module 101 is usually used to perform video monitoring on a designated distant view area, that is, when the gun camera module 101 acquires a video frame, the GPU1 included in the main control module 1013 of the gun camera module 101 performs simple identification on the video frame. That is, the GPU1 matches the feature information in the video frame with the pre-stored feature information, and when the matching rate exceeds a preset value, the GPU1 determines that the target object to be monitored exists in the video frame, and when the matching rate does not exceed the preset value, the GPU1 determines that the target object does not exist in the video frame.
When the GPU1 determines that a target object exists in the video image, the GPU1 reports that the target object exists in the video image to the ARM1, at this time, the ARM1 of the video monitoring device 100 determines that the target object is detected, and the ARM1 controls the laser module 1012 to measure the distance between the target object and the tele electric lens through the FPGA and the MCU1, that is, determines the distance between the target object and the video monitoring device. And determining the current video monitoring area of the target object according to the distance between the target object and the video monitoring equipment.
The specific implementation process of the ARM1 for controlling the laser module 1012 to measure the distance between the target object and the tele electric lens may be: the laser module 1012 sends a preset laser pulse signal to a target object, records the sending time, determines the receiving time of the reflected signal when receiving the reflected signal of the preset laser pulse signal, and determines the distance between the target object and the tele electric lens, that is, the distance between the target object and the video monitoring device, according to the difference between the receiving time and the sending time and the propagation speed of light.
As shown in step 301 in fig. 3, the monitoring area of the video monitoring apparatus is divided into three preset areas, a first preset area, a second preset area and a third preset area. Therefore, according to the distance between the target object and the video monitoring device, the video monitoring area where the target object is currently located is determined, that is, the video monitoring area where the target object is currently located is determined to be one of the first preset area, the second preset area and the third preset area. That is, when the distance between the target object and the video monitoring device is greater than a first preset distance, determining that the video monitoring area is a first preset area; when the distance between the target object and the video monitoring equipment is smaller than a second preset distance, determining that the video monitoring area is a second preset area; and when the distance between the target object and the video monitoring equipment is not greater than a first preset distance and not less than a second preset distance, determining that the video monitoring area is a third preset area.
In step 402, when the video surveillance area is a first preset area, performing video surveillance on the target object through the tele electric lens;
when the video monitoring area is a first preset area, it indicates that the current target object is in a distant view area, and at this time, if the target object is in a moving state, the video monitoring needs to be performed on the target object through the long-focus electric lens, that is, in the moving process of the target object, the zoom parameter of the long-focus electric lens is adjusted in real time, so as to realize the tracking monitoring on the target object.
Specifically, the distance between the center point of the target object and the center point of the tele electric lens is determined by a laser ranging method, and a second distance is obtained. And when the zoom parameter of the long-focus electric lens needs to be adjusted according to the second distance, adjusting the zoom parameter of the long-focus electric lens. And continuously carrying out video monitoring on the target object through the long-focus electric lens after the zooming parameters are adjusted.
The implementation process of determining that the zoom parameter of the tele electric lens needs to be adjusted according to the second distance may be to search, according to the second distance, the zoom parameter corresponding to the second distance from a pre-stored correspondence between the distance of the tele electric lens and the zoom parameter, and determine the current zoom parameter of the tele electric lens. And judging whether the zooming parameter corresponding to the second distance is consistent with the current zooming parameter of the long-focus electric lens, if not, determining that the zooming parameter of the long-focus electric lens needs to be adjusted, namely adjusting the current zooming parameter of the long-focus electric lens to be the zooming parameter corresponding to the second distance.
The pre-stored correspondence between the distance to the telephoto electric lens and the zoom parameter is the correspondence shown in table 1 in step 302 of fig. 3, and will not be described in detail here.
In step 403, when the video monitoring area is a second preset area, performing video monitoring on the target object through the short-focus lens, where the second preset area is an area where a distance between the second preset area and the video monitoring device is smaller than a second preset distance, and the second preset distance is smaller than the first preset distance.
When the video monitoring area is a second preset area, it indicates that the current target object is in a close-range area, and at this time, if the target object is in a moving state, the target object needs to be video monitored through the short-focus lens, that is, in the moving process of the target object, the zoom parameter of the short-focus lens is adjusted in real time, so as to realize tracking monitoring of the target object.
Specifically, the distance between the center point of the target object and the center point of the short-focus lens is determined by a laser ranging method, and a third distance is obtained. And when the zoom parameter of the short-focus lens needs to be adjusted according to the third distance, adjusting the zoom parameter of the short-focus lens. And continuously carrying out video monitoring on the target object through the short-focus lens after the zooming parameters are adjusted.
The implementation process of determining that the zoom parameter of the short-focus lens needs to be adjusted according to the third distance may be to search, according to the third distance, the zoom parameter corresponding to the third distance from a pre-stored correspondence between the distance of the short-focus lens and the zoom parameter, and determine the current zoom parameter of the short-focus lens at the same time. And judging whether the zooming parameter corresponding to the third distance is consistent with the current zooming parameter of the short-focus lens, if not, determining that the zooming parameter of the short-focus lens needs to be adjusted, namely adjusting the current zooming parameter of the short-focus lens to the zooming parameter corresponding to the third distance.
The pre-stored correspondence between the distance to the short-focus lens and the zoom parameter is the correspondence stored in step 303 in fig. 3, and will not be described in detail here.
In step 404, when the video monitoring area is a third preset area, the telephoto electric lens is used to perform video monitoring on the target object, so as to obtain first video information.
When the video monitoring area is a third preset area, it is indicated that the target object is located at the junction of the long-range area and the short-range area at the moment, and at this moment, video monitoring can be performed on the target object through the long lens on one hand, and video monitoring can be performed on the target object through the short-focus lens on the other hand. Namely, the short-focus lens relays the long-focus electric lens to carry out video monitoring on the target object. Because the target object is subjected to video monitoring through the short-focus lens, when the target object is located in the third preset area, the zooming parameters of the long-focus electric lens do not need to be adjusted when the long-focus electric lens is used for carrying out video monitoring on the target object.
As shown in fig. 1A, a pan/tilt head 1024 is installed in the module integrated with the movement to adjust the position of the short-focus lens at any time. Therefore, when the short-focus lens relays the long-focus electric lens to perform video monitoring on the target object, the current position of the short-focus lens may not be the optimal position for monitoring the target object, and therefore, before the short-focus lens relays the long-focus electric lens to perform video monitoring on the target object, the position of the short-focus lens is adjusted, so that the short-focus lens can monitor the target object more clearly.
Wherein adjusting the position of the short focus lens can be implemented by the following step 405.
In step 405, the position of the short focus lens is adjusted so that the target object is located at the center point of the view angle area of the short focus lens.
Specifically, the distance between the center point of the target object and the center point of the short-focus lens is determined by a laser ranging method, and a first distance is obtained. And determining a first rotary displacement from a corresponding relation between the pre-stored distance and the rotary displacement according to the first distance, wherein the first rotary displacement refers to the displacement of the short-focus lens which needs to be rotated when the target object is positioned at the central point of the visual angle area of the short-focus lens. And determining a second rotation displacement, wherein the second rotation displacement refers to the rotation displacement of the short-focus lens. And if the first rotary displacement is not consistent with the second rotary displacement, controlling the short-focus lens to rotate according to the first rotary displacement and the second rotary displacement, namely, adjusting the position of the short-focus lens.
The pre-stored correspondence between the distance and the rotational displacement is the correspondence shown in table 2 in step 304 of fig. 3, and will not be described in detail here.
After the short focus lens rotates, an operation of performing video monitoring on the target object through the short focus lens is triggered, that is, the operation of step 406 described below is performed.
In step 406, the target is video-monitored by the short-focus lens to obtain second video information, and the first video information and the second video information are spliced to obtain video information of the target object.
After the second video information is obtained through the short focus lens, because the first video information and the second video information have images of overlapping parts, the first video information and the second video information can be spliced to obtain an image simultaneously including the first video information and the second video information, that is, to obtain the video information of the target image.
Specifically, image preprocessing is respectively performed on first video information and second video information, such as denoising and edge extraction, matched feature points in the first video information and the second video information are searched, a transformation model between the first video information and the second video information is established according to the matched feature points, the first video information and the second video information are converted into the same coordinate system according to the established transformation model, and the first video information and the second video information converted into the same coordinate system are subjected to splicing reconstruction to obtain video information of the target image.
For example, as shown in fig. 3B, when the target object gradually moves from the first preset area to the second preset area, that is, the target object gradually moves from the distant view area to the close view area, and when the distance between the target object and the video monitoring device is greater than 1500 meters, the target object is video monitored through step 402. When the target object gradually moves to the third preset area, the video monitoring is continuously performed on the target object through the steps 404 to 406, that is, in the third preset area, the long-focus electric lens continuously performs the video monitoring on the target object, and meanwhile, the short-focus lens is started to perform the video monitoring on the target object. When the target object moves to the second preset area, the target object is video-monitored only by the short-focus lens, that is, the target object is video-monitored by the step 403.
The video monitoring equipment provided by the embodiment of the invention simultaneously comprises the long-focus electric lens and the short-focus lens, so that when a target object is detected, the long-focus electric lens or the short-focus lens can be determined to be adopted to carry out video monitoring on the target object according to the current video monitoring area of the target object, the long-focus and short-focus double lenses are utilized to cooperate with each other to monitor the target object in multiple areas, the flexibility of video monitoring is improved, the video monitoring on the target object by frequently adopting a single long-focus electric lens in the whole monitoring area is avoided, the zooming times of the expensive long-focus electric lens can be reduced, the service life of the long-focus electric lens is prolonged, and the wide-range popularization and use of the video monitoring equipment are facilitated.
In addition to providing the above-mentioned video monitoring method based on the far and near view, an embodiment of the present invention further provides a video monitoring apparatus based on the far and near view, where the video monitoring apparatus based on the far and near view is applied to the video monitoring device shown in fig. 1A, as shown in fig. 5A, the video monitoring apparatus 500 based on the far and near view includes a first determining module 501, a first video monitoring module 502, and a second video monitoring module 503:
a first determining module 501, configured to determine, when a target object to be monitored is detected, a distance between the target object and the video monitoring device, and determine, according to the distance between the target object and the video monitoring device, a video monitoring area where the target object is currently located;
a first video monitoring module 502, configured to perform video monitoring on the target object through the tele electric lens when the video monitoring area is a first preset area, where a distance between the first preset area and the video monitoring device is greater than a first preset distance;
the second video monitoring module 503 is configured to perform video monitoring on the target object through the short-focus lens when the video monitoring area is a second preset area, where the second preset area is an area where a distance between the second preset area and the video monitoring device is smaller than a second preset distance, and the second preset distance is smaller than the first preset distance.
Optionally, referring to fig. 5B, the apparatus 500 further includes a third video monitoring module 504, a fourth video monitoring module 505, and a processing module 506:
a third video monitoring module 504, configured to perform video monitoring on the target object through the tele electric lens to obtain first video information when the video monitoring area is a third preset area, where a distance between the third preset area and the video monitoring device is not greater than the first preset distance and not less than the second preset distance;
a fourth video monitoring module 505, configured to perform video monitoring on the target through the short-focus lens, so as to obtain second video information;
the processing module 506 is configured to perform stitching processing on the first video information and the second video information to obtain video information of the target object.
Optionally, the apparatus 500 further comprises:
the second determining module is used for determining the distance between the central point of the target object and the central point of the short-focus lens through a laser ranging method to obtain a first distance;
a third determining module, configured to determine, according to the first distance, a first rotational displacement from a correspondence between a pre-stored distance and a rotational displacement, where the first rotational displacement is a displacement that the short-focus lens needs to rotate when the target object is located at a center point of a view angle area of the short-focus lens;
the fourth determining module is used for determining a second rotational displacement, wherein the second rotational displacement refers to the rotational displacement of the short-focus lens;
the control module is used for controlling the short-focus lens to rotate according to the first rotary displacement and the second rotary displacement if the first rotary displacement and the second rotary displacement are not consistent;
and the triggering module is used for triggering the operation of carrying out video monitoring on the target object through the short-focus lens after the short-focus lens rotates.
Optionally, the apparatus 500 further comprises:
a fifth determining module, configured to determine, for each monitoring point of the multiple monitoring points, a distance between the monitoring point and a center point of the short-focus lens when multiple monitoring points are set in the third preset area;
the adjusting module is used for adjusting the rotational displacement of the short-focus lens and controlling the short-focus lens to rotate according to the adjusted rotational displacement until the monitoring point is positioned at the central point of the visual angle area of the short-focus lens;
and the storage module is used for storing the distance between the monitoring point and the central point of the short-focus lens and the current rotated displacement of the short-focus lens in the corresponding relation between the distance and the rotated displacement.
Optionally, the first video monitoring module 502 includes:
the determining unit is used for determining the distance between the central point of the target object and the central point of the tele electric lens through the laser ranging device to obtain a second distance;
the adjusting unit is used for adjusting the zooming parameters of the long-focus electric lens when the fact that the zooming parameters of the long-focus electric lens need to be adjusted is determined according to the second distance;
and the video monitoring unit is used for continuously carrying out video monitoring on the target object through the long-focus electric lens after the zooming parameters are adjusted.
Optionally, the second video monitoring module 503 includes:
the determining unit is used for determining the distance between the central point of the target object and the central point of the short-focus lens through the laser ranging device to obtain a third distance;
the adjusting unit is used for adjusting the zooming parameters of the short-focus lens when the fact that the zooming parameters of the short-focus lens need to be adjusted is determined according to the third distance;
and the video monitoring unit is used for continuously carrying out video monitoring on the target object through the short-focus lens after the zooming parameters are adjusted.
The video monitoring equipment provided by the embodiment of the invention simultaneously comprises the long-focus electric lens and the short-focus lens, so that when a target object is detected, the long-focus electric lens or the short-focus lens can be determined to be adopted to carry out video monitoring on the target object according to the current video monitoring area of the target object, the long-focus and short-focus double lenses are utilized to cooperate with each other to monitor the target object in multiple areas, the flexibility of video monitoring is improved, the video monitoring on the target object by frequently adopting a single long-focus electric lens in the whole monitoring area is avoided, the zooming times of the expensive long-focus electric lens can be reduced, the service life of the long-focus electric lens is prolonged, and the wide-range popularization and use of the video monitoring equipment are facilitated.
It should be noted that: in the video monitoring apparatus based on the distant view and the close view provided in the above embodiment, only the division of the above functional modules is used for illustration, and in practical application, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the above described functions. In addition, the far and near view-based video monitoring device provided by the above embodiment and the far and near view-based video monitoring method embodiment belong to the same concept, and specific implementation processes thereof are detailed in the method embodiment and are not described herein again.
Fig. 6 is a block diagram of another video surveillance apparatus 600 based on a far-near view according to an embodiment of the present invention. For example, apparatus 600 may be provided as a video surveillance device as shown in FIG. 1A. Referring to fig. 6, the apparatus 600 includes a processor 601, a communication interface 602, a memory 603, and a communication bus 604.
As shown in fig. 6, the processor 601, the communication interface 602 and the memory 603 communicate with each other via a communication bus 604.
The processor 601 may be a Central Processing Unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more ics for controlling the execution of programs according to the present disclosure.
The communication bus 604 may include a path that conveys information between the aforementioned components.
The Memory 603 may be a ROM (Read-Only Memory) or other type of static storage device that can store static information and instructions, a RAM (random access Memory) or other type of dynamic storage device that can store information and instructions, an EEPROM (Electrically Erasable Programmable Read-Only Memory), a CD-ROM (Compact Disc Read-Only Memory) or other optical Disc storage, optical Disc storage (including Compact Disc, laser Disc, optical Disc, digital versatile Disc, blu-ray Disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer, but is not limited to these. The memory 603 may be separate and coupled to the processor 601 through a communication bus 604. The memory 603 may also be integrated with the processor 601.
The communication interface 602 may be any device, such as a transceiver, for communicating with other devices or communication Networks, such as ethernet, radio access network, WLAN (Wireless Local Area network), etc.
The memory 603 is used for storing a computer program for executing the scheme of the application, and is controlled by the processor 601 to execute the computer program. That is, the processor 601 is configured to execute a program stored in the memory to implement the method for monitoring video based on a far-near scene according to the embodiments shown in fig. 2, 3 and 4.
In an exemplary embodiment, there is also provided a computer readable storage medium having a computer program stored therein, which, when executed by a processor of a server, enables the server to perform the distant view-based video monitoring method provided by the embodiments shown in fig. 2, 3 and 4.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims (12)

1. A video monitoring method based on a far and near scene is characterized by being applied to video monitoring equipment, wherein the video monitoring equipment comprises a long-focus electric lens and a short-focus lens, and the method comprises the following steps:
when a target object to be monitored is detected, determining the distance between the target object and the video monitoring equipment, and determining a video monitoring area where the target object is located currently according to the distance between the target object and the video monitoring equipment;
when the video monitoring area is a first preset area, performing video monitoring on the target object through the long-focus electric lens, wherein the first preset area is an area, the distance between the first preset area and the video monitoring equipment is greater than a first preset distance, and the first preset distance is related to the installation height of the video monitoring equipment and the focal length of the long-focus electric lens;
when the video monitoring area is a second preset area, performing video monitoring on the target object through the short-focus lens, wherein the second preset area is an area, the distance between the second preset area and the video monitoring equipment is smaller than a second preset distance, the second preset distance is smaller than the first preset distance, and the second preset distance is related to the installation height of the video monitoring equipment and the focal length of the short-focus lens;
a third preset area exists between the first preset area and the second preset area;
when the video monitoring area is the third preset area, performing video monitoring on the target object through the long-focus electric lens to obtain first video information, wherein the third preset area is an area, and the distance between the third preset area and the video monitoring equipment is not more than the first preset distance and not less than the second preset distance; performing video monitoring on the target object through the short-focus lens to obtain second video information; and splicing the first video information and the second video information to obtain the video information of the target object.
2. The method of claim 1, wherein after the video monitoring of the target object through the tele electric lens to obtain the first video information, further comprising:
determining the distance between the central point of the target object and the central point of the short-focus lens by a laser ranging method to obtain a first distance;
according to the first distance, determining a first rotary displacement from a corresponding relation between a prestored distance and the rotary displacement, wherein the first rotary displacement refers to the displacement of the short-focus lens which needs to be rotated when the target object is positioned at the central point of the visual angle area of the short-focus lens;
determining a second rotary displacement, wherein the second rotary displacement refers to the rotary displacement of the short-focus lens;
if the first rotary displacement is not consistent with the second rotary displacement, controlling the short-focus lens to rotate according to the first rotary displacement and the second rotary displacement;
and after the short-focus lens rotates, triggering the operation of carrying out video monitoring on the target object through the short-focus lens.
3. The method of claim 2, wherein prior to determining the first rotational displacement from the pre-stored correspondence between distance and rotational displacement based on the first distance, further comprising:
when a plurality of monitoring points are arranged in the third preset area, determining the distance between each monitoring point in the plurality of monitoring points and the central point of the short-focus lens;
adjusting the rotational displacement of the short-focus lens, and controlling the short-focus lens to rotate according to the adjusted rotational displacement until the monitoring point is positioned at the central point of the visual angle area of the short-focus lens;
and storing the distance between the monitoring point and the central point of the short-focus lens and the current rotated displacement of the short-focus lens in the corresponding relation between the distance and the rotated displacement.
4. The method of claim 1, wherein the video surveillance of the target object through the tele motorized lens comprises:
determining the distance between the central point of the target object and the central point of the tele electric lens by a laser ranging method to obtain a second distance;
when the zoom parameter of the long-focus electric lens needs to be adjusted according to the second distance, adjusting the zoom parameter of the long-focus electric lens;
and continuously carrying out video monitoring on the target object through the long-focus electric lens after the zooming parameters are adjusted.
5. The method of claim 1, wherein the video surveillance of the target object by the short-focus lens comprises:
determining the distance between the central point of the target object and the central point of the short-focus lens by a laser ranging method to obtain a third distance;
when the zoom parameter of the short-focus lens needs to be adjusted according to the third distance, adjusting the zoom parameter of the short-focus lens;
and continuously carrying out video monitoring on the target object through the short-focus lens after the zooming parameters are adjusted.
6. The utility model provides a video monitoring device based on distant and close view which characterized in that is applied to video monitoring equipment, video monitoring equipment includes long burnt electric lens and short burnt lens, the device includes:
the first determining module is used for determining the distance between the target object and the video monitoring equipment when the target object to be monitored is detected, and determining the video monitoring area where the target object is located currently according to the distance between the target object and the video monitoring equipment;
the first video monitoring module is used for carrying out video monitoring on the target object through the long-focus electric lens when the video monitoring area is a first preset area, the first preset area is an area, the distance between the first preset area and the video monitoring equipment is greater than a first preset distance, and the first preset distance is related to the installation height of the video monitoring equipment and the focal length of the long-focus electric lens;
the second video monitoring module is used for carrying out video monitoring on the target object through the short-focus lens when the video monitoring area is a second preset area, the second preset area is an area, the distance between the second preset area and the video monitoring equipment is smaller than a second preset distance, the second preset distance is smaller than the first preset distance, and the second preset distance is related to the installation height of the video monitoring equipment and the focal length of the short-focus lens;
a third preset area exists between the first preset area and the second preset area;
the device further comprises:
the third video monitoring module is used for carrying out video monitoring on the target object through the long-focus electric lens to obtain first video information when the video monitoring area is the third preset area, and the third preset area is an area, wherein the distance between the third preset area and the video monitoring equipment is not more than the first preset distance and not less than the second preset distance;
the fourth video monitoring module is used for carrying out video monitoring on the target object through the short-focus lens to obtain second video information;
and the processing module is used for splicing the first video information and the second video information to obtain the video information of the target object.
7. The apparatus of claim 6, wherein the apparatus further comprises:
the second determining module is used for determining the distance between the central point of the target object and the central point of the short-focus lens through a laser ranging method to obtain a first distance;
a third determining module, configured to determine, according to the first distance, a first rotational displacement from a correspondence between a pre-stored distance and a rotational displacement, where the first rotational displacement is a displacement that the short-focus lens needs to rotate when the target object is located at a center point of a view angle area of the short-focus lens;
the fourth determining module is used for determining a second rotational displacement, wherein the second rotational displacement refers to the rotational displacement of the short-focus lens;
the control module is used for controlling the short-focus lens to rotate according to the first rotary displacement and the second rotary displacement if the first rotary displacement and the second rotary displacement are not consistent;
and the triggering module is used for triggering the operation of carrying out video monitoring on the target object through the short-focus lens after the short-focus lens rotates.
8. The apparatus of claim 7, wherein the apparatus further comprises:
a fifth determining module, configured to determine, when a plurality of monitoring points are set in the third preset area, a distance between each of the monitoring points and a center point of the short focus lens;
the adjusting module is used for adjusting the rotational displacement of the short-focus lens and controlling the short-focus lens to rotate according to the adjusted rotational displacement until the monitoring point is positioned at the central point of the visual angle area of the short-focus lens;
and the storage module is used for storing the distance between the monitoring point and the central point of the short-focus lens and the current rotated displacement of the short-focus lens in the corresponding relation between the distance and the rotated displacement.
9. The apparatus of claim 6, wherein the first video surveillance module comprises:
the determining unit is used for determining the distance between the central point of the target object and the central point of the tele electric lens through a laser ranging device to obtain a second distance;
the adjusting unit is used for adjusting the zooming parameters of the long-focus electric lens when the fact that the zooming parameters of the long-focus electric lens need to be adjusted is determined according to the second distance;
and the video monitoring unit is used for continuously carrying out video monitoring on the target object through the long-focus electric lens after the zooming parameters are adjusted.
10. The apparatus of claim 6, wherein the second video surveillance module comprises:
the determining unit is used for determining the distance between the central point of the target object and the central point of the short-focus lens through a laser ranging device to obtain a third distance;
the adjusting unit is used for adjusting the zooming parameters of the short-focus lens when the fact that the zooming parameters of the short-focus lens need to be adjusted is determined according to the third distance;
and the video monitoring unit is used for continuously carrying out video monitoring on the target object through the short-focus lens after the zooming parameters are adjusted.
11. The far and near view-based video monitoring device is characterized by comprising a processor, a communication interface, a memory and a communication bus;
the processor, the communication interface and the memory complete mutual communication through the communication bus;
the memory is used for storing computer programs;
the processor is configured to execute a program stored on the memory to implement the steps of the method of any one of claims 1-5.
12. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 5.
CN201710481579.1A 2017-06-22 2017-06-22 Far and near scene-based video monitoring method and device and computer-readable storage medium Active CN109120883B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710481579.1A CN109120883B (en) 2017-06-22 2017-06-22 Far and near scene-based video monitoring method and device and computer-readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710481579.1A CN109120883B (en) 2017-06-22 2017-06-22 Far and near scene-based video monitoring method and device and computer-readable storage medium

Publications (2)

Publication Number Publication Date
CN109120883A CN109120883A (en) 2019-01-01
CN109120883B true CN109120883B (en) 2020-11-27

Family

ID=64732730

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710481579.1A Active CN109120883B (en) 2017-06-22 2017-06-22 Far and near scene-based video monitoring method and device and computer-readable storage medium

Country Status (1)

Country Link
CN (1) CN109120883B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111355943A (en) * 2018-12-20 2020-06-30 深圳光启空间技术有限公司 Monitoring equipment, method and device, storage medium and electronic device
CN110351526A (en) * 2019-07-23 2019-10-18 北京中安信合科技有限公司 A kind of personnel's supervisory systems based on artificial intelligence technology
CN112399033B (en) 2019-08-14 2022-04-15 杭州海康威视数字技术股份有限公司 Camera assembly and monitoring camera
CN110446014B (en) * 2019-08-26 2021-07-20 达闼机器人有限公司 Monitoring method, monitoring equipment and computer readable storage medium
CN111479065B (en) * 2020-04-16 2021-08-10 北京迈格威科技有限公司 Camera field angle synchronization method and device and image shooting method and device
CN111818304B (en) * 2020-07-08 2023-04-07 杭州萤石软件有限公司 Image fusion method and device
CN112702575B (en) * 2020-12-23 2023-04-18 杭州中威电子股份有限公司 Multi-focal-length image acquisition device based on image fusion technology and analysis method
CN112861952B (en) * 2021-01-29 2023-04-28 云南电网有限责任公司电力科学研究院 Partial discharge image matching deep learning method

Also Published As

Publication number Publication date
CN109120883A (en) 2019-01-01

Similar Documents

Publication Publication Date Title
CN109120883B (en) Far and near scene-based video monitoring method and device and computer-readable storage medium
EP3317691B1 (en) System and method for laser depth map sampling
US9955074B2 (en) Target tracking method and system for intelligent tracking high speed dome camera
CN110278382B (en) Focusing method, device, electronic equipment and storage medium
CN102984530B (en) Image processing system and Atomatic focusing method
WO2019114617A1 (en) Method, device, and system for fast capturing of still frame
CN109215111B (en) Indoor scene three-dimensional modeling method based on laser range finder
CN105874384B (en) Based on a variety of distance measuring methods with burnt system, method and camera system
WO2018053825A1 (en) Focusing method and device, image capturing method and device, and camera system
JP5875453B2 (en) Automatic tracking device
CN106444777A (en) Robot automatic return charging method and system
CN110785993A (en) Control method and device of shooting equipment, equipment and storage medium
CN104571132A (en) Tracking photography system and tracking photography method
CN110163963B (en) Mapping device and mapping method based on SLAM
CN104822019A (en) Method for calculating camera field angle
CN104822020A (en) Automatic follow focus device based on video target tracking
CN102636152B (en) Active visual ranging system of movable platform
CN104580872A (en) Automatic-positioning tracking photography system and automatic-positioning tracking photography method
CN113850137A (en) Power transmission line image online monitoring method, system and equipment
CN110602376B (en) Snapshot method and device and camera
CN110677622A (en) Camera control method and monitoring equipment
CN105100577A (en) Imaging processing method and device
JP2016197797A (en) Image processing apparatus, image processing method, and image processing system
CN104580873A (en) Positioning tracking shooting system and positioning tracking shooting method
JP2019205066A (en) Camera adjustment device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant