CN111355943A - A monitoring device, method and device, storage medium, and electronic device - Google Patents

Abstract

The invention provides a monitoring device, a method and a device, a storage medium and an electronic device, wherein the device comprises: the first camera equipment is used for shooting a first image in a first depth range; the second camera shooting equipment is used for shooting a second image in a second depth-of-field range; the control assembly is used for acquiring a first image and a second image, and the first camera equipment and the second camera equipment are electrically connected with the control assembly; wherein the maximum value of the first depth of field range is greater than the maximum value of the second depth of field range, and the minimum value of the first depth of field range is greater than the minimum value of the second depth of field range. By the method and the device, the problem of insufficient depth of field of the image acquired in a monitoring scene by adopting a long focal length in the related technology is solved, and the effect of increasing the depth of field of the image in a long focal length application scene is achieved.

Description

A monitoring device, method and device, storage medium, and electronic device

technical field

The present invention relates to the field of optoelectronics, and in particular, to a monitoring device, method and device, storage medium, and electronic device.

Background technique

According to the optical principle, the imaging depth of field realized by the conventional camera equipment in the related art or the photoelectric sensor node in the monitoring equipment will decrease as the focal length of the camera lens increases. In the scenario involving remote personnel or vehicle monitoring, in order to realize the identification of distant personnel or vehicles, it is necessary to use a telephoto lens; however, according to the above principles, the use of a telephoto lens will reduce the depth of field of the picture, which in turn makes the The effective information in the image captured in the above situation is reduced.

Aiming at the problem of insufficient depth of field of a picture obtained in a monitoring scene using a long focal length in the above related art, no effective solution has been proposed in the related art.

SUMMARY OF THE INVENTION

Embodiments of the present invention provide a monitoring device, method, device, storage medium, and electronic device, so as to at least solve the problem of insufficient depth of field of a picture obtained in a monitoring scenario using a long focal length in the related art.

According to an embodiment of the present invention, a monitoring device is provided, including:

a first imaging device, used for capturing a first image within a first depth of field range;

a second imaging device, configured to capture a second image within a second depth-of-field range;

a control assembly for acquiring the first image and the second image, both the first imaging device and the second imaging device are electrically connected to the control assembly;

Wherein, the maximum value of the first depth of field range is greater than the maximum value of the second depth of field range, and the minimum value of the first depth of field range is greater than the minimum value of the second depth of field range.

According to another embodiment of the present invention, a monitoring method is provided, using the monitoring device in the above embodiment, and the method includes:

Acquiring the first image captured by the first imaging device and the second image captured by the second imaging device; wherein the first image is located within the first depth of field range, and the second image is is located within the second depth of field range, the maximum value of the first depth of field range is greater than the maximum value of the second depth of field range, and the minimum value of the first depth of field range is greater than the minimum value of the second depth of field range;

Stitching the first image and the second image.

According to another embodiment of the present invention, a monitoring apparatus is provided, which applies the monitoring equipment in the above-mentioned embodiments, and the apparatus includes:

an acquisition module, configured to acquire the first image shot by the first camera device and the second image shot by the second camera device; wherein the first image is located within the first depth of field range, The second image is located within the second depth of field range, the maximum value of the first depth of field range is greater than the maximum value of the second depth of field range, and the minimum value of the first depth of field range is greater than the second depth of field range the minimum value of ;

A splicing module for splicing the first image and the second image.

According to yet another embodiment of the present invention, a storage medium is also provided, wherein a computer program is stored in the storage medium, wherein the computer program is configured to execute the steps in any one of the above method embodiments when running.

According to yet another embodiment of the present invention, there is also provided an electronic device comprising a memory and a processor, wherein the memory stores a computer program, the processor is configured to run the computer program to execute any of the above Steps in Method Examples.

Through the present invention, since images in different depth-of-field ranges can be acquired through the first camera device and the second camera device respectively, the present invention can solve the problem of insufficient depth of field of the images obtained in the related art in the monitoring scene using a long focal length, Achieve the effect of increasing the depth of field of the picture in the long focal length application scenario.

Description of drawings

The accompanying drawings described herein are used to provide a further understanding of the present invention and constitute a part of the present application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the attached image:

1 is a functional schematic diagram of a monitoring device provided according to an embodiment of the present invention;

2 is a schematic diagram of an application scenario of a monitoring device provided according to an embodiment of the present invention;

3 is a schematic control diagram of a monitoring device provided according to a specific embodiment of the present invention;

4 is a schematic circuit diagram of an embedded hardware platform connected to an external device provided according to a specific embodiment of the present invention;

FIG. 5 is a schematic diagram of connection power supply control of an embedded hardware platform provided according to a specific embodiment of the present invention;

6 is a circuit schematic diagram of a processing unit provided according to a specific embodiment of the present invention;

7 is a circuit schematic diagram of a first ISP input port in an input unit provided according to a specific embodiment of the present invention;

8 is a circuit schematic diagram of a second ISP input port in an input unit provided according to a specific embodiment of the present invention;

9 is a schematic circuit diagram of a memory cell connection provided according to a specific embodiment of the present invention;

10 is a circuit schematic diagram of a first DDR in a memory unit provided according to a specific embodiment of the present invention;

11 is a circuit schematic diagram of a second DDR in a memory unit provided according to a specific embodiment of the present invention;

12 is a schematic circuit diagram of a communication unit provided according to a specific embodiment of the present invention;

13 is a schematic circuit diagram of an Ethernet unit provided according to a specific embodiment of the present invention;

14 is a circuit schematic diagram of a power supply unit provided according to a specific embodiment of the present invention;

15 is a flowchart of a monitoring method provided according to an embodiment of the present invention;

FIG. 16 is a structural block diagram of a monitoring apparatus provided according to an embodiment of the present invention.

Detailed ways

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings and in conjunction with embodiments. It should be noted that the embodiments in the present application and the features of the embodiments may be combined with each other in the case of no conflict.

It should be noted that the terms "first", "second" and the like in the description and claims of the present invention and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or sequence.

Example 1

A monitoring device is provided in this embodiment. FIG. 1 is a functional schematic diagram of the monitoring device provided according to an embodiment of the present invention, and FIG. 2 is a schematic diagram of an application scenario of the monitoring device provided according to an embodiment of the present invention; 2, the monitoring equipment includes:

a first imaging device 102, configured to capture a first image within a first depth-of-field range;

a second imaging device 104, configured to capture a second image within a second depth-of-field range;

a control component 106, configured to acquire the first image and the second image, and both the first imaging device and the second imaging device are electrically connected to the control component;

The maximum value of the first depth of field range is greater than the maximum value of the second depth of field range, and the minimum value of the first depth of field range is greater than the minimum value of the second depth of field range.

With the device in this embodiment, since images in different depth-of-field ranges can be obtained through the first camera device and the second camera device respectively, the device in this embodiment can solve the problem of using a long focal length for monitoring in the related art The problem of insufficient depth of field of the obtained picture is achieved, and the effect of increasing the depth of field of the picture in the long focal length application scenario is achieved.

It should be further explained that the above-mentioned first depth of field range and second depth of field range are both ranges in distance, the maximum value and minimum value of the first depth of field range are used to indicate a far distance range, and the maximum value of the second depth of field range is the same as The minimum value is used to indicate a relatively close distance range; for example, taking the positions of the first camera device and the second camera device as the origin, the first depth of field range may be 70 to 150 meters, and the second depth of field range may be 15 to 150 meters. 70 meters, the first depth of field range and the second depth of field range together form a long depth of field for monitoring processing.

At the same time, in the related art, in order to improve the depth of field parameters of a single imaging device, it is often achieved by adding lenses, and when light is reflected and refracted through multiple lenses, the luminous flux is reduced; in this embodiment The implementation process of the device does not involve the change of the light path in the shooting process, regardless of the first imaging device and the second imaging device make the light follow the original path during the shooting process. Therefore, for the first image and the second image In terms of luminous flux, there will not be any additional loss, so that the signal-to-noise ratio of the captured image can be guaranteed, especially in scenes with complex lighting environments such as low light and low light, which can significantly improve the clarity of the image. improve.

In an outdoor monitoring scenario, affected by time, weather and even surrounding buildings, the light environment corresponding to the monitoring device is often complicated. Therefore, the device in this embodiment can effectively improve the depth of field of the picture during the monitoring of people or vehicles. At the same time, the clarity of the picture can also be effectively guaranteed, so that the monitoring effect can be further improved.

In addition, in order to realize that the maximum value of the first depth-of-field range in this embodiment is greater than the maximum value of the second depth-of-field range, and the minimum value of the first depth-of-field range is greater than the minimum value of the second depth-of-field range, the The relative positional relationship of the imaging devices is realized, for example, the relative angle of the first imaging device and the second imaging device is adjusted at the same installation position, or the first imaging device and the second imaging device are respectively installed in different installation positions, The present invention does not limit this.

In an optional embodiment, the shooting orientation of the first imaging device 102 and the shooting orientation of the second imaging device 104 form a preset angle, and the preset angle is an acute angle.

It should be further noted that the setting of the above-mentioned preset angle can enable the first camera device and the second camera device to achieve different orientations at the same installation position, so that the first depth of field range corresponding to the first camera device is larger than the second camera device. The second depth-of-field range corresponding to the imaging device may make the first imaging device face the far end, and the second imaging device relative to the near end.

In an optional embodiment, the minimum value of the first depth-of-field range is equal to the maximum value of the second depth-of-field range.

It needs to be further explained that the minimum value of the first depth of field range is equal to the maximum value of the second depth of field range, which is specifically used to indicate that the first depth of field range and the second depth of field range are connected to each other, that is, the first depth of field range and the second depth of field range. There are no extra gaps or overlapping areas between the depth of field ranges. The above technical solution can make the first image and the second image neither overlap nor have a blurred part, thereby ensuring the clarity of the new image obtained by the subsequent splicing of the first image and the second image. , reducing the complexity of its processing by the control component.

In order to realize that the minimum value of the first depth-of-field range is equal to the maximum value of the second depth-of-field range, that is, the mutual connection between the two can be achieved by adjusting the focal length of the first imaging device and the second imaging device when the focal lengths are fixed. The included angle between each other, that is, the adjustment of the orientation of the first camera device and the second camera device can be realized.

In an optional embodiment, the first imaging device 102 is located above the second imaging device 104, and the upper field of view of the first imaging device 102 is in a horizontal direction.

It should be further noted that the fact that the first imaging device is located above the second imaging device means that the first imaging device shoots farther than the second imaging device, so the first imaging device is set at the location where the second imaging device is located. Above the height position, it is not necessary to set the first camera device above the second camera device in the vertical direction.

In an optional embodiment, when the first imaging device and the second imaging device are respectively installed in different installation positions to realize that the maximum value of the first depth of field range in the above-mentioned embodiment is greater than the maximum value of the second depth of field range, the first When the minimum value of the depth of field range is greater than the minimum value of the second depth of field range, the first imaging device and the second imaging device may be installed at the shooting position of the first depth of field range and the shooting position of the second depth of field range, respectively.

In an optional embodiment, both the first camera device 102 and the second camera device 104 are electrically connected to the control component 106, including:

The first camera device 102 and the second camera device 104 are electrically connected to the control component 106 independently, respectively.

It should be further noted that the above-mentioned first imaging device and second imaging device are electrically connected to the control component independently, respectively, and are specifically used to instruct the first imaging device and the second imaging device to obtain the first image and the second image, respectively. Sent to the control component for processing.

In an optional embodiment, the control component 106 is further configured to:

Stitching the acquired first image and the second image.

In an optional embodiment, the control component 106 is further configured to:

The first imaging device 102 is instructed to capture a first image at a first moment, and the second imaging device 104 is instructed to capture a second image at a second moment, wherein the first moment and the second moment are at the same moment.

Through the above technical solution, the first imaging device and the second imaging device can be exposed and photographed at the same time, so that the parameters such as brightness and contrast of the first image and the second image can be kept uniform.

In an optional embodiment, the first imaging device 102 includes: a first imaging lens and a first photoelectric sensor, and the second imaging device 104 includes: a second imaging lens and a second photoelectric sensor;

Wherein, the first camera lens is a telephoto lens, and the second camera lens is a short focus lens; the first photoelectric sensor and the second photoelectric sensor are electrically connected to the control assembly.

It should be further noted that, in this embodiment, the shooting orientation of the first imaging device, the shooting orientation of the second imaging device, or the angle between the first imaging device and the second imaging device all refer to the first imaging lens and the second imaging device. Depending on the orientation or angle of the lens, the first photoelectric sensor and the second photoelectric sensor can be integrated on the corresponding camera lens. Through the cooperative use of the telephoto lens and the short-focus lens in the above technical solution, the acquisition of images with different depths of field can be further realized by the first imaging device and the second imaging device.

In an optional embodiment, the control assembly includes:

a processing unit and an input unit, wherein the processing unit is electrically connected to the input unit;

The input unit includes a first image signal processing ISP input port and a second image signal processing ISP input port, the first photoelectric sensor is electrically connected to the first ISP input port, and the second photoelectric sensor is electrically connected to the second ISP input port.

Wherein, the first photoelectric sensor is set to transmit the first image to the first ISP input port, and the first ISP input port is used to perform ISP processing on the first image to obtain the first color-coded YUV data;

The second photosensor is configured to transmit the second image to the second ISP input port, and the second ISP input port is used to perform ISP processing on the second image to obtain second color-coded YUV data.

It should be further explained that the above-mentioned processing units are electronic components with data processing functions, including but not limited to CPU (central processing unit), DSP (digital signal processor), MCU (microprocessor), etc., used to realize control components and The control and management of the first camera equipment and the second camera equipment; the ISP input port in the above input unit can realize the processing of the first image and the second image. The control component may further include a memory unit, a flash memory unit, an Ethernet unit, a power supply unit and other necessary units or modules for realizing the operation of the device.

In order to further illustrate the monitoring device in this embodiment, a specific description is given below by means of specific embodiments:

The imaging part in this specific embodiment is shown in FIG. 2 and FIG. 3 . The first imaging device 102 includes a first imaging lens 1021 and a first photoelectric sensor 1022 (ie, Sensor1 in FIG. 3 ). The control schematic diagram of the monitoring device provided by the embodiment, the specific structures of the first camera device 102 and the second camera device 104 are shown in FIG. 3; wherein, the corresponding parameters of the first camera lens 1021 are fixed focus 1/1.8 inch, 70mm, The depth of field ranges from 70 to 180 meters. The first photoelectric sensor 1022 adopts 600w pixel CMOS, and its pixel is 2.4 μm. As shown in FIG. 2 and FIG. 3 , the second camera device 104 includes a second camera lens 1041 and a second photoelectric The sensor 1042 (ie, Sensor2 in FIG. 3 ), wherein the corresponding parameters of the second camera lens 1041 are fixed focus 1/1.8 inch, 25mm, and its depth of field range is 15 to 70 meters. The second photoelectric sensor 1042 also adopts 600w pixel. CMOS, its pixel is 2.4μm. As shown in FIG. 2 , the first camera device 102 and the second camera device 104 are stacked on top of each other, and an included angle of 3.9 degrees is formed between the first camera device 102 and the second camera device 104; in the actual installation process, it is necessary to Make sure that the top camera unit is level. In this way, the first camera device can be used to acquire images in a depth of field range of 70 to 180 meters, and the second camera device can be used to acquire images in a depth of field range of 15 to 70 meters, thus forming a long depth of field range (15 to 180 meters) that can be acquired. ) within the image. It should be further explained that the size of the above related components is only a selection according to the actual situation in this specific embodiment. In different instances, components of other types or sizes can be selected according to actual needs. The selection is not limited. In this specific embodiment, the first photoelectric sensor 1022 and the second photoelectric sensor 1042 are preferably sensors whose model is IMX178. As shown in FIG. 3 , in this specific embodiment, the HiSilicon Hi3519V101 embedded hardware platform is used as the monitoring device hardware platform, and the control component 106 in the above-mentioned embodiment is set on the platform. The control component 106 specifically includes: a processing unit 1061, an input unit 1062, memory unit 1063, flash memory unit 1064, communication module 1065, Ethernet unit 1066, power supply unit 1067, wherein, input unit 1062, memory unit 1063, flash memory unit 1064, communication module 1065, Ethernet unit 1066, power supply unit 1067 respectively and the processing unit 1061 are electrically connected to each other; FIG. 4 is a circuit schematic diagram of an embedded hardware platform connected to an external device provided according to a specific embodiment of the present invention; FIG. 5 is a schematic diagram of a power supply control diagram of the embedded hardware platform provided according to a specific embodiment of the present invention , the specific work of the embedded hardware platform or the connection principle with external devices are shown in Figure 4 and Figure 5.

The above-mentioned processing unit 1061 is an electronic component with data processing function, including but not limited to CPU (Central Processing Unit), DSP (Digital Signal Processor), MCU (Microprocessor), etc., used for processing the first image and the second image Perform splicing processing, and control and manage related hardware. FIG. 6 is a circuit schematic diagram of a processing unit provided according to a specific embodiment of the present invention. The connection mode of the processing unit 1061 is shown in FIG. 6 .

The input unit 1062 includes a first ISP input port and a second ISP input port for receiving image information; the first ISP input port and the second ISP input port can be directly integrated into the processing unit 1061, that is, the CPU. FIG. 7 is a circuit schematic diagram of the first ISP input port in the input unit provided according to a specific embodiment of the present invention. The connection operation mode of the first ISP input port in the input unit 1062 and the corresponding first photoelectric sensor is shown in FIG. 7 . FIG. 8 is a circuit schematic diagram of the second ISP input port in the input unit provided according to the specific embodiment of the present invention. The connection operation mode of the second ISP input port in the input unit 1062 and the corresponding second photoelectric sensor is shown in FIG. 8 .

The above-mentioned memory unit 1063 includes a first double-rate synchronous dynamic random access memory (DDR) and a second double-rate synchronous dynamic random access memory (DDR). The connection modes between the second DDR and the hardware platform are shown in FIG. 9 . 10 is a circuit schematic diagram of a first DDR in a memory unit provided according to a specific embodiment of the present invention, FIG. 11 is a circuit schematic diagram of a second DDR in a memory unit provided according to a specific embodiment of the present invention, the first DDR and the second DDR The working modes of DDR are shown in Figure 10 and Figure 11, respectively. The above-mentioned flash memory unit 1064 includes a serial peripheral interface flash memory SPI Nand Flash. Specifically, the above-mentioned flash memory unit 1064 can be connected to a corresponding peripheral storage device through the SPI Nand Flash; the above-mentioned communication unit 1065 includes a universal asynchronous transceiver UARTAlarm IO TF, FIG. 12 is a schematic circuit diagram of a communication unit provided according to a specific embodiment of the present invention. The specific working principle of the communication unit is shown in FIG. 12 ; the above-mentioned Ethernet unit 1066 includes an Ethernet card for network connection, and FIG. 13 is according to the present invention. The circuit schematic diagram of the Ethernet unit provided by the specific embodiment, the working principle of the Ethernet unit is shown in Figure 13; the above-mentioned power supply unit 1067 includes a chopper, which is used for DC conversion of the input voltage. It should be further explained that in There are different power requirements in the hardware platform. The above-mentioned power supply units can use different choppers to achieve corresponding voltage changes according to actual needs. FIG. 14 is a circuit schematic diagram of a power supply unit provided according to a specific embodiment of the present invention. The way is shown in Figure 14. Figure 14 is only a schematic diagram of a circuit for realizing 12V to 5V DC conversion. When DC conversion with different requirements is involved, those skilled in the art can know how to set up a chopper circuit, which is not limited in the present invention, so it will not be repeated.

In the above-mentioned input unit, the first ISP input port and the second ISP input port respectively support image information input of 4K pixels at the maximum; the image information input through the first ISP input port and the second ISP input port is processed by ISP to obtain YUV data. , and then sent to the splicing unit in the control assembly to perform correction and splicing processing on the YUV data corresponding to the first image and the second image, thereby obtaining image data within a complete depth of field range. The above image data is sent to the image coding engine, and the spliced H.264 or H.265 image is sent to the client for display or storage through the IP transmission protocol.

It should be further explained that the circuit schematic diagram shown in any one of the above-mentioned FIG. 4 to FIG. 14 is only used as a circuit connection method for realizing the operation of the corresponding unit or module in the long-focus monitoring device in this specific embodiment. The present invention does not limit the specific circuit connection manner. On the basis of the circuit schematic diagram shown in any one of FIG. 4 to FIG. 14 , those skilled in the art can clearly know the connection method of the corresponding unit or module in this specific embodiment, so the circuit or working principle of the corresponding unit or module in this specific embodiment is no longer known. Repeat.

After the stitching process, the first image and the second image can be stitched together to obtain a picture with a depth of field ranging from 15 to 180 meters. The images of people or objects within this range are clear. The ratio of the picture is 3:4 (length:width). ), the pixel size is 12 million pixels (resolution is 3000*4000), and the pixel is 2.4 μm.

Example 2

This embodiment provides a long-focus monitoring method, which applies the long-focus monitoring device in the above-mentioned Embodiment 1; FIG. 15 is a flowchart of the long-focus monitoring according to an embodiment of the present invention, as shown in FIG. 15 , The process includes the following steps:

Step S202, acquiring a first image captured by the first imaging device and a second image captured by a second imaging device; wherein the first image is located within a first depth of field range, the second image is located within a second depth of field range, and the first depth of field range is is greater than the maximum value of the second depth of field range, and the minimum value of the first depth of field range is greater than the minimum value of the second depth of field range;

Step S204, stitching the first image and the second image.

With the method in this embodiment, since images in different depth-of-field ranges can be obtained through the first camera device and the second camera device, respectively, the method in this embodiment can solve the problem of using a long focal length for monitoring in the related art The problem of insufficient depth of field of the obtained picture is achieved, and the effect of increasing the depth of field of the picture in the long focal length application scenario is achieved.

Optionally, the execution subject of the above steps may be a control component, such as a CPU, etc., but is not limited thereto.

In an optional embodiment, in the foregoing step S202, the minimum value of the first depth of field range is equal to the maximum value of the second depth of field range.

It needs to be further explained that the minimum value of the first depth of field range is equal to the maximum value of the second depth of field range, which is specifically used to indicate that the first depth of field range and the second depth of field range are connected to each other, that is, the first depth of field range and the second depth of field range. There are no extra gaps or overlapping areas between the depth of field ranges. The above technical solution can make the first image and the second image neither overlap nor have a blurred part, thereby ensuring the clarity of the new image obtained by the subsequent splicing of the first image and the second image. , reducing the complexity of its processing by the control component.

In an optional embodiment, in the foregoing step S202, acquiring the first image captured by the first imaging device and the second image captured by the second imaging device includes:

The first image captured by the first imaging device is acquired at the first moment, and the second image captured by the second imaging device is acquired at the second moment; wherein the first moment and the second moment are at the same moment.

Through the above technical solution, the first imaging device and the second imaging device can be exposed and photographed at the same time, so that the parameters such as brightness and contrast of the first image and the second image can be kept uniform. The above makes the first imaging device and the second imaging device perform exposure shooting at the same time. Specifically, the control component can send control instructions to the first imaging device and the second imaging device at the same time, or make the first imaging device and the second imaging device. It is enough to work at the same time when a preset condition (such as a certain time point, etc.) occurs.

In an optional embodiment, stitching the first image and the second image includes:

ISP processing is performed on the first image to obtain the first color-coded YUV data;

ISP processing is performed on the second image to obtain second color-coded YUV data;

The first color-coded YUV data and the second color-coded YUV data are spliced.

It should be further noted that before the splicing processing is performed on the first color-coded YUV data and the second color-coded YUV data, the first color-coded YUV data and the second color-coded YUV data can also be corrected, for example, the obvious in the image is corrected. Distortion point, or corresponding processing in dark light.

In an optional embodiment, in the above step S202, the first imaging device is located above the second imaging device, and the upper field of view of the first imaging device is in a horizontal direction.

It should be further noted that, the relative position setting of the first camera device and the second camera device can make the first image and the second image obtained by the first camera device and the second camera device achieve seamless stitching during the stitching process.

In an optional embodiment, in the above step S202, the first imaging device includes: a first imaging lens and a first photoelectric sensor, and the second imaging device includes: a second imaging lens and a second photoelectric sensor;

Wherein, the first camera lens is a telephoto lens, and the second camera lens is a short focus lens; the first photoelectric sensor and the second photoelectric sensor are electrically connected to the control assembly.

It should be further noted that, the configurations of the above-mentioned first imaging device and second imaging device enable the first imaging device and the second imaging device to achieve simultaneous exposure when acquiring the first image and the second image, so that the first image and the second imaging device can be exposed at the same time. The traces of the two images during the stitching process are minimized, thereby improving the imaging effect.

In an optional embodiment, in the foregoing step S202, acquiring the first image captured by the first imaging device and the second image captured by the second imaging device includes:

The acquisition of the first image and the second image is realized through the first image signal processing ISP input port and the second image signal processing ISP input port. Specifically, the first photoelectric sensor in the first camera device is electrically connected to the first ISP The input port electrically connects the second photosensor in the second camera device to the second ISP input port.

From the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solutions of the present invention can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products are stored in a storage medium (such as ROM/RAM, magnetic disk, CD-ROM), including several instructions to make a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods of the various embodiments of the present invention.

Example 3

In this embodiment, a long-focus monitoring device is also provided, and the device is used to implement the above-mentioned embodiments and preferred implementations, and what has been described will not be repeated. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, implementations in hardware, or a combination of software and hardware, are also possible and contemplated.

FIG. 16 is a structural block diagram of a long-focus monitoring device according to an embodiment of the present invention. As shown in FIG. 16 , the device includes:

The acquiring module 302 is configured to acquire a first image captured by a first camera device and a second image captured by a second camera device; wherein the first image is located within the first depth of field range, the second image is located within the second depth of field range, and the first image is located within the second depth of field range. The maximum value of a depth of field range is greater than the maximum value of the second depth of field range, and the minimum value of the first depth of field range is greater than the minimum value of the second depth of field range;

The splicing module 304 is used for splicing the first image and the second image.

With the device in this embodiment, since images in different depth-of-field ranges can be obtained through the first camera device and the second camera device respectively, the device in this embodiment can solve the problem of using a long focal length for monitoring in the related art The problem of insufficient depth of field of the obtained picture is achieved, and the effect of increasing the depth of field of the picture in the long focal length application scenario is achieved.

In an optional embodiment, in the obtaining module 302, the minimum value of the first depth of field range is equal to the maximum value of the second depth of field range.

It needs to be further explained that the minimum value of the first depth of field range is equal to the maximum value of the second depth of field range, which is specifically used to indicate that the first depth of field range and the second depth of field range are connected to each other, that is, the first depth of field range and the second depth of field range. There are no extra gaps or overlapping areas between the depth-of-field ranges. The above technical solution can make the first image and the second image not overlap with each other, and there is no blurred part, so as to ensure the clarity of the new image obtained by the subsequent splicing of the first image and the second image, The complexity of its processing by the control component is reduced.

In an optional embodiment, in the foregoing obtaining module 302, obtaining the first image captured by the first camera device and the second image captured by the second camera device includes:

The first image captured by the first imaging device is acquired at the first moment, and the second image captured by the second imaging device is acquired at the second moment; wherein the first moment and the second moment are at the same moment.

Through the above technical solution, the first imaging device and the second imaging device can be exposed and photographed at the same time, so that the parameters such as brightness and contrast of the first image and the second image can be kept uniform. The above makes the first imaging device and the second imaging device perform exposure shooting at the same time, specifically, the control component can send control instructions at the same time, or make the first imaging device and the second imaging device under preset conditions (such as a certain It is sufficient to work at the same time when it occurs.

In an optional embodiment, in the above-mentioned splicing module 304, splicing the first image and the second image, including:

ISP processing is performed on the first image to obtain the first color-coded YUV data;

ISP processing is performed on the second image to obtain second color-coded YUV data;

The first color-coded YUV data and the second color-coded YUV data are spliced.

In an optional embodiment, in the obtaining module 302, the first camera device is located above the second camera device, and the upper field of view of the first camera device is in a horizontal direction.

It should be further noted that, the relative position setting of the first camera device and the second camera device can make the first image and the second image obtained by the first camera device and the second camera device achieve seamless stitching during the stitching process.

In an optional embodiment, in the obtaining module 302, the first camera device includes: a first camera lens and a first photoelectric sensor, and the second camera device includes: a second camera lens and a second photoelectric sensor;

Wherein, the first camera lens is a telephoto lens, and the second camera lens is a short focus lens; the first photoelectric sensor and the second photoelectric sensor are electrically connected to the control assembly.

It should be further noted that, the configurations of the above-mentioned first imaging device and second imaging device enable the first imaging device and the second imaging device to achieve simultaneous exposure when acquiring the first image and the second image, so that the first image and the second imaging device can be exposed at the same time. The traces of the two images during the stitching process are minimized, thereby improving the imaging effect.

In an optional embodiment, in the above-mentioned obtaining module 302, obtaining the first image captured by the first camera device and the second image captured by the second camera device includes:

The acquisition of the first image and the second image is realized through the first image signal processing ISP input port and the second image signal processing ISP input port. Specifically, the first photoelectric sensor in the first camera device is electrically connected to the first ISP The input port electrically connects the second photosensor in the second camera device to the second ISP input port.

It should be noted that the above modules can be implemented by software or hardware, and the latter can be implemented in the following ways, but not limited to this: the above modules are all located in the same processor; or, the above modules can be combined in any combination The forms are located in different processors.

Example 4

An embodiment of the present invention further provides a storage medium, where a computer program is stored in the storage medium, wherein the computer program is configured to execute the steps in any one of the above method embodiments when running.

Optionally, in this embodiment, the above-mentioned storage medium may be configured to store a computer program for executing the following steps:

S1, acquiring a first image captured by a first imaging device and a second image captured by a second imaging device; wherein the first image is located within a first depth of field range, the second image is located within a second depth of field range, and the The maximum value is greater than the maximum value of the second depth of field range, and the minimum value of the first depth of field range is greater than the minimum value of the second depth of field range;

S2, stitching the first image and the second image.

Optionally, for specific examples in this embodiment, reference may be made to the examples described in the foregoing embodiments and optional implementation manners, and details are not described herein again in this embodiment.

Optionally, in this embodiment, the above-mentioned storage medium may include but is not limited to: a USB flash drive, a read-only memory (Read-Only Memory, referred to as ROM), a random access memory (Random Access Memory, referred to as RAM), Various media that can store computer programs, such as removable hard disks, magnetic disks, or optical disks.

Example 5

An embodiment of the present invention also provides an electronic device, comprising a memory and a processor, where a computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any of the above method embodiments.

Optionally, the above-mentioned electronic device may further include a transmission device and an input-output device, wherein the transmission device is connected to the above-mentioned processor, and the input-output device is connected to the above-mentioned processor.

Optionally, in this embodiment, the above-mentioned processor may be configured to execute the following steps through a computer program:

S1, acquiring a first image captured by a first imaging device and a second image captured by a second imaging device; wherein the first image is located within a first depth of field range, the second image is located within a second depth of field range, and the The maximum value is greater than the maximum value of the second depth of field range, and the minimum value of the first depth of field range is greater than the minimum value of the second depth of field range;

S2, stitching the first image and the second image.

Optionally, for specific examples in this embodiment, reference may be made to the examples described in the foregoing embodiments and optional implementation manners, and details are not described herein again in this embodiment.

Obviously, those skilled in the art should understand that the above-mentioned modules or steps of the present invention can be implemented by a general-purpose computing device, and they can be centralized on a single computing device or distributed in a network composed of multiple computing devices Alternatively, they may be implemented in program code executable by a computing device, such that they may be stored in a storage device and executed by the computing device, and in some cases, in a different order than here The steps shown or described are performed either by fabricating them separately into individual integrated circuit modules, or by fabricating multiple modules or steps of them into a single integrated circuit module. As such, the present invention is not limited to any particular combination of hardware and software.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modification, equivalent replacement, improvement, etc. made within the principle of the present invention shall be included within the protection scope of the present invention.

Claims (16)

1. a monitoring equipment, is characterized in that, comprises: a first imaging device, used for capturing a first image within a first depth of field range; a second imaging device, configured to capture a second image within a second depth-of-field range; a control assembly for acquiring the first image and the second image, both the first imaging device and the second imaging device are electrically connected to the control assembly; Wherein, the maximum value of the first depth of field range is greater than the maximum value of the second depth of field range, and the minimum value of the first depth of field range is greater than the minimum value of the second depth of field range. 2 . The device according to claim 1 , wherein the shooting orientation of the first imaging device and the shooting orientation of the second imaging device form a preset angle, and the preset angle is an acute angle. 3 . 3 . The apparatus of claim 1 , wherein a minimum value of the first depth-of-field range is equal to a maximum value of the second depth-of-field range. 4 . 4 . The device according to claim 1 , wherein the first imaging device is located above the second imaging device, and an upper field of view of the first imaging device is in a horizontal direction. 5 . 5. The device according to claim 1, wherein the first camera device and the second camera device are both electrically connected to the control assembly, comprising: The first imaging device and the second imaging device are independently electrically connected to the control assembly. 6. The device according to any one of claims 1 to 5, wherein the control assembly is further configured to: Stitching the acquired first image and the second image. 7. The device according to any one of claims 1 to 5, wherein the control assembly is further configured to: instructing the first camera device to capture the first image at a first moment, and instructing the second camera device to capture the second image at a second moment, wherein the first moment and the second moment are located at the same moment. 8. The device according to any one of claims 1 to 5, wherein the first imaging device comprises: a first imaging lens and a first photoelectric sensor, and the second imaging device comprises: a second imaging device a lens and a second photoelectric sensor; Wherein, the first camera lens is a telephoto lens, and the second camera lens is a short focus lens; the first photoelectric sensor and the second photoelectric sensor are electrically connected to the control component. 9. The device according to claim 8, wherein the control component comprises: a processing unit and an input unit, wherein the processing unit is electrically connected to the input unit; The input unit includes a first image signal processing ISP input port and a second image signal processing ISP input port, the first photosensor is electrically connected to the first ISP input port, and the second photosensor is electrically connected to the second ISP input port; The first photoelectric sensor is configured to transmit the first image to the first ISP input port, and the first ISP input port is used to perform ISP processing on the first image to obtain the first color encode YUV data; The second photosensor is configured to transmit the second image to the second ISP input port, and the second ISP input port is used to perform ISP processing on the second image to obtain a second color-coded YUV data. 10. A monitoring method, characterized in that, applied to the monitoring device according to any one of claims 1 to 8, the method comprising: Acquiring the first image captured by the first imaging device and the second image captured by the second imaging device; wherein the first image is located within the first depth of field range, and the second image is located within the second depth of field range, the maximum value of the first depth of field range is greater than the maximum value of the second depth of field range, and the minimum value of the first depth of field range is greater than the minimum value of the second depth of field range; Stitching the first image and the second image. 11. The method of claim 10, wherein a minimum value of the first depth of field range is equal to a maximum value of the second depth of field range. 12. The method according to claim 10, wherein the acquiring the first image captured by the first imaging device and the second image captured by the second imaging device comprises: The first image captured by the first imaging device is acquired at a first moment, and the second image captured by the second imaging device is acquired at a second moment; wherein the first moment and the second moment at the same moment. 13. The method according to claim 10, wherein the stitching the first image and the second image comprises: ISP processing is performed on the first image to obtain first color-coded YUV data; ISP processing is performed on the second image to obtain second color-coded YUV data; The splicing is performed on the first color-coded YUV data and the second color-coded YUV data. 14. A monitoring device, characterized in that, when applied to the monitoring device according to any one of claims 1 to 8, the device comprises: an acquisition module, configured to acquire the first image shot by the first camera device and the second image shot by the second camera device; wherein the first image is located within the first depth of field range, The second image is located within the second depth of field range, the maximum value of the first depth of field range is greater than the maximum value of the second depth of field range, and the minimum value of the first depth of field range is greater than the second depth of field range the minimum value of ; A splicing module for splicing the first image and the second image. 15. A storage medium, wherein a computer program is stored in the storage medium, wherein the computer program is configured to execute the method according to any one of claims 10 to 13 when running. 16. An electronic device comprising a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute any one of claims 10 to 13 method described in.

Images