WO2020125185A1

WO2020125185A1 - Monitoring device, method and apparatus, storage medium, and electronic apparatus

Info

Publication number: WO2020125185A1
Application number: PCT/CN2019/112424
Authority: WO
Inventors: 刘若鹏; 赵治亚; 杨亮
Original assignee: 深圳光启空间技术有限公司
Priority date: 2018-12-20
Filing date: 2019-10-22
Publication date: 2020-06-25
Also published as: CN111355943A

Abstract

Provided are a monitoring device, method and apparatus, a storage medium, and an electronic apparatus. The device comprises: a first camera device for photographing a first image within a first depth-of-field range; a second camera device for photographing a second image within a second depth-of-field range; and a control assembly for acquiring the first image and the second image, with the first camera device and the second camera device both being electrically connected to the control assembly, wherein the maximum value of the first depth-of-field range is greater than the maximum value of the second depth-of-field range, and the minimum value of the first depth-of-field range is greater than the minimum value of the second depth-of-field range. By means of the invention, the problem in the related art of an insufficient depth of field of a picture acquired in a scenario where monitoring is performed by means of a long focal length is solved, thereby achieving the effect of increasing the depth of field of a picture in a long focal length application scenario.

Description

Monitoring equipment, method and device, storage medium, electronic device

Technical field

The present invention relates to the field of optoelectronics, and in particular, to a monitoring device, method and device, storage medium, and electronic device.

Background technique

According to the optical principle, the imaging depth of field realized by the photoelectric sensor nodes in the conventional camera equipment or monitoring equipment in the related art will decrease as the focal length of the camera lens increases. In the scenarios involving remote personnel or vehicle monitoring, in order to realize the recognition of distant people or vehicles, it is necessary to use a telephoto lens; however, according to the above principle, the use of a telephoto lens will cause the depth of field of the picture to become smaller, which in turn makes In the above situation, the effective information in the captured image is reduced.

technical problem

In view of the above-mentioned related technologies, the problem of insufficient depth of field of a picture acquired in a monitoring scene with a long focal length has not yet been proposed in the related technologies.

Technical solution

Embodiments of the present invention provide a monitoring device, method and device, storage medium, and electronic device, to at least solve the problem of insufficient depth of field of a picture obtained in a monitoring scene using a long focal length in a related art.

According to an embodiment of the present invention, a monitoring device is provided, including:

The first camera device is used to shoot the first image within the first depth of field;

The second camera device is used to take a second image within the second depth of field;

A control component, used to obtain the first image and the second image, and both the first camera device and the second camera device are electrically connected to the control component;

Wherein, the maximum value of the first depth of field range is greater than the maximum value of the second depth of field range, and the minimum value of the first depth of field range is greater than the minimum value of the second depth of field range.

According to another embodiment of the present invention, a monitoring method is provided, and the monitoring device in the above embodiment is applied. The method includes:

Acquiring the first image captured by the first camera device and the second image captured by the second camera device; wherein, the first image is within the first depth of field, and the second image Located in the second depth of field range, the maximum value of the first depth of field range is greater than the maximum value of the second depth of field range, and the minimum value of the first depth of field range is greater than the minimum value of the second depth of field range;

Stitching the first image and the second image.

According to another embodiment of the present invention, a monitoring device is provided, to which the monitoring device in the above embodiment is applied, the device includes:

An obtaining module, configured to obtain the first image captured by the first camera device and the second image captured by the second camera device; wherein the first image is within the first depth of field, The second image is located in the second depth of field range, the maximum value of the first depth of field range is greater than the maximum value of the second depth of field range, and the minimum value of the first depth of field range is greater than the second depth of field range The minimum value of

The stitching module is used to stitch the first image and the second image.

According to yet another embodiment of the present invention, there is also provided a storage medium in which a computer program is stored, wherein the computer program is configured to execute the steps in any one of the above method embodiments during runtime.

According to yet another embodiment of the present invention, there is also provided an electronic device, including a memory and a processor, the memory stores a computer program, the processor is configured to run the computer program to perform any of the above The steps in the method embodiment.

Beneficial effect

According to the present invention, since the first camera device and the second camera device can respectively acquire images in different depth of field, the present invention can solve the problem of insufficient depth of field of the picture obtained in a monitoring scene using a long focal length in the related art, To achieve the effect of increasing the depth of field of the picture in the application scenarios of long focal length.

BRIEF DESCRIPTION

The drawings described herein are used to provide a further understanding of the present invention and form a part of the present application. The schematic embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an undue limitation on the present invention. In the drawings:

FIG. 1 is a functional schematic diagram of a monitoring device provided according to an embodiment of the present invention;

2 is a schematic diagram of an application scenario of a monitoring device provided according to an embodiment of the present invention;

3 is a control schematic diagram of a monitoring device provided according to a specific embodiment of the present invention;

4 is a circuit schematic diagram of an embedded hardware platform connected to an external device according to a specific embodiment of the present invention;

FIG. 5 is a schematic diagram of power supply control of an embedded hardware platform according to a specific embodiment of the present invention;

6 is a circuit schematic diagram of a processing unit according to a specific embodiment of the present invention;

7 is a circuit schematic diagram of a first ISP input port in an input unit according to a specific embodiment of the present invention;

8 is a circuit schematic diagram of a second ISP input port in an input unit according to a specific embodiment of the present invention;

9 is a circuit schematic diagram of a memory unit connection according to a specific embodiment of the present invention;

10 is a schematic circuit diagram of a first DDR in a memory unit according to a specific embodiment of the present invention;

11 is a circuit schematic diagram of a second DDR in a memory unit according to a specific embodiment of the present invention;

12 is a circuit schematic diagram of a communication unit provided according to a specific embodiment of the present invention;

13 is a circuit schematic diagram of an Ethernet unit provided according to a specific embodiment of the present invention;

14 is a circuit schematic diagram of a power supply unit according to a specific embodiment of the present invention;

15 is a flowchart of a monitoring method according to an embodiment of the present invention;

16 is a structural block diagram of a monitoring device according to an embodiment of the present invention.

Embodiments of the invention

Hereinafter, the present invention will be described in detail with reference to the drawings and in conjunction with the embodiments. It should be noted that the embodiments in the present application and the features in the embodiments can be combined with each other if there is no conflict.

It should be noted that the terms “first” and “second” in the description and claims of the present invention and the above drawings are used to distinguish similar objects, and do not have to be used to describe a specific order or sequence.

Example 1

In this embodiment, a monitoring device is provided. FIG. 1 is a functional schematic diagram of a monitoring device according to an embodiment of the present invention, and FIG. 2 is a schematic diagram of an application scenario of the monitoring device according to an embodiment of the present invention; as shown in FIG. 1 and FIG. As shown in 2, the monitoring equipment includes:

The first camera device 102 is used to take a first image within the first depth of field;

The second camera device 104 is used to take a second image within the second depth of field;

The control component 106 is used to acquire the first image and the second image, and the first camera device and the second camera device are both electrically connected to the control component;

The maximum value of the first depth of field range is greater than the maximum value of the second depth of field range, and the minimum value of the first depth of field range is greater than the minimum value of the second depth of field range.

With the device in this embodiment, since the first camera device and the second camera device can respectively acquire images in different depth of field, the device in this embodiment can solve the problem of using a long focal length for monitoring scenarios in the related art The problem of insufficient depth of field of the obtained picture achieves the effect of increasing the depth of field of the picture under the application scene of long focal length.

It should be further noted that the first depth of field range and the second depth of field range are both distance ranges. The maximum and minimum values of the first depth of field range are used to indicate a longer distance range, and the maximum values of the second depth of field range are The minimum value is used to indicate a short distance range; for example, taking the positions of the first camera device and the second camera device as the origin, the first depth of field range may be 70 to 150 meters, and the second depth of field range may be 15 to At 70 meters, the first depth of field and the second depth of field together form a long depth of field for monitoring and processing.

At the same time, in the related art, in order to improve the depth of field parameter of a single camera device, it is often achieved by adding a lens, and when light is reflected and refracted by multiple lenses, it will cause a reduction in luminous flux; in this embodiment The implementation of the device does not involve changes to the light path during shooting, regardless of whether the first camera device and the second camera device make the light follow the original path during the shooting process. Therefore, for the first image and the second image In general, there is no additional loss of luminous flux, which in turn ensures the signal-to-noise ratio of the captured image, especially in scenes with low light, low light, and other complex light environments, which can make the image sharper. improve.

In outdoor monitoring scenes, the light environment corresponding to the monitoring device is often more complicated due to the influence of time, weather, and surrounding buildings. Therefore, the device in this embodiment effectively improves the depth of field during the monitoring of personnel or vehicles. At the same time, it can also effectively ensure the clarity of the picture, so that the monitoring effect can be further improved.

In addition, to achieve the maximum value of the first depth of field range greater than the maximum value of the second depth of field range in this embodiment, the minimum value of the first depth of field range is greater than the minimum value of the second depth of field range, by adjusting the first imaging device and the second The relative positional relationship of the camera devices is realized, for example, adjusting the relative angle of the first camera device and the second camera device at the same installation position, or installing the first camera device and the second camera device at different installation positions, The invention does not limit this.

In an alternative embodiment, the shooting direction of the first camera device 102 and the shooting direction of the second camera device 104 are at a preset angle, and the preset angle is an acute angle.

It should be further explained that the setting of the above-mentioned preset angle can enable the first camera device and the second camera device to achieve different orientations at the same installation position, so that the first depth of field range corresponding to the first camera device is greater than the second The second depth of field range corresponding to the camera device may cause the first camera device to face the far end, and the second camera device to face the near end.

In an alternative embodiment, the minimum value of the first depth of field range is equal to the maximum value of the second depth of field range.

It should be further noted that the minimum value of the first depth of field range is equal to the maximum value of the second depth of field range, which is specifically used to indicate the connection between the first depth of field range and the second depth of field range, that is, the first depth of field range and the second depth of field range. There are no extra gaps or overlapping areas between the depth of field. The above technical solution can make the first image and the second image have no overlap with each other, and there is no blurred part, so as to ensure that the first image and the second image are subsequently spliced to obtain the clarity of the new image , Reducing the complexity of the control component to deal with it.

In order to realize that the minimum value of the first depth of field range is equal to the maximum value of the second depth of field range, that is, the two are connected to each other, specifically, by adjusting the focal length of the first imaging device and the second imaging device to be fixed The angle between each other, that is, adjusting the orientation of the first camera device and the second camera device is achieved.

In an alternative embodiment, the first camera device 102 is located above the second camera device 104, and the upper field of view of the first camera device 102 is horizontal.

It should be further noted that the first camera device is located above the second camera device, which means that the first camera device shoots farther than the second camera device, so the first camera device is placed at the location of the second camera device Above the height position, it is not necessary to set the first imaging device above the vertical direction of the second imaging device.

In an optional embodiment, when the first camera device and the second camera device are respectively installed in different installation positions to achieve the maximum value of the first depth of field range greater than the maximum value of the second depth of field range in the above embodiment, the first When the minimum value of the depth of field range is greater than the minimum value of the second depth of field range, the first imaging device and the second imaging device may be installed at the shooting position of the first depth range and the shooting position of the second depth range, respectively.

In an alternative embodiment, both the first camera device 102 and the second camera device 104 are electrically connected to the control component 106, including:

The first imaging device 102 and the second imaging device 104 are electrically connected to the control component 106 independently.

It should be further noted that the above-mentioned first camera device and second camera device are independently and electrically connected to the control component, and are specifically used to instruct the first camera device and the second camera device to obtain the first image and the second image, respectively. Send to the control component for processing.

In an alternative embodiment, the control component 106 is also used to:

Stitch the acquired first image with the second image.

In an alternative embodiment, the control component 106 is also used to:

The first camera device 102 is instructed to take a first image at a first moment, and the second camera device 104 is instructed to take a second image at a second moment, where the first moment and the second moment are at the same moment.

Through the above technical solution, the first imaging device and the second imaging device can perform exposure shooting at the same time, so that the brightness and contrast parameters of the first image and the second image can be unified.

In an alternative embodiment, the first camera device 102 includes: a first camera lens and a first photo sensor, and the second camera device 104 includes: a second camera lens and a second photo sensor;

Wherein, the first camera lens is a telephoto lens, and the second camera lens is a short focus lens; the first photoelectric sensor and the second photoelectric sensor are electrically connected to the control component.

It should be further noted that in this embodiment, the shooting direction of the first camera device, the shooting direction of the second camera device, or the angle between the first camera device and the second camera device refers to the first camera lens and the second camera The orientation or angle of the lens is set, and the first photo sensor and the second photo sensor may be integrated on the corresponding camera lens. Through the cooperation of the telephoto lens and the short focal lens in the above technical solution, the first camera device and the second camera device can be used to obtain images with different depths of field.

In an alternative embodiment, the control component includes:

Processing unit and input unit, wherein the processing unit and the input unit are electrically connected;

The input unit includes a first image signal processing ISP input port and a second image signal processing ISP input port, the first photosensor is electrically connected to the first ISP input port, and the second photosensor is electrically connected to the second ISP input port.

The first photoelectric sensor is configured to transmit the first image to the first ISP input port, and the first ISP input port is used to perform ISP processing on the first image to obtain the first color-coded YUV data;

The second photosensor is configured to transmit the second image to the second ISP input port, and the second ISP input port is used to perform ISP processing on the second image to obtain second color-coded YUV data.

It should be further explained that the above processing unit is an electronic component with data processing functions, including but not limited to CPU (Central Processing Unit), DSP (Digital Signal Processor), MCU (Microprocessor), etc., used to implement control components and Control and management of the first imaging device and the second imaging device; the ISP input port in the above input unit can realize the processing of the first image and the second image. The control component may further include a memory unit, a flash memory unit, an Ethernet unit, a power supply unit, and other necessary units or modules for implementing the work of the device.

To further illustrate the monitoring device in this embodiment, the following is a specific description by way of specific embodiments:

The imaging part in this specific embodiment is shown in FIGS. 2 and 3. The first imaging device 102 includes a first imaging lens 1021 and a first photoelectric sensor 1022 (ie Sensor1 in FIG. 3). FIG. 3 is a specific example according to the present invention. The control schematic diagram of the monitoring device provided in the embodiment, the specific composition of the first camera device 102 and the second camera device 104 is shown in FIG. 3; wherein, the corresponding parameters of the first camera lens 1021 are fixed focus 1/1.8 inches, 70 mm, The depth of field ranges from 70 to 180 meters. The first photoelectric sensor 1022 adopts 600w pixel CMOS and its picture element is 2.4 μm. As shown in FIGS. 2 and 3, the second camera 104 includes a second camera lens 1041 and a second photoelectric Sensor 1042 (Sensor2 in FIG. 3), where the corresponding parameters of the second camera lens 1041 are fixed focus 1/1.8 inches, 25mm, and the depth of field range is 15 to 70 meters. The second photoelectric sensor 1042 also uses 600w pixels. CMOS, its picture element is 2.4μm. As shown in FIG. 2, the first camera device 102 and the second camera device 104 adopt a stacked structure, and an angle of 3.9 degrees is formed between the first camera device 102 and the second camera device 104; during the actual installation process, Make sure that the first camera device above is level. In this way, the first camera device can be used to obtain images within a depth of field of 70 to 180 meters, and the second camera device can be used to obtain images within a depth of field of 15 to 70 meters, thus forming a long depth of field (15 to 180 meters) ) Within the image. It should be further noted that the sizes of the above related components are only one choice according to the actual situation in this specific embodiment. In different examples, other types or sizes of components can be selected according to the actual needs. The selection is not limited. In this specific embodiment, the first photo sensor 1022 and the second photo sensor 1042 preferably use a sensor model IMX178. As shown in FIG. 3, this specific embodiment uses the HiSilicon Hi3519V101 embedded hardware platform as the monitoring device hardware platform. The control component 106 in the above embodiment is provided on the platform. The control component 106 specifically includes: a processing unit 1061 and an input unit 1062, memory unit 1063, flash memory unit 1064, communication module 1065, Ethernet unit 1066, power supply unit 1067, wherein the input unit 1062, memory unit 1063, flash memory unit 1064, communication module 1065, Ethernet unit 1066, power supply unit 1067 are And the processing unit 1061 are electrically connected to each other; FIG. 4 is a circuit schematic diagram of an embedded hardware platform connected to an external device according to a specific embodiment of the present invention; FIG. 5 is a schematic diagram of control of a power supply connected to an embedded hardware platform according to a specific embodiment of the present invention The specific work of the embedded hardware platform or the connection principle with external devices is shown in Figure 4 and Figure 5.

The processing unit 1061 is an electronic component with data processing functions, including but not limited to CPU (Central Processing Unit), DSP (Digital Signal Processor), MCU (Microprocessor), etc., used for the first image and the second image To perform splicing processing and control and management of related hardware, FIG. 6 is a circuit schematic diagram of a processing unit provided according to a specific embodiment of the present invention, and the connection mode of the processing unit 1061 is shown in FIG. 6.

The input unit 1062 includes a first ISP input port and a second ISP input port for receiving image information; the first ISP input port and the second ISP input port can be directly integrated into the processing unit 1061, that is, the CPU. FIG. 7 is a circuit schematic diagram of a first ISP input port in an input unit according to a specific embodiment of the present invention. A connection operation mode of the first ISP input port in the input unit 1062 and a corresponding first photoelectric sensor is shown in FIG. 7. FIG. 8 is a circuit schematic diagram of a second ISP input port in an input unit provided according to a specific embodiment of the present invention. The connection operation mode of the second ISP input port in the input unit 1062 and the corresponding second photoelectric sensor is shown in FIG. 8.

The above memory unit 1063 includes a first double-rate synchronous dynamic random access memory DDR and a second double-rate synchronous dynamic random access memory DDR. FIG. 9 is a circuit schematic diagram of a memory unit connection provided according to a specific embodiment of the present invention. The first DDR or The connection mode between the second DDR and the hardware platform is shown in FIG. 9. 10 is a circuit diagram of a first DDR in a memory unit according to a specific embodiment of the present invention, FIG. 11 is a circuit diagram of a second DDR in the memory unit according to a specific embodiment of the present invention, the first DDR and the second DDR works as shown in Figure 10 and Figure 11, respectively. The flash memory unit 1064 includes a serial peripheral interface flash memory SPI Nand Flash. Specifically, the flash memory unit 1064 can be connected to a corresponding peripheral storage device through SPI Nand Flash; the communication unit 1065 includes a universal asynchronous transceiver transmitter UARTAlarm IO TF, FIG. 12 is a schematic circuit diagram of a communication unit according to a specific embodiment of the present invention. The specific working principle of the communication unit is shown in FIG. 12; the above Ethernet unit 1066 includes an Ethernet card for network connection, and FIG. 13 is according to the present invention. The circuit schematic diagram of the Ethernet unit provided by the specific embodiment. The working principle of the Ethernet unit is shown in FIG. 13; the above power unit 1067 includes a chopper for DC conversion of the input voltage. It needs to be further explained that There are different power requirements in the hardware platform. The above power unit can use different choppers to achieve the corresponding voltage changes according to actual needs. FIG. 14 is a circuit schematic diagram of the power unit according to a specific embodiment of the present invention. The connection of the power unit The method is shown in Figure 14. FIG. 14 is only a circuit schematic diagram for realizing 12V to 5V DC conversion. When DC conversion with different requirements is involved, a person skilled in the art can learn how to set up a chopper circuit, which is not limited in the present invention, so details are not described here.

In the above input unit, the first ISP input port and the second ISP input port respectively support a maximum of 4K pixel image information input; the image information input through the first ISP input port and the second ISP input port is processed by ISP to obtain YUV data , And then sent to the splicing unit in the control component to correct and splice the YUV data corresponding to the first image and the second image, thereby obtaining image data within the complete depth of field. The above image data is then sent to the image encoding engine, and after the IP transmission protocol, the spliced H.264 or H.265 image is sent to the client for display or storage.

It should be further explained that the above circuit schematic diagram shown in any one of FIG. 4 to FIG. 14 is only used as a circuit connection method to realize the operation of the corresponding unit or module in the long focal length monitoring device in this specific embodiment, The present invention does not limit the specific circuit connection mode. A person skilled in the art can clearly know the connection method of the corresponding unit or module in this specific embodiment on the basis of the circuit schematic diagram shown in any one of FIGS. 4 to 14, so the circuit or the working principle is no longer Repeat.

After the stitching process, the first image and the second image can be stitched to obtain a picture with a depth of field ranging from 15 to 180 meters. The images of people or objects in this range are clear. The ratio of the picture is 3:4 (length: width ), the pixel size is 12 million pixels (resolution is 3000*4000), and the pixel is 2.4μm.

Example 2

In this embodiment, a long focal length monitoring method is provided. The method uses the long focal length monitoring device in Embodiment 1 above; FIG. 15 is a flowchart of long focal length monitoring according to an embodiment of the present invention, as shown in FIG. 15, The process includes the following steps:

Step S202: Acquire a first image captured by the first camera device and a second image captured by the second camera device; wherein, the first image is within the first depth of field range, the second image is within the second depth of field range, and the first depth of field range The maximum value of is greater than the maximum value of the second depth of field range, and the minimum value of the first depth of field range is greater than the minimum value of the second depth of field range;

Step S204, stitching the first image and the second image.

According to the method in this embodiment, since the first camera device and the second camera device can respectively obtain images in different depth of field, the method in this embodiment can solve the problem of using a long focal length to monitor a scene in the related art The problem of insufficient depth of field of the obtained picture achieves the effect of increasing the depth of field of the picture under the application scene of long focal length.

Optionally, the execution body of the above steps may be a control component, such as a CPU, etc., but it is not limited thereto.

In an optional embodiment, in the above step S202, the minimum value of the first depth range is equal to the maximum value of the second depth range.

In an optional embodiment, in the above step S202, acquiring the first image captured by the first camera device and the second image captured by the second camera device includes:

The first image captured by the first camera device is acquired at the first moment, and the second image captured by the second camera device is acquired at the second moment; where the first moment and the second moment are at the same moment.

Through the above technical solution, the first imaging device and the second imaging device can perform exposure shooting at the same time, so that the brightness and contrast parameters of the first image and the second image can be unified. The above causes the first camera device and the second camera device to perform exposure shooting at the same time, specifically, the control component can simultaneously send control instructions to the first camera device and the second camera device, or the first camera device and the second camera device It is sufficient to work at the same time when the preset conditions (such as a certain time point, etc.) occur.

In an alternative embodiment, stitching the first image and the second image includes:

Perform ISP processing on the first image to obtain the first color-coded YUV data;

Perform ISP processing on the second image to obtain the second color-coded YUV data;

The first color-coded YUV data and the second color-coded YUV data are stitched together.

It should be further noted that before the first color-coded YUV data and the second color-coded YUV data are stitched together, the first color-coded YUV data and the second color-coded YUV data can also be corrected, for example, obvious in the image Distortion point, or corresponding treatment in dark light.

In an optional embodiment, in the above step S202, the first camera device is located above the second camera device, and the upper field of view of the first camera device is horizontal.

It should be further explained that the above relative position setting of the first camera device and the second camera device can enable the first image and the second image acquired by the first camera device and the second camera device to be seamlessly stitched during the stitching process.

In an optional embodiment, in the above step S202, the first camera device includes: a first camera lens and a first photo sensor, and the second camera device includes: a second camera lens and a second photo sensor;

It should be further noted that the above-mentioned configuration of the first imaging device and the second imaging device enables the first imaging device and the second imaging device to achieve simultaneous exposure in acquiring the first image and the second image, so that the first image and the second imaging device The traces of the two images during the stitching process are minimized, thereby improving the imaging effect.

The first image signal processing ISP input port and the second image signal processing ISP input port realize the acquisition of the first image and the second image, specifically, the first photoelectric sensor in the first imaging device is electrically connected to the first ISP The input port electrically connects the second photoelectric sensor in the second camera device to the second ISP input port.

Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware, but in many cases the former is Better implementation. Based on this understanding, the technical solution of the present invention can be embodied in the form of a software product in essence or part that contributes to the existing technology, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, The CD-ROM includes several instructions to enable a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods of various embodiments of the present invention.

Example 3

In this embodiment, a long focal length monitoring device is also provided. The device is used to implement the above-mentioned embodiments and preferred implementations, and descriptions that have already been described will not be repeated. As used below, the term "module" may implement a combination of software and/or hardware that performs predetermined functions. Although the devices described in the following embodiments are preferably implemented in software, implementation of hardware or a combination of software and hardware is also possible and conceived.

16 is a structural block diagram of a long focal length monitoring device according to an embodiment of the present invention. As shown in FIG. 16, the device includes:

The obtaining module 302 is configured to obtain the first image captured by the first camera device and the second image captured by the second camera device; wherein, the first image is within the first depth of field range, and the second image is within the second depth of field range, The maximum value of the first depth of field range is greater than the maximum value of the second depth of field range, and the minimum value of the first depth of field range is greater than the minimum value of the second depth of field range;

The stitching module 304 is used to stitch the first image and the second image.

With the device in this embodiment, since the first camera device and the second camera device can respectively acquire images in different depth of field, the device in this embodiment can solve the problem of using a long focal length to monitor a scene in the related art The problem of insufficient depth of field of the obtained picture achieves the effect of increasing the depth of field of the picture in a long focal length application scene.

In an optional embodiment, in the above acquisition module 302, the minimum value of the first depth of field range is equal to the maximum value of the second depth of field range.

It should be further noted that the minimum value of the first depth of field range is equal to the maximum value of the second depth of field range, which is specifically used to indicate the connection between the first depth of field range and the second depth of field range, that is, the first depth of field range and the second depth of field range. There are no extra gaps or overlapping areas between the depth of field. The above technical solution can make the first image and the second image have no overlap with each other, and there is no blur part, and then ensure that the first image and the second image are subsequently spliced to obtain the clarity of the new image, Reduce the complexity of the control component to deal with it.

In an optional embodiment, the obtaining module 302 obtains the first image captured by the first camera device and the second image captured by the second camera device, including:

Through the above technical solution, the first imaging device and the second imaging device can perform exposure shooting at the same time, so that the brightness and contrast parameters of the first image and the second image can be unified. The above causes the first camera device and the second camera device to perform exposure shooting at the same time, specifically, the control component can simultaneously send a control instruction, or the first camera device and the second camera device are under preset conditions (such as a certain Time point, etc.) Just work at the same time.

In an alternative embodiment, in the above-mentioned stitching module 304, stitching the first image and the second image includes:

In an optional embodiment, in the above acquisition module 302, the first camera device is located above the second camera device, and the upper field of view of the first camera device is horizontal.

In an optional embodiment, in the above acquisition module 302, the first camera device includes: a first camera lens and a first photoelectric sensor, and the second camera device includes: a second camera lens and a second photoelectric sensor;

It should be noted that the above modules can be implemented by software or hardware, and the latter can be implemented by the following methods, but not limited to this: the above modules are all located in the same processor; or, the above modules can be combined in any combination The forms are located in different processors.

Example 4

An embodiment of the present invention further provides a storage medium in which a computer program is stored, wherein the computer program is set to execute any of the steps in the above method embodiments during runtime.

Optionally, in this embodiment, the above storage medium may be set to store a computer program for performing the following steps:

S1. Acquire a first image captured by the first camera device and a second image captured by the second camera device; wherein, the first image is within the first depth of field range, the second image is within the second depth of field range, The maximum value is greater than the maximum value in the second depth of field range, and the minimum value in the first depth of field range is greater than the minimum value in the second depth of field range;

S2, stitching the first image and the second image.

Optionally, for specific examples in this embodiment, reference may be made to the examples described in the foregoing embodiments and optional implementation manners, and details are not repeated in this embodiment.

Optionally, in this embodiment, the above storage medium may include, but is not limited to: a U disk, a read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory (referred to as RAM), mobile hard disk, magnetic disk or optical disk and other media that can store computer programs.

Example 5

An embodiment of the present invention also provides an electronic device, including a memory and a processor, where the computer program is stored in the memory, and the processor is configured to run the computer program to perform the steps in any one of the foregoing method embodiments.

Optionally, the electronic device may further include a transmission device and an input-output device, wherein the transmission device is connected to the processor, and the input-output device is connected to the processor.

Optionally, in this embodiment, the above processor may be configured to perform the following steps through a computer program:

S2, stitching the first image and the second image.

Industrial applicability

Obviously, those skilled in the art should understand that the above-mentioned modules or steps of the present invention can be implemented by a general-purpose computing device, they can be concentrated on a single computing device, or distributed in a network composed of multiple computing devices Above, optionally, they can be implemented with program code executable by the computing device, so that they can be stored in the storage device to be executed by the computing device, and in some cases, can be in a different order than here The steps shown or described are performed, or they are made into individual integrated circuit modules respectively, or multiple modules or steps among them are made into a single integrated circuit module to achieve. In this way, the present invention is not limited to any specific combination of hardware and software.

The above are only preferred embodiments of the present invention, and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modification, equivalent replacement, and improvement made within the principles of the present invention should be included in the protection scope of the present invention.

Claims

A monitoring device, characterized in that it includes:

The first camera device is used to shoot the first image within the first depth of field;

The second camera device is used to take a second image within the second depth of field;

A control component, used to obtain the first image and the second image, and both the first camera device and the second camera device are electrically connected to the control component;

Wherein, the maximum value of the first depth of field range is greater than the maximum value of the second depth of field range, and the minimum value of the first depth of field range is greater than the minimum value of the second depth of field range.
The device according to claim 1, wherein the shooting direction of the first camera device and the shooting direction of the second camera device are at a preset angle, and the preset angle is an acute angle.
The apparatus of claim 1, wherein the minimum value of the first depth of field range is equal to the maximum value of the second depth of field range.
The device according to claim 1, wherein the first imaging device is located above the second imaging device, and the upper field of view of the first imaging device is horizontal.
The device according to claim 1, wherein both the first camera device and the second camera device are electrically connected to the control component, including:

The first camera device and the second camera device are electrically connected to the control component independently.
The device according to any one of claims 1 to 5, wherein the control component is further used to:

Stitching the acquired first image and the second image.
The device according to any one of claims 1 to 5, wherein the control component is further used to:

Instructing the first camera device to take the first image at a first moment, and instructing the second camera device to take the second image at a second moment, where the first moment and the second moment are located At the same moment.
The device according to any one of claims 1 to 5, wherein the first camera device includes: a first camera lens and a first photoelectric sensor, and the second camera device includes: a second camera lens and Second photoelectric sensor;

Wherein, the first camera lens is a telephoto lens, and the second camera lens is a short focus lens; the first photoelectric sensor and the second photoelectric sensor are electrically connected to the control component.
The device according to claim 8, wherein the control component comprises: a processing unit and an input unit, wherein the processing unit is electrically connected to the input unit;

The input unit includes a first image signal processing ISP input port and a second image signal processing ISP input port, the first photosensor is electrically connected to the first ISP input port, and the second photosensor is electrically connected to The second ISP input port;

Wherein, the first photosensor is configured to transmit the first image to the first ISP input port, and the first ISP input port is used to perform ISP processing on the first image to obtain a first color Encode YUV data;

The second photoelectric sensor is configured to transmit the second image to the second ISP input port, and the second ISP input port is used to perform ISP processing on the second image to obtain a second color-coded YUV data.
A monitoring method, which is applied to the monitoring device according to any one of claims 1 to 8, the method comprising:

Acquiring the first image captured by the first camera device and the second image captured by the second camera device; wherein, the first image is within the first depth of field, and the second image Located in the second depth of field range, the maximum value of the first depth of field range is greater than the maximum value of the second depth of field range, and the minimum value of the first depth of field range is greater than the minimum value of the second depth of field range;

Stitching the first image and the second image.
The method according to claim 10, wherein the minimum value of the first depth range is equal to the maximum value of the second depth range.
The method according to claim 10, wherein the acquiring the first image captured by the first camera device and the second image captured by the second camera device includes:

Acquiring the first image captured by the first camera device at a first moment, and acquiring the second image captured by the second camera device at a second moment; wherein, the first moment and the second The moment is at the same moment.
The method according to claim 10, wherein the stitching of the first image and the second image comprises:

ISP processing the first image to obtain first color-coded YUV data;

ISP processing the second image to obtain second color-coded YUV data;

The splicing is performed on the first color-coded YUV data and the second color-coded YUV data.
A monitoring device, which is applied to the monitoring device according to any one of claims 1 to 8, the device comprising:

An obtaining module, configured to obtain the first image captured by the first camera device and the second image captured by the second camera device; wherein the first image is within the first depth of field, The second image is located in the second depth of field range, the maximum value of the first depth of field range is greater than the maximum value of the second depth of field range, and the minimum value of the first depth of field range is greater than the second depth of field range The minimum value of

The stitching module is used to stitch the first image and the second image.
A storage medium characterized in that a computer program is stored in the storage medium, wherein the computer program is configured to execute the method described in any one of claims 10 to 13 when it is run.
An electronic device, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute any one of claims 10 to 13. Described method.