WO2018214838A1

WO2018214838A1 - Surveillance image capture method, apparatus, and system

Info

Publication number: WO2018214838A1
Application number: PCT/CN2018/087617
Authority: WO
Inventors: 马伟民; 张国平; 尤灿
Original assignee: 杭州海康威视数字技术股份有限公司
Priority date: 2017-05-22
Filing date: 2018-05-21
Publication date: 2018-11-29
Also published as: CN108961169A

Abstract

The present application relates to a surveillance image capture method, apparatus, and system, belonging to the technical field of video surveillance. The method comprises: acquiring a luminance value of each of n continuously acquired initial images, wherein n > 1, and each initial image is acquired on the basis of an initial exposure parameter and corresponds to an exposure time; according to the luminance value of each initial image, adjusting the initial exposure parameter of the corresponding initial image to obtain n target exposure parameters; continuously acquiring z target images on the basis of the n target exposure parameters, wherein z ≥ n; and obtaining at least two video streams according to the z target images, wherein each video stream has a different exposure time, and the at least two video streams comprise a preview stream for previewing and a surveillance stream for images captured during surveillance. The present application solves the problem in the prior art that the sharpness of a preview image obtained in a road surveillance image capture scenario is low, implementing both a preview function and a surveillance image capture function for preview and capture of surveillance images.

Description

Monitoring and capturing method, device and system

The present application claims priority to Chinese Patent Application No. JP-A No. No. No. No. No. No. No. No. No. No. No. No. No. No. No. No. No. No. No. .

Technical field

The present application relates to the field of video surveillance technologies, and in particular, to a method, device, and system for monitoring and capturing.

Background technique

With the increasing importance of security monitoring equipment and the continuous improvement of security technology, more and more functions are integrated into a security monitoring device. For example, a security monitoring device can implement simple monitoring functions, and can also implement violations. Capture, track and other functions. For example, in a wide-ranging and low-demand local scene, in order to meet the preview requirements of the screen, the security monitoring device usually works in a slow shutter exposure (ie, a long exposure time, that is, a long exposure) state, in slow shutter exposure. In the state, the image captured by the security monitoring device has less gain, less noise, higher brightness of the overall picture, and better definition. For example, in the scene of road monitoring capture (such as vehicle information recognition), in order to meet the preview request of the screen, the security monitoring device turns on the electronic police capture function and works in a slow shutter exposure state, however, because the speed of the vehicle is fast, In the slow shutter exposure state, the vehicle tailing phenomenon in the image taken by the security monitoring equipment is serious, which directly affects the definition and recognition rate of vehicle information (such as license plate), especially in the low illumination environment at night. more obvious.

In the related art, in order to improve the vehicle tailing phenomenon in an image, the exposure time of the security monitoring device is usually shortened, for example, the exposure time is shortened to 5 milliseconds or less.

Although the above method improves the tailing phenomenon of the vehicle to a certain extent, and improves the definition and recognition rate of the license plate, at the same time, the gain of the image is large, the noise is large, the clarity of the overall picture is poor, and the scene of the road monitoring is captured. Under the above method, a preview image with better definition cannot be obtained.

Summary of the invention

The embodiment of the present application provides a method, a device, and a system for monitoring and capturing, which can solve the problem that the related technology cannot simultaneously obtain a preview image and a monitoring image with better definition. The technical solution is as follows:

In one aspect, a method of monitoring capture is provided, the method comprising:

Obtaining a brightness value of each of the n initial images acquired in a continuous manner, n>1, each of the initial images is acquired based on an initial exposure parameter, and corresponds to one exposure time;

Adjusting an initial exposure parameter corresponding to the initial image according to a brightness value of each of the initial images to obtain n target exposure parameters;

Collecting z target images continuously based on the n target exposure parameters, z≥n;

Obtaining at least two video streams according to the z target images, each of the video streams having different exposure times, the at least two video streams including a preview stream for previewing and a monitoring stream for monitoring snapshots.

Optionally, the initial exposure parameter corresponding to the initial image is adjusted according to the brightness value of each of the initial images to obtain n target exposure parameters, including:

Adjusting an initial exposure parameter of the first initial image to a first exposure parameter when the brightness value of the first initial image is greater than a preset value, the first exposure parameter being smaller than an initial exposure parameter of the first initial image, The first initial image is any one of the n initial images;

When the brightness value of the first initial image is not greater than the preset value, adjusting an initial exposure parameter of the first initial image to a second exposure parameter, the second exposure parameter being greater than the first initial image Initial exposure parameters.

Optionally, each of the initial images is an initial preview image or an initial monitoring image, and an exposure time of the initial preview image is greater than a target exposure time, and an exposure time of the initial monitoring image is less than the target exposure time.

The continuously acquiring z target images based on the n target exposure parameters includes:

Collecting a target preview image based on the target exposure parameter corresponding to the initial preview image,

Collecting a target monitoring image based on a target exposure parameter corresponding to the initial monitoring image;

Obtaining at least two video streams according to the z target images, including:

Extracting a target preview image from the z target images to obtain the preview stream;

Extracting a target monitoring image from the z target images to obtain the monitoring stream.

Optionally, before the obtaining the brightness value of each of the n initial images in the consecutively acquired images, the method further includes:

Marking the initial preview image with a first mark, each initial preview image corresponding to at least one target preview image;

Marking the initial monitoring image with a second mark, each initial monitoring image corresponding to at least one target monitoring image;

Extracting the target preview image from the z target images, including:

Extracting, from the z target images, a target preview image corresponding to each initial preview image based on the first mark;

Extracting the target monitoring image from the z target images, including:

And extracting, from the z target images, a target monitoring image corresponding to each initial monitoring pattern based on the second mark.

P initial preview images and q initial monitoring images are alternately acquired, p≥1, q≥1, and when p>1, the p initial preview images are continuous, and when q>1, the q initial monitoring The image is continuous.

Optionally, p:q is 1:1;

Or, p:q is 2:1.

Optionally, after the target monitoring image is extracted from the z target images, and the monitoring flow is obtained, the method further includes:

When the trigger signal of the snap target vehicle is acquired, the attribute information of the target vehicle is extracted from the monitoring stream.

Optionally, after the obtaining at least two video streams according to the z target images, the method further includes:

Noise reduction processing and white balance processing are performed on each of the video streams.

In another aspect, a monitoring capture device is provided, the device comprising:

One or more processors; and

Memory

The memory stores one or more programs, the one or more programs being configured to be executed by the one or more processors, the one or more programs including instructions for:

Optionally, the one or more programs further include instructions for:

The one or more programs also include instructions for performing the following operations:

Optionally, the one or more programs further include instructions for:

Marking the initial monitoring image by using a second mark, each initial monitoring image corresponding to at least one target monitoring image;

Optionally, the one or more programs further include instructions for:

Optionally, p:q is 1:1;

Or, p:q is 2:1.

Optionally, the one or more programs further include instructions for:

In still another aspect, a non-transitory computer readable storage medium is provided having stored therein instructions that, when executed on a computer, cause the computer to perform the above-described monitoring capture method.

In still another aspect, a computer program product comprising instructions for causing a computer to perform the above-described monitoring capture method when the computer program product is run on a computer is provided.

In another aspect, a monitoring capture system is provided, the system including a monitoring capture device and a terminal,

The monitoring and capturing device is configured to output at least two video streams to the terminal, the exposure time of each of the video streams is different, and the at least two video streams include a preview stream for previewing and monitoring for monitoring and capturing And the monitoring and capturing device comprises the monitoring and capturing device.

The technical solutions provided by the embodiments of the present application may include the following beneficial effects:

The monitoring and capturing method, device and system provided by the embodiments of the present application can adjust initial exposure parameters of each initial image according to brightness values of a plurality of initial images collected in advance, and collect new differences based on the adjusted exposure parameters. The image of the exposure time further obtains at least two video streams including a preview stream and a monitoring stream, wherein each of the video streams has different exposure times, and the preview function and the monitoring and capturing function can be simultaneously implemented compared to related technologies.

The above general description and the following detailed description are merely exemplary and are not intended to limit the application.

DRAWINGS

In order to more clearly illustrate the embodiments of the present application, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present application, For the ordinary technicians, other drawings can be obtained based on these drawings without any creative work.

1 is a schematic diagram of an implementation environment involved in a monitoring and capturing method provided in some embodiments of the present application;

FIG. 2 is a flowchart of a method for monitoring a capture method according to an exemplary embodiment; FIG.

FIG. 3 is a flowchart of another method for monitoring a capture method according to an exemplary embodiment;

4 is a schematic structural diagram of a security monitoring device provided by an embodiment of the present application;

Figure 5 is a schematic illustration of n initial images acquired in the embodiment of Figure 3;

6 is a schematic diagram of n initial images acquired in the embodiment shown in FIG. 3;

7 is a flow chart of a method for obtaining n target exposure parameters in the embodiment shown in FIG. 3;

8 is a schematic diagram of a preview stream and a monitoring stream obtained in the embodiment shown in FIG. 3;

FIG. 9 is a block diagram of a monitoring and capturing device according to an exemplary embodiment;

FIG. 10 is a block diagram of still another monitoring capture device, according to an exemplary embodiment.

The drawings herein are incorporated in and constitute a part of the specification,

detailed description

The present application will be further described in detail below with reference to the accompanying drawings, and it is obvious that the described embodiments are only a part of the embodiments of the present application, but not all embodiments. . All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are the scope of the present application.

Please refer to FIG. 1, which is a schematic diagram showing an implementation environment involved in the monitoring and capturing method provided in some embodiments of the present application. The implementation environment can include a security monitoring device 01. The security monitoring device is a device having a camera function, such as a video camera. The security monitoring device can be applied to a variety of scenarios, for example, the security monitoring device can be located at an intersection, used to capture a vehicle, or take a road night image.

The number of the security monitoring device 01 is not limited in the embodiment of the present application.

FIG. 2 is a flowchart of a method for monitoring a capture method, which may be performed by the security monitoring device 01 in the implementation environment shown in FIG. 1 according to an exemplary embodiment. Referring to FIG. 2, the method flow may include the following steps:

Step 201: Acquire brightness values of each of the n initial images that are continuously acquired, n>1, and each initial image is acquired based on an initial exposure parameter, and corresponds to one exposure time.

Step 202: Adjust initial exposure parameters corresponding to the initial image according to the brightness values of each initial image to obtain n target exposure parameters.

Step 203: continuously collect z target images based on n target exposure parameters, z≥n.

Step 204: Obtain at least two video streams according to the z target images, where the exposure time of each video stream is different, and at least two video streams include a preview stream for preview and a monitoring stream for monitoring the capture.

In the embodiment of the present application, the security monitoring device firstly collects n initial images based on n initial exposure parameters, and obtains the luminance value of each initial image, and then adjusts the initial of the corresponding initial image according to the luminance value of each initial image. Exposing parameters, obtaining n target exposure parameters, and then continuously acquiring z target images based on the adjusted n target exposure parameters, and obtaining at least two video streams including a preview stream and a monitoring stream according to the acquired z target images, A shooting scene that meets the needs of different exposure times.

In summary, the monitoring and capturing method provided by the embodiment of the present application can adjust the initial exposure parameters of each initial image according to the brightness values of the plurality of initial images collected in advance, and collect new based on the adjusted exposure parameters. The images of different exposure times further obtain at least two video streams including a preview stream and a monitoring stream, wherein each of the video streams has different exposure times, and the preview function and the monitoring and capturing function can be simultaneously implemented compared with related technologies.

FIG. 3 is a flowchart of another method for monitoring a capture method, which may be performed by the security monitoring device 01 in the implementation environment shown in FIG. 1 according to an exemplary embodiment. Referring to FIG. 3, the method flow may include the following steps:

Step 301: Collecting p initial preview images and q initial monitoring images alternately.

Where p≥1, q≥1, and when p>1, p initial preview images are continuous, and when q>1, q initial monitoring images are continuous. The exposure time of the initial preview image is greater than the target exposure time, and the exposure time of the initial monitor image is less than the target exposure time. Alternate acquisition refers to collecting p initial preview images, then collecting q initial monitoring images, collecting p initial preview images, and then collecting q initial monitoring images, and then executing the loop until n initial images are collected. n>1, each initial image is an initial preview image or an initial monitoring image. Each initial image is acquired based on an initial exposure parameter.

As shown in FIG. 4, the security monitoring device may include an image sensor, an image acquisition module, an exposure control module, and an image processing module that are sequentially connected. Among them, the image sensor is an important part of the security monitoring equipment. An image sensor, also referred to as a light sensor, is used to convert an optical image into an electrical signal and transmit the electronic signal to an image acquisition module. For example, the security monitoring device may alternately acquire p initial preview images and q initial monitoring images through the image acquisition module to obtain n initial images.

For example, p:q can be 1:1, or p:q is 2:1. The ratio of p to q is not limited in the embodiment of the present application.

Assume that the initial preview image is represented by A1, and the initial monitoring image is represented by B2. When n is equal to 2, p is equal to 1, and q is equal to 1, the two initial images acquired by the security monitoring device through the image acquisition module are: A1, B2. When n is equal to 6, p is equal to 2, q is equal to 1, the six initial images collected by the security monitoring device through the image acquisition module are: A1, A1, B2, A1, A1, B2.

For example, FIG. 5 exemplarily shows a schematic diagram of n initial images acquired by the security monitoring device through the image acquisition module, where n is equal to 16, p is equal to 1, and q is equal to 1.

By way of example, FIG. 6 exemplarily shows a schematic diagram of n initial images acquired by the security monitoring device through the image acquisition module, where n is equal to 9, p is equal to 2, and q is equal to 1.

Step 302: Mark the initial preview image with the first mark.

Wherein each initial preview image corresponds to at least one target preview image.

In the embodiment of the present application, after the image acquisition module of the security monitoring device collects n initial images, the initial preview image may be marked with the first mark, so that the target preview image is extracted based on the first mark, and the preview is obtained. flow.

For example, the first mark may be represented by a letter plus a number. For example, the first mark may be represented by P1, and the image capture module of the security monitoring device may mark the initial preview image by using P1. In addition, the first mark may also be represented by a number. For example, the first mark may be represented by 0. The embodiment of the present application does not limit the form of the first mark.

Step 303: Mark the initial monitoring image with the second mark.

Wherein the second mark is different from the first mark. Each initial monitoring image corresponds to at least one target surveillance image.

In the embodiment of the present application, after the image acquisition module of the security monitoring device collects n initial images, the initial monitoring image may be marked by using the second marker, so that the target monitoring image is extracted and subsequently monitored based on the second marker. flow.

For example, the second mark may also be represented by a letter plus a number. For example, the second mark may be represented by P2, and the image acquisition module of the security monitoring device may mark the initial monitored image by using P2. In addition, the second mark may also be represented by a number. For example, the second mark may be represented by 1.

Step 304: Acquire a brightness value of each of the n initial images that are continuously acquired.

Generally, the brightness value of an image refers to the intensity value of an image pixel. Each image includes a plurality of pixels, each of which has a luminance value in the range of [0, 255], 255 is the maximum luminance value, and 0 is the minimum luminance value. In the embodiment of the present application, the brightness value of each initial image may be an average value of the brightness values of the plurality of pixels included in the initial image. For example, referring to FIG. 4, the security monitoring device can acquire the brightness value of each initial image through the image acquisition module, and the image acquisition module transmits the brightness value of each initial image to the exposure control module.

Step 305: Adjust initial exposure parameters corresponding to the initial image according to the brightness values of each initial image to obtain n target exposure parameters.

For example, referring to FIG. 4, the security monitoring device may adjust an initial exposure parameter corresponding to the initial image according to the brightness value of each initial image by the exposure control module to obtain n target exposure parameters, and the exposure control module selects the n target exposure parameters. Transfer to the image acquisition module, so that the image acquisition module continuously collects z target images based on n target exposure parameters, z≥n.

For example, in step 301, the security monitoring device continuously acquires two initial images through the image acquisition module, the first initial image is an initial preview image, and the initial exposure parameter of the initial preview image is x1, and the second initial image is an initial image. The image is monitored. At the same time, the initial exposure parameter of the initial monitoring image is y1, then the security monitoring device can adjust x1 according to the brightness of the initial preview image by the exposure control module to obtain the target exposure parameter x2, and according to the brightness of the initial monitoring image. The y1 is adjusted to obtain the target exposure parameter y2.

Optionally, as shown in FIG. 7, step 305 may include:

Step 3051: When the brightness value of the first initial image is greater than a preset value, adjust an exposure parameter of the first initial image to a first exposure parameter, where the first exposure parameter is smaller than an initial exposure parameter of the first initial image, and the first initial image Is any of the n initial images.

When the brightness value of the first initial image is greater than the preset value, the exposure control module may determine that the brightness value of the first initial image is large. At this time, in order to reduce the brightness value of the first initial image, the security monitoring device may pass the exposure. The control module adjusts an initial exposure parameter of the first initial image to a first exposure parameter that is less than an initial exposure parameter of the first initial image. By performing this step, the exposure control module can adjust the exposure parameter of the initial image to a smaller exposure parameter based on the luminance value of the initial image.

Step 3052: When the brightness value of the first initial image is not greater than a preset value, adjust an initial exposure parameter of the first initial image to a second exposure parameter, and the second exposure parameter is greater than an initial exposure parameter of the first initial image.

When the brightness value of the first initial image is not greater than the preset value, the exposure control module may determine that the brightness value of the first initial image is small. At this time, in order to increase the brightness value of the first initial image, the security monitoring device may pass The exposure control module adjusts an initial exposure parameter of the first initial image to a second exposure parameter that is greater than an initial exposure parameter of the first initial image. By performing this step, the exposure control module can adjust the exposure parameter of the initial image to a larger exposure parameter based on the brightness value of the initial image.

Step 306: Collect a target preview image based on the target exposure parameter corresponding to the initial preview image.

The security monitoring device collects the target preview image by the image acquisition module based on the target exposure parameter corresponding to the initial preview image.

Step 307: Collect a target monitoring image based on a target exposure parameter corresponding to the initial monitoring image.

The security monitoring device collects the target monitoring image by the image acquisition module based on the target exposure parameter corresponding to the initial monitoring image.

In the embodiment of the present application, the security monitoring device continuously collects z target images by using the image acquisition module based on n target exposure parameters, so that the image processing module of the security monitoring device obtains two video streams according to the z target images: for previewing The preview stream and the monitor stream used to monitor the capture, each video stream has a different exposure time.

Assume that the initial preview image is represented by A1, the initial monitoring image is represented by B2, n is equal to 2, p is equal to 1, q is equal to 1, and the two initial images acquired by the security monitoring device through the image acquisition module are: A1, B2. And the initial exposure parameter of the initial preview image is x1, and the initial exposure parameter of the initial monitoring image is y1. The brightness value of the initial preview image is greater than a preset value, and the security monitoring device adjusts the initial exposure parameter x1 of the initial preview image to the target exposure parameter x2, x2<x1 through the exposure control module; the brightness value of the initial monitoring image is less than the preset value. The security monitoring device adjusts the initial exposure parameter y1 of the initial monitoring image to the target exposure parameter y2, y2>y1 through the exposure control module. The exposure control module transmits the adjusted target exposure parameter to the image acquisition module, and the image acquisition module acquires the target preview image based on the target exposure parameter x2, and collects the target surveillance image based on the target exposure parameter y2, thereby obtaining two target images.

It should be noted that each initial monitoring image corresponds to at least one target monitoring image. Each initial monitoring image corresponds to at least one target surveillance image. The number z of target images collected by the security monitoring device through the image acquisition module may be equal to n or greater than n. For example, n is equal to 2, and the first initial image collected by the security monitoring device through the image acquisition module is the initial preview image, and the second initial image is the initial monitoring image. For example, the target image captured by the security monitoring device through the image acquisition module. It can be two or three, or four. When the acquired target image is two, the first target image is the target preview image, and the second target image is the target surveillance image; when the acquired target image is three, the first target image is the target preview image, The second target image is the target surveillance image, and the third target image is the target preview image; when the acquired target image is four, the first target image is the target preview image, and the second target image is the target surveillance image. The third target image is the target preview image, and the fourth target image is the target surveillance image.

Alternatively, the exposure parameters may include an aperture value and a gain. The aperture value is used to control the amount of light entering when the target image is acquired, and the gain is used to control the brightness of the target image during exposure when the target image is acquired. The aperture is the part of the security monitoring device that controls how much light enters. The larger the aperture value, the more the amount of light entering, the greater the exposure; the smaller the aperture value, the less the amount of light entering, the smaller the exposure; the greater the gain, the security The brightness of the image collected by the monitoring device is higher; the smaller the gain, the lower the brightness of the image captured by the security monitoring device.

It should be noted that in practical applications, different security monitoring devices have different aperture time and gain effective time. Therefore, in order to continuously acquire the target image based on the aperture value and the gain, the exposure control module needs to control the aperture value and the gain to be effective at the same time.

Step 308: Extract a target preview image from the z target images to obtain a preview stream.

For example, when the initial preview image is marked with the first mark, step 308 may include extracting a target preview image corresponding to each initial preview image from the z target images based on the first mark. Since the initial preview image is marked by the first mark, and the initial preview image corresponds to the at least one target preview image, the security monitoring device may determine, by the image processing module, at least one target preview image corresponding to the initial preview image based on the first mark, and further All target preview images are extracted from the z target images.

Step 309: Extract a target monitoring image from the z target images to obtain a monitoring stream.

For example, when the initial monitoring image is marked with the second mark, step 309 may include: extracting, from the z target images, a target monitoring image corresponding to each initial monitoring graphic based on the second mark. Since the initial monitoring image is marked by the second mark, and the initial monitoring image corresponds to the at least one target monitoring image, the security monitoring device may determine, by the image processing module, at least one target monitoring image corresponding to the initial monitoring image based on the second flag, and further All target surveillance images are extracted from the z target images.

Taking the 16 initial images shown in Figure 5 as an example, the security monitoring device obtains 16 target exposure parameters through the exposure control module, and continuously collects 16 target images based on 16 target exposure parameters through the image acquisition module, among which 16 targets The first target image, the third target image, the fifth target image, the seventh target image, the ninth target image, the eleventh target image, the thirteenth target image, and the fifteenth target image in the image are Target preview image; second target image, fourth target image, sixth target image, eighth target image, tenth target image, twelfth target image, 14th target image, and 16th target The image is a target monitoring image, and the security monitoring device extracts a target preview image corresponding to each initial preview image from the 16 target images by the image processing module, and a total of 8 target preview images, and based on the second mark from 16 The target monitoring images corresponding to each initial monitoring graphic are extracted from the target images, and a total of 8 target monitoring images are obtained. The schematic diagram of the obtained preview stream h1 and the monitoring stream h2 is as shown in FIG. .

In the embodiment of the present application, the security monitoring device may output a preview stream for preview and a monitoring stream for monitoring the capture, especially in a low-light environment at night, the security monitoring device may simultaneously output a preview stream for preview and use In the monitoring flow of monitoring and capturing, the preview effect and monitoring and capturing effect are better. Based on the monitoring stream, the license plate image with better definition can be obtained, and the definition and recognition rate of the license plate image are not affected by the vehicle speed, so that more accurate license plate information can be obtained, thereby achieving the purpose of monitoring and capturing; Based on the preview stream, the night road image of the city road with better definition can be obtained, thereby achieving the purpose of image preview.

Step 310: Perform noise reduction processing and white balance processing on each video stream.

In order to further improve the brightness of the image in the video stream, after the security monitoring device obtains two video streams through the image processing module, it can also perform noise reduction processing and white balance processing on each video stream, and then output the processed video stream.

Optionally, the image processing module may separately perform noise reduction processing on the preview stream and the monitoring stream, so that the noise of the target preview image in the preview stream (noise refers to foreign pixels that should not appear in the image) is smaller, and the definition is more clear. Well, at the same time, the target monitoring image in the monitoring stream has less noise and better definition. The image processing module can also perform white balance processing on the preview stream and the monitor stream, respectively, so that the color of the target preview image in the preview stream is corrected to a normal range, and the display effect is better, and the color of the target monitoring image in the monitoring stream is made. Corrected to the normal range, the display is better.

The security monitoring device can output the processed preview stream and the monitoring stream to the terminal through the image processing module, and the target preview image in the processed preview stream and the target monitoring image in the monitoring stream have different display effects on the terminal, and the user can The terminal selection is to view the target preview image in the processed preview stream or to view the target monitoring image in the processed monitor stream. The target preview image in the processed preview stream has higher brightness and better definition, but the trailing phenomenon of the moving object is more obvious; the trailing phenomenon of the moving object in the target monitoring image in the processed monitoring stream after processing Less obvious. For example, when the moving object is a vehicle, the vehicle tailing phenomenon in the target monitoring image is weak. In addition, the target monitoring image also has a better suppression effect on the vehicle lamp, and the resolution and recognition rate of the license plate image are higher.

Further, the security monitoring device can also improve the image quality of the target image in each video stream by adjusting the gamma (English: Gamma) value.

Further, after step 309, the monitoring and capturing method may further include: extracting attribute information of the target vehicle from the monitoring stream when the trigger signal of the capturing target vehicle is acquired. Optionally, the attribute information is license plate information.

For example, the image processing module of the security monitoring device may be integrated with an intelligent algorithm module, and when acquiring the trigger signal of the target vehicle, the image of the target vehicle may be extracted from the monitoring flow obtained by the image processing module, and The license plate information of the target vehicle is extracted from the image, and then the license plate information of the target vehicle is output to provide data support for the monitored vehicle.

It should be noted that the sequence of the steps of the monitoring and capturing method provided by the embodiment of the present application may be appropriately adjusted, and the steps may also be correspondingly increased or decreased according to the situation. Anyone skilled in the art may be within the technical scope disclosed in the present application. Methods that can be easily conceived of variations are covered by the scope of the present application and therefore will not be described again.

FIG. 9 is a block diagram of a monitoring and capture device 400 for use in a security monitoring device 01 in the implementation environment shown in FIG. 1 according to an exemplary embodiment. Referring to FIG. 9, the monitoring and capturing device 400 may include :

The obtaining module 410 is configured to obtain a brightness value of each of the n initial images acquired continuously, n>1, and each initial image is acquired based on an initial exposure parameter, and corresponds to one exposure time.

The adjusting module 420 is configured to adjust an initial exposure parameter corresponding to the initial image according to the brightness value of each initial image to obtain n target exposure parameters.

The acquisition module 430 is configured to continuously acquire z target images based on n target exposure parameters, z≥n.

The processing module 440 is configured to obtain at least two video streams according to the z target images, where the exposure time of each video stream is different, and at least two video streams include a preview stream for preview and a monitoring stream for monitoring the capture.

In summary, the monitoring and capturing device provided by the embodiment of the present application can adjust the initial exposure parameters of each initial image according to the brightness values of the plurality of initial images collected in advance, and collect new based on the adjusted exposure parameters. The images of different exposure times further obtain at least two video streams including a preview stream and a monitoring stream, wherein each of the video streams has different exposure times, and the preview function and the monitoring and capturing function can be simultaneously implemented compared with related technologies.

Optionally, the adjustment module 420 is configured to:

When the brightness value of the first initial image is greater than a preset value, adjusting an initial exposure parameter of the first initial image to a first exposure parameter, the first exposure parameter being smaller than an initial exposure parameter of the first initial image, the first initial image Is any of the n initial images;

When the brightness value of the first initial image is not greater than the preset value, the initial exposure parameter of the first initial image is adjusted to a second exposure parameter, the second exposure parameter being greater than the initial exposure parameter of the first initial image.

Optionally, each initial image is an initial preview image or an initial monitoring image, the exposure time of the initial preview image is greater than the target exposure time, and the exposure time of the initial monitoring image is less than the target exposure time, and the acquiring module 430 is configured to: based on the initial preview image The corresponding target exposure parameter collects a target preview image, and the target monitoring image is collected based on the target exposure parameter corresponding to the initial monitoring image.

The processing module 440 is configured to: extract a target preview image from the z target images to obtain a preview stream; and extract a target monitoring image from the z target images to obtain a monitoring stream.

Optionally, the monitoring and capturing device 400 may further include:

The first marking module is configured to mark the initial preview image with the first mark, and each initial preview image corresponds to at least one target preview image.

And a second marking module, configured to mark the initial monitoring image by using the second marking, each initial monitoring image corresponding to the at least one target monitoring image.

The processing module 440 is configured to: extract a target preview image corresponding to each initial preview image from the z target images based on the first mark; and extract, from the z target images, a target corresponding to each initial monitoring graphic based on the second mark Monitor images.

Optionally, the collecting module 430 is further configured to: alternately collect p initial preview images and q initial monitoring images, p≥1, q≥1, and when p>1, p initial preview images are continuous, when q >1, q initial monitoring images are continuous.

For example, p:q is 1:1; or, p:q is 2:1.

Optionally, the processing module 440 is further configured to: when acquiring a trigger signal of the captured target vehicle, extract attribute information of the target vehicle from the monitoring stream.

Optionally, the processing module 440 is further configured to: perform noise reduction processing and white balance processing on each video stream.

The embodiment of the present application further provides a monitoring and capturing device, and the device includes

One or more processors; and

Memory

The memory stores one or more programs, the one or more programs configured to be executed by the one or more processors, and configured to be executed by one or more processors by executing the above-described programs The monitoring and capture method performed by the security monitoring device in the embodiment.

FIG. 10 is a block diagram of a monitoring capture device 500 for use in a security monitoring device 01 in the implementation environment shown in FIG. 1, according to an exemplary embodiment. It should be understood that the monitoring capture device may have more or fewer components than those shown in FIG. 10, two or more components may be combined, or may have different component configurations. The various components shown in Figure 10 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits. A specific description will be given by taking the monitoring and capturing device shown in FIG. 10 as an example. As shown in FIG. 10, the monitoring capture device 500 includes at least one processor 501, a memory 502, a communication module 503, and at least one communication bus 504. The monitoring capture device 500 also includes other functional components such as a battery module, a wired/wireless charging structure, and the like. Communication bus 504 is used to implement connection communication between these components. Memory 502 may include non-volatile solid state memory and/or dynamic non-volatile storage devices such as flash memory, rotatable disk drives. The communication module 503 is for communication, and the memory 502 includes an application 5021. Processor 501 communicates with various modules and components over communication bus 504. The processor 501 can execute the application 5021 stored in the memory 502 to implement the security monitoring device, so that the security monitoring device implements a monitoring and capturing method, and the method includes:

Obtaining brightness values of each of the n initial images acquired continuously, n>1, each initial image is acquired based on an initial exposure parameter, and corresponds to one exposure time;

Adjusting an initial exposure parameter corresponding to the initial image according to the brightness value of each initial image to obtain n target exposure parameters;

Continuously acquiring z target images based on n target exposure parameters, z≥n;

At least two video streams are obtained according to the z target images, and the exposure time of each video stream is different, and at least two video streams include a preview stream for preview and a monitoring stream for monitoring capture.

Optionally, according to the brightness value of each initial image, adjusting an initial exposure parameter corresponding to the initial image to obtain n target exposure parameters, including:

Optionally, each initial image is an initial preview image or an initial monitoring image, and an exposure time of the initial preview image is greater than a target exposure time, and an exposure time of the initial monitoring image is less than a target exposure time.

Continuously acquiring z target images based on n target exposure parameters, including:

Obtain at least two video streams based on z target images, including:

Extracting a target preview image from z target images to obtain a preview stream;

The target monitoring image is extracted from the z target images to obtain a monitoring stream.

Optionally, before acquiring the luminance values of each of the n initial images that are continuously acquired, the method further includes:

The initial monitoring image is marked with a second mark, each initial monitoring image corresponding to at least one target monitoring image;

Extracting the target preview image from the z target images, including:

Extracting target surveillance images from z target images, including:

A target surveillance image corresponding to each initial monitoring pattern is extracted from the z target images based on the second marker.

P initial preview images and q initial monitoring images are alternately acquired, p≥1, q≥1, and when p>1, p initial preview images are continuous, and when q>1, q initial monitoring images are continuous.

Optionally, p:q is 1:1;

Or, p:q is 2:1.

Optionally, after extracting the target monitoring image from the z target images to obtain the monitoring stream, the method further includes:

When the trigger signal of the captured target vehicle is acquired, the attribute information of the target vehicle is extracted from the monitoring flow.

Optionally, after obtaining at least two video streams according to the z target images, the method further includes:

Noise reduction processing and white balance processing are performed for each video stream.

The embodiment of the present application further provides a monitoring and capturing system, where the monitoring and capturing system includes a monitoring and capturing device and a terminal.

The monitoring and capturing device is configured to output at least two video streams to the terminal, and each of the video streams has different exposure times, and the at least two video streams include a preview stream for previewing and a monitoring stream for monitoring the snapshot. The monitoring capture device may include the monitoring capture device shown in FIG.

Optionally, the terminal is a monitor display.

The monitoring and capturing system provided by the embodiment of the present application can acquire the brightness value of each initial image in n (n>1) initial images continuously collected, and then according to the brightness value of each initial image, Adjusting initial exposure parameters corresponding to the initial image to obtain n target exposure parameters, and continuously acquiring z (z≥n) target images based on the n target exposure parameters, and obtaining at least two video streams based on the z target images The exposure time of each video stream is different. At least two video streams include a preview stream for previewing and a monitoring stream for monitoring snapshots, and then output at least two video streams to the terminal, which can be simultaneously implemented compared with related technologies. Preview function and monitor capture function.

The embodiment of the present application provides a non-transitory computer readable storage medium having instructions stored therein, when the computer readable storage medium is run on a computer, causing the computer to execute FIG. 2 or FIG. The monitoring capture method is shown.

The embodiment of the present application provides a computer program product comprising instructions, when the computer program product is run on a computer, causing the computer to execute the monitoring and capturing method shown in FIG. 2 or FIG. 3.

A person skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working process of the foregoing apparatus and module can be referred to the corresponding process in the foregoing method embodiment, and details are not described herein again.

Other embodiments of the present application will be apparent to those skilled in the <RTIgt; The application is intended to cover any variations, uses, or adaptations of the application, which are in accordance with the general principles of the application and include common general knowledge or common technical means in the art that are not disclosed herein. . The specification and examples are to be regarded as illustrative only,

It is to be understood that the invention is not limited to the details of the details and The scope of the present application is limited only by the accompanying claims.

Claims

A method for monitoring capture, the method comprising:

Obtaining a brightness value of each of the n initial images acquired in a continuous manner, n>1, each of the initial images is acquired based on an initial exposure parameter, and corresponds to one exposure time;

Adjusting an initial exposure parameter corresponding to the initial image according to a brightness value of each of the initial images to obtain n target exposure parameters;

Collecting z target images continuously based on the n target exposure parameters, z≥n;

Obtaining at least two video streams according to the z target images, each of the video streams having different exposure times, the at least two video streams including a preview stream for previewing and a monitoring stream for monitoring snapshots.
The method according to claim 1, wherein the initial exposure parameter corresponding to the initial image is adjusted according to the brightness value of each of the initial images to obtain n target exposure parameters, including:

Adjusting an initial exposure parameter of the first initial image to a first exposure parameter when the brightness value of the first initial image is greater than a preset value, the first exposure parameter being smaller than an initial exposure parameter of the first initial image, The first initial image is any one of the n initial images;

When the brightness value of the first initial image is not greater than the preset value, adjusting an initial exposure parameter of the first initial image to a second exposure parameter, the second exposure parameter being greater than the first initial image Initial exposure parameters.
The method according to claim 2, each of said initial images being an initial preview image or an initial monitoring image, said initial preview image having an exposure time greater than a target exposure time, said initial monitoring image having an exposure time less than said target exposure time,

The continuously acquiring z target images based on the n target exposure parameters includes:

Collecting a target preview image based on the target exposure parameter corresponding to the initial preview image,

Collecting a target monitoring image based on a target exposure parameter corresponding to the initial monitoring image;

Obtaining at least two video streams according to the z target images, including:

Extracting a target preview image from the z target images to obtain the preview stream;

Extracting a target monitoring image from the z target images to obtain the monitoring stream.
The method according to claim 3, before the obtaining the luminance values of each of the n initial images acquired in succession, the method further comprises:

Marking the initial preview image with a first mark, each initial preview image corresponding to at least one target preview image;

Marking the initial monitoring image by using a second mark, each initial monitoring image corresponding to at least one target monitoring image;

Extracting the target preview image from the z target images, including:

Extracting, from the z target images, a target preview image corresponding to each initial preview image based on the first mark;

Extracting the target monitoring image from the z target images, including:

And extracting, from the z target images, a target monitoring image corresponding to each initial monitoring pattern based on the second mark.
The method according to claim 3, before the obtaining the luminance value of each of the n initial images acquired in the continuous acquisition, the method further comprises:

P initial preview images and q initial monitoring images are alternately acquired, p≥1, q≥1, and when p>1, the p initial preview images are continuous, and when q>1, the q initial monitoring The image is continuous.
The method of claim 5,

p:q is 1:1;

Or, p:q is 2:1.
The method according to claim 3, after the target monitoring image is extracted from the z target images to obtain the monitoring stream, the method further includes:

When the trigger signal of the snap target vehicle is acquired, the attribute information of the target vehicle is extracted from the monitoring stream.
The method according to any one of claims 1 to 7, after the obtaining at least two video streams according to the z target images, the method further comprises:

Noise reduction processing and white balance processing are performed on each of the video streams.
A monitoring and capture device, the device comprising:

One or more processors; and

Memory

The memory stores one or more programs, the one or more programs being configured to be executed by the one or more processors, the one or more programs including instructions for:

Obtaining a brightness value of each of the n initial images acquired in a continuous manner, n>1, each of the initial images is acquired based on an initial exposure parameter, and corresponds to one exposure time;

Adjusting an initial exposure parameter corresponding to the initial image according to a brightness value of each of the initial images to obtain n target exposure parameters;

Collecting z target images continuously based on the n target exposure parameters, z≥n;

Obtaining at least two video streams according to the z target images, each of the video streams having different exposure times, the at least two video streams including a preview stream for previewing and a monitoring stream for monitoring snapshots.
The apparatus of claim 9 wherein said one or more programs further comprise instructions for:

Adjusting an initial exposure parameter of the first initial image to a first exposure parameter when the brightness value of the first initial image is greater than a preset value, the first exposure parameter being smaller than an initial exposure parameter of the first initial image, The first initial image is any one of the n initial images;

When the brightness value of the first initial image is not greater than the preset value, adjusting an initial exposure parameter of the first initial image to a second exposure parameter, the second exposure parameter being greater than the first initial image Initial exposure parameters.
The apparatus according to claim 10, each of said initial images being an initial preview image or an initial monitoring image, said initial preview image having an exposure time greater than a target exposure time, said initial monitoring image having an exposure time smaller than said target exposure time,

The one or more programs also include instructions for performing the following operations:

Collecting a target preview image based on the target exposure parameter corresponding to the initial preview image,

Collecting a target monitoring image based on a target exposure parameter corresponding to the initial monitoring image;

Extracting a target preview image from the z target images to obtain the preview stream;

Extracting a target monitoring image from the z target images to obtain the monitoring stream.
The apparatus of claim 11 wherein said one or more programs further comprise instructions for performing the following operations:

Marking the initial preview image with a first mark, each initial preview image corresponding to at least one target preview image;

Marking the initial monitoring image by using a second mark, each initial monitoring image corresponding to at least one target monitoring image;

Extracting, from the z target images, a target preview image corresponding to each initial preview image based on the first mark;

And extracting, from the z target images, a target monitoring image corresponding to each initial monitoring pattern based on the second mark.
The apparatus of claim 11 wherein said one or more programs further comprise instructions for:

P initial preview images and q initial monitoring images are alternately acquired, p≥1, q≥1, and when p>1, the p initial preview images are continuous, and when q>1, the q initial monitoring The image is continuous.
The device of claim 13

p:q is 1:1;

Or, p:q is 2:1.
The apparatus of claim 11 wherein said one or more programs further comprise instructions for:

When the trigger signal of the snap target vehicle is acquired, the attribute information of the target vehicle is extracted from the monitoring stream.
The apparatus of any one of claims 9 to 15, the one or more programs further comprising instructions for:

Noise reduction processing and white balance processing are performed on each of the video streams.
A surveillance capture system, the system comprising a surveillance capture device and a terminal,

The monitoring and capturing device is configured to output at least two video streams to the terminal, the exposure time of each of the video streams is different, and the at least two video streams include a preview stream for previewing and monitoring for monitoring and capturing And the monitoring and capturing device comprises the monitoring and capturing device of any one of claims 9 to 16.
The system of claim 17 wherein said terminal is a monitor display.