WO2017197865A1

WO2017197865A1 - Method and apparatus for detecting state of lens

Info

Publication number: WO2017197865A1
Application number: PCT/CN2016/107732
Authority: WO
Inventors: 晁目力
Original assignee: 中兴通讯股份有限公司
Priority date: 2016-05-20
Filing date: 2016-11-29
Publication date: 2017-11-23
Also published as: CN107404647A

Abstract

Disclosed are a method and an apparatus for detecting the state of the lens, the method comprising: determining, from respective blocks of a captured image, a target block, the characteristic information of which satisfies a first preset condition; acquiring first luminance information and first characteristic information of the target block; determining whether a lens is abnormal according to the first luminance information and the first characteristic information; prompting a user to process the state of the lens if it is determined that the lens is abnormal. The present invention implements the automatic detection of the state of the lens, and prompts the user to process the state of the lens when the lens is determined to be abnormal, improving the quality of photographs taken.

Description

Lens state detection method and device

Technical field

Embodiments of the present invention relate to image processing technologies in the field of communication technologies, and in particular, to a lens state detection method and apparatus.

Background technique

With the rapid development of smart terminals and the convenience of taking pictures of mobile devices, mobile phone photography has become the new favorite of people's online social communication. Therefore, the camera system of mobile phones has higher and higher requirements for photo quality, and the guarantee of photo quality is not only In addition to the debugging optimization of the performance of the sensor and the image processor (ISP), it is also necessary to consider from the perspective of the photographer, for example, whether the surface of the camera lens is free of stains and the shooting environment.

In the related technology, the camera developer considers the user's various usage scenarios as much as possible, and the algorithm considers the mode of the fully automatic adaptive scene. Most of the techniques are based on objective weather, lighting, environment, etc. Sexual treatment. Therefore, the related art ignores the degradation of the quality of photographs caused by the artificial contamination of the lens. That is to say, since the mobile phone is often held in the hand, the lens of the camera will inevitably be affected by perspiration and oil stains. The lens stain will often make the video or photo color of the film dim, the texture is blurred, if it encounters the illumination source (such as Light-emitting diode billboards, headlights, street lights, etc.) The halo will also become larger. At this time, the quality of the photos taken by the fully automatic camera is still very poor.

Summary of the invention

In order to solve the related technical problem, the embodiment of the present invention provides a lens state detecting method and device, which can automatically detect the lens state, prompt the user to perform processing when determining the lens abnormality, and improve the quality of the captured photo.

To achieve the above objective, the technical solution of the embodiment of the present invention is implemented as follows:

In a first aspect, an embodiment of the present invention provides a lens state detecting method, where the method includes:

Determining a target area in which the feature information satisfies the first preset condition from each block of the captured image Piece;

Obtaining first brightness information and first feature information of the target block;

Determining whether the lens is abnormal according to the first brightness information and the first feature information;

The user is prompted to perform processing when it is determined that the lens is abnormal.

In the above solution, the determining whether the lens is abnormal according to the first brightness information and the first feature information includes:

Determining, according to a correspondence between the preset brightness information and the feature information, second feature information corresponding to the first brightness information;

Calculating a difference between the first feature information and the second feature information;

Determining whether the difference satisfies a second preset condition;

If yes, it is determined that the lens is abnormal; otherwise, the lens is determined to be normal.

In the above solution, the method further includes:

Obtaining atmospheric visibility information;

Determining whether the lens is abnormal according to the first brightness information and the first feature information includes:

Determining whether the lens is abnormal according to the atmospheric visibility information, the first brightness information, and the first feature information.

In the above solution, after the determining that the lens is abnormal, prompting the user to perform processing, the method further includes:

Determining nonlinear compensation information corresponding to the first brightness information according to a correspondence between the previously acquired brightness information and the nonlinear compensation information;

And performing nonlinear compensation processing on the captured image according to the nonlinear compensation information.

In the above solution, the determining, according to the correspondence between the pre-acquired luminance information and the nonlinear compensation information, the nonlinear compensation information corresponding to the first luminance information, including:

Determining the first relationship according to the correspondence between the first brightness information and the brightness level The brightness level corresponding to the brightness information;

The gamma correction information corresponding to the brightness level is determined according to a correspondence relationship between the brightness level acquired in advance and the gamma correction information.

In a second aspect, an embodiment of the present invention provides a lens state detecting device, where the device includes:

a detecting module, configured to determine, from each block of the captured image, a target block whose feature information satisfies a first preset condition;

An acquiring module, configured to acquire first brightness information and first feature information of the target block;

The determining module is configured to determine whether the lens is abnormal according to the first brightness information and the first feature information;

The first response module is configured to prompt the user to perform processing when the lens is abnormal.

In the above solution, the determining module is specifically configured as:

Determining whether the difference satisfies a second preset condition;

In the above solution, the determining module is specifically configured as:

Obtaining atmospheric visibility information;

In the above solution, the device further includes:

The second response module determines, according to the correspondence between the previously acquired luminance information and the nonlinear compensation information, nonlinear compensation information corresponding to the first luminance information;

In the above solution, the second response module is specifically configured as:

Determining a brightness level corresponding to the first brightness information according to a correspondence between the first brightness information and a brightness level;

In the embodiment of the present invention, a computer storage medium is further provided, and the computer storage medium may store an execution instruction for executing the lens state detection method in the foregoing embodiment.

In the embodiment of the present invention, by determining, from each block of the captured image, that the feature information meets the target block of the first preset condition, determining whether the lens is abnormal based on the first brightness information and the first feature information of the target block, determining When the lens is abnormal, the user is prompted to perform processing, which realizes automatic detection of the lens state, prompts the user to process when determining the lens abnormality or nonlinearly compensates for the captured image, thereby avoiding photo distortion caused by lens stain/scratch. Can improve the quality of the photos taken.

DRAWINGS

1 is an optional schematic flowchart of a lens state detecting method according to an embodiment of the present invention;

2 is another schematic flow chart of a lens state detecting method according to an embodiment of the present invention;

3 is a schematic structural diagram of an apparatus for detecting a lens state according to an embodiment of the present invention;

4 is an optional schematic diagram of a storage format of a LUT table according to an embodiment of the present invention;

FIG. 5 is still another schematic flow chart of a lens state detecting method according to an embodiment of the present invention; FIG.

6 is another schematic structural diagram of a lens state detecting device according to an embodiment of the present invention;

FIG. 7 is still another schematic structural diagram of a lens state detecting device according to an embodiment of the present invention.

detailed description

In various embodiments of the invention: the lens state detecting device from the various blocks of the captured image Determining, in the target block, that the feature information meets the first preset condition, acquiring the first brightness information and the first feature information of the target block, determining whether the lens is abnormal according to the first brightness information and the first feature information, and determining that the lens is abnormal Prompt the user to process.

The technical solutions in the embodiments of the present invention will be clearly and completely described in the following with reference to the accompanying drawings.

Embodiment 1

The embodiment provides a lens state detecting method, which can be applied to a scene in which the quality of the photographed photograph may be degraded due to the user's neglect of the lens abnormality (such as stains/scratches of the lens); the lens state detection in this embodiment The execution body of the method may be a lens state detecting device, and the lens state detecting device may be implemented in the following manner, for example, implementing components of the lens state detecting device in a mobile terminal, a photographing device or a monitoring device, or in a mobile terminal or a photographing device. Or the monitoring device side implements components of the lens state detecting device in a coupled manner, wherein the camera device can be, for example, a camera, a camera, a DV, or the like having a camera/camera function.

FIG. 1 is an optional schematic flowchart of a lens state detecting method according to an embodiment of the present invention; as shown in FIG. 1 , a lens state detecting method includes:

Step 101: Determine, from each block of the captured image, a target block whose feature information satisfies a first preset condition.

The captured image may be, for example, an image captured by a lens of a mobile terminal such as a mobile phone, a notebook, or a tablet; the feature information is a characteristic parameter that reflects the quality of the captured image, and may be, for example, a sharpness (a color difference closely related to sharpness), and a brightness. And the contrast and the noise are not specifically limited in this embodiment of the present invention.

The target block of the first preset condition may be a block with the largest contrast value and the sharpness value in the captured image, and the size of the block is determined according to the reference standard image; the sharpness value of the captured image may be in the frequency domain range. To calculate, the calculation method calculates the spatial frequency according to the ISO12233 standard, and the image sharpness is expressed by the spatial frequency of MTF50 or MTF50P; the image contrast can be the sum of the square of the difference between the gray value of the central pixel and the gray value of the surrounding neighboring pixels, except In the embodiment of the present invention, the number of the squared terms is not specifically limited.

Step 102: Acquire first brightness information and first feature information of the target block.

The first brightness information may be the first brightness value and the first brightness level corresponding to the first brightness value, which is not specifically limited in this embodiment.

The first feature information may be a parameter or an element for describing an image characteristic such as a sharpness, a contrast, or the like, which is not specifically limited in this embodiment.

Step 103: Determine whether the lens is abnormal according to the first brightness information and the first feature information.

A possible implementation manner of the step 103 includes: determining, according to a correspondence between the preset brightness information and the feature information, second feature information corresponding to the first brightness information; and calculating the first feature information and the second feature information. The difference value is determined whether the difference satisfies the second preset condition; if yes, the lens abnormality is determined; otherwise, the lens is determined to be normal.

Here, the lens abnormality may include: a factor/state in which the lens is stained, the lens is scratched, the lens is blocked, and the like; the second preset condition may be a preset threshold or a difference range. The second feature information may be sharpness and contrast, which is not specifically limited in this embodiment. The process of determining the second feature information is: selecting an object with an angular shape as a standard image, and obtaining a sharp image with different brightness values. The degree value and the contrast value are used as an index mark, and a mapping relationship between the brightness value and the sharpness value and the contrast value is established, and is stored as an associated index table.

Another possible implementation manner of the step 103 includes: obtaining the atmospheric visibility information after determining the feasible implementation manner; and determining whether the lens is abnormal according to the atmospheric visibility information, the first brightness information, and the first feature information.

The above-mentioned feasible implementation method for determining whether the lens is abnormal according to the atmospheric visibility information, the first brightness information and the first feature information comprises: obtaining atmospheric visibility information; determining whether the atmospheric visibility value is higher than a preset condition; the atmospheric visibility value is higher than The lens abnormality is determined when the third preset condition is met.

The third preset condition may be a range of the difference between the preset atmospheric visibility threshold, the current atmospheric visibility, and the preset atmospheric visibility value, which is not specifically limited in this embodiment. The visibility information of the atmosphere can be obtained, for example, by detecting the smog detector installed in the mobile terminal, or by receiving the atmospheric visibility information sent by the server by the mobile terminal, which is not limited in this embodiment.

Step 104: Prompt the user to perform processing when determining that the lens is abnormal.

The lens state detecting method in the real-time example of the present invention may automatically detect the lens state in real time every time the camera is photographed; or may preset a sleep timer to determine the lens abnormality, start the sleep timer, and determine that the sleep timer exceeds the preset wake-up. When the threshold is used, the function of automatic detection of the lens state is turned off.

In the embodiment of the present invention, the first brightness information and the first feature information of the target block satisfying the first preset condition are obtained by detecting the feature information in each block of the lens captured image, and according to the first brightness information and the first The feature information determines whether the lens is abnormal, and prompts the user to perform processing when determining that the lens is abnormal, thereby avoiding the degradation of the quality of the photographed photo caused by the user's neglect of the lens abnormality, thereby improving the quality of the photograph taken by the user.

Embodiment 2

The embodiment is based on the first embodiment and can be applied to improve the image captured by the lens state detecting device without requiring the user to detect whether the lens has stains/scratches in advance, or the user does not completely treat the lens stain/scratch. Take a picture of the quality of the scene.

The detection of the lens state by the lens state detecting device can be detected in real time or periodically according to the user's requirements, which is not limited in this embodiment.

2 is a schematic diagram of another optional flow of a lens state detecting method according to an embodiment of the present invention; the method shown in FIG. 2 supplements the process of correcting a captured image after prompting the user to perform processing when determining a lens abnormality, The method includes:

Step 201: Determine nonlinear compensation information corresponding to the first brightness information according to a correspondence between the previously acquired brightness information and the nonlinear compensation information.

The feasible implementation of step 201 can be any of the following:

In the first mode, the brightness level corresponding to the first brightness information is determined according to the correspondence between the first brightness information and the brightness level; and the brightness level is determined according to the correspondence between the brightness level and the gamma correction information acquired in advance. Gamma correction information.

After the lens abnormality is determined, when the user does not respond to the lens abnormality or the lens still has an abnormality, the first brightness information and the first feature information of the target block are acquired; and the index table corresponding to the first brightness information is searched according to the first brightness information. Determining, in the index table corresponding to the first brightness information, the first gamma correction information; wherein the first index table is used to indicate the associated index table with the mapping relationship established by the preset brightness information and the gamma correction information;

The second mode determines the brightness level corresponding to the first brightness information according to the correspondence between the first brightness information and the brightness level; and determines the number corresponding to the brightness level according to the correspondence between the brightness level and the feature information acquired in advance The second feature information is calculated; the difference between the first feature information and the second feature information is calculated; and the second gamma correction information corresponding to the difference is determined according to the correspondence between the previously acquired difference and the gamma correction information.

After the lens abnormality is determined, when the user does not respond to the lens abnormality or the lens still has an abnormality, the first brightness information and the first feature information of the target block are acquired; and the brightness information of the target block is determined according to the first brightness information. a brightness level; searching for a second index table corresponding to the brightness level according to the brightness level, determining gamma correction information in the second index table corresponding to the brightness level; wherein the second index table is used to indicate different preset brightness levels and presets An association index table having a mapping relationship established by gamma correction information;

The method 3: determining a brightness level corresponding to the first brightness information according to a correspondence between the first brightness information and the brightness level; determining a number corresponding to the brightness level according to a correspondence between the brightness level and the feature information acquired in advance The second feature information is calculated; the difference between the first feature information and the second feature information is calculated; and the second gamma correction information corresponding to the difference is determined according to the correspondence between the previously acquired difference and the gamma correction information.

After the lens abnormality is determined, when the user does not respond to the lens abnormality or the lens still has an abnormality, the first brightness information and the first feature information of the target block are acquired; and the brightness level corresponding to the brightness information is determined according to the brightness information; And searching for a third index table corresponding to the brightness level, determining a sharpness value and a contrast value in the third index table corresponding to the brightness level; wherein the third index table is used to indicate the sharpness of the image of the standard version of the different preset brightness levels A relational index table with a mapping relationship between the value, the contrast value, and the preset brightness level; from the blocks of the captured image The block that determines the sharpness value and the contrast value is the target block, obtains the sharpness value and the contrast value of the target block, and compares the sharpness value and the contrast value of the target block with the corresponding third index table. The sharpness value and the contrast value are matched, and the difference between the sharpness value and the contrast value of the target block and the sharpness value and the contrast value in the third index table are calculated; according to the difference, the fourth index table corresponding to the difference value is searched And determining gamma correction information in the fourth index table corresponding to the difference, wherein the fourth index table is used to indicate a correlation index table having a mapping relationship established by the difference value and the gamma correction information.

The determination of the above-mentioned standard image may be, for example, when the lens is clean, the object with a sharp angle of about 3 meters is selected as the shooting condition, and in a scene of taking a series of photographs of the object with strong contrast and sharp edges under different brightness, The selection of the brightness can be obtained by adjusting the brightness gain and adjusting the exposure compensation, which is not specifically limited in this embodiment.

Step 202: Perform nonlinear compensation processing on the captured image according to the nonlinear compensation information.

The nonlinear compensation information may be a preset gamma value, and gamma correction of the captured image compensates for a difference in image color due to lens stain/damage.

In the lens state detecting method of the embodiment of the present invention, the lens state detecting device determines the nonlinear compensation information corresponding to the first brightness information according to the correspondence between the previously acquired brightness information and the nonlinear compensation information, and according to the nonlinear compensation information, The captured image is automatically subjected to nonlinear compensation processing, which avoids the difference between the input image and the output image color, thereby avoiding the photo quality caused by the user ignoring the detection of the lens state, or the lens is not wiped clean, or the lens is scratched. The drop in the image quality is improved.

Embodiment 3

The embodiment is based on the first embodiment and can be applied to a scenario in which it is desired to prompt the user to wipe clean when the camera lens of the terminal device is stained or damaged, and correct the taken photo to improve the quality of the photo.

The lens state detecting device provided by the present invention is a system for smudging and correcting the camera lens of the terminal device, and is divided into a corresponding hardware component part and a software part.

Hardware part, except for the module related to the camera module of the relevant mobile phone (including the camera mode) In addition to the group, image processor, audio, light-emitting diode (LCD, Light Emitting Diode) display, storage unit, etc., it is also necessary to add a special modulus transfer function (MTF) calculation unit to the image processor. In order to easily calculate the relevant spatial frequency, the sharpness of the image is evaluated. The camera module includes lens, motor and image sensor. The image processor is used to complete the processing of captured image data, including lens shading correction (LSC, lens shading), color correction, color conversion, gamma correction. And other modules. The LCD is for previewing the captured image. The storage unit is for the storage of the last photo.

In the software part, the sharpness and contrast of a typical scene taken at a certain distance (about 3m) under different brightness are arranged into a table for storage. This scene requires strong contrast and sharp edges and corners. The sorted table can be stored in a certain format and used as a display lookup table (LUT, Look-Up-Table). When the user uses, as long as the mobile phone is used to take a photo (the distance is also about 3m), the mobile phone automatically detects the area with high contrast in the current scene, and selects the area through the MTF calculation unit in the image processing unit. Obtain the corresponding sharpness value, and find the LUT prepared in advance according to the current brightness. If the current sharpness or contrast value is lower than the value in the LUT, it is considered that the sharpness and contrast are seriously degraded, and the lens contamination is prompted. Remind users to wipe clean. If the user fails to wipe in time, the software automatically increases the contrast by modifying the gamma to enhance the visual clarity. At the same time, the exposure is adjusted to reduce the halo of the light caused by the lens stain, so as to correct the negative effect of the stain on the photo.

The embodiment provides a lens state detecting device for detecting and reminding a stain of a camera lens. Referring to FIG. 3, the device includes:

1. The main processor 301 is an access point (AP, Access Point) in the mobile phone, and is applied to respond to the request of the image processor, simultaneously displays to the LCD, reads and writes data of the storage unit, and sounds the corresponding prompt of the audio system. In the scene.

2. The image processor 302 is configured to perform image color space conversion, color correction, gamma correction, noise reduction, and the like in the image signal.

3. Lens and module 303: set to convert the light of the scene being shot into a field of image signals In the scenery.

4. LCD display 304: Set to the scene in which the processed data is previewed.

5. Audio output 305: Set to the scene in which the prompting sound is emitted during the photographing process.

6. Storage unit 306: Set in a scene to compress the processed data.

The MTF calculation unit, located in the image processor, can of course also be implemented in pure software. The reason why it is placed in the image processor is because the hardware is calculated faster and the real-time performance can be guaranteed. You need to take a series of photos with sharp contrasts and sharp edges at different brightnesses with the camera lens clean beforehand. The selected image contains the area of the corner of the object to calculate the MTF, and the MTF50 is obtained as the sharpness value. The current brightness value, sharpness value, contrast, etc. are arranged into a LUT table according to the following format, and stored in the storage unit for software to call. The LUT table storage format is as shown in FIG. 4: for example, the data 1_1 may represent the luminance value Lux, or the index value of the exposure table, and the data 1_2 may represent the MTF50 value obtained by the MTF calculation unit, and the value may be obtained by extracting the edge according to IS012233. And perform Fourier transform to find the spatial frequency and find the value at the spatial frequency 50; the data 1_3 can be the contrast value. The LUT table may indicate the correspondence between the luminance value and the gamma correction; or the correspondence between the luminance value and the sharpness value and the contrast value corresponding to the luminance value; or the gamma correction and the difference (the sharpness of the target block) The correspondence between the degree value, the contrast value, and the difference between the preset sharpness value and the contrast value is not specifically limited in this embodiment.

Software processing flow, referring to FIG. 5, the lens state detecting method of this embodiment includes:

Step 501: When using the mobile phone, turn on the camera and aim at an object around a certain distance (such as 3m);

Step 502: At this time, the mobile phone automatically detects the area with the highest contrast and sharpness in the captured picture, and the size of the area can be set in advance.

Step 503: Next, the MTF calculation unit in the image processor automatically calculates the MTF50 value and the contrast value of an edge of the edge-cleared area, and the value can be calculated according to the ISO12233 standard, and the spatial frequency is calculated by Fourier transform. Further, MTF50 is obtained. At the same time, the corresponding contrast value can also be obtained.

Step 504: The MTF50 value and the contrast value obtained in the above steps are not subject to before The contaminated lens is compared with the LUTs at different brightnesses to determine whether the difference is greater than a certain threshold. If yes, go to step 505; otherwise, go to step 510.

Step 505: When the difference between the sharpness (MTF50) and the contrast value in the LUT and the current MTF 50 and the contrast value is greater than a certain threshold, when it is greater than a certain threshold, step 506 is performed, otherwise step 511 is performed.

Step 506: determining the current weather, which may be obtained by the PM2.5 detector provided by the mobile phone or the real-time networked weather forecast; when the weather is foggy, skip the steps for prompting and correcting, and perform step 511, otherwise Go to step 507.

Step 507: When the weather is good, the lens may be judged to be contaminated, and the audio prompts a voice or a prompt message pops up on the LCD;

Step 508: Determine whether the user wipes clean. When the user wipes but does not wipe clean or does not respond, step 509 is performed; otherwise, step 511 is performed.

Step 509: At this time, the built-in, tested gamma and exposure values can be used to improve the contrast of the photo and improve the picture quality.

Step 510: Take the normal photo taking process.

Step 511: Finally save the photo. At this point, the lens stain prompting and correction system software is completed.

For the 509 link, the specific implementation may be implemented as follows. The obtained MTF 50 at the current brightness and the difference between the contrast value and the response value in the LUT may be divided into multiple levels, and each level corresponds to a group of gamma prepared in advance. The gamma is arranged according to the contrast from high to low. Each level is selected, corresponding to a group of gamma. After the user selects gamma, the LCD will preview in real time, and the user selects a photo with better effect. The adjustment of the exposure can be adjusted according to the brightness change of the gamma modified screen. If a certain level is selected, the screen is found to be dark. At this time, the exposure amount can be appropriately increased manually, so that the brightness of the screen is moderate, and it can also be based on the lamp, the street lamp, etc. Light source, select the area focus to adjust the exposure.

The embodiments of the present invention can also be applied to the following scenarios:

Scene 1, when the user is outdoors during the day, as long as the camera is turned on, the captured image contains sharp edges, strong contrast tree branches, street light poles, utility poles, or street signs, etc., and the system can be used to determine whether the lens has been It is contaminated or not cleaned. If it has not been wiped clean, you can use this method to make special corrections to the photos you take to ensure the shooting.

Scene 2, special weather, such as foggy weather, can be triggered by the real-time weather forecast of the network or the dust detector provided by the mobile phone. When a certain threshold is reached, the lens pollution reminding function is automatically turned off. In addition, scenes with dark lighting cannot use lens contamination to alert this feature.

In the embodiment of the invention, the mobile phone camera lens stain correction system is also applicable to the scratches caused by the sharpening of the camera lens by the sharp object, and the scratches also cause the photo quality to deteriorate. Scratch tips and corrections can be achieved with this system.

In the embodiment of the present invention, the user can also bring a small card that can be put into the wallet. The card is half-divided in black and white, half black, half white, and can be placed one meter away from the camera when in use. The system can also be used to achieve contamination prompts and corrections.

The embodiment of the invention obtains the brightness value of the target block of the captured image, and finds the preset gamma correction information according to the brightness value, thereby realizing the adjustment of the contrast of the captured image, and simultaneously adjusting the exposure to reduce the light caused by the lens stain. The halo at the place improves the quality of the photos taken.

Embodiment 4

FIG. 6 is a schematic diagram of another optional structure of a lens state detection processing device according to an embodiment of the present invention; the lens state detection processing device provided by the embodiment includes:

The detecting module 601 is configured to determine, from each block of the captured image, a target block whose feature information satisfies a first preset condition;

The obtaining module 602 is configured to acquire first brightness information and first feature information of the target block;

The determining module 603 is configured to determine whether the lens is abnormal according to the first brightness information and the first feature information;

The first response module 604 is configured to prompt the user to perform processing when determining that the lens is abnormal.

In the embodiment of the present invention, the first brightness information and the first feature information of the target block are obtained by determining the target block that the feature information meets the first preset condition from the respective blocks of the captured image, according to the first brightness information and the first A feature information is used to determine whether the lens is abnormal, and the user is prompted to perform processing when determining that the lens is abnormal, thereby preventing the user from detecting the state of the lens in real time, preventing the quality of the photographed image from being degraded when the lens is abnormal, and realizing automatic detection of the lens state. Can improve the quality of the photos taken.

On the basis of the foregoing embodiment, the determining module 603 is specifically configured to: determine, according to a correspondence between the preset brightness information and the feature information, second feature information corresponding to the first brightness information; and calculate the first feature information and The difference of the second feature information; determining whether the difference satisfies the second preset condition; if yes, determining the lens abnormality; otherwise determining that the lens is normal.

On the basis of the foregoing embodiment, the determining module 603 is specifically configured to: obtain atmospheric visibility information; determine whether the lens is abnormal according to the first brightness information and the first feature information, including: according to atmospheric visibility information, first brightness information, and The first feature information determines whether the lens is abnormal.

Based on the above embodiment, FIG. 7 is still another optional structural diagram of the lens state detecting device according to the embodiment of the present invention. The lens state detecting device shown in FIG. 7 also includes a detecting module 601, an obtaining module 602, and a judgment. The module 603, the first response module 604, and the modules also have the corresponding functions described in the above embodiments. Meanwhile, the lens state detecting device shown in FIG. 7 further includes:

The second response module 605 determines nonlinear compensation information corresponding to the first brightness information according to the correspondence between the previously acquired brightness information and the nonlinear compensation information; and performs nonlinear compensation processing on the captured image according to the nonlinear compensation information. .

On the basis of the foregoing embodiment, the second response module 605 is specifically configured to: determine, according to a correspondence between the first brightness information and the brightness level, a brightness level corresponding to the first brightness information; according to the pre-acquired brightness level and The correspondence between the gamma correction information determines the gamma correction information corresponding to the brightness level.

In an actual application, the detecting module 601, the obtaining module 602, the determining module 603, the first response module 604, and the second response module 605 can all be processed by the central processing unit located in the communication number processing device. Implemented by a CPU (CPU), a microprocessor (MPU), a digital signal processor (DSP), or a field programmable gate array (FPGA).

Embodiment 5

This embodiment describes a computer readable medium, which may be a ROM (eg, a read only memory, a FLASH memory, a transfer device, etc.), a magnetic storage medium (eg, a magnetic tape, a disk drive, etc.), an optical storage medium (eg, a CD- ROM, DVD-ROM, paper card, paper tape, etc.) and other well-known types of program memory; computer-readable medium storing computer-executable instructions that, when executed, cause at least one processor to perform operations including:

Determining, from each block of the captured image, a target block whose feature information satisfies a first preset condition;

Prompt the user to process when the lens is abnormal.

In summary, in the embodiment of the present invention, the detecting module determines, from each block of the captured image, that the feature information meets the target block of the first preset condition; the acquiring module acquires the first brightness information and the first feature information of the target block; The determining module determines whether the lens is abnormal according to the first brightness information and the first feature information; the first response module prompts the user to perform processing when determining that the lens is abnormal, and prompts the user to perform processing when determining the lens abnormality due to automatic detection of the lens state. It avoids the user shooting in the scene of ignoring the lens state, which improves the quality of the photos taken by the user.

Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention can take the form of a hardware embodiment, a software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.

The present invention is directed to a method, apparatus (system), and computer program in accordance with an embodiment of the present invention. The flow chart and/or block diagram of the product is described. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

The above is only the preferred embodiment of the present invention and is not intended to limit the scope of the present invention.

Industrial applicability

Claims

A lens state detecting method, the method comprising:

Determining, from each block of the captured image, a target block whose feature information satisfies a first preset condition;

Obtaining first brightness information and first feature information of the target block;

Determining whether the lens is abnormal according to the first brightness information and the first feature information;

The user is prompted to perform processing when it is determined that the lens is abnormal.
The method according to claim 1, wherein the determining whether the lens is abnormal according to the first brightness information and the first feature information comprises:

Determining, according to a correspondence between the preset brightness information and the feature information, second feature information corresponding to the first brightness information;

Calculating a difference between the first feature information and the second feature information;

Determining whether the difference satisfies a second preset condition;

If yes, it is determined that the lens is abnormal; otherwise, the lens is determined to be normal.
The method of claim 2, wherein the method further comprises:

Obtaining atmospheric visibility information;

Determining whether the lens is abnormal according to the first brightness information and the first feature information includes:

Determining whether the lens is abnormal according to the atmospheric visibility information, the first brightness information, and the first feature information.
The method of claim 1, wherein after the determining that the lens is abnormal, prompting the user to perform processing, the method further comprises:

Determining nonlinear compensation information corresponding to the first brightness information according to a correspondence between the previously acquired brightness information and the nonlinear compensation information;

And performing nonlinear compensation processing on the captured image according to the nonlinear compensation information.
The method of claim 4, wherein said based on a pre-acquired brightness letter Determining the nonlinear compensation information corresponding to the first brightness information, comprising: a correspondence between the information and the nonlinear compensation information, including:

Determining a brightness level corresponding to the first brightness information according to a correspondence between the first brightness information and a brightness level;

The gamma correction information corresponding to the brightness level is determined according to a correspondence relationship between the brightness level acquired in advance and the gamma correction information.
A lens state detecting device, the device comprising:

a detecting module, configured to determine, from each block of the captured image, a target block whose feature information satisfies a first preset condition;

An acquiring module, configured to acquire first brightness information and first feature information of the target block;

The determining module is configured to determine whether the lens is abnormal according to the first brightness information and the first feature information;

The first response module is configured to prompt the user to perform processing when the lens is abnormal.
The device according to claim 6, wherein the determining module is specifically configured to:

Determining, according to a correspondence between the preset brightness information and the feature information, second feature information corresponding to the first brightness information;

Calculating a difference between the first feature information and the second feature information;

Determining whether the difference satisfies a second preset condition;

If yes, it is determined that the lens is abnormal; otherwise, the lens is determined to be normal.
The device according to claim 7, wherein the determining module is specifically configured to:

Obtaining atmospheric visibility information;

Determining whether the lens is abnormal according to the first brightness information and the first feature information includes:

Determining whether the lens is abnormal according to the atmospheric visibility information, the first brightness information, and the first feature information.
The apparatus of claim 6 wherein said apparatus further comprises:

The second response module determines, according to the correspondence between the previously acquired luminance information and the nonlinear compensation information, nonlinear compensation information corresponding to the first luminance information;

And performing nonlinear compensation processing on the captured image according to the nonlinear compensation information.
The device according to claim 9, wherein the second response module is specifically configured to:

Determining a brightness level corresponding to the first brightness information according to a correspondence between the first brightness information and a brightness level;

The gamma correction information corresponding to the brightness level is determined according to a correspondence relationship between the brightness level acquired in advance and the gamma correction information.