CN112911280B

CN112911280B - Lens state detection method and device, electronic equipment and storage medium

Info

Publication number: CN112911280B
Application number: CN202110153498.5A
Authority: CN
Inventors: 李滨何
Original assignee: Guangdong Genius Technology Co Ltd
Current assignee: Guangdong Genius Technology Co Ltd
Priority date: 2021-02-04
Filing date: 2021-02-04
Publication date: 2022-03-01
Anticipated expiration: 2041-02-04
Also published as: CN112911280A

Abstract

The embodiment of the application discloses a method and a device for detecting the state of a lens, electronic equipment and a storage medium, wherein the method is applied to the electronic equipment, the electronic equipment comprises a camera module and a convex lens module which is detachably arranged with the camera module, the convex lens module is used for magnifying the image of an object to be shot in the camera module, and the method comprises the following steps: acquiring a first image which is acquired by a camera module when the electronic equipment is assembled with a convex lens module and is amplified by the convex lens module; acquiring a second image acquired by the camera module when the electronic equipment is not provided with the convex lens module; and determining a first lens state of the camera module and a second lens state of the convex lens module according to the first image and the second image and outputting the first lens state and the second lens state. By implementing the embodiment of the application, the lens state of the imaging module of the electronic equipment can be determined.

Description

Lens state detection method and device, electronic equipment and storage medium

Technical Field

The present application relates to the field of electronic device technologies, and in particular, to a method and an apparatus for detecting a lens state, an electronic device, and a storage medium.

Background

Along with the rapid development of electronic equipment technology, more and more electronic equipment embeds there is various imaging module to make things convenient for the user to shoot through electronic equipment anytime and anywhere.

In practice, it is found that an imaging module of an electronic device is inevitably stained with dust or dirt during use, so that a stain exists in a shot image. Moreover, the dust or dirt is usually small and difficult to be found by naked eyes, so how to determine the lens state of the imaging module becomes a problem to be solved urgently.

Disclosure of Invention

The embodiment of the application discloses a method and a device for detecting a lens state, electronic equipment and a storage medium, which can determine the lens state of an imaging module of the electronic equipment.

The embodiment of the application discloses a method for detecting the state of a lens, which is applied to electronic equipment, wherein the electronic equipment comprises a camera module and a convex lens module which is detachably arranged with the camera module, the convex lens module is used for enlarging the image of an object to be shot in the camera module, and the method comprises the following steps:

acquiring a first image which is acquired by the camera module when the electronic equipment is assembled with the convex lens module and is amplified by the convex lens module;

acquiring a second image acquired by the camera module when the electronic equipment is not provided with the convex lens module;

determining a first lens state of the camera module and a second lens state of the convex lens module according to the first image and the second image;

outputting the first lens state and the second lens state.

The second aspect of the embodiment of this application discloses a detection device of camera lens state, the device is applied to electronic equipment, electronic equipment including the module of making a video recording, and with the convex lens module that the module of making a video recording can dismantle the setting, the convex lens module is used for making and waits to shoot the object and is in the formation of image in the module of making a video recording enlargies, detection device includes:

the first acquisition unit is used for acquiring a first image which is acquired by the camera module when the electronic equipment is assembled with the convex lens module and is amplified by the convex lens module;

the second acquisition unit is used for acquiring a second image acquired by the camera module when the convex lens module is not assembled on the electronic equipment;

the determining unit is used for determining a first lens state of the camera module and a second lens state of the convex lens module according to the first image and the second image;

a first output unit for outputting the first lens state and the second lens state.

A third aspect of the embodiments of the present application discloses an electronic device, including:

a memory storing executable program code;

a processor coupled with the memory;

the processor calls the executable program code stored in the memory to execute the method for detecting the lens state disclosed in the first aspect of the embodiment of the present application.

A fourth aspect of the embodiments of the present application discloses a computer-readable storage medium storing a computer program, where the computer program enables a computer to execute the method for detecting a lens state disclosed in the first aspect of the embodiments of the present application.

A fifth aspect of embodiments of the present application discloses a computer program product, which, when run on a computer, causes the computer to perform part or all of the steps of any one of the methods of the first aspect of embodiments of the present application.

A sixth aspect of the present embodiment discloses an application publishing platform, where the application publishing platform is configured to publish a computer program product, where the computer program product, when running on a computer, causes the computer to perform part or all of the steps of any one of the methods in the first aspect of the present embodiment.

Compared with the related art, the embodiment of the application has the following beneficial effects:

implement this application embodiment, electronic equipment can gather the first image of being enlargied by the convex lens module through the module of making a video recording to and when dismantling the convex lens module from the module of making a video recording, directly gather the second image through the module of making a video recording, and determine the camera lens state of the module of making a video recording and convex lens module through comparing first image and second image, for example: whether the lens is contaminated, the location of contamination, etc. And the electronic equipment can output the determined lens state to remind the user to clean the polluted lens, so that the lens of the camera module and the convex lens module can be always kept in a clean state, and the imaging quality of the camera module is improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.

Fig. 1 is a schematic view of an application scenario of a method for detecting a lens state disclosed in an embodiment of the present application;

fig. 2 is a schematic flowchart of a method for detecting a lens state disclosed in an embodiment of the present application;

fig. 3 is a schematic flowchart of another lens state detection method disclosed in the embodiment of the present application;

fig. 4 is a schematic flowchart of another lens state detection method disclosed in the embodiment of the present application;

fig. 5 is a schematic structural diagram of a lens state detection apparatus disclosed in an embodiment of the present application;

fig. 6 is a schematic structural diagram of another lens state detection apparatus disclosed in an embodiment of the present application;

fig. 7 is a schematic structural diagram of an electronic device disclosed in an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

It should be noted that the terms "first", "second", "third" and "fourth", etc. in the description and claims of the present application are used for distinguishing different objects, and are not used for describing a specific order. The terms "comprises," "comprising," and "having," and any variations thereof, of the embodiments of the present application, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

The technical solution of the present application will be described in detail with reference to specific examples.

To more clearly illustrate the method and apparatus for detecting a lens state, the electronic device, and the storage medium disclosed in the embodiments of the present application, an application scenario applicable to the method for detecting a lens state is first introduced. Fig. 1 is a schematic view of an application scenario of a method for detecting a lens state disclosed in an embodiment of the present application, as shown in fig. 1, an electronic device 110 (e.g., a tablet computer, a mobile phone, a wearable device, etc.) may include a camera module (not shown), optionally, a convex lens module 120 (e.g., a microscope module, a magnifier module, etc., optionally, a connection device such as a buckle, a limiting member, etc. may be detachably disposed between the camera module and the convex lens module 120) may be detachably disposed at a position of the camera module, and the convex lens module 120 may be used to magnify an image of an object to be photographed in the camera module, so that the electronic device may acquire a magnified image of the object to be photographed, and particularly, when the object to be photographed is a specimen or teaching material content with a small font, a user may make the magnified image clearer, The contents of the specimen or the contents of the teaching material are observed in detail. In another embodiment, the convex lens module 120 can be detached from the camera module, so that the electronic device can capture normal images without magnification through the camera module.

Optionally, the convex lens module 120 may be provided with a receiving groove 1201 for inserting a sample insert (e.g., an insect sample insert, a cell sample insert, etc.), a card (e.g., various cards printed with teaching material data), or a test paper (e.g., an acid-base dyeing test paper, a humidity dyeing test paper, etc.) to be observed. Make the module of making a video recording can gather by the enlarged sample of waiting to observe of convex lens module magnification or the card waits to observe the enlarged image of object, and then make the user can observe in detail through enlarged image and wait to observe the object. In addition, the amplified image collected by the camera module can be stored in the electronic equipment, so that the user can conveniently check and compare the amplified image with other images at any time.

In practice, it is found that the lenses of the camera module and the convex lens module are inevitably stained with dust or dirt in the using process, so that the shot image has stains, and further, the user is not favorable for observing the object to be observed in detail through magnifying the image. In addition, since dust or dirt attached to the lens is generally small, it is difficult for a user to find and handle the lens in time with the naked eye. To this, in the embodiment of the application, electronic equipment can acquire the module of making a video recording when electronic equipment assembles the convex lens module, by the first image that the convex lens module is enlargied, and acquire the module of making a video recording when electronic equipment does not assemble the convex lens module, the second image of collection, and whether have the stain according to first image and second image, judge whether the camera lens of the module of making a video recording and convex lens module is contaminated, and the suggestion user cleans contaminated camera lens when the camera lens of the module of making a video recording and/or convex lens module is contaminated, so that the camera lens of the module of making a video recording and convex lens module can keep clean state always, thereby be favorable to improving the image quality of the module of making a video recording. In addition, because first image is the enlarged image that the module of making a video recording was gathered through the convex lens module, so electronic equipment can confirm more accurately through enlarged image whether the convex lens module has the stain, is favorable to having improved whether contaminated accuracy of electronic equipment determination camera lens.

Referring to fig. 2, fig. 2 is a schematic flow chart illustrating a method for detecting a lens state according to an embodiment of the present disclosure, where the method for detecting a lens state can be applied to the electronic device (for example, a tablet computer, a mobile phone, and the like, which is not limited herein). Optionally, the electronic device may include a camera module and a convex lens module detachably disposed with the camera module, and the convex lens module is used for magnifying an image of the object to be photographed in the camera module. The lens state detection method can comprise the following steps:

202. the method comprises the steps of acquiring a first image which is acquired by a camera module when the electronic equipment is assembled with a convex lens module and is amplified by the convex lens module.

In this embodiment of the application, the camera module may include one or more (including two or more) cameras, and the types of the cameras may include RGB color cameras, black and white cameras, or wide-angle cameras, and the like, which is not limited herein. Optionally, a convex lens module (e.g., a microscope module, a magnifier module, etc.) may be detachably disposed on a side of the camera module facing the object to be photographed, and a convex lens capable of magnifying an image is disposed in the convex lens module, so that the convex lens module can magnify an image of the object to be photographed in the camera, and the camera can acquire a magnified image of the object to be photographed magnified by the convex lens module.

In the embodiment of the application, the electronic equipment acquires the first image which is acquired by the camera module when the electronic equipment is assembled with the convex lens module and is amplified by the convex lens module, and whether the lens of the convex lens module is polluted is judged by detecting whether the stain exists in the first image, so that the stain in the first image is detected by the electronic equipment under the influence of avoiding the existence of an object to be shot in the first image. Therefore, when the electronic equipment is provided with the convex lens module through the camera module, the acquired image can be a blank image (such as a pure white image, a transparent image and the like), and other objects which influence the electronic equipment to detect the stain in the first image do not exist in the first image, so that the accuracy of detecting whether the stain exists in the first image by the electronic equipment is improved.

204. And acquiring a second image acquired by the camera module when the electronic equipment is not provided with the convex lens module.

In this application embodiment, can dismantle the connection through connecting device such as buckle, locating part between convex lens module and the module of making a video recording, and whether contaminated in order to judge the camera lens of the module of making a video recording, electronic equipment needs an image that the imaging process only passes through the camera lens of the module of making a video recording. Therefore, the electronic equipment can acquire the directly acquired second image which is not amplified when the camera module is not assembled on the electronic equipment, and the imaging process of the second image passes through the lens of the camera module and does not pass through the lens of the convex lens module, so that the electronic equipment can judge whether the lens of the camera module is polluted or not according to whether stains exist in the second image or not.

Similarly, when the convex lens module is not assembled on the electronic device through the camera module, the acquired image can be a blank image (for example, a pure white image, a transparent image and the like), and further, other objects which influence the electronic device to detect the stains in the second image do not exist in the second image, so that the accuracy of detecting whether the stains exist in the second image by the electronic device is improved.

Optionally, the electronic device may obtain, when detecting that the camera module is started, a first image that is acquired by the camera module when the electronic device is equipped with the convex lens module and is amplified by the convex lens module; and acquiring a second image acquired by the camera module when the electronic equipment is not provided with the convex lens module.

By implementing the method, the first image and the second image can be obtained when the electronic equipment shoots through the camera module at each time so as to perform self-checking on the states of the camera module and the lens of the convex lens module, so that the camera module and the lens of the convex lens module can be kept in a clean state all the time, and the imaging quality of the camera module is improved.

As another alternative embodiment, in consideration that the lenses of the camera module and the convex lens module are not frequently polluted, the electronic device may acquire, at intervals of a first time (for example, a week, a month, and the like, which are not limited herein), a first image, which is acquired by the camera module when the electronic device is equipped with the convex lens module, and is enlarged by the convex lens module; and acquiring a second image acquired by the camera module when the electronic equipment is not provided with the convex lens module.

By implementing the method, the electronic equipment can be prevented from frequently detecting the lens states of the camera module and the convex lens module, so that the power consumption of the electronic equipment is saved.

As still another alternative implementation, when the user wants to capture an important image and the quality and effect requirements of the image are high, the user may manually trigger the electronic device to detect the lens states of the camera module and the convex lens module. Optionally, the electronic device may obtain, when receiving a detection instruction for detecting lens states of the camera module and the convex lens module, a first image, which is acquired by the camera module when the convex lens module is assembled to the electronic device and is amplified by the convex lens module; and acquiring a second image acquired by the camera module when the electronic equipment is not provided with the convex lens module. Thereby the controllability that electronic equipment detected the camera lens state of module and the convex lens module of making a video recording has been improved.

It should be further noted that there is no time sequence relationship between step 202 and step 204, and in fact, the electronic device may acquire the first image first and then acquire the second image; the second image may be acquired first, and then the first image may be acquired, which is not limited herein.

206. And determining a first lens state of the camera module and a second lens state of the convex lens module according to the first image and the second image.

The lens state may include a contamination state indicating that contamination is present on the lens and a clean state indicating that contamination is not present on the lens. In this embodiment, the electronic device may extract a first image feature of the first image and a second image feature of the second image (for example, an edge feature, a color feature, a gray scale feature, and the like, which are not limited herein) through an image processing technique, and then the electronic device may determine whether a stain exists in the first image and the second image according to the first image feature and the second image feature, for example: when an area with a gray value larger than a preset gray value and an irregular contour exists in the first image, the electronic device can determine the area as a stain, and the area is not limited herein.

It should be further noted that the second image is only imaged through the lens of the camera module, so that if a stain exists in the second image, it indicates that the lens of the camera module is contaminated. And because the imaging process of the first image in the camera module passes through the camera lens of the camera module and the convex lens module, if stains exist in the first image, the situation that the camera lens of any one of the camera module or the convex lens module is polluted or the camera lens of both the camera module and the convex lens module is polluted is shown. Therefore, the electronic equipment can accurately determine whether the lens of the camera module is polluted or not through the second image, and firstly, the imaging process of the first image in the camera module needs to pass through the lens of the camera module and the convex lens module, so that only the lens of any one of the camera module or the convex lens module can be determined to be polluted, or the lens of the camera module and the lens of the convex lens module are polluted.

In this regard, the electronic device may determine the first lens state of the camera module and the second lens state of the convex lens module together according to the first image and the second image. For example, if a stain exists in the first image and a stain does not exist in the second image, the electronic device may determine that the lens of the camera module is in a clean state, and then the stain in the first image may only be caused by the stain on the lens of the convex lens module, so the electronic device may determine that the convex lens module is in a contaminated state, and if the stain exists in both the first image and the second image, the electronic device may further determine whether a first position of the stain in the first image is the same as a second position of the stain in the second image; if the first position of the stain in the first image is the same as the second position of the stain in the second image, it is determined that the stain in the first image is caused by the lens stain of the camera module, and the electronic device can determine that the lens of the convex lens module is in a clean state and the lens of the camera module is in a contaminated state. If the first position of the stain in the first image is different from the second position of the stain in the second image, it indicates that the stain in the first image is not caused by the lens stain of the camera module but may be caused by the lens stain of the convex lens module, so the electronic device can determine that both the lens of the convex lens module and the lens of the camera module are in a contaminated state, which is not limited herein.

208. And outputting the first lens state and the second lens state.

In the embodiment of the application, after the electronic equipment determines the first lens state of the camera module and the second lens state of the convex lens module, the first lens state of the camera module and the second lens state of the convex lens module can be output for the user to refer to. Optionally, the electronic equipment can also output prompt information aiming at the polluted lens so as to prompt a user to clean the polluted lens, so that the camera module and the lens of the convex lens module can be kept in a clean state all the time, and the imaging quality of the camera module is improved.

As another alternative, the electronic device may further determine the first lens state of the camera module, and the second lens state of the convex lens module, the first lens state of the camera module and the second lens state of the convex lens module are sent to other electronic equipment (such as a smart watch, a smart bracelet and the like of a user) which is in communication connection with the electronic equipment, and other electronic equipment which is in communication connection with the electronic equipment displays the first lens state of the camera module and the second lens state of the convex lens module for the reference of a user, thereby avoiding the electronic equipment from displaying the first lens state of the camera module on the display screen of the electronic equipment, and the second lens state of the convex lens module, the display of the view-finding frame of the camera module is shielded, and then influence the condition that the user confirms the object that needs to shoot through the frame of finding a view, be favorable to having improved user's shooting efficiency.

Implementing the method disclosed in each of the above embodiments, the electronic device can acquire the first image amplified by the convex lens module through the camera module, and directly acquire the second image through the camera module when the convex lens module is detached from the camera module, and determine the lens states of the camera module and the convex lens module by comparing the first image and the second image, for example: whether the lens is contaminated, the location of contamination, etc. And the electronic equipment can output the determined lens state to remind the user to clean the polluted lens, so that the lens of the camera module and the convex lens module can be always kept in a clean state, and the imaging quality of the camera module is improved.

Referring to fig. 3, fig. 3 is a flow chart illustrating another lens state detection method disclosed in the embodiment of the present application, which can be applied to the electronic device (for example, a tablet computer, a mobile phone, and the like, but not limited thereto). Optionally, the electronic device may include a camera module and a convex lens module detachably disposed with the camera module, and the convex lens module is used for magnifying an image of the object to be photographed in the camera module. The lens state detection method can comprise the following steps:

302. the method comprises the steps of acquiring a first image which is acquired by a camera module when the electronic equipment is assembled with a convex lens module and is amplified by the convex lens module.

304. And acquiring a second image acquired by the camera module when the electronic equipment is not provided with the convex lens module.

306. First image features of the first image are extracted, and first taint information of the first image is determined according to the first image features.

In the embodiment of the application, the electronic device may extract a first image feature of the first image (the first image feature may include, but is not limited to, an edge feature, a color feature, and a gray-scale value feature, and is not limited herein) through an image processing technique (for example, an edge detection technique, an image recognition technique, an image segmentation technique, and the like, and the electronic device may determine the first blur information of the first image according to the first image feature.

The first stain information may include, but is not limited to, the presence of a stain in the first image, the absence of a stain in the first image, a location of a stain, a type of a stain, and the like.

Optionally, after the electronic device extracts the first image feature of the first image, the first image feature may be matched with a stain image feature, where the stain image feature may be set by a developer according to a large amount of development experience, and optionally, the stain image feature may include a color with a color feature of a dark color system, a gray value greater than a preset gray value, an image contour of an irregular figure, and the like, which is not limited herein. For this, optionally, the electronic device may determine that the first image feature matches with the stain image feature when the first image feature satisfies that the gray value is greater than the preset gray value or the image contour is an irregular figure, and may further determine that the stain exists in the first image; otherwise, if the first image feature does not match the above-mentioned smear image feature, the electronic device may determine that no smear exists in the first image.

By implementing the method, the electronic equipment can accurately determine whether the stains exist in the first image in an image feature matching mode according to the first image features of the image, so that the electronic equipment can conveniently determine the lens states of the camera module and the convex lens module according to whether the stains exist in the first image.

308. Second image features of the second image are extracted, and second taint information of the second image is determined according to the second image features.

Similarly, the electronic device may extract a second image feature of the second image (the second image feature may include, but is not limited to, an edge feature, a color feature, and a gray-scale value feature) through an image processing technique (for example, an edge detection technique, an image recognition technique, an image segmentation technique, and the like, which are not limited herein), and the electronic device may determine second blur information of the second image according to the second image feature.

The second stain information may include, but is not limited to, the presence of a stain in the second image, the absence of a stain in the second image, the location of a stain, and the type of a stain.

Optionally, after extracting the second image feature of the second image, if it is detected that the second image feature matches the stain image feature, the electronic device may determine that a stain exists in the second image; conversely, if the electronic device detects that the second image feature does not match the taint image feature, it may be determined that the taint is not present in the second image.

By implementing the method, the electronic equipment can accurately determine whether the stains exist in the second image in an image feature matching mode according to the second image features of the image, so that the electronic equipment can conveniently determine the lens states of the camera module and the convex lens module according to whether the stains exist in the second image.

310. And determining a first lens state of the camera module and a second lens state of the convex lens module according to the first taint information and the second taint information.

In the embodiment of the present disclosure, the first lens state of the camera module and the second lens state of the convex lens module may include a contamination state (i.e., a state where the lens may be contaminated with dust or dirt), a cleaning state (i.e., a state where the lens is not contaminated with dirt such as dust or dirt), and the like, which is not limited herein.

As described above, in the embodiment of the present application, the imaging process of the first image in the camera module passes through the camera module and the lens of the convex lens module, so that if there is a stain in the first image, it indicates that the lens of either the camera module or the convex lens module is contaminated, or the lenses of both the camera module and the convex lens module are contaminated. And the imaging process of the second image in the camera module is only through the lens of the camera module, so that if stains exist in the second image, the lens of the camera module is polluted. Therefore, the electronic equipment can accurately determine whether the lens of the camera module is polluted or not through the second image. And the imaging process of the first image in the camera module passes through the camera module and the lens of the convex lens module, so that the camera module or the lens of any one of the convex lens modules can only be determined to be polluted, or the camera module and the lens of the convex lens module are polluted. Therefore, after the electronic equipment determines the first taint information of the first image and the second taint information of the second image, the first lens state of the camera module and the second lens state of the convex lens module can be determined by combining the first taint information and the second taint information.

Alternatively, the electronic device may determine that the lens of the convex lens module and the lens of the camera module are both in a clean state when the electronic device detects that the stain does not exist in the first image and the stain does not exist in the second image.

In another embodiment, if the second image has a stain and the second image has no stain, the electronic device may determine that the lens of the convex lens module is in a contaminated state and the lens of the camera module is in a clean state.

It should be noted that the imaging process of the second image in the camera module is only through the lens of the camera module, so that if there is no stain in the second image, it indicates that the lens of the camera module is not contaminated and is in a clean state. The imaging process of the first image passes through the lens of the camera module and the convex lens, and the lens of the module is not polluted because the lens of the camera module can be determined to be not polluted according to the second image, which indicates that the stains existing in the first image are caused by the stains stained on the lens of the convex lens module, so the electronic equipment can determine that the lens of the convex lens module is in a polluted state.

By implementing the method, as the imaging process of the image shot by the camera module passes through the camera module and/or the lens of the convex lens module, if stains exist on the camera module or the lens of the convex lens module, the stains also exist in the image shot by the camera module. To this, whether the camera lens of module and the convex lens module of making a video recording has the stain according to the image that the module of making a video recording was gathered of electronic equipment, confirms the camera lens state of module and convex lens module of making a video recording, has improved the accuracy of the camera lens state of the module of making a video recording and the convex lens module that electronic equipment determined.

In another optional embodiment, after determining the first stain information of the first image and the second stain information of the second image, if a stain is detected in the first image and a stain is also detected in the second image, the electronic device may determine that the lens of the camera module is in a stained state (because the imaging process of the second image only passes through the lens of the camera module, the stain is only likely to be caused by the stain on the lens of the camera module, and then the lens state of the convex lens module cannot be directly determined. That is, if the stain in the first image is caused by a lens stain of the camera module, the lens of the convex lens module is not contaminated; on the contrary, if the stain in the first image is not caused by the lens stain of the camera module, the lens of the convex lens module is polluted.

In this regard, the electronic device may further determine whether a first location of the stain in the first image is the same as a second location of the stain in the second image; if the first position of the stain in the first image is the same as the second position of the stain in the second image, it is determined that the stain in the first image is caused by the lens stain of the camera module, and the electronic device can determine that the lens of the convex lens module is in a clean state and the lens of the camera module is in a contaminated state. If the first position of the stain in the first image is different from the second position of the stain in the second image, it is indicated that the stain in the first image is not caused by the lens stain of the camera module but may be caused by the lens stain of the convex lens module, so that the electronic device can determine that both the lens of the convex lens module and the lens of the camera module are in a contaminated state.

By implementing the method, the electronic equipment can skillfully determine the lens state of the convex lens module by comparing the positions of the stains in the first image and the second image when the stains exist in the first image and the second image, so that the accuracy of the camera module and the lens state of the convex lens module determined by the electronic equipment is improved.

312. And outputting the first lens state and the second lens state.

The method disclosed by each embodiment can be implemented by acquiring a first image amplified by the convex lens module through the camera module, acquiring a second image directly through the camera module when the convex lens module is detached from the camera module, and determining the lens states of the camera module and the convex lens module by comparing the first image with the second image, for example: whether the lens is contaminated, the location of contamination, etc. The electronic equipment can output the determined lens state to remind a user of cleaning a polluted lens, so that the lenses of the camera module and the convex lens module can be kept in a clean state all the time, and the imaging quality of the camera module is improved; whether stains exist in the first image can be accurately determined in an image feature matching mode according to the first image features of the image, and therefore the electronic equipment can conveniently determine the lens states of the camera module and the convex lens module according to whether stains exist in the first image or not; whether stains exist on the camera lens of the camera module and the convex lens module can be judged according to the image collected by the camera module, so that the lens states of the camera module and the convex lens module can be determined, and the accuracy of the lens states of the camera module and the convex lens module determined by the electronic equipment is improved; and when stains exist in the first image and the second image, the lens state of the convex lens module can be determined ingeniously by comparing the positions of the stains in the two images, so that the accuracy of the camera module determined by the electronic equipment and the accuracy of the lens state of the convex lens module are improved.

Referring to fig. 4, fig. 4 is a flowchart illustrating a method for detecting a lens state according to another embodiment of the present disclosure, where the method for detecting a lens state can be applied to the electronic device (for example, a tablet computer, a mobile phone, and the like, which is not limited herein). Optionally, the electronic device may include a camera module and a convex lens module detachably disposed with the camera module, and the convex lens module is used for magnifying an image of the object to be photographed in the camera module. The lens state detection method can comprise the following steps:

402. the method comprises the steps of acquiring a first image which is acquired by a camera module when the electronic equipment is assembled with a convex lens module and is amplified by the convex lens module.

404. And acquiring a second image acquired by the camera module when the electronic equipment is not provided with the convex lens module.

406. And determining a first lens state of the camera module and a second lens state of the convex lens module according to the first image and the second image.

In this embodiment of the application, after the electronic device acquires the first image and the second image, the first image feature of the first image and the second image feature of the second image may be respectively extracted, and then the electronic device may determine first stain information corresponding to the first image according to the first image feature, where the first stain information may include whether a stain exists in the first image, a position of the stain, a type of the stain, a degree of contamination, and the like, and is not limited herein.

Optionally, the first image feature may include an edge feature, a color feature, a gray value feature, and the like, and then the electronic device may determine that a stain exists in the first image when the first image feature satisfies that the gray value is greater than a preset gray value, or the edge feature is an irregular figure; further, the electronic equipment can obtain the first coordinate of the image pixel point included by the stain, and then determine the position of the stain according to the first coordinate.

As an alternative implementation, the electronic device may determine the type of the stain according to the color feature and the edge feature included in the first image feature.

In one embodiment, if the first image feature includes a color feature that is a dark color such as black, gray, etc., and the edge feature is an irregular pattern, the electronic device can determine that the stain is dust or dirt. Alternatively, if the first image feature includes a color feature that is white or transparent and the edge feature is drop-shaped, the electronic device may determine that the stain is a water stain. Alternatively, if the first image feature includes a color feature of dark color such as black, gray, etc., and the edge feature is a droplet, the electronic device may determine that the stain is ink, which is not limited herein.

Similarly, the electronic device may also determine second taint information corresponding to the second image according to the second image feature, and the second taint information may also include whether a taint exists in the first image, a location of the taint, a type of the taint, and the like, which is not limited herein. In addition, the determination manner of the second taint information is similar to that of the first taint information, and is not repeated herein.

Optionally, the electronic device may directly output the first taint information and the second taint information for a user to refer to, which is not limited herein.

By implementing the method, the electronic equipment can also determine whether stains exist on the camera lenses of the camera module and the convex lens module according to the first image characteristics of the first image and the second image characteristics of the second image, and the positions and types of the stains are used as stain information of the camera lenses, so that subsequent electronic equipment can output the stain information for a user to refer to, the user can accurately clean the contaminated camera lenses according to the stain information, the camera lenses of the camera module and the convex lens module can be kept in a clean state all the time, and the imaging quality of the camera module is improved.

As described above, in the embodiment of the present application, the first lens state of the camera module and the second lens state of the convex lens module may include a contamination state, a cleaning state, and the like, and the electronic apparatus may determine the first lens state of the camera module and the second lens state of the convex lens module according to the stain information in the first image and the second image. However, in practice, it is found that in the process of imaging the first image and the second image, due to the converging effect of light, the areas of the mirror surfaces of the first image and the lens are not completely the same, but have a certain proportional relationship, so that the position of the stain in the second image is not necessarily the position of the stain on the lens.

In contrast, as an optional implementation manner, after determining that the lens of the convex lens module is in the contaminated state, the electronic device may determine a third position of the stain on the lens of the convex lens module according to the first position of the stain in the first image, and output the third position for reference by the user, so that the user can accurately find the stain on the lens of the convex lens module. The third position and the first position are in a first matching relationship (optionally, the first matching relationship may be an area ratio of the first image and a lens surface of the convex lens module, or a fixed ratio set by a developer, which is not limited).

In another embodiment, after determining that the lens of the camera module is in a contaminated state, the electronic device may determine a fourth position of the stain on the lens of the camera module according to the second position of the stain in the second image, and output the fourth position for reference by the user, so that the user can accurately find the stain on the lens of the camera module. The fourth position and the second position are in a second matching relationship (optionally, the second matching relationship may be an area ratio of the second image to a lens surface of the camera module, or a fixed ratio set by a developer, which is not limited).

By implementing the method, when the camera module or the lens of the convex lens module is polluted, the electronic equipment can determine the position of the stain in one step and output the position of the stain for the user to refer, so that the user can accurately find the stain on the lens of the camera module and clean the stain in time, the camera module and the lens of the convex lens module can be kept in a clean state all the time, and the imaging quality of the camera module is improved.

408. And when the lens state is a pollution state in the first lens state and the second lens state, outputting prompt information for prompting a user to clean the lens with the pollution state.

In this embodiment of the application, after the electronic device determines the first lens state and the second lens state, if the first lens state and/or the second lens state are/is a contamination state, the electronic device may output the prompt information, for example, if the first lens state is the contamination state, the electronic device may output the prompt information for cleaning for the lens of the camera module. And when the second lens state is a contamination state, the electronic device may output a cleaning prompt for the lens of the convex lens module, which is not limited herein. Thereby make the user can be fast, accurately clean contaminated camera lens to make the camera lens of making a video recording module and convex lens module can keep clean state always, be favorable to improving the imaging quality of the module of making a video recording.

As an optional implementation manner, after the electronic device outputs the prompt message and waits for a preset time period (for example, 5 minutes, 10 minutes, which is not limited herein), a third image, which is acquired by the camera module again when the electronic device assembles the convex lens module and is amplified by the convex lens module, may be acquired; acquiring a fourth image which is acquired again by the camera module when the electronic equipment is not provided with the convex lens module; and if stains still exist in the third image and/or the fourth image, the electronic equipment can output alarm information again to urge the user to clean the polluted lens in time.

By implementing the method, the electronic equipment can detect whether the user cleans the lens according to the prompt information after outputting the prompt information for a period of time, and if the user does not clean, the electronic equipment can output alarm information with higher prompt level to urge the user to clean the lens in time, so that the user is prompted to clean the polluted lens in time, the camera module and the lens of the convex lens module can be kept in a clean state all the time, and the imaging quality of the camera module is improved.

The method disclosed by each embodiment can be implemented by acquiring a first image amplified by the convex lens module through the camera module, acquiring a second image directly through the camera module when the convex lens module is detached from the camera module, and determining the lens states of the camera module and the convex lens module by comparing the first image with the second image, for example: whether the lens is contaminated, the location of contamination, etc. The electronic equipment can output the determined lens state to remind a user of cleaning a polluted lens, so that the lenses of the camera module and the convex lens module can be kept in a clean state all the time, and the imaging quality of the camera module is improved; when the camera module or the lens of the convex lens module is determined to be polluted, the position of the stain can be determined in one step, and the position of the stain is output for a user to refer, so that the user can accurately find the stain on the lens of the camera module and clean the stain in time, the camera module and the lens of the convex lens module can be kept in a clean state all the time, and the imaging quality of the camera module is improved; and, can carry out clear prompt message to contaminated camera lens output to make the user can be fast, accurately clean contaminated camera lens, thereby make the camera lens of module of making a video recording and convex lens module keep clean state always, be favorable to improving the imaging quality of the module of making a video recording.

Please refer to fig. 5, fig. 5 is a schematic structural diagram of a lens state detection apparatus disclosed in an embodiment of the present application, the lens state detection apparatus can be applied to the electronic device, the electronic device can include a camera module and a convex lens module detachably disposed with the camera module, the convex lens module can be used for magnifying an image of an object to be photographed in the camera module, and the detection apparatus can include: a first acquisition unit 501, a second acquisition unit 502, a determination unit 503, and a first output unit 504, wherein:

the first obtaining unit 501 is configured to obtain a first image, which is collected by the camera module when the electronic device is equipped with the convex lens module and is amplified by the convex lens module;

a second obtaining unit 502, configured to obtain a second image acquired by the camera module when the electronic device is not equipped with a convex lens module;

a determining unit 503, configured to determine a first lens state of the camera module and a second lens state of the convex lens module according to the first image and the second image;

a first output unit 504 for outputting a first lens state and a second lens state.

Implement detection device of above-mentioned camera lens state, can gather the first image that is enlargied by convex lens module through the module of making a video recording to and when dismantling convex lens module from the module of making a video recording, directly gather the second image through the module of making a video recording, and determine the camera lens state of the module of making a video recording and convex lens module through comparing first image and second image, for example: whether the lens is contaminated, the location of contamination, etc. And the electronic equipment can output the determined lens state to remind the user to clean the polluted lens, so that the lens of the camera module and the convex lens module can be always kept in a clean state, and the imaging quality of the camera module is improved.

Referring to fig. 6, fig. 6 is a schematic structural diagram of another lens state detection apparatus disclosed in the embodiment of the present application, the lens state detection apparatus can be applied to the electronic device, the electronic device can include a camera module and a convex lens module detachably disposed with the camera module, and the convex lens module can be used for magnifying an image of an object to be photographed in the camera module. The detection apparatus shown in fig. 6 may be optimized by the detection apparatus shown in fig. 5, and compared with the detection apparatus shown in fig. 5, the first determining unit 503 in the detection apparatus shown in fig. 6 is configured to determine the first lens state of the image capturing module and the second lens state of the convex lens module according to the first image and the second image, specifically, may be:

a first determining unit 503, configured to extract a first image feature of the first image, and determine first stain information of the first image according to the first image feature; extracting a second image characteristic of the second image, and determining second taint information of the second image according to the second image characteristic; and determining a first lens state of the camera module and a second lens state of the convex lens module according to the first taint information and the second taint information.

By implementing the detection device for the lens state, whether stains exist in the first image and the second image can be accurately determined in an image feature matching mode according to the image features of the first image and the second image, so that the lens state of the camera module and the lens state of the convex lens module can be conveniently determined by the electronic equipment according to whether stains exist in the first image and the second image.

As an optional implementation manner, the manner by which the first determining unit 503 is used to determine the first stain information of the first image according to the first image feature may specifically be:

a first determining unit 503, configured to determine that a stain exists in the first image when the first image feature matches the stain image feature, and determine that the stain does not exist in the first image if the first image feature does not match the stain image feature.

And the way that the first determining unit 503 is used for determining the second taint information of the second image according to the second image feature may specifically be:

a first determining unit 503, configured to determine that a stain exists in the second image when the second image feature matches the stain image feature, and determine that the stain does not exist in the second image if the second image feature does not match the stain feature.

The detection device for implementing the lens state can accurately determine whether stains exist in the first image in an image feature matching mode according to the first image features of the image, so that the lens state of the camera module and the lens state of the convex lens module can be conveniently determined by the electronic equipment according to whether stains exist in the first image or not.

As an alternative embodiment, the manner by which the first determining unit 503 is configured to determine the first lens state of the image capturing module and the second lens state of the convex lens module according to the first blur information and the second blur information may specifically be:

a first determining unit 503, configured to determine that the lens of the convex lens module and the lens of the camera module are both in a clean state when the stain does not exist in the first image and the stain does not exist in the second image; and if the first image has stains and the second image does not have stains, determining that the lens of the convex lens module is in a pollution state and the lens of the camera module is in a clean state.

Implement above-mentioned detection device of camera lens state, can judge whether the camera lens of making a video recording module and convex lens module has the stain according to the image of making a video recording module collection, confirm the camera lens state of making a video recording module and convex lens module, improved the accuracy of the camera lens state of the module of making a video recording and convex lens module that electronic equipment determined.

a first determining unit 503, configured to determine whether a first position of a stain in the first image is the same as a second position of the stain in the second image when the stain exists in the first image and the stain exists in the second image; if the first position of the stain in the first image is the same as the second position of the stain in the second image, determining that the lens of the convex lens module is in a clean state and the lens of the camera module is in a polluted state; and if the first position of the stain in the first image is different from the second position of the stain in the second image, determining that the lens of the convex lens module and the lens of the camera module are in a polluted state.

By implementing the detection device for the lens state, when stains exist in the first image and the second image, the lens state of the convex lens module can be determined ingeniously by comparing the positions of the stains in the two images, so that the accuracy of the camera module and the lens state of the convex lens module determined by the electronic equipment is improved.

As an alternative embodiment, the detection device shown in fig. 6 may further include: a second output unit 505 and a third output unit 506, wherein:

and a second output unit 505, configured to determine a third position of the stain on the lens of the convex lens module according to the first position of the stain in the first image and output the third position when it is determined that the lens of the convex lens module is in a contaminated state, where the third position and the first position are in a first matching relationship.

And the third output unit 506 is configured to determine a fourth position of the stain on the lens of the camera module and output the fourth position according to the second position of the stain in the second image when it is determined that the lens of the camera module is in a contaminated state, where the fourth position and the second position are in a second matching relationship.

Implement detection device of above-mentioned camera lens state, can be when determining the module of making a video recording, perhaps the camera lens of convex lens module is polluted, through the position that one step determined the stain to the position confession user of output stain refers to, so that the user can accurately find the foretell stain of camera lens of the module of making a video recording and in time clean, thereby make the camera lens of the module of making a video recording and convex lens module can keep clean state always, be favorable to improving the imaging quality of the module of making a video recording.

As an optional implementation manner, the manner for the first output unit 504 to output the first lens state and the second lens state may specifically be:

a first output unit 504, configured to output a prompt message for prompting a user to clean the lens with the lens state being a contaminated state when the lens state is a contaminated state in the first lens state and the second lens state.

Implement the detection device of above-mentioned camera lens state, can carry out clear prompt message to contaminated camera lens output to make the user can be fast, accurately clean contaminated camera lens, thereby make the camera lens of module and convex lens module of making a video recording keep clean state always, be favorable to improving the imaging quality of the module of making a video recording.

Referring to fig. 7, fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. As shown in fig. 7, the electronic device may include:

a memory 701 in which executable program code is stored;

a processor 702 coupled to the memory 701;

the processor 702 calls the executable program code stored in the memory 701 to execute the lens state detection method disclosed in each of the above embodiments.

The embodiment of the application discloses a computer-readable storage medium, which stores a computer program, wherein the computer program enables a computer to execute the lens state detection method disclosed in each embodiment.

The embodiment of the present application also discloses an application publishing platform, wherein the application publishing platform is used for publishing a computer program product, and when the computer program product runs on a computer, the computer is caused to execute part or all of the steps of the method in the above method embodiments.

It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. Those skilled in the art should also appreciate that the embodiments described in this specification are all alternative embodiments and that the acts and modules involved are not necessarily required for this application.

In various embodiments of the present application, it should be understood that the size of the serial number of each process described above does not mean that the execution sequence is necessarily sequential, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated units, if implemented as software functional units and sold or used as a stand-alone product, may be stored in a computer accessible memory. Based on such understanding, the technical solution of the present application, which is a part of or contributes to the prior art in essence, or all or part of the technical solution, may be embodied in the form of a software product, stored in a memory, including several requests for causing a computer device (which may be a personal computer, a server, a network device, or the like, and may specifically be a processor in the computer device) to execute part or all of the steps of the above-described method of the embodiments of the present application.

It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by hardware instructions of a program, and the program may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Compact Disc Read-Only Memory (CD-ROM), or other Memory, such as a magnetic disk, or a combination thereof, A tape memory, or any other medium readable by a computer that can be used to carry or store data.

The method and the device for detecting the lens state, the electronic device, and the storage medium disclosed in the embodiments of the present application are introduced in detail, and a specific example is applied in the present application to explain the principle and the implementation of the present application, and the description of the embodiments is only used to help understanding the method and the core idea of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. A method for detecting a lens state, wherein the lens state is used for indicating cleanliness of a lens, the method is applied to an electronic device, the electronic device comprises a camera module and a convex lens module detachably arranged with the camera module, the convex lens module is used for magnifying an image of an object to be shot in the camera module, and the method comprises the following steps: acquiring a first image which is acquired by the camera module when the electronic equipment is assembled with the convex lens module and is amplified by the convex lens module;

outputting the first lens state and the second lens state.

2. The method of claim 1, wherein determining a first lens state of the camera module and a second lens state of the convex lens module based on the first image and the second image comprises:

extracting first image characteristics of the first image, and determining first stain information of the first image according to the first image characteristics;

extracting second image characteristics of the second image, and determining second stain information of the second image according to the second image characteristics;

and determining a first lens state of the camera module and a second lens state of the convex lens module according to the first taint information and the second taint information.

3. The method of claim 2, wherein determining the first taint information of the first image from the first image feature comprises:

if the first image feature is matched with the taint image feature, determining that the taint exists in the first image, and if the first image feature is not matched with the taint image feature, determining that the taint does not exist in the first image;

and determining second taint information of the second image according to the second image feature, comprising:

if the second image feature is matched with the taint image feature, determining that a taint exists in the second image, and if the second image feature is not matched with the taint image feature, determining that a taint does not exist in the second image.

4. The method of claim 2, wherein determining a first lens state of the camera module and a second lens state of the convex lens module based on the first blur information and the second blur information comprises:

if the stains do not exist in the first image and the stains do not exist in the second image, determining that the lens of the convex lens module and the lens of the camera module are in a clean state;

and if the first image has stains and the second image does not have stains, determining that the lens of the convex lens module is in a pollution state and the lens of the camera module is in a clean state.

5. The method of claim 2, wherein determining a first lens state of the camera module and a second lens state of the convex lens module based on the first blur information and the second blur information comprises:

if the first image has the stain and the second image has the stain, judging whether a first position of the stain in the first image is the same as a second position of the stain in the second image;

if the first position is the same as the second position, determining that the lens of the convex lens module is in a clean state and the lens of the camera module is in a polluted state;

and if the first position is different from the second position, determining that the lens of the convex lens module and the lens of the camera module are in a pollution state.

6. The method according to any one of claims 4 or 5, further comprising:

if the lens of the convex lens module is determined to be in a pollution state, determining a third position of the stain on the lens of the convex lens module according to the first position of the stain in the first image and outputting the third position, wherein the third position and the first position are in a first matching relation;

and if the camera lens of the camera module is determined to be in a pollution state, determining a fourth position of the stain on the camera lens of the camera module and outputting the fourth position according to the second position of the stain in the second image, wherein the fourth position and the second position are in a second matching relation.

7. The method of claim 1, wherein the outputting the first lens state and the second lens state comprises:

and if the first lens state is a pollution state and/or the second lens state is a pollution state, outputting prompt information, wherein the prompt information is used for prompting a user to clean the lens with the pollution state.

8. The utility model provides a detection device of camera lens state, its characterized in that, the camera lens state is used for showing the clean degree of camera lens, electronic equipment is applied to the device, electronic equipment including the module of making a video recording, and with the convex lens module that the setting can be dismantled to the module of making a video recording, the convex lens module is used for making and treats that the shooting object is in formation of image magnification in the module of making a video recording, detection device includes:

9. An electronic device comprising a memory storing executable program code, and a processor coupled to the memory; wherein the processor calls the executable program code stored in the memory to execute the method of any one of claims 1 to 7.

10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method of any one of claims 1 to 7.