CN110557575B

CN110557575B - Method for eliminating glare and electronic equipment

Info

Publication number: CN110557575B
Application number: CN201910801980.8A
Authority: CN
Inventors: 李泽
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2019-08-28
Filing date: 2019-08-28
Publication date: 2021-04-27
Anticipated expiration: 2039-08-28
Also published as: CN110557575A

Abstract

The invention discloses a method for eliminating glare and electronic equipment, wherein the method comprises the following steps: shooting a first image, wherein a first area of the first image comprises glare; outputting first prompt information; when the electronic equipment meets a first shooting condition corresponding to the first prompt message, shooting at least one second image, wherein a second area corresponding to the first area in the at least one second image does not include glare; a target image is generated based on the first image and the at least one second image. According to the method, a first area of a first image obtained by shooting comprises glare, when electronic equipment meets a first shooting condition, at least one second image is shot, a second area corresponding to the first area in the at least one second image does not comprise the glare, a picture of the second area replaces a picture of the first area to obtain a target image, the target image comprises the second area and other areas except the first area in the first image, the glare in the first area is eliminated, and image quality is improved.

Description

Method for eliminating glare and electronic equipment

Technical Field

The invention relates to the field of terminals, in particular to a method for eliminating glare and electronic equipment.

Background

All lenses are subject to some non-ideality factor during their image transmission, one factor being called glare.

A camera lens is assembled by mounting a number of individual glass lenses, called lens units. When bright light passes through the camera lens, a portion of the light is reflected back by the various surfaces of the lens elements. This internal reflection can cause a ghost image and appear as an image on the final image. As shown in fig. 1, glare a appearing in the upper left corner and center of the image resembles a heptagonal spot, which degrades the quality of the image.

Disclosure of Invention

The embodiment of the invention provides a glare elimination method and electronic equipment, and aims to solve the problem that in the prior art, image quality is reduced due to glare in an image.

In order to solve the technical problem, the invention is realized as follows:

in a first aspect, a glare elimination method is provided, and the method includes:

shooting a first image, wherein a first area of the first image comprises glare;

outputting first prompt information;

when the electronic equipment meets a first shooting condition corresponding to the first prompt message, shooting at least one second image, wherein a second area corresponding to the first area in the at least one second image does not include glare;

and generating a target image according to the first image and the at least one second image.

In a second aspect, an electronic device is provided, the electronic device comprising:

the device comprises a first shooting module, a second shooting module and a control module, wherein the first shooting module is used for shooting a first image, and a first area of the first image comprises dazzling light;

the output module is used for outputting first prompt information;

the second shooting module is used for shooting at least one second image when the electronic equipment meets a first shooting condition corresponding to the first prompt message, wherein a second area corresponding to the first area in the at least one second image does not include glare;

a generating module for generating a target image according to the first image and the at least one second image.

In a third aspect, an electronic device is provided, comprising a processor, a memory and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the method according to the first aspect.

In a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored, which computer program, when being executed by a processor, realizes the steps of the method according to the first aspect.

In the embodiment of the invention, a first image is shot, a first area of the first image comprises glare, when electronic equipment meets a first shooting condition, at least one second image is shot, the at least one second image is used for assisting in eliminating the glare in the first area, a second area corresponding to the first area in the at least one second image does not comprise the glare, a picture of the second area in the at least one second image is replaced by a picture of the first area in the first image to obtain a target image, the target image comprises the second area and other areas except the first area in the first image, the glare in the first area is eliminated, and the image quality is improved.

Drawings

The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention and not to limit the invention. In the drawings:

FIG. 1 is a schematic representation of a prior art image containing glare;

FIG. 2 is a flow chart of a glare elimination method according to an embodiment of the present invention;

FIG. 3 is a schematic view of an image containing glare according to an embodiment of the present invention;

FIG. 4 is a schematic view of an image containing glare according to another embodiment of the present invention;

FIG. 5 is a schematic view of an image containing glare according to yet another embodiment of the present invention;

FIG. 6 is a schematic view of an image containing glare according to yet another embodiment of the present invention;

FIG. 7 is a schematic structural diagram of an electronic device of one embodiment of the invention;

fig. 8 is a schematic structural diagram of an electronic device according to another embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Fig. 2 is a flowchart illustrating a glare elimination method according to an embodiment of the present invention, where the method illustrated in fig. 2 may be performed by an electronic device, as illustrated in fig. 2, and the method includes:

s110, shooting a first image, wherein a first area of the first image comprises glare.

In S110, when a light source directly irradiates the electronic device, a first image is captured, where a first area of the first image includes one or more glare lights, the first area may also include one or more glare lights, and the glare lights may have other shapes such as a triangle, a circle, and a hexagon.

For example, as shown in fig. 3, the area beside the zebra crossing, i.e., the first area, includes three ellipse-like flare lights a. As shown in fig. 4, the area below and to the left of the light source, i.e. the first area, comprises a triangular glare a.

And S120, outputting the first prompt message.

In S120, first prompt information is output, where the first prompt information is used for prompting, by the electronic device, the user to perform a corresponding operation according to the glare interference degree, so that the electronic device satisfies the first shooting condition.

Optionally, in some embodiments, the method shown in fig. 2 may include:

when the glare interference degree of the first image is lower than the preset interference degree, the first prompt message comprises a shooting angle of the electronic equipment.

It should be understood that the glare interference degree refers to a degree of interference of the glare in the first area to the entire first image.

In some embodiments, whether the glare interference degree of the first image is lower than a preset interference degree is judged, if the glare interference degree of the first image is lower than the preset interference degree, it is indicated that the ratio of the glare picture in the first area to the whole first image is small, the electronic device outputs first prompt information for prompting a user to change a shooting angle of the electronic device, and one or more second images can be shot in response to a shooting operation of the user under the condition that the subsequent electronic device satisfies a first shooting condition corresponding to the first prompt information, so that the positions of the glare in the one or more second images are different from the positions of the glare in the first image, and the first image can be assisted in repairing the glare. The operation mode is simple and convenient, and the user experience is improved. Meanwhile, according to the first prompt message, the user can quickly know how to operate to enable the electronic equipment to meet the first shooting condition, and the working efficiency is improved.

Optionally, in other embodiments, when the glare interference degree of the first image is lower than the preset interference degree, the electronic device outputs first prompt information, where the first prompt information is used to prompt the user to move the electronic device toward the target direction by a target shooting angle, and when the subsequent electronic device meets the first shooting condition corresponding to the first prompt information and responds to the shooting operation of the user, shoots at least one second image, so that the shooting process is more intelligent, the time for the user to determine the shooting angle is reduced, and the user experience is improved.

For example, the electronic device outputs a prompt message for moving the electronic device by 30 ° to the left when the glare interference degree of the first image is lower than a preset interference degree, and takes a second image in response to a shooting operation of the user when the user moves the electronic device by 30 ° to the left, where the second area in the second image does not include glare.

Optionally, in still other embodiments, the first prompt message further includes: and displaying the appointed first area according to a preset mode.

It is understood that there are many preset ways, such as framing, marking, highlighting, etc. the first area to be designated.

In some embodiments, the first prompt message includes displaying the designated first area in a preset manner, so as to prompt the user to eliminate glare in the designated first area only for a subsequently generated target image, that is, the user may freely select glare to be eliminated, thereby improving user experience.

For example, if the first image has only one first area, the electronic device outputs first prompt information, and responds to an operation of selecting the designated first area by the user, and the designated first area, that is, the only first area in the first image, displays the first area. If the first image has a plurality of first areas, the electronic equipment outputs first prompt information, responds to the operation of selecting the appointed first area, the appointed first area is any one or more first areas, and displays the one or more first areas selected by the user.

Optionally, in some embodiments, the method shown in fig. 2 further includes:

when the dazzling light interference degree of the first image is not lower than the preset interference degree, the first prompt message comprises a light source for shielding and generating dazzling light.

When the glare interference degree of the first image is not lower than the preset interference degree, it is described that the ratio of the glare image in the first area to the entire first image is large, then a plurality of second images with different glare positions are shot by changing the shooting angle of the electronic device, and the plurality of second images cannot assist in repairing the glare in the first image, so that a user is required to shield a light source generating the glare to assist in repairing the glare in the first image. When a user blocks a light source by hands or other objects, a second image with a blocked light source is shot in response to the shooting operation of the user, namely the second image is an image with a blocked part of picture but without glare, and is used for assisting the first image in repairing the glare, and only one second image needs to be shot. Between the operation of changing the shooting angle of the electronic equipment and the operation of shielding the light source, the user can quickly determine the optimal operation, and the working efficiency is improved.

Optionally, in other embodiments, when the glare interference degree of the first image is not lower than the preset interference degree, the electronic device may automatically shield the light source, and shoot a second image in response to the shooting operation of the user, so that the shooting process is more intelligent, the operation steps of the user are reduced, and the user experience is improved.

And S130, when the electronic equipment meets a first shooting condition corresponding to the first prompt message, shooting at least one second image, wherein a second area corresponding to the first area in the at least one second image does not include glare.

In S130, in a case where the electronic device satisfies the first photographing condition, in response to a user photographing operation, at least one second image is photographed, a second area of the second image does not include glare, and the second area corresponds to the first area.

For example, as shown in fig. 5, a first area of the first image includes glare a, and the first area is below and to the left of the light source. As shown in fig. 6, a second area of the second image corresponds to the first area, the second area is also at the lower left of the light source, and the second area does not include the glare a. That is, a second region corresponding to the first region in the second image does not include glare a, the glare a of the second image is located at the lower right of the light source, and the region where the glare a is located is not the second region.

Or, the first image includes three first regions, the three first regions are respectively at the lower left, lower right and right sides of the light source, if only one of the first regions is eliminated, the first region is at the lower left of the light source, and the other two first regions do not greatly affect the first image, then one second image can be shot, and the second region corresponding to the first region in the second image does not include glare.

Or the first image includes three first regions respectively at the lower left, lower right, and directly above the light source, and at least one second image is photographed if glare in the three first regions is eliminated, specifically, if the number of the second images is one, the second regions corresponding to the three first regions in the second image do not include glare. If the number of the second images is three, a second area corresponding to a first area located on the lower left of the light source in the first second image does not include glare, a second area corresponding to a first area located on the lower right of the light source in the second image does not include glare, and a second area corresponding to a first area located directly above the light source in the third second image does not include glare.

Optionally, in some embodiments, after capturing the at least one second image, before generating the target image from the first image and the at least one second image, the method shown in fig. 2 further comprises:

identifying feature points of the first image and feature points of the at least one second image;

and aligning the first image and the at least one second image based on the feature points of the first image and the feature points of the at least one second image, and determining a second region corresponding to the first region in the at least one second image.

In some embodiments, an image processing method of feature point alignment is adopted, the first image is aligned with the at least one second image, and a second region corresponding to the first region in the at least one second image is determined based on an alignment result, so that the accuracy of matching between the first region and the second region can be improved.

S140, generating a target image according to the first image and the at least one second image.

In S140, according to the first image and the at least one second image, specifically, replacing a picture of the second area in the at least one second image with a picture of the first area in the first image to obtain a target image, where the target image includes the picture in the second area, that is, the target image is an image that has a light source directly reaching the electronic device but does not have glare interference.

Fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present invention, and the electronic device 70 shown in fig. 7 includes:

a first shooting module 71, configured to shoot a first image, where a first area of the first image includes glare;

an output module 72, configured to output the first prompt message;

the second shooting module 73 is configured to shoot at least one second image when the electronic device 70 meets a first shooting condition corresponding to the first prompt message, where a second area corresponding to the first area in the at least one second image does not include glare;

a generating module 74 for generating a target image from the first image and the at least one second image.

Optionally, as an embodiment, the electronic device 70 further includes:

and the mobile module is configured to, when the glare interference degree of the first image is lower than the preset interference degree, enable the first prompt message to include a shooting angle of the mobile electronic device 70.

Optionally, as an embodiment, the electronic device 70 further includes:

and the shielding module is used for shielding the light source generating the dazzling light when the dazzling light interference degree of the first image is not lower than the preset interference degree.

Optionally, as an embodiment, the first prompt information further includes: and displaying the first area according to a preset mode.

Optionally, as an embodiment, the electronic device 70 further includes:

the identification module is used for identifying the characteristic points of the first image and the characteristic points of at least one second image;

and the alignment module is used for aligning the first image and the at least one second image based on the characteristic points of the first image and the characteristic points of the at least one second image, and determining a second area corresponding to the first area in the at least one second image.

The electronic device 70 provided in the embodiment of the present invention can implement each process implemented by the electronic device in the method embodiments shown in fig. 2 to fig. 6, and for avoiding repetition, details are not described here again.

Fig. 8 is a schematic diagram of a hardware structure of an electronic device for implementing various embodiments of the present invention, where the electronic device 800 includes, but is not limited to: a radio frequency unit 801, a network module 802, an audio output unit 803, an input unit 804, a sensor 805, a display unit 806, a user input unit 807, an interface unit 808, a memory 809, a processor 810, and a power supply 811. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 8 does not constitute a limitation of the electronic device, and that the electronic device may include more or fewer components than shown, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.

The sensor 805 is configured to capture a first image, where a first area of the first image includes glare; a display unit 806 for outputting first prompt information; a sensor 805 configured to capture at least one second image when the electronic device satisfies a first capture condition corresponding to the first prompt message, wherein a second area corresponding to the first area in the at least one second image does not include glare; a processor 810 for generating a target image from the first image and the at least one second image.

It should be understood that, in the embodiment of the present invention, the radio frequency unit 801 may be used for receiving and sending signals during a message sending and receiving process or a call process, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 810; in addition, the uplink data is transmitted to the base station. In general, radio frequency unit 801 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. Further, the radio frequency unit 801 can also communicate with a network and other devices through a wireless communication system.

The electronic device provides wireless broadband internet access to the user via the network module 802, such as to assist the user in sending and receiving e-mails, browsing web pages, and accessing streaming media.

The audio output unit 803 may convert audio data received by the radio frequency unit 801 or the network module 802 or stored in the memory 809 into an audio signal and output as sound. Also, the audio output unit 803 may also provide audio output related to a specific function performed by the electronic apparatus 800 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 803 includes a speaker, a buzzer, a receiver, and the like.

The input unit 804 is used for receiving an audio or video signal. The input Unit 804 may include a Graphics Processing Unit (GPU) 8041 and a microphone 8042, and the Graphics processor 8041 processes image data of a still picture or video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 806. The image frames processed by the graphics processor 8041 may be stored in the memory 809 (or other storage medium) or transmitted via the radio frequency unit 801 or the network module 802. The microphone 8042 can receive sound, and can process such sound into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 801 in case of a phone call mode.

The electronic device 800 also includes at least one sensor 805, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 8061 according to the brightness of ambient light and a proximity sensor that can turn off the display panel 8061 and/or the backlight when the electronic device 800 is moved to the ear. As one type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of an electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 805 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.

The display unit 806 is used to display information input by the user or information provided to the user. The Display unit 806 may include a Display panel 8061, and the Display panel 8061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 807 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic apparatus 800. Specifically, the user input unit 807 includes a touch panel 8071 and other input devices 8072. The touch panel 8071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 8071 (e.g., operations by a user on or near the touch panel 8071 using a finger, a stylus, or any other suitable object or accessory). The touch panel 8071 may include two portions of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 810, receives a command from the processor 810, and executes the command. In addition, the touch panel 8071 can be implemented by various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 8071, the user input unit 807 can include other input devices 8072. In particular, other input devices 8072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.

Further, the touch panel 8071 can be overlaid on the display panel 8061, and when the touch panel 8071 detects a touch operation on or near the touch panel 8071, the touch operation is transmitted to the processor 810 to determine the type of the touch event, and then the processor 810 provides a corresponding visual output on the display panel 8061 according to the type of the touch event. Although the touch panel 8071 and the display panel 8061 are shown in fig. 8 as two separate components to implement the input and output functions of the electronic device, in some embodiments, the touch panel 8071 and the display panel 8061 may be integrated to implement the input and output functions of the electronic device 800, and this is not limited herein.

The interface unit 808 is an interface for connecting an external device to the electronic apparatus 800. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 808 may be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the electronic device 800 or may be used to transmit data between the electronic device 800 and external devices.

The memory 809 may be used to store software programs as well as various data. The memory 809 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 809 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 810 is a control center of the electronic device, connects various parts of the whole electronic device by using various interfaces and lines, performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 809 and calling data stored in the memory 809, thereby monitoring the whole electronic device. Processor 810 may include one or more processing units; preferably, the processor 810 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 810.

The electronic device 800 may also include a power supply 811 (e.g., a battery) for powering the various components, and preferably, the power supply 811 may be logically coupled to the processor 810 via a power management system to manage charging, discharging, and power consumption management functions via the power management system.

In addition, the electronic device 800 includes some functional modules that are not shown, and are not described in detail herein.

Preferably, an embodiment of the present invention further provides an electronic device, which includes a processor 810, a memory 809, and a computer program stored in the memory 809 and capable of running on the processor 810, and when the computer program is executed by the processor 810, the computer program implements each process of the method embodiments shown in fig. 2 to 6, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

An embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the method embodiments shown in fig. 2 to fig. 6, and can achieve the same technical effect, and is not described herein again to avoid repetition. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims

1. A method for eliminating glare, applied to an electronic device, is characterized by comprising the following steps:

outputting first prompt information;

2. The method of claim 1, wherein the method further comprises:

when the glare interference degree of the first image is lower than a preset interference degree, the first prompt message comprises a shooting angle for moving the electronic equipment.

3. The method of claim 1, wherein the method further comprises:

4. The method of claim 2, wherein the first hint information further comprises: and displaying the appointed first area according to a preset mode.

5. The method of claim 1, wherein after said capturing at least one second image and before said generating a target image from said first image and said at least one second image, said method further comprises:

6. An electronic device, characterized in that the electronic device comprises:

the output module is used for outputting first prompt information;

7. The electronic device of claim 6, wherein the electronic device further comprises:

the mobile module is used for enabling the first prompt message to comprise a shooting angle of the mobile electronic device when the dazzling light interference degree of the first image is lower than a preset interference degree.

8. The electronic device of claim 6, wherein the electronic device further comprises:

9. The electronic device of claim 7 or 8, wherein the first prompt message further comprises: and displaying the first area according to a preset mode.

10. The electronic device of claim 6, wherein the electronic device further comprises:

an identification module for identifying feature points of the first image and feature points of the at least one second image;