CN106651823A

CN106651823A - Device and method for eliminating picture light spot and mobile terminal

Info

Publication number: CN106651823A
Application number: CN201611232052.7A
Authority: CN
Inventors: 姚智; 陈鹏飞
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2016-12-28
Filing date: 2016-12-28
Publication date: 2017-05-10

Abstract

The invention discloses a device and a method for eliminating a picture light spot and a mobile terminal, and relates to the technical field of electronic information. According to the device for eliminating the picture light spot provided by the invention, an obtaining unit simultaneously obtains two pictures, namely a first picture and a second picture; then, an analysis unit analyzes the first picture to obtain a position of the light spot in the first picture; and at last, a processing unit carries out integrating and matching on a light spot area of the first picture according to the position of the light spot in the first picture and through an image area, corresponding to the light spot, in the second picture, thereby eliminating the light spot in the first picture. Therefore, a user can obtain the relatively good picture under strong light; and thus, the problem of the light spot occurring when the existing mobile terminal photographs under the strong light is avoided; and the user experience is also greatly improved.

Description

Device and method for eliminating image light spots and mobile terminal

Technical Field

The invention relates to the technical field of electronic information, in particular to a device and a method for eliminating picture light spots and a mobile terminal.

Background

In daily life, a mobile terminal has become an indispensable tool for random photographing, a lens of the mobile terminal is often a lens group consisting of a plurality of lenses, each lens has high permeability but inevitably has a part of reflection and scattering, and especially under a strong illumination condition (a strong light source may be in the field of vision or in the field of vision), light can reflect at the lens surface to form multiple light paths, so that light spots are formed.

Disclosure of Invention

The invention mainly aims to provide a device and a method for eliminating image light spots and a mobile terminal, and aims to solve the problem that the light spots are easy to appear when the conventional mobile terminal is used for photographing under strong light, so that the user experience is reduced.

In order to achieve the above object, the present invention provides an apparatus for eliminating image flare, comprising: the judging unit is used for judging whether a strong light source with a brightness value larger than a preset first brightness threshold exists in the surrounding environment according to incident light of the two cameras, if so, the strong light source is determined to exist, and the acquiring unit is triggered; the device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for respectively acquiring a picture through two cameras to obtain a first picture and a second picture; the analysis unit is used for analyzing the first picture to acquire the position of the light spot in the first picture; and the processing unit is used for integrating and matching the light spot region of the first picture through the image region corresponding to the light spot in the second picture according to the position of the light spot in the first picture, so as to eliminate the light spot in the first picture.

Further, the analysis unit is further configured to analyze the first picture, acquire all pixel points in the first picture whose luminance values are greater than a second luminance threshold, and acquire the positions of the light spots in the first picture according to the pixel points.

Further, the analysis unit is further configured to traverse and detect all pixel points of the first picture, determine whether there is a pixel point whose luminance value is greater than a second luminance threshold, further determine whether the pixel points are in the same region if the pixel points exist, determine whether the radius of the region is within a preset range if the pixel points are in the same region, determine that the region of the pixel point cluster is a light spot region if the radius of the region is within the preset range, and record coordinates of the light spot region.

Further, the analysis unit is further configured to traverse and detect all pixel points of the first picture, determine whether there is a pixel point whose luminance value is greater than a second luminance threshold, further determine whether the pixel points are in the same region if the pixel points exist, determine whether the radius of the region is within a preset range if the pixel points are in the same region, determine that the region of the pixel point cluster is a light spot region if the radius of the region is within the preset range, and record coordinates of an annular region within a predetermined distance range from the center of the light spot region.

Further, the processing unit is further configured to obtain a gray average value and/or a brightness average value of an annular region within a predetermined distance range from the center of the light spot, intercept the annular region of the same gray average value and/or brightness average value in the second picture, and replace a region surrounded by the annular region with a region surrounded by the annular region in the first picture, so as to eliminate the light spot in the first picture; or, according to the scene at a certain position around the light spot, the area of the scene in the second picture is obtained and replaced, and the light spot in the first picture is eliminated.

In another aspect, the present invention further provides a method for eliminating image flare, including: judging whether a strong light source with a brightness value larger than a preset first brightness threshold exists in the surrounding environment according to incident light of the two cameras, if so, respectively obtaining a picture through the two cameras to obtain a first picture and a second picture; analyzing the first picture to obtain the position of a light spot in the first picture; according to the position of the light spot in the first picture, the light spot region of the first picture is integrated and matched through the image region corresponding to the light spot in the second picture, and the light spot in the first picture is eliminated.

Further, the analyzing the first picture to obtain the position of the light spot in the first picture specifically includes: analyzing the first picture, acquiring all pixel points of which the brightness values are greater than a second brightness threshold value in the first picture, and acquiring the positions of light spots in the first picture according to the pixel points.

Further, analyzing the first picture, obtaining all pixel points of which the brightness values are greater than a second brightness threshold value in the first picture, and obtaining the positions of the light spots in the first picture according to the pixel points specifically include: traversing and detecting all pixel points of the first picture, judging whether pixel points with brightness values larger than a second brightness threshold exist, if yes, further judging whether the pixel points are in the same area, if yes, judging whether the area radius is in a preset range, if the area radius is in the preset range, determining that the area of the pixel point cluster is a light spot area, and recording the coordinates of the light spot area.

Further, the recording the coordinates of the spot area specifically includes: and recording the coordinates of the annular area within a preset distance range from the center of the light spot area.

Further, the integrating and matching the light spot region of the first picture through the image region corresponding to the light spot in the second picture according to the position of the light spot in the first picture to eliminate the light spot in the first picture specifically includes:

acquiring a gray average value and/or a brightness average value of an annular region within a preset distance range from the center of the light spot, intercepting the annular region with the same gray average value and/or brightness average value in the second picture, and replacing the region surrounded by the annular region with the region surrounded by the annular region in the first picture to eliminate the light spot in the first picture; or, according to the scene at a certain position around the light spot, the area of the scene in the second picture is obtained and replaced, and the light spot in the first picture is eliminated.

On the other hand, the invention also provides a mobile terminal which comprises any device for eliminating the image facula provided by the invention.

The invention can at least obtain the following beneficial effects:

according to the device for eliminating the light spots of the pictures, provided by the invention, when the judging unit judges that the strong light source exists, the obtaining unit is triggered to simultaneously obtain two pictures, namely a first picture and a second picture, the first picture is analyzed through the analyzing unit to obtain the position of the light spots in the first picture, and finally, the processing unit integrates and matches the light spot region of the first picture through the image region corresponding to the light spots in the second picture according to the position of the light spots in the first picture to eliminate the light spots in the first picture. Therefore, the user can obtain a better picture under the strong light, the problem that the light spot appears when the existing mobile terminal takes a picture under the strong light is avoided, and the user experience is greatly improved.

Drawings

Fig. 1 is a schematic diagram of a hardware structure of an optional mobile terminal for implementing various embodiments of the present invention;

FIG. 2 is a diagram of a wireless communication system for the mobile terminal shown in FIG. 1;

FIG. 3 is a schematic structural diagram of an apparatus for eliminating image flare according to various embodiments of the present invention;

fig. 4 is a flowchart of a method for eliminating a picture light spot according to an embodiment of the present invention.

The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

A mobile terminal implementing various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in themselves. Thus, "module" and "component" may be used in a mixture.

The mobile terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a navigation device, and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, it will be understood by those skilled in the art that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for moving purposes.

Fig. 1 is a schematic hardware structure of an optional mobile terminal for implementing various embodiments of the present invention.

The mobile terminal 100 may include a wireless communication unit 110, an a/V (audio/video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190, etc. Fig. 1 illustrates a mobile terminal having various components, but it is to be understood that not all illustrated components are required to be implemented. More or fewer components may alternatively be implemented. Elements of the mobile terminal will be described in detail below.

The wireless communication unit 110 typically includes one or more components that allow radio communication between the mobile terminal 100 and a wireless communication system or network. For example, the wireless communication unit may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short-range communication module 114, and a location information module 115.

The broadcast receiving module 111 receives a broadcast signal and/or broadcast associated information from an external broadcast management server via a broadcast channel. The broadcast channel may include a satellite channel and/or a terrestrial channel. The broadcast management server may be a server that generates and transmits a broadcast signal and/or broadcast associated information or a server that receives a previously generated broadcast signal and/or broadcast associated information and transmits it to a terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and the like. Also, the broadcast signal may further include a broadcast signal combined with a TV or radio broadcast signal. The broadcast associated information may also be provided via a mobile communication network, and in this case, the broadcast associated information may be received by the mobile communication module 112. The broadcast signal may exist in various forms, for example, it may exist inAn Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB), an Electronic Service Guide (ESG) of digital video broadcasting-handheld (DVB-H), etc. The broadcast receiving module 111 may receive a signal broadcast by using various types of broadcasting systems. In particular, the broadcast receiving module 111 may receive a broadcast signal by using a signal such as multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), digital video broadcasting-handheld (DVB-H), forward link media (MediaFLO)^@) A digital broadcasting system of a terrestrial digital broadcasting integrated service (ISDB-T), etc. receives digital broadcasting. The broadcast receiving module 111 may be constructed to be suitable for various broadcasting systems that provide broadcast signals as well as the above-mentioned digital broadcasting systems. The broadcast signal and/or broadcast associated information received via the broadcast receiving module 111 may be stored in the memory 160 (or other type of storage medium).

The mobile communication module 112 transmits and/or receives radio signals to and/or from at least one of a base station (e.g., access point, node B, etc.), an external terminal, and a server. Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received according to text and/or multimedia messages.

The wireless internet module 113 supports wireless internet access of the mobile terminal. The module may be internally or externally coupled to the terminal. The wireless internet access technology to which the module relates may include WLAN (wireless LAN) (Wi-Fi), Wibro (wireless broadband), Wimax (worldwide interoperability for microwave access), HSDPA (high speed downlink packet access), and the like.

The short-range communication module 114 is a module for supporting short-range communication. Some examples of short-range communication technologies include bluetooth^TMRadio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), zigbee^TMAnd so on.

The location information module 115 is a module for checking or acquiring location information of the mobile terminal. A typical example of the location information module is a GPS (global positioning system). According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information, thereby accurately calculating three-dimensional current location information according to longitude, latitude, and altitude. Currently, a method for calculating position and time information uses three satellites and corrects an error of the calculated position and time information by using another satellite. In addition, the GPS module 115 can calculate speed information by continuously calculating current position information in real time.

The a/V input unit 120 is used to receive an audio or video signal. The a/V input unit 120 may include a camera 121 and a microphone 122, and the camera 121 processes image data of still pictures or video obtained by an image capturing apparatus in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 151. The image frames processed by the cameras 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 121 may be provided according to the construction of the mobile terminal. The microphone 122 may receive sounds (audio data) via the microphone in a phone call mode, a recording mode, a voice recognition mode, or the like, and can process such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the mobile communication module 112 in case of a phone call mode. The microphone 122 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.

The user input unit 130 may generate key input data according to a command input by a user to control various operations of the mobile terminal. The user input unit 130 allows a user to input various types of information, and may include a keyboard, dome sheet, touch pad (e.g., a touch-sensitive member that detects changes in resistance, pressure, capacitance, and the like due to being touched), scroll wheel, joystick, and the like. In particular, when the touch pad is superimposed on the display unit 151 in the form of a layer, a touch screen may be formed.

The sensing unit 140 detects a current state of the mobile terminal 100 (e.g., an open or closed state of the mobile terminal 100), a position of the mobile terminal 100, presence or absence of contact (i.e., touch input) by a user with the mobile terminal 100, an orientation of the mobile terminal 100, acceleration or deceleration movement and direction of the mobile terminal 100, and the like, and generates a command or signal for controlling an operation of the mobile terminal 100. For example, when the mobile terminal 100 is implemented as a slide-type mobile phone, the sensing unit 140 may sense whether the slide-type phone is opened or closed. In addition, the sensing unit 140 can detect whether the power supply unit 190 supplies power or whether the interface unit 170 is coupled with an external device. The sensing unit 140 may include a proximity sensor 141.

The interface unit 170 serves as an interface through which at least one external device is connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The identification module may store various information for authenticating a user using the mobile terminal 100 and may include a User Identity Module (UIM), a Subscriber Identity Module (SIM), a Universal Subscriber Identity Module (USIM), and the like. In addition, a device having an identification module (hereinafter, referred to as an "identification device") may take the form of a smart card, and thus, the identification device may be connected with the mobile terminal 100 via a port or other connection means. The interface unit 170 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal and the external device.

In addition, when the mobile terminal 100 is connected with an external cradle, the interface unit 170 may serve as a path through which power is supplied from the cradle to the mobile terminal 100 or may serve as a path through which various command signals input from the cradle are transmitted to the mobile terminal. Various command signals or power input from the cradle may be used as signals for recognizing whether the mobile terminal is accurately mounted on the cradle. The output unit 150 is configured to provide output signals (e.g., audio signals, video signals, alarm signals, vibration signals, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and the like.

The display unit 151 may display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 may display a User Interface (UI) or a Graphical User Interface (GUI) related to a call or other communication (e.g., text messaging, multimedia file downloading, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or an image and related functions, and the like.

Meanwhile, when the display unit 151 and the touch pad are overlapped with each other in the form of a layer to form a touch screen, the display unit 151 may serve as an input device and an output device. The display unit 151 may include at least one of a Liquid Crystal Display (LCD), a thin film transistor LCD (TFT-LCD), an Organic Light Emitting Diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as transparent displays, and a typical transparent display may be, for example, a TOLED (transparent organic light emitting diode) display or the like. Depending on the particular desired implementation, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown). The touch screen may be used to detect a touch input pressure as well as a touch input position and a touch input area.

The audio output module 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 into an audio signal and output as sound when the mobile terminal is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output module 152 may provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 may provide an output to notify the mobile terminal 100 of the occurrence of an event. Typical events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, the alarm unit 153 may provide output in different ways to notify the occurrence of an event. For example, the alarm unit 153 may provide an output in the form of vibration, and when a call, a message, or some other incoming communication (communicating communication) is received, the alarm unit 153 may provide a tactile output (i.e., vibration) to inform the user thereof. By providing such a tactile output, the user can recognize the occurrence of various events even when the user's mobile phone is in the user's pocket. The alarm unit 153 may also provide an output notifying the occurrence of an event via the display unit 151 or the audio output module 152.

The memory 160 may store software programs and the like for processing and controlling operations performed by the controller 180

Etc., or may temporarily store data that has been or will be output (e.g., phone book, messages, still images, video, etc.). Also, the memory 160 may store data regarding various ways of vibration and audio signals output when a touch is applied to the touch screen.

The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. Also, the mobile terminal 100 may cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.

The controller 180 generally controls the overall operation of the mobile terminal. For example, the controller 180 performs control and processing related to voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 181 for reproducing (or playing back) multimedia data, and the multimedia module 181 may be constructed within the controller 180 or may be constructed separately from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.

The power supply unit 190 receives external power or internal power and provides appropriate power required to operate various elements and components under the control of the controller 180.

The various embodiments described herein may be implemented in a computer-readable medium using, for example, computer software, hardware, or any combination thereof. For a hardware implementation, the embodiments described herein may be implemented using at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a processor, a controller, a microcontroller, a microprocessor, an electronic unit designed to perform the functions described herein, and in some cases, such embodiments may be implemented in the controller 180. For a software implementation, the implementation such as a process or a function may be implemented with a separate software module that allows performing at least one function or operation. The software codes may be implemented by software applications (or programs) written in any suitable programming language, which may be stored in the memory 160 and executed by the controller 180.

Up to this point, mobile terminals have been described in terms of their functionality. Hereinafter, a slide-type mobile terminal among various types of mobile terminals, such as a folder-type, bar-type, swing-type, slide-type mobile terminal, and the like, will be described as an example for the sake of brevity. Accordingly, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.

The mobile terminal 100 as shown in fig. 1 may be configured to operate with communication systems such as wired and wireless communication systems and satellite-based communication systems that transmit data via frames or packets.

A communication system in which a mobile terminal according to the present invention is operable will now be described with reference to fig. 2.

Such communication systems may use different air interfaces and/or physical layers. For example, the air interface used by the communication system includes, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and Universal Mobile Telecommunications System (UMTS) (in particular, Long Term Evolution (LTE)), global system for mobile communications (GSM), and the like. By way of non-limiting example, the following description relates to a CDMA communication system, but such teachings are equally applicable to other types of systems.

Referring to fig. 2, the CDMA wireless communication system may include a plurality of mobile terminals 100, a plurality of Base Stations (BSs) 270, Base Station Controllers (BSCs) 275, and a Mobile Switching Center (MSC) 280. The MSC280 is configured to interface with a Public Switched Telephone Network (PSTN) 290. The MSC280 is also configured to interface with a BSC275, which may be coupled to the base station 270 via a backhaul. The backhaul may be constructed according to any of several known interfaces including, for example, E1/T1, ATM, IP, PPP, frame Relay, HDSL, ADSL, or xDSL. It will be understood that a system as shown in fig. 2 may include multiple BSCs 275.

Each BS270 may serve one or more sectors (or regions), each sector covered by a multi-directional antenna or an antenna pointing in a particular direction being radially distant from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS270 may be configured to support multiple frequency allocations, with each frequency allocation having a particular frequency spectrum (e.g., 1.25MHz,5MHz, etc.).

The intersection of partitions with frequency allocations may be referred to as a CDMA channel. The BS270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology. In such a case, the term "base station" may be used to generically refer to a single BSC275 and at least one BS 270. The base stations may also be referred to as "cells". Alternatively, each sector of a particular BS270 may be referred to as a plurality of cell sites.

As shown in fig. 2, a Broadcast Transmitter (BT)295 transmits a broadcast signal to the mobile terminal 100 operating within the system. A broadcast receiving module 111 as shown in fig. 1 is provided at the mobile terminal 100 to receive a broadcast signal transmitted by the BT 295. In fig. 2, several Global Positioning System (GPS) satellites 300 are shown. The satellite 300 assists in locating at least one of the plurality of mobile terminals 100.

In fig. 2, a plurality of satellites 300 are depicted, but it is understood that useful positioning information may be obtained with any number of satellites. The GPS module 115 as shown in fig. 1 is generally configured to cooperate with satellites 300 to obtain desired positioning information. Other techniques that can track the location of the mobile terminal may be used instead of or in addition to GPS tracking techniques. In addition, at least one GPS satellite 300 may selectively or additionally process satellite DMB transmission.

As a typical operation of the wireless communication system, the BS270 receives reverse link signals from various mobile terminals 100. The mobile terminal 100 is generally engaged in conversations, messaging, and other types of communications. Each reverse link signal received by a particular base station 270 is processed within the particular BS 270. The obtained data is forwarded to the associated BSC 275. The BSC provides call resource allocation and mobility management functions including coordination of soft handoff procedures between BSs 270. The BSCs 275 also route the received data to the MSC280, which provides additional routing services for interfacing with the PSTN 290. Similarly, the PSTN290 interfaces with the MSC280, the MSC interfaces with the BSCs 275, and the BSCs 275 accordingly control the BS270 to transmit forward link signals to the mobile terminal 100.

Based on the above mobile terminal hardware structure and communication system, the present invention provides various embodiments of the method.

As shown in fig. 3, a first embodiment of the present invention provides an apparatus for eliminating picture flare, which corresponds to the camera 121 of the mobile terminal, and may include: the judging unit 30 is configured to judge whether a strong light source with a luminance value larger than a preset first luminance threshold exists in the surrounding environment according to incident light of the camera, and if so, determine that the strong light source exists and trigger the obtaining unit 31; the acquiring unit 31 is configured to acquire one picture through two cameras respectively to obtain a first picture and a second picture; an analyzing unit 32, configured to analyze the first picture and obtain a position of a light spot in the first picture; and the processing unit 33 is configured to integrate and match the light spot region of the first picture through the image region corresponding to the light spot in the second picture according to the position of the light spot in the first picture, so as to eliminate the light spot in the first picture.

According to the device for eliminating the light spots of the pictures, provided by the invention, when the judging unit 30 judges that the strong light source exists, the acquiring unit 31 is triggered to acquire two pictures, namely a first picture and a second picture, the first picture is analyzed through the analyzing unit 32 to acquire the position of the light spots in the first picture, and finally, the processing unit 33 integrates and matches the light spot region of the first picture through the image region corresponding to the light spots in the second picture according to the position of the light spots in the first picture to eliminate the light spots in the first picture. Therefore, the user can obtain a better picture under the strong light, the problem that the light spot appears when the existing mobile terminal takes a picture under the strong light is avoided, and the user experience is greatly improved.

Further, an embodiment of the present invention further provides an apparatus for eliminating picture flare, where the apparatus includes:

the determining unit 30 is configured to determine whether a strong light source with a luminance value larger than a preset first luminance threshold exists in the surrounding environment according to incident light of the camera, and if so, determine that the strong light source exists, and trigger the acquiring unit 31. The acquiring unit 31 is configured to acquire one picture through two cameras respectively to obtain a first picture and a second picture; an analyzing unit 32, configured to analyze the first picture and obtain a position of a light spot in the first picture; and the processing unit 33 is configured to integrate and match the light spot region of the first picture through the image region corresponding to the light spot in the second picture according to the position of the light spot in the first picture, so as to eliminate the light spot in the first picture.

According to the device for eliminating the light spots of the pictures, provided by the invention, two pictures, namely a first picture and a second picture, are simultaneously obtained through the obtaining unit 31, the first picture is analyzed through the analyzing unit 32 to obtain the position of the light spots in the first picture, and finally, the processing unit 33 integrates and matches the light spot region of the first picture through the image region corresponding to the light spots in the second picture according to the position of the light spots in the first picture, so that the light spots in the first picture are eliminated. Therefore, the user can obtain a better picture under the strong light, the problem that the light spot appears when the existing mobile terminal takes a picture under the strong light is avoided, and the user experience is greatly improved.

That is to say, the present invention firstly determines whether there is a strong light source through the determining unit 30, if yes, the acquiring unit 31 is triggered to start the dual cameras to take a photo, and the analyzing unit 32 and the processing unit 33 are used to integrate and match the two pictures acquired by the acquiring unit 31, so as to eliminate the light spots in the pictures. Therefore, a better photographing effect is obtained, and the user experience is greatly improved. A

In specific implementation, the embodiment of the present invention determines whether a strong light source with a luminance exceeding a first luminance threshold exists in the surrounding environment according to the incident light of the lens, if not, a normal photographing mode is performed, and if the strong light source exists, the obtaining unit 31 is triggered to start the dual cameras to photograph.

Further, an embodiment of the present invention further provides an apparatus for eliminating picture flare, where the apparatus includes: the acquiring unit 31 is configured to acquire one picture through two cameras respectively to obtain a first picture and a second picture; an analyzing unit 32, configured to analyze the first picture and obtain a position of a light spot in the first picture; and the processing unit 33 is configured to integrate and match the light spot region of the first picture through the image region corresponding to the light spot in the second picture according to the position of the light spot in the first picture, so as to eliminate the light spot in the first picture.

After the framing and focusing operation is completed, the acquiring unit 31 according to the embodiment of the present invention respectively acquires one picture, that is, a first picture and a second picture, through two cameras; due to the position relation of the double cameras, the mutual distance determines that the imaging coordinates of the two cameras have certain displacement. In the normal mode, the two-camera imaging is performed by correcting and then synthesizing the images acquired by the two cameras.

In specific implementation, the analysis unit 32 in the embodiment of the present invention is further configured to analyze the first picture, obtain all pixel points in the first picture whose luminance values are greater than a second luminance threshold, and obtain the positions of the light spots in the first picture according to the pixel points.

That is, the embodiment of the present invention analyzes the first picture and the second picture by the analysis unit 32. The purpose of the analysis is to obtain the position of the light spot, which is just one brightness area in the lens frame for the mobile terminal. In the embodiment of the present invention, the luminance region is characterized by two parameters, one is the range of the luminance region, for example, 20 pixels by 20 pixels, and of course, the luminance of the luminance region can be adaptively modified according to the different resolutions of the screen of the mobile terminal; secondly, the average brightness value of all pixel points in the brightness area;

in specific implementation, the analysis unit 32 according to the embodiment of the present invention is further configured to traverse and detect all pixel points of the first picture, determine whether there is a pixel point whose luminance value is greater than the second luminance threshold, further determine whether the pixel points are in the same region if there is a pixel point whose luminance value is greater than the second luminance threshold, determine whether the radius of the region is within a preset range if yes, determine that the region of the pixel point cluster is a light spot region if the radius of the region is within the preset range, and record the coordinates of the light spot region.

In practice, the embodiment of the present invention records the coordinates of the light spot area, which is substantially the coordinates of an annular area within a predetermined distance range from the center of the light spot area, that is, the coordinates of an annular zone surrounding the light spot area, for example, a circular area with a radius of 5 pixels, and the annular zone may be 5 pixels to 10 pixels.

That is, in practical implementation, the analysis unit 32 of the embodiment of the present invention records the coordinates of the light spot area by recording the coordinates of an annular zone surrounding the light spot area. Specifically, the analysis unit 32 performs traversal detection on all pixel points on the first picture or the second picture, and detects whether pixel points with brightness values reaching a threshold range exist; if yes, whether the coordinates of all the pixels are in the same region or not is analyzed, and whether the region range is a preset brightness region range or not is analyzed, for example, the 20 pixels by 20 pixels are analyzed. If yes, the pixel cluster is determined to be a light spot brightness area, and coordinates of the light spot brightness area are recorded.

The processing unit 33 in the embodiment of the present invention is further configured to obtain a gray average value and/or a brightness average value of an annular region within a predetermined distance range from the center of the light spot, intercept an annular region in the second picture with the same gray average value and/or brightness average value, and replace a region surrounded by the annular region with a region surrounded by an annular region in the first picture, so as to eliminate the light spot in the first picture; or, according to the scene at a certain position around the light spot, the area of the scene in the second picture is obtained and replaced, and the light spot in the first picture is eliminated.

That is to say, the processing unit according to the embodiment of the present invention may eliminate the light spots in the first picture by obtaining the average grayscale value and/or the average brightness value around the light spots, obtaining the corresponding region of the other picture according to the average grayscale value and/or the average brightness value, and performing region replacement, or obtain the region of the scene in the other picture according to the scene around the light spots, and perform replacement, so as to eliminate the light spots in the first picture.

In detail, the embodiment of the invention obtains that the brightness area of the light spot in the first picture corresponds to the corresponding area in the second picture. Specifically, the following two ways may be adopted to obtain the corresponding region of the light spot brightness region in the first picture in the second picture in the embodiment of the present invention: first, pixel information in a certain annular range (such as three pixel units) around the spot brightness area is analyzed, such as a gray scale average value and/or a brightness average value in the annular range. Matching a corresponding area in the second picture according to the annular gray scale average value and/or the brightness average value, and if the position of the annular range in the second picture is determined, taking an area defined by the corresponding annular range of the annular range in the second picture as a corresponding area of the light spot in the second picture in the first picture; secondly, due to the nature of the relative distance of the two cameras, each pixel in the picture acquired by each camera is offset relative to each other by a certain proportion, so that the position of the scene at the spot position of the first picture in the second picture can be acquired according to the offset proportion.

Generally speaking, the invention achieves the purpose of eliminating the light spots by intercepting the corresponding area of the light spots in the first picture in the second picture and the light spot area in the first picture and replacing the light spot area in the first picture by the intercepted corresponding area in the second picture.

It should be noted that, the utilization relationship between the first picture and the second picture in the above method of the present invention may also be used in reverse, and the magnitude of each luminance threshold described in the embodiment of the present invention may be arbitrarily set according to the actual situation.

The device according to the invention will be explained and illustrated in detail below by means of a specific example:

the device can be applied to the mobile terminal with double cameras.

1. Judging whether a strong light source with the brightness value exceeding a first brightness threshold exists in the surrounding environment according to incident light of the lens, if not, performing a normal photographing mode, and if so, performing a step 2;

2. after the framing and focusing operation is finished, respectively acquiring a picture, namely a first picture and a second picture through two cameras; due to the position relation of the double cameras, the mutual distance determines that the imaging coordinates of the two cameras have certain displacement. In the normal mode, the two-camera imaging is performed by correcting and then synthesizing the images acquired by the two cameras.

3. And analyzing the first picture and the second picture, wherein the analysis is to acquire the position of a light spot, and for the mobile terminal, the light spot is only one brightness area in the lens picture. In the embodiment of the present invention, the luminance region is characterized by two parameters, one is the range of the luminance region, for example, 20 pixels by 20 pixels, and of course, the luminance of the luminance region can be adaptively modified according to the different resolutions of the screen of the mobile terminal; secondly, the average brightness value of all pixel points in the brightness area;

4. traversing all pixel points on the first picture or the second picture, and detecting whether pixel points with brightness values reaching a second brightness threshold range exist; if yes, whether the coordinates of all the pixels are in the same region or not is analyzed, and whether the region range is a preset brightness region range or not is analyzed, for example, the 20 pixels by 20 pixels are analyzed. If so, determining the pixel cluster as a light spot brightness area, and recording the coordinates of the light spot brightness area;

5. and acquiring a corresponding area in the second picture corresponding to the light spot brightness area in the first picture. Specifically, the following two ways can be adopted to obtain the corresponding region of the light spot brightness region in the first picture in the second picture: first, pixel information in a certain annular range (such as three pixel units) around the spot brightness area is analyzed, such as a gray scale average value and/or a brightness average value in the annular range. Matching a corresponding area in the second picture according to the annular gray scale average value and/or the brightness average value, and if the position of the annular range in the second picture is determined, taking an area defined by the corresponding annular range of the annular range in the second picture as a corresponding area of the light spot in the second picture in the first picture; secondly, due to the nature of the relative distance of the two cameras, each pixel in the picture acquired by each camera is offset relative to each other by a certain proportion, so that the position of the scene at the spot position of the first picture in the second picture can be acquired according to the offset proportion.

6. And intercepting a corresponding area of the light spot in the first picture in the second picture and a light spot area in the first picture, and replacing the light spot area in the first picture with the intercepted corresponding area in the second picture so as to achieve the purpose of eliminating the light spot.

Correspondingly, as shown in fig. 4, an embodiment of the present invention further provides a method for eliminating a picture flare, where the method includes:

s40, judging whether a strong light source with a brightness value larger than a preset first brightness threshold exists in the surrounding environment according to the incident light of the two cameras, and if so, entering the next step;

s41, respectively obtaining a picture through two cameras to obtain a first picture and a second picture;

s42, analyzing the first picture to obtain the position of the light spot in the first picture;

and S43, according to the position of the light spot in the first picture, integrating and matching the light spot region of the first picture through the image region corresponding to the light spot in the second picture, and eliminating the light spot in the first picture.

According to the invention, when a strong light source exists, two pictures, namely a first picture and a second picture, are acquired at the same time, the first picture is analyzed to acquire the position of the light spot in the first picture, and finally, according to the position of the light spot in the first picture, the light spot region of the first picture is integrated and matched through the image region corresponding to the light spot in the second picture to eliminate the light spot in the first picture, so that a user can obtain a better picture under strong light, the problem that the light spot occurs when the traditional mobile terminal takes pictures under the strong light is avoided, and the user experience is greatly improved.

Further, before step S41, in the embodiment of the present invention, the method further includes:

and step S50, judging whether the surrounding environment has a strong light source with the brightness value larger than a preset first brightness threshold value according to the incident light of the camera, and if so, determining that the strong light source exists.

That is to say, the invention firstly judges whether a strong light source exists, if so, the invention triggers and starts the double cameras to shoot, and integrates and matches the two acquired pictures to eliminate the light spots in the pictures. Therefore, a better photographing effect is obtained, and the user experience is greatly improved. A

In specific implementation, the embodiment of the invention judges whether a strong light source with the brightness exceeding a first brightness threshold exists in the surrounding environment according to the incident light of the lens, if not, a normal photographing mode is carried out, and if the strong light source exists, the double cameras are started to photograph.

In specific implementation, the step S41 implemented by the present invention specifically includes:

after the framing and focusing operation is finished, respectively acquiring a picture, namely a first picture and a second picture through two cameras; due to the position relation of the double cameras, the mutual distance determines that the imaging coordinates of the two cameras have certain displacement. In the normal mode, the two-camera imaging is performed by correcting and then synthesizing the images acquired by the two cameras.

In specific implementation, the analyzing the first picture to obtain the position of the light spot in the first picture includes:

analyzing the first picture, acquiring all pixel points of which the brightness values are greater than a second brightness threshold value in the first picture, and acquiring the positions of light spots in the first picture according to the pixel points.

That is, the embodiment of the present invention analyzes the first picture and the second picture. The purpose of the analysis is to obtain the position of the light spot, which is just one brightness area in the lens frame for the mobile terminal. In the embodiment of the present invention, the luminance region is characterized by two parameters, one is the range of the luminance region, for example, 20 pixels by 20 pixels, and of course, the luminance of the luminance region can be adaptively modified according to the different resolutions of the screen of the mobile terminal; secondly, the average brightness value of all pixel points in the brightness area;

in specific implementation, the analyzing the first picture to obtain all pixel points in the first picture whose luminance values are greater than the second luminance threshold value and obtaining the positions of the light spots in the first picture according to the pixel points in the embodiment of the present invention specifically includes:

traversing and detecting all pixel points of the first picture, judging whether pixel points with brightness values larger than a second brightness threshold exist, if yes, further judging whether the pixel points are in the same area, if yes, judging whether the area radius is in a preset range, if the area radius is in the preset range, determining that the area of the pixel point cluster is a light spot area, and recording the coordinates of the light spot area. Specifically, the method and the device detect whether pixel points with brightness values reaching a threshold range exist by traversing and detecting all pixel points on the first picture or the second picture; if yes, whether the coordinates of all the pixels are in the same region or not is analyzed, and whether the region range is a preset brightness region range or not is analyzed, for example, the 20 pixels by 20 pixels are analyzed. If yes, the pixel cluster is determined to be a light spot brightness area, and coordinates of the light spot brightness area are recorded.

That is, in practical implementation, the analysis unit 32 of the embodiment of the present invention records the coordinates of the light spot area by recording the coordinates of an annular zone surrounding the light spot area.

Further, according to the position of the light spot in the first picture, the embodiment of the present invention integrates and matches the light spot region of the first picture through the image region corresponding to the light spot in the second picture, so as to eliminate the light spot in the first picture, specifically including:

acquiring a gray average value and/or a brightness average value of an annular region within a preset distance range from the center of the light spot, intercepting the annular region with the same gray average value and/or brightness average value in the second picture, replacing the annular region with the annular region in the first picture, replacing the region surrounded by the annular region with the region surrounded by the annular region in the first picture, and eliminating the light spot in the first picture; or, according to the scene at a certain position around the light spot, the area of the scene in the second picture is obtained and replaced, and the light spot in the first picture is eliminated.

The method comprises the steps of obtaining a gray average value and/or a brightness average value of an annular area within a preset distance range from the center of a light spot, intercepting the annular area with the same gray average value and/or brightness average value in a second picture, and replacing the annular area with the annular area in a first picture to eliminate the light spot in the first picture; or, according to the scene of the position around the light spot, the area of the scene in the second picture is obtained and replaced, and the light spot in the first picture is eliminated.

Accordingly, an embodiment of the present invention further provides a mobile terminal, where any one of the devices for eliminating picture light spots provided in the foregoing embodiments is disposed on the mobile terminal, so that a corresponding technical effect can also be achieved, and the foregoing has been described in detail, and is not described herein again.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims

1. An apparatus for eliminating speckle in a picture, comprising:

the judging unit is used for judging whether a strong light source with a brightness value larger than a preset first brightness threshold exists in the surrounding environment according to incident light of the two cameras, if so, the strong light source is determined to exist, and the acquiring unit is triggered;

the device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for respectively acquiring a picture through two cameras to obtain a first picture and a second picture;

the analysis unit is used for analyzing the first picture to acquire the position of the light spot in the first picture;

and the processing unit is used for integrating and matching the light spot region of the first picture through the image region corresponding to the light spot in the second picture according to the position of the light spot in the first picture, so as to eliminate the light spot in the first picture.

2. The apparatus of claim 1,

the analysis unit is further configured to analyze the first picture, acquire all pixel points in the first picture, of which the brightness values are greater than a second brightness threshold, and acquire the positions of the light spots in the first picture according to the pixel points.

3. The apparatus of any one of claim 2,

the analysis unit is further configured to traverse and detect all pixel points of the first picture, determine whether there is a pixel point with a luminance value greater than a second luminance threshold, further determine whether the pixel point is in the same region if the pixel point exists, determine whether the radius of the region is within a preset range if the pixel point exists, determine that the region of the pixel point cluster is a light spot region if the radius of the region is within the preset range, and record coordinates of the light spot region.

4. The apparatus of any one of claim 3,

the analysis unit is further configured to traverse and detect all pixel points of the first picture, determine whether there is a pixel point with a luminance value greater than a second luminance threshold, further determine whether the pixel points are all in the same region if the pixel points exist, determine whether the radius of the region is within a preset range if the pixel points exist, determine that the region of the pixel point cluster is a light spot region if the radius of the region is within the preset range, and record coordinates of an annular region within a predetermined distance range from the center of the light spot region.

5. The apparatus according to any one of claims 1 to 4,

the processing unit is further configured to obtain a gray average value and/or a brightness average value of an annular region within a predetermined distance range from the center of the light spot, intercept an annular region of the same gray average value and/or brightness average value in the second picture, and replace a region surrounded by the annular region with a region surrounded by an annular region in the first picture, so as to eliminate the light spot in the first picture; or, according to the scene at a certain position around the light spot, the area of the scene in the second picture is obtained and replaced, and the light spot in the first picture is eliminated.

6. A method for eliminating picture faculae is characterized by comprising the following steps:

judging whether a strong light source with a brightness value larger than a preset first brightness threshold exists in the surrounding environment according to incident light of the two cameras, if so, respectively obtaining a picture through the two cameras to obtain a first picture and a second picture;

analyzing the first picture to obtain the position of a light spot in the first picture;

according to the position of the light spot in the first picture, the light spot region of the first picture is integrated and matched through the image region corresponding to the light spot in the second picture, and the light spot in the first picture is eliminated.

7. The method according to claim 6, wherein the analyzing the first picture to obtain the position of the light spot in the first picture specifically comprises:

8. The method according to claim 7, wherein analyzing the first picture to obtain all pixel points in the first picture whose luminance values are greater than a second luminance threshold, and obtaining the positions of the light spots in the first picture according to the pixel points specifically includes:

traversing and detecting all pixel points of the first picture, judging whether pixel points with brightness values larger than a second brightness threshold exist, if yes, further judging whether the pixel points are in the same area, if yes, judging whether the area radius is in a preset range, if the area radius is in the preset range, determining that the area of the pixel point cluster is a light spot area, and recording the coordinates of the light spot area.

9. The method according to claim 8, wherein the recording the coordinates of the spot area comprises:

and recording the coordinates of the annular area within a preset distance range from the center of the light spot area.

10. The method according to any one of claims 6 to 9, wherein the removing the light spot in the first picture by performing integration matching on the light spot region of the first picture through an image region corresponding to the light spot in the second picture according to the position of the light spot in the first picture specifically comprises:

acquiring a gray average value and/or a brightness average value of an annular region within a preset distance range from the center of the light spot, intercepting the annular region with the same gray average value and/or brightness average value in the second picture, and replacing the region surrounded by the annular region with the region surrounded by the annular region in the first picture to eliminate the light spot in the first picture;

or,

and according to the scene at a certain position around the light spot, acquiring the region of the scene in the second picture, replacing the region, and eliminating the light spot in the first picture.

11. A mobile terminal, characterized by comprising the apparatus for eliminating picture flare according to any one of claims 1 to 5.