CN112653806B - Camera module, image processing method and device and electronic equipment - Google Patents

Camera module, image processing method and device and electronic equipment Download PDF

Info

Publication number
CN112653806B
CN112653806B CN201910959257.2A CN201910959257A CN112653806B CN 112653806 B CN112653806 B CN 112653806B CN 201910959257 A CN201910959257 A CN 201910959257A CN 112653806 B CN112653806 B CN 112653806B
Authority
CN
China
Prior art keywords
light source
source information
image
camera module
image processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910959257.2A
Other languages
Chinese (zh)
Other versions
CN112653806A (en
Inventor
陈朝喜
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Priority to CN201910959257.2A priority Critical patent/CN112653806B/en
Publication of CN112653806A publication Critical patent/CN112653806A/en
Application granted granted Critical
Publication of CN112653806B publication Critical patent/CN112653806B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/54Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/55Optical parts specially adapted for electronic image sensors; Mounting thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/56Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/57Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/71Circuitry for evaluating the brightness variation

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

The disclosure relates to a camera module, an image processing method and device and electronic equipment. The camera module includes: a camera module for acquiring an image; a flash module comprising a flash lens; the light sensor is positioned below the flash lamp lens and used for acquiring light source fluctuation information of an external light source, the light source fluctuation information comprises constant light source information and periodically-changed light source information, and the changed light source information is used for carrying out image processing on the image so as to balance the brightness of the image.

Description

Camera module, image processing method and device and electronic equipment
Technical Field
The disclosure relates to the technical field of terminals, and in particular relates to a camera module, an image processing method and device, and electronic equipment.
Background
The photographing function has become one of the most important functions of electronic devices. When the camera of the electronic equipment is used for shooting, particularly when an LED light source or an OLED light source is shot, the light source can regularly fluctuate under a certain frequency, the image capturing speed of the camera is high, the exposure time is short, and the obtained image can present water wave stripes with alternate light and shade corresponding to the corresponding light source, so that the shooting effect is poor.
Disclosure of Invention
The disclosure provides a camera module, an image processing method and device and electronic equipment, and aims to overcome the defects in the related art.
According to a first aspect of the embodiments of the present disclosure, a camera module is provided, including:
a camera module for acquiring an image;
a flash module comprising a flash lens;
the light sensor is positioned below the flash lamp lens and used for acquiring light source fluctuation information of an external light source, the light source fluctuation information comprises constant light source information and periodically-changed light source information, and the changed light source information is used for carrying out image processing on the image so as to balance the brightness of the image;
the circuit board, light sensor with the camera module all is connected to the circuit board, the circuit board is connected to and is configured the mainboard of the electronic equipment of camera module.
Optionally, the flash module further includes:
a Fresnel lens positioned between the light sensor and the flash lens, the Fresnel lens comprising a Fresnel texture positioned on a surface of the Fresnel lens facing the light sensor;
and the diffusion sheet is positioned between the Fresnel lens and the light sensor.
Optionally, the thickness of the diffusion sheet is in the range of 50um-120 um.
Optionally, the flash module further includes:
a Fresnel lens positioned between the light sensor and the flash lens, the Fresnel lens comprising a Fresnel texture positioned on a surface of the Fresnel lens facing the light sensor;
the Fresnel lens further comprises ink particles positioned inside the Fresnel lens, and the ink particles are used for diffusing light rays.
Optionally, the frequency of the variable light source information is 50Hz or 60Hz.
According to a second aspect of the embodiments of the present disclosure, there is provided an electronic device including the camera module described in any one of the embodiments above.
According to a third aspect of the embodiments of the present disclosure, there is provided an image processing method applied to the electronic device of any one of the above embodiments; the image processing method comprises the following steps:
acquiring constant light source information and periodically-changed variable light source information in external light source fluctuation information;
and carrying out image processing on the image acquired by the camera module according to the changed light source information so as to balance the brightness of the image.
Optionally, the electronic device includes a light sensor for determining a frequency of the varying light source information;
the acquiring constant light source information and periodically-changing variable light source information in the external light source fluctuation information includes:
and receiving the frequency of the variable light source information sent by the light sensor.
Optionally, the performing image processing on the image acquired by the camera module according to the changed light source information includes:
determining the brightness corresponding to the variable light source information according to a fast Fourier transform algorithm and the frequency of the variable light source information;
and carrying out image processing according to the brightness of the image acquired by the camera module and the brightness corresponding to the changed light source information so as to balance the brightness of the image.
According to a fourth aspect of the embodiments of the present disclosure, there is provided an image processing apparatus applied to the electronic device according to any one of the embodiments; the image processing apparatus includes:
the acquisition module is used for acquiring constant light source information and periodically-changed variable light source information in the external light source fluctuation information;
and the processing module is used for carrying out image processing on the images acquired by the camera module according to the changed light source information so as to balance the brightness of the images.
Optionally, the electronic device includes a light sensor, and the light sensor is configured to determine a frequency of the varying light source information;
the acquisition module includes:
and the receiving unit is used for receiving the frequency of the variable light source information sent by the light sensor.
Optionally, the processing module includes:
the determining unit is used for determining the brightness corresponding to the variable light source information according to the fast Fourier transform algorithm and the frequency of the variable light source information;
and the processing unit is used for processing the image according to the brightness of the image acquired by the camera module and the brightness corresponding to the changed light source information so as to balance the brightness of the image.
According to a fifth aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium having stored thereon computer instructions, which when executed by a processor, implement the steps of the method according to any one of the embodiments described above.
According to a sixth aspect of embodiments of the present disclosure, there is provided an electronic apparatus including:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to carry out the steps of the method according to any of the embodiments described above when executed.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:
known by the above embodiment, in the technical scheme of this disclosure, can determine the invariable information of light source and light source change information through setting up light sensor, can confirm the frequency of the light source that produces this light source change information through this light source change information, can carry out image processing to the image according to this frequency to the luminance of each position on the balanced image avoids appearing the alternate stripe of light and shade, promotes the effect of shooing.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a schematic structural diagram of a camera module according to an exemplary embodiment.
FIG. 2 is a graph illustrating an angular response of a light sensor according to an exemplary embodiment.
FIG. 3 is a graph comparing angular response curves of a light sensor according to an exemplary embodiment.
Fig. 4 is a schematic structural diagram of another camera module according to an exemplary embodiment.
Fig. 5 is a schematic diagram of a structure of an electronic device according to an exemplary embodiment.
FIG. 6 is a flow diagram illustrating an image processing method according to an exemplary embodiment.
Fig. 7 is a frequency diagram illustrating a power supply in accordance with an exemplary embodiment.
FIG. 8 is a frequency plot illustrating one type of varying light source information, according to an example embodiment.
Fig. 9 is a block diagram illustrating an image processing apparatus according to an exemplary embodiment.
Fig. 10 is a block diagram illustrating another image processing apparatus according to an exemplary embodiment.
Fig. 11 is a block diagram illustrating still another image processing apparatus according to an exemplary embodiment.
Fig. 12 is a block diagram illustrating an apparatus for image processing according to an exemplary embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present application. The word "if," as used herein, may be interpreted as "at … …" or "at … …" or "in response to a determination," depending on the context.
Fig. 1 is a schematic structural diagram of a camera module 100 according to an exemplary embodiment. As shown in fig. 1, the camera module 100 may include a camera module 1, a flash module 2, a light sensor 3, and a circuit board 4, the circuit board 4 is connected to both the camera module 1 and the light sensor 3, and the circuit board may be connected to a main board of an electrical device in which the camera module 100 is configured, so as to control a switching state of the camera module 100, and to acquire and display an image taken by the camera module 1.
Wherein, this camera module 1 can be used for acquireing the image, and when electronic equipment's external brightness was not enough, flash light module 2 can carry out the light filling to promote the effect of the image that camera module 1 acquireed. The flash module 2 may include a light source (not shown) and a flash lens 21, and the flash lens 21 is closer to the outer surface of the camera module 100 than the light source, so as to protect the light source through the flash lens 21, and the light source 21 may be an LED light source, which may perform blanking for an object to be photographed in a dark environment.
The light sensor 3 is located below the flash lens 21, the light sensor 3 may be configured to obtain light source fluctuation information of an external light source, the light source fluctuation information may include constant light source information and periodically changing light source information, and the periodically changing light source information may be configured to perform image processing on an image obtained by the camera module 1, so as to equalize brightness at each position on the image.
For example, when the camera module 100 is used to capture a picture shown by a display, the external light source may include ambient light and light emitted by an LED element or an OLED element in the display, and it can be understood that both the LED element and the OLED element are refreshed and scanned at a certain frequency to realize picture display.
Further, when the camera module 100 is shooting a display screen, due to a difference between the exposure time of the camera module 1 and the refresh frequency of the LED module or the OLED module in the display, there may exist some rows of pixels that are not lighted in all rows of pixels on the display at a single shutter speed, so that the image obtained by the camera module 1 has stripes with alternate light and shade, and the image effect is not good. And through this disclosed technical scheme, can set up light sensor 3 and determine light source constant information and light source change information, can confirm the frequency of the light source that produces this light source change information through this light source change information, can determine corresponding luminance through fast Fourier change algorithm according to this frequency, follow-up can subtract the luminance that changes the light source information and correspond on the luminance basis that the camera module was confirmed at the same moment, realize the image processing to the image, the luminance of each position on the balanced image, avoid appearing the stripe of alternate light and shade, promote the effect of shooing. The frequency of the variable light source information may be 50Hz or 60Hz, or may also be 80Hz, and the like, which is not limited in this disclosure.
In this embodiment, the flash module 2 may further include a fresnel lens 22 and a diffusion sheet 23, the fresnel lens 22 is located between the light sensor 3 and the flash lens 21, and the fresnel lens 22 may include a fresnel texture 221 formed on a surface of the fresnel lens 22 disposed toward the light sensor 3. Therefore, the internal electronic components can be shielded by the fresnel texture 221 on the fresnel lens 22, and the visual effect can be improved.
Since the fresnel lens 22 is provided with the uneven fresnel texture 221, the detection of the light incident from various angles by the light sensor 3 is affected, and the processing effect of the image processing is affected. Therefore, in the technical solution of the present disclosure, a diffusion sheet 23 is further provided, the diffusion sheet 23 may be located between the fresnel lens 22 and the light sensor 3, and the light emitted from the fresnel lens 22 may be softened by the diffusion sheet 23, so that the light can be uniformly received by the light sensor 3.
Specifically, the response of the light ray sensor 3 to each angle light ray substantially satisfies a cosine response curve as shown in fig. 2, where the abscissa is an angle β between the incident light ray and the light ray receiving surface S1 of the light ray sensor 3, and the ordinate is S1 × cos β/S1. As shown in fig. 3, a curve L1 is a response curve of an incident light ray directly incident on the light sensor 3 from various angles, a curve L2 is a response curve of an incident light ray directly incident on the light sensor 3 from various angles after passing through the fresnel lens 22, which has deviated from a theoretical response curve of the light sensor 3, and a curve L3 is a response curve of an incident light ray directly incident on the light sensor 3 from various angles after passing through the fresnel lens 22 and the diffusion sheet 3, which is substantially similar to the curve L1 and satisfies a theoretical response of the light sensor 3 to an incident angle. The thickness of the diffusion sheet 3 may be in a range of 50um-120um, such as 60um, 80um, 100um, etc., in order to satisfy the theoretical response curve of the light exiting the sensor 3 as much as possible, which is not limited by the disclosure.
In another embodiment, as shown in fig. 4, the fresnel lens 23 may also include ink particles 222 located inside the fresnel lens, and the ink particles 222 may diffuse the light, so that the light in each direction can substantially satisfy the theoretical response condition of the light sensor 3 when being incident to the light sensor 3 through the fresnel lens 22, thereby improving the detection accuracy.
Based on the above embodiments, the present disclosure may further provide an electronic device 200 as shown in fig. 5, where the electronic device 200 may include the camera module 100 described in any of the above embodiments. The electronic device 200 may include a mobile phone terminal or a tablet terminal, which is not limited in this disclosure.
Based on the technical scheme of the present disclosure, an image processing method is also provided, which can be applied to an electronic device, where the electronic device includes a camera module, the camera module includes a camera module, and the camera module is used to obtain an image information image; a flash module comprising a flash lens; a light sensor located below the flash lens. As shown in fig. 6, the method may include the steps of:
in step 601, constant light source information and periodically varying light source information among the external light source fluctuation information are acquired.
In this embodiment, the external light source may include an ambient light source and a display light source, and the display light source may include an LED light source or an OLED light source, wherein the light emitting frequency of the ambient light source is generally constant, and the display light source emits light outwards at a certain frequency. Therefore, the light source fluctuation information may include a constant light source information and a periodically varying light source information.
Further, the electronic device 200 may further comprise a light sensor, which may be used to determine the frequency of the varying light source information, which may further be sent to a processor of the electronic device. For example, assuming that the light source information is changed to be the display light source, the display is usually powered by the power supply with a certain frequency in a sine wave shape as shown in fig. 7, so that when the power supply is changed, the light emitted by the display light source also changes in a sine wave shape, and since the power signal has positive and negative portions and the light has no positive and negative portions, the frequency of the light emitted by the display light source is twice as high as the frequency of the power supply as shown in fig. 8. For example, if the frequency of the power supply signal is 50Hz, the frequency of the changed light source information is 100Hz, and if the frequency of the power supply signal is 60Hz, the frequency of the changed light source information is 120 Hz.
In step 602, image processing is performed on the image acquired by the camera module according to the changed light source information, so as to equalize brightness of the image.
In this embodiment, the processor may determine the brightness corresponding to each time through the fast fourier transform algorithm and the frequency of the changed light source information, and the camera module may also obtain the brightness at each time when acquiring the image information, so that, under the same timestamp, the brightness of the changed light information is subtracted from the brightness acquired by the camera module, and the processing of the image acquired by the camera module and the brightness of the image are equalized.
Corresponding to the embodiment of the image processing method, the disclosure also provides an embodiment of the image processing device.
Fig. 9 is a block diagram illustrating an image processing apparatus according to an exemplary embodiment. The apparatus is applied to the electronic device described in the foregoing embodiment, and referring to fig. 9, the apparatus includes an obtaining module 701 and a processing module 702, where:
the obtaining module 701 obtains constant light source information and periodically changing light source information in the external light source fluctuation information.
The processing module 702 performs image processing on the image acquired by the camera module according to the changed light source information to balance the brightness of the image.
Fig. 10 is a block diagram of another image processing apparatus according to an exemplary embodiment, which is based on the foregoing embodiment shown in fig. 9, and the electronic device includes a light sensor for determining the frequency of the varying light source information; the obtaining module 701 may include:
the receiving unit 7011 receives the frequency of the variable light source information sent by the light sensor.
As shown in fig. 11, fig. 11 is a block diagram of another image processing apparatus according to an exemplary embodiment, which is based on the foregoing embodiment shown in fig. 10, and the processing module 702 may include: a determining unit 7021 and a processing unit 7022, wherein:
a determining unit 7021, configured to determine, according to a fast fourier transform algorithm and a frequency of the variable light source information, a luminance corresponding to the variable light source information;
and the processing unit 7022 performs image processing according to the brightness of the image acquired by the camera module and the brightness corresponding to the changed light source information, so as to balance the brightness of the image.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the disclosed solution. One of ordinary skill in the art can understand and implement it without inventive effort.
Correspondingly, the present disclosure further provides an image processing apparatus, which is applied to the electronic device described in the above embodiment, and further includes: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to: acquiring constant light source information and periodically-changed variable light source information in external light source fluctuation information; and carrying out image processing on the image acquired by the camera module according to the changed light source information so as to balance the brightness of the image.
Accordingly, the present disclosure also provides a terminal, which is applied to the electronic device described in the above embodiments, the terminal including a memory, and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs configured to be executed by the one or more processors include instructions for: acquiring constant light source information and periodically-changed variable light source information in external light source fluctuation information; and carrying out image processing on the image acquired by the camera module according to the changed light source information so as to balance the brightness of the image.
Fig. 12 is a block diagram illustrating an exemplary method for an image processing apparatus 1000 according to an exemplary embodiment. For example, the apparatus 1000 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 10, the apparatus 1000 may include one or more of the following components: processing component 1002, memory 1004, power component 1006, multimedia component 1008, audio component 1010, input/output (I/O) interface 1012, sensor component 1014, and communications component 1016.
The processing component 1002 generally controls the overall operation of the device 1000, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 1002 may include one or more processors 1020 to execute instructions to perform all or a portion of the steps of the methods described above. Further, processing component 1002 may include one or more modules that facilitate interaction between processing component 1002 and other components. For example, the processing component 1002 may include a multimedia module to facilitate interaction between the multimedia component 1008 and the processing component 1002.
The memory 1004 is configured to store various types of data to support operations at the apparatus 1000. Examples of such data include instructions for any application or method operating on device 1000, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 1004 may be implemented by any type or combination of volatile or non-volatile storage devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power supply component 1006 provides power to the various components of the device 1000. The power components 1006 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 1000.
The multimedia component 1008 includes a screen that provides an output interface between the device 1000 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 1008 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 1000 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 1010 is configured to output and/or input audio signals. For example, audio component 1010 includes a Microphone (MIC) configured to receive external audio signals when apparatus 1000 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 1004 or transmitted via the communication component 1016. In some embodiments, audio component 1010 also includes a speaker for outputting audio signals.
I/O interface 1012 provides an interface between processing component 1002 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 1014 includes one or more sensors for providing various aspects of status assessment for the device 1000. For example, sensor assembly 1014 may detect an open/closed state of device 1000, the relative positioning of components, such as a display and keypad of device 1000, the change in position of device 1000 or a component of device 1000, the presence or absence of user contact with device 1000, the orientation or acceleration/deceleration of device 1000, and the change in temperature of device 1000. The sensor assembly 1014 may include a proximity sensor configured to detect the presence of a nearby object in the absence of any physical contact. The sensor assembly 1014 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1014 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 1016 is configured to facilitate communications between the apparatus 1000 and other devices in a wired or wireless manner. The device 1000 may access a wireless network based on a communication standard, such as WiFi,2G or 3g,4g LTE, 5G NR, or a combination thereof. In an exemplary embodiment, the communication component 1016 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communications component 1016 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 1000 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the memory 1004 comprising instructions, executable by the processor 1020 of the device 1000 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (10)

1. The utility model provides a camera module which characterized in that includes:
a camera module for acquiring an image;
a flash module including a flash lens, a diffusion sheet, and a Fresnel lens;
the light sensor is positioned below the flash lamp lens and used for acquiring light source fluctuation information of an external light source, the light source fluctuation information comprises constant light source information and periodically-changed light source information, and the changed light source information is used for carrying out image processing on the image so as to balance the brightness of the image; the Fresnel lens is positioned between the light sensor and the flash lamp lens and comprises Fresnel textures, the Fresnel textures are positioned on the surface, facing the light sensor, of the Fresnel lens, and light is incident to the light sensor through the Fresnel lens; the diffusion sheet is positioned between the Fresnel lens and the light ray sensor and used for diffusing light rays;
the image processing includes: determining the brightness corresponding to the variable light source information according to a fast Fourier transform algorithm and the frequency of the variable light source information; and performing image processing according to the brightness of the image acquired by the camera module and the brightness corresponding to the changed light source information so as to balance the brightness of the image.
2. The camera module of claim 1, wherein the thickness of the diffuser is in the range of 50um-120 um.
3. The camera module of claim 1, wherein the frequency of the varying light source information is 50Hz or 60Hz.
4. An electronic device, comprising the camera module according to any one of claims 1 to 3.
5. An image processing method applied to the electronic device according to claim 4, the image processing method comprising:
acquiring constant light source information and periodically-changed variable light source information in external light source fluctuation information;
performing image processing on the image acquired by the camera module according to the changed light source information to balance the brightness of the image;
the image processing of the image obtained by the camera module according to the changed light source information includes:
determining the brightness corresponding to the variable light source information according to a fast Fourier transform algorithm and the frequency of the variable light source information;
and carrying out image processing according to the brightness of the image acquired by the camera module and the brightness corresponding to the changed light source information so as to balance the brightness of the image.
6. The image processing method of claim 5, wherein the electronic device comprises a light sensor for determining a frequency of the varying light source information;
the acquiring constant light source information and periodically-changing variable light source information in the external light source fluctuation information includes:
and receiving the frequency of the variable light source information sent by the light sensor.
7. An image processing apparatus applied to the electronic device according to claim 4, the image processing apparatus comprising:
the acquisition module is used for acquiring constant light source information and periodically-changed variable light source information in the external light source fluctuation information;
the processing module is used for carrying out image processing on the images acquired by the camera module according to the changed light source information so as to balance the brightness of the images;
the processing module comprises:
the determining unit is used for determining the brightness corresponding to the variable light source information according to the fast Fourier transform algorithm and the frequency of the variable light source information;
and the processing unit is used for processing the image according to the brightness of the image acquired by the camera module and the brightness corresponding to the changed light source information so as to balance the brightness of the image.
8. The image processing apparatus according to claim 7, wherein the electronic device includes a light sensor for determining a frequency of the varying light source information;
the acquisition module comprises:
and the receiving unit is used for receiving the frequency of the variable light source information sent by the light sensor.
9. A computer-readable storage medium having stored thereon computer instructions, which, when executed by a processor, carry out the steps of the method according to any one of claims 5 to 6.
10. An electronic device, comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to perform the steps of the method according to any one of claims 5-6 when executed.
CN201910959257.2A 2019-10-10 2019-10-10 Camera module, image processing method and device and electronic equipment Active CN112653806B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910959257.2A CN112653806B (en) 2019-10-10 2019-10-10 Camera module, image processing method and device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910959257.2A CN112653806B (en) 2019-10-10 2019-10-10 Camera module, image processing method and device and electronic equipment

Publications (2)

Publication Number Publication Date
CN112653806A CN112653806A (en) 2021-04-13
CN112653806B true CN112653806B (en) 2022-11-04

Family

ID=75343425

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910959257.2A Active CN112653806B (en) 2019-10-10 2019-10-10 Camera module, image processing method and device and electronic equipment

Country Status (1)

Country Link
CN (1) CN112653806B (en)

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7777787B2 (en) * 2005-10-17 2010-08-17 Nokia Corporation Preventing flicker effects in video electronic devices
US7605359B2 (en) * 2007-09-14 2009-10-20 Omnivision Technologies, Inc. Light source frequency detection circuit for image sensor
US9891098B2 (en) * 2010-12-30 2018-02-13 Apple Inc. Diffuser and filter structures for light sensors
CN204721463U (en) * 2015-05-29 2015-10-21 瑞声声学科技(深圳)有限公司 Mobile terminal
CN204611452U (en) * 2015-06-03 2015-09-02 厦门理工学院 A kind of multi-functional intelligent lamp
KR20170014357A (en) * 2015-07-29 2017-02-08 엘지전자 주식회사 Mobile terminal equipped with a camera and controlling method thereof
CN106644061A (en) * 2016-12-12 2017-05-10 华为机器有限公司 Ambient light detection system
CN107580185B (en) * 2017-09-30 2020-02-14 德淮半导体有限公司 Image sensor, operating method and imaging device

Also Published As

Publication number Publication date
CN112653806A (en) 2021-04-13

Similar Documents

Publication Publication Date Title
CN107463052B (en) Shooting exposure method and device
US11698297B2 (en) Methods and devices for detecting ambient light based on different states of flexible screen, and storage medium
US10708512B2 (en) Method and device for capturing image and storage medium
CN108810422B (en) Light supplementing method and device for shooting environment and computer readable storage medium
CN108040204B (en) Image shooting method and device based on multiple cameras and storage medium
CN106791339B (en) Imaging system and control method thereof
CN111128091B (en) Screen brightness adjusting method, screen brightness adjusting device and computer storage medium
EP3352453A1 (en) Photographing method for intelligent flight device and intelligent flight device
CN105678296B (en) Method and device for determining character inclination angle
CN112331158B (en) Terminal display adjusting method, device, equipment and storage medium
CN112135117B (en) Test box body, system, method and device of camera module and storage medium
US10827156B2 (en) Light filling method and apparatus for photographing environment, and computer-readable storage medium
CN108847199B (en) Brightness determination method and device
CN111835941B (en) Image generation method and device, electronic equipment and computer readable storage medium
CN111131596B (en) Screen brightness adjusting method and device
CN112653806B (en) Camera module, image processing method and device and electronic equipment
CN107770444B (en) Photographing parameter determination method and device
CN106775246B (en) Screen brightness adjusting method and device
CN111277754B (en) Mobile terminal shooting method and device
CN113452813B (en) Image acquisition device, terminal device, method, processing device, and medium
US11617023B2 (en) Method for brightness enhancement of preview image, apparatus, and medium
EP3975548A1 (en) Photographing method and apparatus, terminal, and storage medium
CN112689047B (en) Display control method and device and electronic equipment
CN110971722B (en) Image shooting method and device
CN112087539A (en) Screen light adjusting method for terminal equipment and terminal equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant