WO2025218599A1 - 摄像头模组、电子设备、拍摄方法及装置 - Google Patents

摄像头模组、电子设备、拍摄方法及装置

Info

Publication number
WO2025218599A1
WO2025218599A1 PCT/CN2025/088602 CN2025088602W WO2025218599A1 WO 2025218599 A1 WO2025218599 A1 WO 2025218599A1 CN 2025088602 W CN2025088602 W CN 2025088602W WO 2025218599 A1 WO2025218599 A1 WO 2025218599A1
Authority
WO
WIPO (PCT)
Prior art keywords
dimming
camera module
image sensor
image
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/CN2025/088602
Other languages
English (en)
French (fr)
Inventor
马骁
袁旺程
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Publication of WO2025218599A1 publication Critical patent/WO2025218599A1/zh
Pending legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/75—Circuitry for compensating brightness variation in the scene by influencing optical camera components
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/71—Circuitry for evaluating the brightness variation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50—Control of the SSIS exposure
    • H04N25/57—Control of the dynamic range

Definitions

  • the present application belongs to the field of camera technology, and specifically relates to a camera module, electronic equipment, shooting method and device.
  • HDR High Dynamic Range
  • HDR high dynamic range
  • traditional devices typically use multi-exposure HDR technology. This involves capturing multiple frames using different exposure strategies and then fusing them into a single HDR image. Because the fused HDR image exhibits natural exposure, it avoids overexposure of bright areas and underexposure of dark areas, thus achieving HDR imaging.
  • the HDR image formed by fusing multiple frames may exhibit motion blur, impacting the imaging quality of the camera.
  • the present application aims to provide a camera module, electronic device, shooting method and device to solve the problem of motion blur in the high dynamic image formed by the fusion of multiple frames of images shot with different exposure strategies due to the time difference when shooting images using the multiple exposure HDR technology in the related art.
  • an embodiment of the present application proposes a camera module, comprising a first lens assembly, a total reflection mirror, a dimming assembly, an image sensor and a feedback circuit, wherein the first lens assembly, the total reflection mirror and the dimming assembly are arranged in sequence, and the image sensor and the total reflection mirror are arranged opposite to each other; the incident light is converged by the first lens assembly and then enters the dimming assembly through the total reflection mirror, the dimming assembly modulates the incident light and reflects it to the total reflection mirror, and the total reflection mirror reflects the incident light to the image sensor; the image sensor includes at least one photosensitive area, the dimming assembly includes at least one dimming area, and one photosensitive area corresponds to one dimming area; the feedback circuit is respectively connected to the image sensor and the dimming assembly; the feedback circuit is used to obtain a feedback signal based on image data collected by the first photosensitive area in the image sensor, and transmit it to the dimming assembly; the dimming assembly is used to adjust the reflect
  • an embodiment of the present application proposes an electronic device comprising the camera module as described in the first aspect.
  • an embodiment of the present application proposes an image processing method, which is executed by an electronic device, and the electronic device includes a camera module as described in the first aspect.
  • the method includes: controlling the feedback circuit of the camera module to obtain first image data collected by the image sensor in the camera module in the first photosensitive area; controlling the feedback circuit in the camera module to obtain a first feedback signal based on the first image data; controlling the dimming component in the camera module to adjust the reflectivity of the first dimming area in the dimming component corresponding to the first photosensitive area based on the first feedback signal; and controlling the image sensor to collect second image data.
  • an embodiment of the present application proposes an image processing device, comprising a camera module as described in the first aspect; the image processing device also includes: a processing module, used to control the feedback circuit of the camera module to obtain the first image data collected by the image sensor in the camera module in the first photosensitive area; the processing module is also used to control the feedback circuit in the camera module to obtain a first feedback signal based on the first image data; the processing module is also used to control the dimming component in the camera module to adjust the reflectivity of the first dimming area in the dimming component corresponding to the first photosensitive area based on the first feedback signal; the processing module is also used to control the image sensor to collect second image data.
  • a processing module used to control the feedback circuit of the camera module to obtain the first image data collected by the image sensor in the camera module in the first photosensitive area
  • the processing module is also used to control the feedback circuit in the camera module to obtain a first feedback signal based on the first image data
  • the processing module is also used to control the dimming component in the camera
  • an embodiment of the present application provides an electronic device comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the third aspect are implemented.
  • an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored.
  • the program or instruction is executed by a processor, the steps of the method described in the third aspect are implemented.
  • an embodiment of the present application provides a chip, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the steps of the method described in the third aspect.
  • an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the steps of the method described in the third aspect.
  • the feedback circuit can obtain a feedback signal based on the image data collected by the first photosensitive area in the image sensor; the dimming component can adjust the reflectivity of the first dimming area corresponding to the first photosensitive area in the dimming component based on the feedback signal. Therefore, the feedback circuit can obtain a feedback signal based on the brightness value of the first photosensitive area and transmit it to the dimming component.
  • the dimming component can reduce or increase the reflectivity of the first dimming area based on the feedback signal, thereby changing the intensity of the light reflected by the first dimming area, so that the light is reflected by the first dimming area of the dimming component to the total reflection mirror, and then reflected by the total reflection mirror to the first photosensitive area of the image sensor.
  • the image sensor can obtain an image with normal exposure, thereby avoiding overexposure of the first photosensitive area due to excessive light intensity, thereby achieving the requirements of high dynamic range imaging and improving the imaging quality of the camera module.
  • the camera module of the present application since there is no need to adopt multiple-exposure HDR technology for imaging, the camera module does not need to fuse multiple frames of images into one image when taking images, thereby avoiding the problem of motion blur in the synthesized image caused by the time difference between multiple frames of images, thereby improving the imaging quality of the camera module.
  • FIG1 is a schematic diagram of a camera module according to an embodiment of the present application.
  • FIG2 is a schematic diagram of a pixel array and a dimming array according to an embodiment of the present application
  • FIG3 is a first schematic diagram of a dimming unit according to an embodiment of the present application.
  • FIG4 is a second schematic diagram of a dimming unit according to an embodiment of the present application.
  • FIG5 is a second schematic diagram of a camera module according to an embodiment of the present application.
  • FIG6 is a third schematic diagram of a camera module according to an embodiment of the present application.
  • FIG7 is a first schematic diagram of an image processing method according to an embodiment of the present application.
  • FIG8 is a second schematic diagram of the image processing method according to an embodiment of the present application.
  • FIG9 is a schematic diagram of the first functional relationship of the embodiment of the present application.
  • FIG10 is a third schematic diagram of the image processing method according to an embodiment of the present application.
  • FIG11 is a schematic diagram of a pixel array on an image sensor and a dimming array on a dimming component when calibrating using a checkerboard projection method according to an embodiment of the present application;
  • FIG12 is a schematic diagram of data encoded by an encoding module according to an embodiment of the present application.
  • FIG13 is a fourth schematic diagram of the image processing method according to an embodiment of the present application.
  • FIG14 is a schematic diagram of an image processing device according to an embodiment of the present application.
  • FIG15 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.
  • FIG16 is a second schematic diagram of the hardware structure of the electronic device according to an embodiment of the present application.
  • first, second, third, and fourth in this specification may explicitly or implicitly refer to one or more of these features.
  • plural means two or more.
  • and/or in this specification refers to at least one of the connected elements, and the character “/” generally indicates an “or” relationship between the connected elements.
  • connection should be understood in a broad sense. For example, they can refer to fixed connections, detachable connections, or integral connections; mechanical connections, or electrical connections; direct connections, indirect connections through an intermediate medium, or internal connections between two components. Those skilled in the art will understand the specific meanings of the above terms in this application based on the specific circumstances.
  • CCM Camera Compact Module
  • IR Cut Filter infrared cut filter
  • Image Sensor image sensor
  • VCM voice coil motor
  • the CCM workflow is as follows: First, the voice coil motor drives the lens to achieve focus, focusing the light carrying visual information through the lens. This light is then filtered out by an infrared cutoff filter to remove infrared wavelengths invisible to the human eye, and then imaged onto the image sensor. Next, the photodiode in the image sensor converts the light signal into an electrical signal, which is then amplified and converted into a digital signal matrix, or RAW image. Finally, the image signal is processed by the Image Signal Processing (ISP) module and compressed for storage in memory. The RAW image is the raw data generated by the image sensor converting the captured light source signal into a digital signal.
  • ISP Image Signal Processing
  • An image sensor is a device that converts optical images into electronic signals and is the core component of a camera module.
  • image sensors are primarily classified into charge-coupled devices (CCDs) and complementary metal oxide semiconductors (CMOS).
  • CMOS complementary metal oxide semiconductors
  • the core function of an image sensor is to sense light, converting the detected light signal into a digital signal for easy transmission and processing.
  • CMOS Image Sensor is a type of image sensor that utilizes CMOS semiconductors. Compared to CCD image sensors, CMOS image sensors offer lower cost and power consumption, and more flexible readout methods.
  • the CIS operates as follows: an array of photodiodes senses light signals and converts them into electrical signals. This is then processed through an amplification circuit and analog-to-digital conversion (ADC) circuit to form a digital signal matrix, or image. This is then processed by the ISP module to generate image data, which is then compressed and stored.
  • ADC analog-to-digital conversion
  • the lens is another core component in the camera module. Its function is to focus light within the field of view onto the imaging plane. Its optical quality directly affects image quality. From the perspective of information transmission, the design of the lens determines the transmission of high-frequency information to the image plane, which directly affects the module's image clarity. From the perspective of energy transmission, the lens structure and transmittance determine the intensity and distribution of light reaching the CIS, which directly affects the CIS's signal-to-noise ratio.
  • Dynamic range refers to the ability of an image sensor to capture both highlights and shadows in an image.
  • High Dynamic Range (HDR) imaging technology is an imaging technology that can achieve a larger dynamic range.
  • dynamic range is defined as the ratio between the full well capacity (FWC) of an image sensor and the noise floor.
  • Full well capacity refers to the maximum amount of charge that can be accumulated by the capacitance of the photodiode of an image sensor.
  • the noise floor also known as readout noise, is defined as the noise generated by the readout circuit, which does not include the noise generated in the detector.
  • the readout circuit includes an amplifier within the pixel. Therefore, by increasing the full well capacity or reducing the noise floor, the dynamic range of the image sensor can be improved, allowing the image sensor to achieve the imaging requirements of high dynamic range imaging. It is understandable that when the dynamic range of an image sensor is small, the image acquired by the image sensor will have bright or dark areas. Bright areas will be too bright due to overexposure, and dark areas will lose details due to underexposure, affecting the quality of the image captured by the image sensor.
  • Liquid Crystal on Silicon is an optical component that combines liquid crystal and silicon chip technology. It inputs electrical signals to a semiconductor chip through tiny interconnects, driving the liquid crystal array to change pixel states, thereby varying the intensity of reflected light.
  • a camera's imaging performance for highlight and dark areas in the same scene is limited.
  • a highlight area may appear white due to overexposure, while a dark area may appear black due to underexposure. This limitation is caused by insufficient dynamic range.
  • HDR high dynamic range
  • traditional devices typically use multi-exposure HDR technology. This involves capturing multiple frames using different exposure strategies and then fusing them into a single HDR image. Because the fused HDR image maintains proper exposure, it avoids overexposure of bright areas and underexposure of dark areas, thus achieving HDR imaging.
  • the resulting HDR image formed by fusing multiple frames, may exhibit motion blur, impacting the imaging quality of the camera.
  • HDR high dynamic range
  • traditional devices can also employ HDR technologies such as dual conversion gain (DCG) and digital overlap (DOL).
  • DCG adds two photoelectric conversion amplifier circuits with different amplification powers, while digital overlap reads out and fuses images with different exposure times.
  • the embodiment of the present application adopts a camera module, which includes a first lens assembly, a total reflection mirror, a dimming assembly, an image sensor and a feedback circuit.
  • the first lens assembly, the total reflection mirror and the dimming assembly are arranged in sequence, and the image sensor and the total reflection mirror are arranged opposite to each other; after the incident light is converged by the first lens assembly and enters the dimming assembly through the total reflection mirror, the dimming assembly modulates the incident light and reflects it to the total reflection mirror, and the total reflection mirror reflects the incident light to the image sensor;
  • the image sensor includes at least one photosensitive area, and the dimming assembly includes at least one dimming area, and one photosensitive area corresponds to one dimming area;
  • the feedback circuit is connected to the image sensor and the dimming assembly respectively; the feedback circuit is used to obtain a feedback signal based on the image data collected by the first photosensitive area in the image sensor, and transmit it to the dimming assembly; the dimming assembly is used to
  • the feedback circuit can obtain a feedback signal based on the image data collected by the first photosensitive area in the image sensor; the dimming component can adjust the reflectivity of the first dimming area corresponding to the first photosensitive area in the dimming component based on the feedback signal. Therefore, the feedback circuit can obtain a feedback signal based on the brightness value of the first photosensitive area and transmit it to the dimming component.
  • the dimming component can reduce or increase the reflectivity of the first dimming area based on the feedback signal, thereby changing the intensity of the light reflected by the first dimming area, so that the light passes through the first dimming area of the dimming component and is reflected to the total reflection mirror, and then reflected to the first photosensitive area of the image sensor by the total reflection mirror.
  • the image sensor can obtain an image with normal exposure, thereby avoiding overexposure of the first photosensitive area due to excessive light intensity, thereby achieving the requirements of high dynamic range imaging and improving the imaging quality of the camera module.
  • the camera module of the present application since there is no need to use multiple exposure HDR technology for imaging, the camera module does not need to fuse multiple frames of images into one image when shooting images, thereby avoiding the problem of motion blur in the fused image caused by time difference between multiple frames of images, thereby improving the imaging quality of the camera module.
  • the image sensor of the present application has a simple circuit structure and low manufacturing cost.
  • the camera module of the present application can be used with different types of image sensors, enabling high dynamic range functionality on the main camera, telephoto, wide-angle, and front-facing modules, enabling full-scene HDR photo and video recording, which is conducive to mass reuse and thus reduces costs.
  • FIG. 1 shows possible structural diagrams of a camera module 100 provided by the embodiment of the present application.
  • the camera module 100 includes a first lens assembly 1, a total reflection mirror 2, a dimming assembly 3, an image sensor 4 and a feedback circuit 5.
  • the first lens assembly 1, the total reflection mirror 2 and the dimming assembly 3 are arranged in sequence, and the image sensor 4 is arranged opposite to the total reflection mirror 2; after the incident light is converged by the first lens assembly 1 and enters the dimming assembly 3 through the total reflection mirror 2, the dimming assembly 3 modulates the incident light and reflects it to the total reflection mirror 2, and the total reflection mirror 2 reflects the incident light to the image sensor 4;
  • the image sensor 4 includes at least one photosensitive area 41, and the dimming assembly 3 includes at least one dimming area 31, and one photosensitive area 41 corresponds to one dimming area 31;
  • the feedback circuit 5 is connected to the image sensor 4 and the dimming assembly 3 respectively; the feedback circuit 5 is used to obtain a feedback signal based on the image data collected by the first photosensitive area in the image sensor 4, and transmit it to the dimming assembly 3; the dim
  • the first lens assembly 1 is composed of multiple aspheric lenses, which can be equivalent to a convex lens and has the function of converging incident light, so that the light passes through the first lens assembly 1 and the total reflection mirror 2 and converges onto the dimming assembly 3.
  • light can achieve a first imaging after passing through the first lens assembly 1 and the total reflection mirror 2, that is, an intermediate image plane can be generated.
  • the dimming component 3 can be arranged at the position of the intermediate image plane.
  • the total reflection mirror 2 also known as an internal total reflection prism, is a prism manufactured based on the principle of total reflection.
  • the function of the total reflection mirror 2 is to fully reflect the light modulated by the dimming component 3, allowing the fully reflected light to enter the image sensor 4, thereby avoiding light loss during reflection and achieving lossless light transmission.
  • the proportional relationship between the incident angle of the incident light reflected by the total reflection mirror 2 and the exit angle of the exit light it is possible to ensure that the light modulated by the dimming component 3 is fully reflected to the image sensor 4 when passing through the total reflection mirror 2, thereby avoiding light loss during reflection.
  • the total reflection mirror 2 includes a first mirror body 21 and a second mirror body 22 arranged opposite to each other, the first mirror body 21 is arranged opposite to the first lens assembly 1, and the second mirror body 22 has a reflective surface; the incident light through the first lens assembly 1 is transmitted through the first mirror body 21 and the second mirror body 22 in sequence to the dimming component 3, and is modulated by the dimming component 3 and reflected to the reflective surface of the second mirror body 22, and then reflected to the image sensor 4 through the reflective surface.
  • the first mirror body 21 can correct and converge the light, preventing the transmission direction of the incident light from deviating.
  • the incident light is modulated by the dimming component 3 and reflected to the reflective surface of the second mirror body 22, the incident light can be totally reflected and reflected to the image sensor 4, allowing the image sensor 4 to collect light information in the environment of the camera module 100, achieving lossless light transmission.
  • a transmissive film may be coated on the first mirror body 21 to increase the transmittance of the first mirror body 21 and reduce the loss of incident light when it is transmitted through the first mirror body 21 .
  • the camera module 100 further includes a driving device for driving the dimming component 3 to move so as to adjust the angle between the exit surface of the dimming component 3 and the optical axis of the first lens component 1 .
  • the dimming component 3 is driven to move by the driving device to adjust the angle between the exit surface of the dimming component 3 and the optical axis of the first lens component 1, so that the incident angle of the incident light reflected by the total reflection mirror 2 can be adjusted, so that when the incident light modulated by the dimming component 3 is emitted from the exit surface of the dimming component 3 and irradiates the reflection surface of the second mirror body 22, it can be ensured that the incident angle of the incident light reflected by the total reflection mirror 2 is greater than the total reflection angle, thereby ensuring that the light modulated by the dimming component 3 can be completely reflected to the image sensor 4 when passing through the total reflection mirror 2, thereby realizing lossless transmission of light.
  • the driving device may be a linear actuator, such as a rack and pinion mechanism, a screw-nut mechanism, etc.
  • the driving device may also be a rotary mechanism, etc.
  • the embodiments of the present application are not limited here.
  • the driving device can drive the dimming component 3 to move on one side relative to the other side in a direction perpendicular to the optical axis of the first lens component 1 to adjust the inclination angle of the dimming component 3, and then adjust the angle between the exit surface of the dimming component 3 and the optical axis of the first lens component 1, that is, adjust the angle between the exit surface of the dimming component 3 and the reflective surface of the second mirror body 22.
  • the dimming component 3 includes two or more dimming areas 31 , and different dimming areas 31 can respectively adjust incident light with different incident angles.
  • the image sensor 4 includes two or more photosensitive areas 41, one photosensitive area 41 corresponds to one dimming area 31, and different dimming areas 31 can individually adjust the brightness value of the corresponding photosensitive area 41, so that the dimming component 3 can accurately adjust the brightness value of a single pixel point in the image captured by the image sensor 4, avoiding overexposure caused by excessive light intensity in some areas of the image, thereby achieving the requirements of high dynamic range imaging and improving the imaging quality of the camera module 100.
  • the image data collected by the first photosensitive area in the image sensor 4 may be a brightness value, position information, etc. of the first photosensitive area.
  • the image sensor 4 includes a pixel array, the pixel array includes at least one pixel unit 8; the dimming component 3 includes a dimming array, the dimming array includes at least one dimming unit 9; each pixel unit 8 in the pixel array corresponds to a dimming unit 9 in the dimming array.
  • the feedback circuit 5 can generate a feedback signal based on the image data collected by the target pixel unit 8 in the image sensor 4, and transmit it to the dimming component 3; the dimming component 3 can adjust the reflectivity of the target dimming unit 9 in the dimming component 3 based on the feedback signal, so as to adjust the intensity of the light reflected by the target dimming unit 9, and then make the light reflected by the target dimming unit 9, when reflected by the total reflection mirror 2 into the target pixel unit 8, avoid excessive light intensity causing overexposure, so that the dimming component 3 can accurately adjust the brightness value of a single pixel point in the image collected by the image sensor 4, so that the camera module 100 can achieve the requirements of high dynamic range.
  • each pixel unit 8 in the pixel array corresponds to a dimming unit 9 in the dimming array, which means that the target pixel unit 8 in the pixel array corresponds to the target dimming unit 9 in the dimming array, that is, the incident light is reflected by the target dimming unit 9 to the total reflection mirror 2, and then reflected by the total reflection mirror 2 to enter the target pixel unit 8 of the image sensor 4.
  • the dimming array includes two or more dimming units 9 , and different dimming units 9 can respectively adjust light with different incident angles.
  • the image sensor 4 includes two or more pixel units 8, one pixel unit 8 corresponds to one dimming unit 9, and different dimming units 9 can individually adjust the brightness value of the corresponding pixel unit 8, so that the dimming component 3 can accurately adjust the brightness value of a single pixel point in the image captured by the image sensor 4, avoiding overexposure caused by excessive light intensity in some areas of the image, thereby achieving the requirements of high dynamic range imaging and improving the imaging quality of the camera module 100.
  • the feedback circuit 5 can obtain a feedback signal based on the image data captured by the first photosensitive area in the image sensor 4 and transmit it to the dimming component 3.
  • the dimming component 3 can adjust the reflectivity of the first dimming area corresponding to the first photosensitive area in the dimming component 3 based on the feedback signal. Therefore, the feedback circuit 5 can obtain a feedback signal based on the brightness value of the first photosensitive area and transmit it to the dimming component 3.
  • the dimming component 3 can reduce or increase the reflectivity of the first dimming area based on the feedback signal, thereby changing the intensity of light reflected by the first dimming area.
  • the image sensor 4 can obtain a properly exposed image, thereby avoiding overexposure of the first photosensitive area due to excessive light intensity, thereby achieving high dynamic range imaging requirements and improving the imaging quality of the camera module 100. Furthermore, when the camera module 100 of the present application is used, since there is no need to use multiple exposure HDR technology for imaging, the camera module 100 does not need to fuse multiple frames of images into one image when capturing images, thereby avoiding the problem of motion blur in the synthesized image caused by the time difference between the multiple frames of images, thereby improving the imaging quality of the camera module 100.
  • the circuit structure of the image sensor 4 of the present application is simple and the manufacturing cost is low.
  • the camera module 100 of the present application can be used with image sensors 4 of different models, and high dynamic range functions can be achieved on modules such as the main camera, telephoto, wide angle, and front camera, and full-scene HDR photo and video recording functions can be achieved, which is conducive to mass reuse and thus reduces costs.
  • the brightness value of the first photosensitive area is large.
  • the feedback circuit 5 can generate a feedback signal based on the brightness value of the first photosensitive area and transmit it to the dimming component 3.
  • the dimming component 3 can reduce the reflectivity of the first dimming area based on the feedback signal, thereby changing the intensity of the light reflected by the first dimming area, so that the incident light is reflected from the first dimming area of the dimming component 3 to the total reflection mirror 2, and then reflected to the first photosensitive area of the image sensor 4 through the total reflection mirror 2.
  • the brightness value of the first photosensitive area is correspondingly reduced, so that the image sensor 4 can obtain an image with normal exposure, avoiding overexposure due to excessive light intensity when the first photosensitive area is a highlight area.
  • the dimming unit 9 includes a first polarizer 91, a second polarizer 92 and a liquid crystal module 93
  • the liquid crystal module 93 includes a microlens 931, an electrode layer 932, a liquid crystal layer 933, a reflective layer 934, a circuit layer 935 and a substrate 936
  • the feedback signal includes a first voltage signal
  • the feedback circuit 5 is specifically used to apply a first voltage signal between the electrode layer 932 and the circuit layer 935 of the first dimming unit 9 to adjust the reflectivity of the first dimming unit 9, and the first dimming unit 9 is the dimming unit 9 in the second area
  • the incident light entering the dimming component 3 passes through the first polarizer 91, the microlens 931 and the liquid crystal layer 933 in sequence to be transmitted to the reflective layer 934, and after being reflected by the reflective layer 934, it is emitted through the liquid crystal layer 933, the microlens 931 and the second polarizer
  • the feedback circuit 5 applies a first voltage signal between the electrode layer 932 and the circuit layer 935 of the first dimming unit 9, thereby controlling the voltage between the electrode layer 932 and the circuit layer 935 to control the deflection of the liquid crystal molecules in the liquid crystal layer 933, thereby adjusting the reflectivity of the first dimming unit 9.
  • the first polarizer 91, the liquid crystal layer 933, and the second polarizer 92 can modulate the polarization state of light, thereby modulating the amplitude of the light.
  • the dimming component 3 can adjust the intensity of the incident light by modulating the amplitude of the light, thereby avoiding overexposure caused by excessive intensity of the incident light, thereby enabling the camera module 100 to achieve high dynamic range imaging requirements.
  • the microlens 931 has excellent light-gathering capabilities, it can gather more light, further reducing light loss and improving the imaging quality of the camera module 100.
  • the substrate 936 may be a printed circuit board (PCB).
  • PCB printed circuit board
  • the electrode layer 932 may be a transparent electrode, so as to ensure that light can be transmitted through the electrode layer 932 and avoid the electrode layer 932 blocking the transmission of light.
  • the circuit layer 935 may be a silicon-based circuit layer.
  • the dimming unit 9 includes a first polarizer 91, a second polarizer 92 and a liquid crystal module 93, and the liquid crystal module 93 includes a glass cover 937, an electrode layer 932, a liquid crystal layer 933, a reflective layer 934, a circuit layer 935 and a substrate 936;
  • the feedback signal includes a first voltage signal;
  • the feedback circuit 5 is specifically used to apply a first voltage signal between the electrode layer 932 and the circuit layer 935 of the first dimming unit 9 to adjust the reflectivity of the first dimming unit 9, and the first dimming unit 9 is the dimming unit 9 in the second area;
  • the incident light entering the dimming component 3 passes through the first polarizer 91, the glass cover 937 and the liquid crystal layer 933 in sequence to be transmitted to the reflective layer 934, and after being reflected by the reflective layer 934, it passes through the liquid crystal layer 933, the glass cover 937 and the second polarizer 92 in sequence to be emitted
  • the electrode layer 932 is disposed at an edge of the liquid crystal layer 933 .
  • the electrode layer 932 when the electrode layer 932 is disposed at the edge of the liquid crystal layer 933, since the electrode layer 932 is not disposed near the middle of the liquid crystal layer 933, the incident light passing through the microlens 931 and entering the liquid crystal layer 933 can bypass the electrode layer 932. This avoids light energy loss when the light passes through the transparent electrode, further reducing light loss when passing through the dimming component 3 and improving the imaging quality of the camera module 100.
  • a driving voltage that drives the movement of liquid crystal molecules in the liquid crystal layer 933 can be generated between the electrode layer 932 and the circuit layer 935, allowing the dimming component 3 to adjust the reflectivity of the dimming component 3 by adjusting the voltage between the electrode layer 932 and the circuit layer 935.
  • the electrode layer 932 may be a ring-shaped electrode, and a ring-shaped groove may be provided at the edge of the liquid crystal layer 933 , and the ring-shaped electrode is nested in the ring-shaped groove.
  • the electrode layer 932 covers the liquid crystal layer 933 .
  • a driving voltage that drives the movement of liquid crystal molecules in the liquid crystal layer 933 can be formed between the electrode layer 932 and the circuit layer 935, so that the dimming component 3 can adjust the reflectivity of the dimming component 3 by adjusting the voltage value between the electrode layer 932 and the circuit layer 935.
  • the reflective layer 934 is a high reflective coating.
  • the high-reflective coating is a coating structure with high reflectivity.
  • the reflective layer 934 is a high-reflective coating, it can improve the reflectivity of the reflective layer 934, avoid the loss of light energy during the reflection process, thereby further reducing the loss of light when passing through the dimming component 3, and improving the imaging quality of the camera module 100.
  • the dimming component 3 is one of a liquid crystal on silicon (LCoS) chip, a spatial light modulator, and a micro-mirror array.
  • LCD liquid crystal on silicon
  • the LCoS chip is a silicon-based liquid crystal chip having a liquid crystal layer 933.
  • the liquid crystal layer 933 of the chip can regulate the amplitude of light and then adjust the intensity of light, so that the dimming component 3 can adjust the intensity of the incident light to avoid overexposure caused by excessive intensity of the incident light, thereby enabling the camera module 100 to achieve the requirements of high dynamic range imaging.
  • a spatial light modulator is a device that modulates the spatial distribution of light waves. Under the control of an electrical drive signal, it changes the amplitude or intensity, phase, polarization state, etc. of the spatial light distribution.
  • Spatial light modulators are key components in modern optical fields such as real-time optical information processing, adaptive optics, and optical computing. In this way, the spatial light modulator can regulate the amplitude of light and, in turn, the intensity of light, so that the dimming component 3 can adjust the intensity of the incident light to avoid overexposure caused by excessive intensity of the incident light, thereby enabling the camera module 100 to achieve the requirements of high dynamic range imaging.
  • a micromirror array is also called a digital micromirror device (DMD).
  • the micromirror array includes a plurality of mirror units distributed in an array, and each mirror unit includes a mirror and a mechanical structure for driving the mirror to deflect.
  • the deflection angle of the mirror is controlled by the mechanical structure, so that the transmission direction of the light reflected by the mirror can be controlled, and then the number of light beams reflected to the total reflector 2 can be controlled, thereby adjusting the reflectivity of the mirror unit, so that the dimming component 3 can adjust the intensity of the incident light to avoid overexposure caused by excessive intensity of the incident light, so that the camera module 100 can achieve the requirements of high dynamic range imaging.
  • the camera module 100 also includes a second lens assembly 7, which is arranged between the total reflection mirror 2 and the image sensor 4; the incident light reflected by the total reflection mirror 2 is converged by the second lens assembly 7 and transmitted to the image sensor 4.
  • the second lens assembly 7 can compensate for the aberrations of the first lens group, improving the resolving power of the imaging system. For example, when a certain aberration of the first lens assembly 1 (such as coma, astigmatism, etc.) is +A, the curvature, thickness, lens spacing, and other variables of the second lens assembly 7 can be changed to produce an aberration of -A. Thus, the aberration can be compensated by superimposing the first lens assembly 1 and the second lens assembly 7.
  • a certain aberration of the first lens assembly 1 such as coma, astigmatism, etc.
  • the second lens assembly 7 can also achieve chief ray angle (CRA) matching.
  • CRA chief ray angle
  • the incident angle of the chief ray can be controlled to meet the chief ray angle matching requirements of the image sensor 4, avoiding crosstalk between the pixel units 8 of the image sensor 4 caused by a mismatch in the chief ray angle, resulting in color cast and other phenomena.
  • the camera module 100 further includes an infrared cutoff filter 6, which is disposed between the second lens assembly 7 and the image sensor 4. Incident light transmitted through the second lens assembly 7 is filtered by the infrared cutoff filter 6 before entering the image sensor 4. In this way, the infrared cutoff filter 6 can filter out infrared wavelengths that are invisible to the human eye, thereby improving the imaging effect of the camera module 100.
  • the feedback circuit 5 includes a calculation module 51 , which is configured to calculate a feedback value of a feedback signal based on image data collected by the first photosensitive area in the image sensor 4 .
  • the calculation module 51 may include a clock circuit, a counter, a feedback signal mapping unit, a matrix multiplication calculation unit and a memory (EEPROM).
  • the calculation process of the calculation module 51 may be: first, the electrical signal of the first photosensitive area is read out by the analog-to-digital converter of the image sensor 4, and the electrical signal is transmitted to the feedback signal mapping unit, and the feedback signal mapping unit calculates the feedback value of the feedback signal according to the mapping relationship.
  • the clock circuit obtains the clock signal
  • the counter obtains the position information of the first photosensitive area according to the clock signal
  • the matrix multiplication calculation unit can obtain the position information of the first dimming area according to the set solution matrix, that is, the coordinate information.
  • the feedback value of the feedback signal and the position information of the first dimming area can be stored in the memory.
  • the feedback circuit 5 may further include an encoding module 52, which is connected to the calculation module 51.
  • the encoding module 52 can compress the feedback value of the feedback signal calculated by the calculation module 51 and the position information of the first dimming area into several bytes for encoding to obtain encoded data.
  • the feedback circuit 5 may further include a decoding module 53 that can decode the encoded data generated by the encoding module 52 to obtain decoded data.
  • the decoded data includes the feedback value of the feedback signal calculated by the calculation module 51 and the position information of the first dimming zone.
  • the feedback circuit 5 may further include a transmission line for transmitting the encoded data to the decoding module 53.
  • data may be transmitted between the encoding module 52 and the decoding module 53 via an 8-bit bus.
  • the transmission speed of the feedback signal can be improved to achieve fast real-time feedback.
  • the feedback circuit 5 may further include a driver module 54, i.e., a driver IC.
  • the driver module 54 is connected to the decoding module 53, and the driver module 54 may obtain a feedback signal based on the decoded data.
  • the driver module 54 may include a row selector and a column selector.
  • the driver module 54 may receive the decoded data generated by the decoding module 53, and based on the position information of the first dimming area in the decoded data, find the position of the first dimming area in the dimming component 3 through the row selector and the column selector.
  • a feedback signal is obtained based on the feedback value of the feedback signal in the decoded data, and the feedback signal is transmitted to the dimming component 3.
  • the dimming component 3 includes an electrode layer 932, a liquid crystal layer 933, and a circuit layer 935
  • the feedback signal is a voltage signal applied between the electrode layer 932 and the circuit layer 935.
  • a circuit of a photosensitive region 41 in an image sensor 4 may include a parasitic capacitor FD, a reset switch RST, an analog switch TG, a voltage follower SF, a row select switch RSL, and a photodiode.
  • the first end of the reset switch RST is connected to the first end of the voltage follower SF
  • the second end of the reset switch RST is connected to the first end of the analog switch TG
  • the second end of the analog switch TG is connected to the photodiode
  • the second end of the voltage follower SF is connected to the first end of the row select switch RSL
  • the second end of RSL is grounded.
  • the third end of the voltage follower SF is connected between the second end of the reset switch RST and the first end of the analog switch TG, the first end of the parasitic capacitor FD is connected between the third end of the voltage follower SF and the second end of the reset switch RST, and the second end of the photosensitive capacitor FD is grounded.
  • the analog switch TG can control the current flow to the parasitic capacitor FD, allowing charge to be stored in the parasitic capacitor FD.
  • the reset switch RST can control the parasitic capacitor FD to reset to a high level, making it easier to read the charge in the parasitic capacitor FD.
  • the row select switch RSL outputs an electrical signal, thereby converting the optical signal into an electrical signal.
  • An embodiment of the present application also provides an electronic device, which includes: the camera module 100 in the above embodiment.
  • An embodiment of the present application provides an electronic device comprising the camera module 100 of the aforementioned embodiment. Since the image sensor of the camera module 100 can capture image data of the environment in which the camera module is located, a feedback circuit can generate a feedback signal based on the image data captured by a first photosensitive region in the image sensor and transmit the feedback signal to a dimming component. The dimming component can adjust the reflectivity of a first dimming region in the dimming component corresponding to the first photosensitive region based on the feedback signal, thereby enabling the electronic device to achieve high dynamic range imaging requirements and improve the imaging quality of the electronic device.
  • the image processing method provided in the embodiments of the present application can be executed by a camera module, an image processing device, an electronic device, or a functional module or entity in an electronic device.
  • the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, or the like, and the electronic device includes a camera module.
  • the image processing method provided in the embodiments of the present application is described by taking an image processing device executing the image processing method as an example.
  • FIG7 shows a schematic diagram of an image processing method provided in an embodiment of the present application.
  • the image processing method provided in an embodiment of the present application may include the following steps 101 to 104 .
  • Step 101 An image processing device controls a feedback circuit of a camera module to obtain first image data collected by an image sensor in a first photosensitive area of the camera module.
  • the first photosensitive area when light enters the image sensor and illuminates the first photosensitive area, the first photosensitive area can convert the light signal into an electrical signal, the electrical signal can be amplified by a signal amplification circuit, and the amplified electrical signal can be converted into a digital signal by an analog-to-digital conversion circuit.
  • the digital signal can be transmitted to the processing module of the image sensor through the Mobile Industry Processor Interface (MIPI).
  • MIPI Mobile Industry Processor Interface
  • the image data collected by the image sensor in the first photosensitive area may include a brightness value and first position information of the first photosensitive area.
  • the first position information includes row coordinates and column coordinates of the first photosensitive area. It should be noted that the row coordinates and column coordinates of the first photosensitive area refer to the coordinates of a single pixel unit in the pixel array of the image sensor.
  • Step 102 The image processing device controls a feedback circuit in the camera module to obtain a first feedback signal based on the first image data.
  • the image processing device With respect to the dimming unit structure of the dimming component shown in Figures 3 and 4 , the image processing device generates second position information of the first dimming area based on the first position information of the first photosensitive area, and then generates a feedback value corresponding to the second position information based on the brightness value of the first photosensitive area.
  • the feedback signal transmitted by the image processing device to the dimming component carries the second position information of the first dimming area and the feedback value corresponding to the second position information.
  • the image processing device generates a feedback signal based on the image data of the first photosensitive area and transmits it to the dimming component, so that the dimming component can adjust the reflectivity of the first dimming area based on the feedback signal of the first photosensitive area, thereby enabling the dimming component to adjust the brightness value of the first photosensitive area to avoid overexposure of the first photosensitive area, thereby enabling the image processing device to achieve the requirements of high dynamic range imaging and improve the imaging quality of the image processing device.
  • the image processing device in step 102 generates a feedback signal based on the image data, which can be specifically implemented through the following steps 102 a to 102 c.
  • Step 102a The image processing device determines an average brightness value of the first photosensitive area based on the first image data.
  • the first photosensitive area when incident light enters the image sensor and illuminates the first photosensitive area, the first photosensitive area can convert the light signal into an electrical signal, the electrical signal can be amplified by a signal amplification circuit, and the amplified electrical signal can be converted into a digital signal by an analog-to-digital conversion circuit.
  • the image processing device can obtain the average brightness value by calculating the average value of the digital signal.
  • Step 102b The image processing apparatus generates a first digital signal based on the average brightness value and the first functional relationship.
  • the first functional relationship may be a linear functional relationship, and the first functional relationship is used to represent the mapping relationship between the signal mean value of the photosensitive area of the image sensor and the feedback value of the feedback signal.
  • the first functional relationship is used to represent the mapping relationship between the brightness value of the photosensitive area of the image sensor and the voltage value required to be applied to the corresponding dimming area.
  • FIG9 is a schematic diagram showing a mapping relationship between a signal mean value of a photosensitive area of an image sensor and a feedback value of a feedback signal.
  • Step 102c The image processing apparatus obtains a first feedback signal based on the first digital signal.
  • the image processing device determines the first voltage value and generates a first digital signal based on the average brightness value and the first functional relationship, and the image processing device obtains a first feedback signal based on the first digital signal, so that the image processing device can obtain the first feedback signal based on the first image data.
  • Step 103 The image processing device controls the dimming component in the camera module to adjust the reflectivity of the first dimming area corresponding to the first photosensitive area in the dimming component based on the first feedback signal;
  • Step 104 The image processing device controls the image sensor to collect second image data.
  • the image processing device determines the first voltage value and generates a first digital signal based on the average brightness value and the first functional relationship, and the image processing device obtains a first feedback signal based on the first digital signal.
  • the image processing device controls the dimming component in the camera module to adjust the reflectivity of the first dimming area corresponding to the first photosensitive area in the dimming component based on the first feedback signal, so that the dimming component can adjust the intensity of the incident light reflected by the first dimming area, so that the incident light is reflected by the first dimming area of the dimming component to the total reflection mirror, and then reflected by the total reflection mirror to the first photosensitive area of the image sensor.
  • the image sensor can obtain second image data with normal exposure, which can avoid overexposure of the first photosensitive area due to excessive light intensity, achieve the requirements of high dynamic range imaging, and improve the imaging quality of the camera module.
  • the image processing method provided in the embodiment of the present application can be implemented through the following steps S101 to S104 , taking the image processing device as a camera module as an example.
  • the camera module performs module calibration on first position information of a first photosensitive area and second position information of a first dimming area.
  • module calibration is performed on the first position information of the first photosensitive area and the second position information of the first dimming area, specifically including: establishing a spatial mapping relationship between the first position information (x, y) of the first photosensitive area and the second position information (u, v) of the first dimming area, and determining that the spatial mapping relationship can be calculated based on the following formula 1:
  • x is the row coordinate of the first photosensitive area
  • y is the column coordinate of the first photosensitive area
  • u is the row coordinate of the first dimming area
  • v is the column coordinate of the first dimming area
  • T is the solution matrix
  • t11 is the value of the first row and first column of the solution matrix T
  • t12 is the value of the first row and second column of the solution matrix T
  • t13 is the value of the first row and third column of the solution matrix T
  • t21 is the value of the second row and first column of the solution matrix T
  • t22 is the value of the second row and second column of the solution matrix T
  • t23 is the value of the second row and third column of the solution matrix T
  • t31 is the value of the third row and first column of the solution matrix T
  • t32 is the value of the third row and second column of the solution matrix T
  • t33 is the value of the third row and third column of the solution matrix T.
  • Equation 1 when the first position information (x, y) of the first photosensitive area and the solution matrix T are known, the second position information (u, v) of the first dimming area corresponding to the first photosensitive area can be obtained, which facilitates the feedback circuit to transmit a feedback signal to the first dimming area based on the second position information. Therefore, the key to the above module calibration lies in calculating the value of the solution matrix T.
  • the module calibration method may be a checkerboard projection method, and the value of the solution matrix T may be calculated by the checkerboard projection method.
  • the checkerboard method is a method that uses the Zhang Zhengyou calibration method to obtain the internal parameters of the camera, utilizes the consistency of the checkerboard plane in the two coordinate systems, establishes a set of constraint equations, uses a linear method to solve the initial solution of the external parameters of the two coordinate systems, and then uses a nonlinear optimization method to further optimize.
  • the checkerboard projection calibration process is as follows: first, the dimming component is driven to display a specific checkerboard pattern. This pattern is then formed between the second lens group and read out by the image sensor. A sophisticated detection algorithm is used to calculate the corner coordinates, which then determines the mapping relationship between the corner points. Matrix T is then solved based on Equation 1. The values of the solved matrix T are then stored in memory (EEPROM) for use by the feedback circuit's calculation module.
  • EEPROM electrically erasable programmable read-only memory
  • the image sensor senses light and processes data.
  • the image sensor converts the light signal into an electrical signal after being sensitive to light.
  • the electrical signal can be amplified by a signal amplification circuit.
  • the amplified electrical signal can be converted into a digital signal by an analog-to-digital conversion circuit.
  • the digital signal can be transmitted to the processing module of the image sensor through the Mobile Industry Processor Interface (MIPI), and the processing module processes the image data.
  • MIPI Mobile Industry Processor Interface
  • the feedback circuit of the camera module generates a feedback signal based on the image data and transmits the feedback signal to the dimming component.
  • the feedback circuit of the camera module includes a calculation module, and the above-mentioned processing module can transmit the readout data of the current frame of the image to the calculation module of the feedback circuit.
  • the calculation module can perform block processing on the image in RAW format, calculate the position coordinates (x, y) and the signal mean SIG_MEAN of each pixel block (block), that is, calculate the first position information (x, y) and the average brightness value of the first photosensitive area. Furthermore, the calculation module can calculate the second position information (u, v) of the first dimming area corresponding to the first photosensitive area according to the above formula 1.
  • the calculation module can calculate the size of the feedback signal SIG_FEEDBACK according to the signal mean SIG_MEAN and the first functional relationship.
  • the first functional relationship is used to characterize the mapping relationship between the brightness values of different photosensitive areas of the image sensor and the voltage values that need to be applied to the corresponding dimming areas.
  • the feedback circuit of the camera module further includes an encoding module and a decoding module.
  • the encoding module can encode the second position information (u, v) and the feedback signal SIG_FEEDBACK and package them into 2-byte data, which is then transmitted to the decoding module via a data bus.
  • the 2-byte data includes a start identifier, the second position information (u, v), the feedback signal SIG_FEEDBACK, and an end identifier, which are sequentially distributed.
  • the feedback circuit of the camera module further includes a driver module, which transmits a voltage to the first dimming area of the dimming component based on the decoded data from the decoding module.
  • the driver module can apply a voltage between the electrode layer and the circuit layer based on the decoded data to adjust the inter-electrode voltage between the electrode layer and the circuit layer to adjust the reflectivity of the first dimming area.
  • the driver module when the signal value of the feedback signal is relatively low, the driver module applies a higher voltage between the electrode layer and the circuit layer to increase the reflectivity of the first dimming area; when the signal value of the feedback signal is relatively high, the driver module applies a lower voltage between the electrode layer and the circuit layer to decrease the reflectivity of the first dimming area, thereby achieving adaptive control of the image sensor exposure and improving the dynamic range of the camera module.
  • the dimming component adjusts the reflectivity
  • the light enters the image sensor again and generates a target image.
  • the target image is processed by an image signal processing (ISP) module and the target image is compressed.
  • ISP image signal processing
  • the target image due to significant differences between the photosensitive characteristics of image sensors and those of the human eye, it is necessary to further process the target image in RAW format to satisfy the preferences of the human eye.
  • the target image can be sent to the ISP module for processing.
  • noise reduction, white balance, color calibration, gamma conversion, and other operations it is compressed into a JPEG image format for storage or transmission to a display.
  • Gamma conversion is an image enhancement method that adjusts the contrast of an image and enhances details in dark or bright areas.
  • the specific process of the above image processing method may be:
  • the position mapping relationship between the first photosensitive area and the first dimming area is determined by the above module calibration method, and the position mapping relationship is stored in the memory (EEPROM).
  • the image sensor obtains the first position information and the average brightness of the first photosensitive area.
  • the calculation module calculates the second position information of the first dimming area based on the first position information and the position mapping relationship, and calculates the feedback value of the feedback signal corresponding to the second position information based on the average brightness and the first functional relationship.
  • the feedback signal is then encoded by the encoding module and decoded by the decoding module, so that the feedback signal is transmitted to the driving module.
  • the driving module adjusts the voltage between the electrode layer and the circuit layer of the dimming component based on the second position information and the feedback value of the feedback signal corresponding to the second position information to adjust the reflectivity of the dimming component, thereby adjusting the intensity of the light passing through the dimming component.
  • the adjusted light is reflected again by the total reflection mirror to the first photosensitive area of the image sensor, so that the first photosensitive area can collect image data with normal exposure, thereby enabling the image sensor to collect the target image with normal exposure.
  • the target image is transmitted to the ISP module through the Mobile Industry Processor Interface (MIPI).
  • MIPI Mobile Industry Processor Interface
  • the ISP module processes the target image and compresses it to obtain an image that meets the preferences of the human eye.
  • the image processing method provided in the embodiment of the present application can be executed by an image processing device.
  • the image processing device provided in the embodiment of the present application is described by taking the image processing device executing the image processing method as an example.
  • FIG14 shows a possible structural diagram of a shooting device involved in an embodiment of the present application.
  • the image processing device 300 may include the camera module 100 in the above embodiment, and the image processing device 300 may also include:
  • the processing module 301 is configured to control a feedback circuit of the camera module to obtain first image data collected by an image sensor in a first photosensitive area of the camera module;
  • the processing module 301 is further configured to control a feedback circuit in the camera module to obtain a first feedback signal based on the first image data;
  • the processing module 301 is further configured to control a dimming component in the camera module to adjust a reflectivity of a first dimming area in the dimming component corresponding to the first photosensitive area based on the first feedback signal;
  • the processing module 301 is further configured to control the image sensor to collect second image data.
  • the present embodiment provides an image processing device 300, which includes the camera module 100 described in the above embodiment. Because the image sensor of the camera module 100 can capture image data of the environment in which the camera module is located, a feedback circuit can generate a feedback signal based on the image data captured by a first photosensitive region in the image sensor and transmit the feedback signal to a dimming component. The dimming component can adjust the reflectivity of a first dimming region in the dimming component corresponding to the first photosensitive region based on the feedback signal, thereby enabling the electronic device to achieve high dynamic range imaging requirements and improve the imaging quality of the electronic device.
  • the processing module 301 is specifically used to: determine the average brightness value of the first photosensitive area based on the first image data; generate a first digital signal based on the average brightness value and a first functional relationship; and obtain the first feedback signal based on the first digital signal.
  • the image processing device 300 in the embodiment of the present application can be an electronic device or a component in an electronic device, such as an integrated circuit or a chip.
  • the electronic device can be a terminal or other device other than a terminal.
  • the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile internet device (MID), an augmented reality (AR)/virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc.
  • It can also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not specifically limit it.
  • the image processing device 300 in the embodiment of the present application may be a device having an operating system.
  • the operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
  • the shooting device provided in the embodiment of the present application can implement the various processes implemented in the method embodiments of Figures 1 to 13 and achieve the same technical effects. To avoid repetition, they will not be described here.
  • an embodiment of the present application also provides an electronic device 400, including a processor 401 and a memory 402, and the memory 402 stores a program or instruction that can be run on the processor 401.
  • the program or instruction is executed by the processor 401, the various process steps of the above-mentioned shooting method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
  • the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.
  • FIG16 is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.
  • the electronic device 500 includes, but is not limited to, components such as a radio frequency unit 501, a network module 502, an audio output unit 503, an input unit 504, a sensor 505, a display unit 506, a user input unit 507, an interface unit 508, a memory 509, and a processor 510. Furthermore, the electronic device 500 also includes a camera module 100. It should be noted that the functions and connections of the various modules in the camera module 100 can be found in the above description and will not be further elaborated here.
  • the electronic device 500 may further include a power source (e.g., a battery) to power various components.
  • the power source may be logically connected to the processor 510 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption.
  • the electronic device structure shown in FIG13 does not limit the electronic device.
  • the electronic device may include more or fewer components than shown, or may combine certain components, or have different component arrangements, which will not be described in detail here.
  • the processor 510 is used to control the feedback circuit of the camera module 100 to obtain the first image data collected by the image sensor in the camera module 100 in the first photosensitive area; it is also used to control the feedback circuit in the camera module 100 to obtain a first feedback signal based on the first image data; it is also used to control the dimming component in the camera module 100 to adjust the reflectivity of the first dimming area corresponding to the first photosensitive area in the dimming component based on the first feedback signal; and it is also used to control the image sensor to collect second image data.
  • An embodiment of the present application provides an electronic device 500, which includes the camera module 100 of the above embodiment. Because the image sensor of the camera module 100 can capture image data of the environment in which the camera module is located, a feedback circuit can generate a feedback signal based on the image data captured by a first photosensitive area in the image sensor and transmit the feedback signal to a dimming component. The dimming component can adjust the reflectivity of a first dimming area in the dimming component corresponding to the first photosensitive area based on the feedback signal, thereby enabling the electronic device 500 to achieve high dynamic range imaging requirements and improve the imaging quality of the electronic device 500.
  • the processor 510 is specifically used to determine the average brightness value of the first photosensitive area based on the first image data; generate a first digital signal based on the average brightness value and the first functional relationship; and obtain a first feedback signal based on the first digital signal.
  • the processor 510 is specifically used to determine the average brightness value of the first photosensitive area based on the image data; based on the average brightness value and the first functional relationship, determine the first voltage value and generate a feedback signal; the first functional relationship is used to characterize the mapping relationship between the brightness values of different photosensitive areas of the image sensor and the voltage values that need to be applied to the corresponding dimming areas.
  • the input unit 504 may include a graphics processing unit (GPU) 5041 and a microphone 5042, and the graphics processor 5041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode.
  • the display unit 506 may include a display panel 5061, which may be configured in the form of a liquid crystal display, an organic light emitting diode, etc.
  • the user input unit 507 includes a touch panel 5071 and at least one of other input devices 5072.
  • the touch panel 5071 is also called a touch screen.
  • the touch panel 5071 may include two parts: a touch detection device and a touch controller.
  • Other input devices 5072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be described in detail here.
  • the memory 509 can be used to store software programs and various data.
  • the memory 509 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data.
  • the first storage area may store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.).
  • the memory 509 may include a volatile memory or a non-volatile memory, or the memory 509 may include both volatile and non-volatile memory.
  • the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory.
  • the volatile memory may be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM RAM (DRRAM).
  • the memory 509 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.
  • Processor 510 may include one or more processing units.
  • processor 510 integrates an application processor and a modem processor.
  • the application processor primarily handles operations related to the operating system, user interface, and application programs, while the modem processor primarily processes wireless communication signals, such as a baseband processor. It is understood that the modem processor may not be integrated into processor 510.
  • An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored.
  • a program or instruction is stored.
  • the various processes of the above-mentioned focusing method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
  • the processor is the processor in the electronic device described in the above embodiment.
  • the readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
  • An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned focusing method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
  • the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
  • An embodiment of the present application provides a computer program product, which is stored in a storage medium.
  • the program product is executed by at least one processor to implement the various processes of the above-mentioned focusing method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
  • the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), including a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.
  • a storage medium such as ROM/RAM, magnetic disk, optical disk

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

本申请公开了一种摄像头模组、电子设备、拍摄方法、装置及可读存储介质，属于摄像技术领域。该摄像头模组包括第一透镜组件、全反射镜、调光组件、图像传感器以及反馈电路，第一透镜组件、全反射镜和调光组件依次设置，图像传感器与全反射镜相对设置；图像传感器包括至少一个感光区域，调光组件包括至少一个调光区域，一个感光区域与一个调光区域对应；反馈电路分别与图像传感器和调光组件连接；反馈电路，用于基于图像传感器中第一感光区域采集的图像数据得到反馈信号，并传输至调光组件；调光组件，用于基于反馈信号调节调光组件中与第一感光区域对应的第一调光区域的反射率。

Description

摄像头模组、电子设备、拍摄方法及装置
相关申请的交叉引用
本申请主张在2024年04月17日在中国提交申请号为202410464340.3的中国专利的优先权，其全部内容通过引用包含于此。
技术领域
本申请属于摄像技术领域，具体涉及一种摄像头模组、电子设备、拍摄方法及装置。
背景技术
通常，摄像设备在同一场景中对高亮区域和昏暗区域的成像表现是存在局限的，高亮区域可能因为曝光过度，成像后呈现白色，昏暗区域可能因为曝光不足，成像后呈现黑色，这种局限就是动态范围不足，这会影响成像后的图像质量。高动态范围成像(High Dynamic Range Imaging，HDR)技术是一种可以实现更大的动态范围的成像技术。
传统设备为了实现高动态范围成像，通常采用多重曝光HDR技术，即通过不同曝光策略拍摄多帧图像，然后将多帧图像融合为一张高动态图像，因为融合后的高动态图像曝光自然，因此可以避免图像中的高亮区域过度曝光，避免图像中的昏暗区域曝光不足，从而可以实现高动态范围成像的要求。但是，由于采用多重曝光HDR技术拍摄图像时存在时间差，因此导致多帧图像融合形成的高动态图像中，可能会存在运动模糊的问题，影响摄像设备的成像质量。
发明内容
本申请旨在提供一种摄像头模组、电子设备、拍摄方法及装置，以解决相关技术中采用多重曝光HDR技术拍摄图像时存在时间差，导致通过不同曝光策略拍摄的多帧图像融合形成的高动态图像中，存在运动模糊的问题。
为了解决上述技术问题，本申请是这样实现的：
第一方面，本申请实施例提出了一种摄像头模组，包括第一透镜组件、全反射镜、调光组件、图像传感器以及反馈电路，第一透镜组件、全反射镜和调光组件依次设置，图像传感器与全反射镜相对设置；入射光线经第一透镜组件汇聚后镜全反射镜进入调光组件，调光组件将入射光线调制后反射至全反射镜，全反射镜将入射光线反射至图像传感器；图像传感器包括至少一个感光区域，调光组件包括至少一个调光区域，一个感光区域与一个调光区域对应；反馈电路分别与图像传感器和调光组件连接；反馈电路，用于基于图像传感器中第一感光区域采集的图像数据得到反馈信号，并传输至调光组件；调光组件，用于基于反馈信号调节调光组件中与第一感光区域对应的第一调光区域的反射率。
第二方面，本申请实施例提出了一种电子设备，包括如第一方面所述的摄像头模组。
第三方面，本申请实施例提出了一种图像处理方法，由电子设备执行，该电子设备包括如第一方面所述的摄像头模组，该方法包括：控制摄像头模组的反馈电路获取摄像头模组中图像传感器在第一感光区域采集的第一图像数据；控制摄像头模组中的反馈电路基于所述第一图像数据，得到第一反馈信号；控制摄像头模组中的调光组件基于第一反馈信号调节调光组件中与第一感光区域对应的第一调光区域的反射率；控制图像传感器采集第二图像数据。
第四方面，本申请实施例提出了一种图像处理装置，包括如第一方面所述的摄像头模组；该图像处理装置还包括：处理模块，用于控制所述摄像头模组的反馈电路获取所述摄像头模组中图像传感器在第一感光区域采集的第一图像数据；处理模块，还用于控制所述摄像头模组中的反馈电路基于所述第一图像数据，得到第一反馈信号；处理模块，还用于控制所述摄像头模组中的调光组件基于所述第一反馈信号调节所述调光组件中与所述第一感光区域对应的第一调光区域的反射率；处理模块，还用于控制所述图像传感器采集第二图像数据。
第五方面，本申请实施例提供了一种电子设备，该电子设备包括处理器和存储器，所述存储器存储可在所述处理器上运行的程序或指令，所述程序或指令被所述处理器执行时实现如第三方面所述的方法的步骤。
第六方面，本申请实施例提供了一种可读存储介质，所述可读存储介质上存储程序或指令，所述程序或指令被处理器执行时实现如第三方面所述的方法的步骤。
第七方面，本申请实施例提供了一种芯片，所述芯片包括处理器和通信接口，所述通信接口和所述处理器耦合，所述处理器用于运行程序或指令，实现如第三方面所述的方法的步骤。
第八方面，本申请实施例提供一种计算机程序产品，该程序产品被存储在存储介质中，该程序产品被至少一个处理器执行以实现如第三方面所述的方法的步骤。
在本申请的实施例中，由于图像传感器可以采集摄像头模组所处环境的图像数据，反馈电路可以基于图像传感器中第一感光区域采集的图像数据得到反馈信号；调光组件可以基于反馈信号调节调光组件中与第一感光区域对应的第一调光区域的反射率。因此反馈电路可以基于第一感光区域的亮度值得到反馈信号并传输至调光组件，调光组件可以基于反馈信号减小或增强第一调光区域的反射率，从而改变经由第一调光区域反射的光线的强度，使得光线经过调光组件的第一调光区域反射至全反射镜，再经全反射镜反射至图像传感器的第一感光区域后，图像传感器能够得到曝光正常的图像，从而可以避免第一感光区域由于光线强度过高而造成过度曝光，进而可以实现高动态范围成像的要求，提高摄像头模组的成像质量。并且，采用本申请上述摄像头模组时，由于无需采用多重曝光HDR技术进行成像，因此使得摄像头模组拍摄图像时无需将多帧图像融合为一张图像，从而避免了多帧图像存在时间差而导致合成的图像存在运动模糊的问题，进而提高摄像头模组的成像质量。
附图说明
本申请的上述和/或附加的方面和优点从结合下面附图对实施例的描述中将变得明显和容易理解，其中：
图1是本申请实施例的摄像头模组的示意图一；
图2是本申请实施例的像素阵列和调光阵列的示意图；
图3是本申请实施例的调光单元的示意图一；
图4是本申请实施例的调光单元的示意图二；
图5是本申请实施例的摄像头模组的示意图二；
图6是本申请实施例的摄像头模组的示意图三；
图7是本申请实施例的图像处理方法的示意图一；
图8是本申请实施例的图像处理方法的示意图二；
图9是本申请实施例的第一函数关系的示意图
图10是本申请实施例的图像处理方法的示意图三；
图11是本申请实施例的采用棋盘格投影法标定时图像传感器上的像素阵列和调光组件上的调光阵列的示意图；
图12是本申请实施例的编码模块编码形成的数据的示意图；
图13是本申请实施例的图像处理方法的示意图四；
图14是本申请实施例的图像处理装置的示意图；
图15是本申请实施例的电子设备的硬件结构示意图之一；
图16是本申请实施例的电子设备的硬件结构示意图之二。
具体实施方式
下面将详细描述本申请的实施例，所述实施例的示例在附图中示出，其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的，仅用于解释本申请，而不能理解为对本申请的限制。基于本申请中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。
本申请的说明书中的术语“第一”、“第二”、“第三”、“第四”的特征可以明示或者隐含地包括一个或者更多个该特征。在本申请的描述中，除非另有说明，“多个”的含义是两个或两个以上。此外，说明书中“和/或”表示所连接对象的至少其中之一，字符“/”，一般表示前后关联对象是一种“或”的关系。
在本申请的描述中，需要理解的是，术语“中心”、“轴向”、“径向”、“周向”、“上”、“内”、“外”、“长”、“短”、“两侧”、“之间”等指示的方位或位置关系为基于附图所示的方位或位置关系，仅是为了便于描述本申请和简化描述，而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作，因此不能理解为对本申请的限制。
在本申请的描述中，需要说明的是，除非另有明确的规定和限定，术语“相连”、“连接”应做广义理解，例如，可以是固定连接，也可以是可拆卸连接，或一体地连接；可以是机械连接，也可以是电连接；可以是直接相连，也可以通过中间媒介间接相连，可以是两个元件内部的连通。对于本领域的普通技术人员而言，可以具体情况理解上述术语在本申请中的具体含义。
以下将对本申请实施例涉及的术语进行说明。
1、摄像头模组
摄像头模组(Camera Compact Module,CCM)是获取视觉信息的重要工具，通常由镜头(Lens)、红外截止滤光片(IR Cut Filter)、图像传感器(Image Sensor)和音圈马达(Voice Coil Motor,VCM)构成。
CCM的工作流程如下：首先，音圈马达带动镜头实现对焦，将携带视觉信息的光线经由镜头聚焦，并经红外截止滤光片滤除人眼不可见的红外波段，成像到图像传感器。其次，图像传感器中的感光二极管将光信号转换成电信号，通过放大和模数转换形成数字信号矩阵，即RAW图像。最后，经过图像信号处理(Image Signal Process，ISP)模块处理后压缩存储在内存中。其中，RAW图像是图像传感器将捕捉到的光源信号转化为数字信号的原始数据。
2、图像传感器
图像传感器是一种将光学影像转换成电子信号的设备，是摄像头模组的核心器件。如今，图像传感器主要分为电荷耦合(Charge coupled device,CCD)元件和互补金属氧化物半导体(Complementary Metal Oxide Semiconductor,CMOS)器件。图像传感器的核心作用是感光，即将探测的光信号转换成便于传输和处理的数字信号。
3、互补式金属氧化物半导体图像传感器
互补式金属氧化物半导体图像传感器(CMOS Image Sensor,CIS)是一类利用CMOS半导体的图像传感器。相较于CCD图像传感器，CMOS图像传感器的成本和功耗较低，读取方式更为灵活。CIS的工作机制如下：通过阵列排列的感光二极管，感知光信号并转换成电信号，通过放大电路和模数转换(Analog-to-Digital Conversion,ADC)电路，形成数字信号矩阵，即图像，再经过ISP模块处理形成图像数据，并将该图像数据压缩存储起来。
4、镜头
镜头(Lens)是摄像头模组中的另一个核心器件，其作用是将视场内的光线汇聚成像平面，它的光学素质直接影响到成像质量。从信息传输的角度来看，镜头的设计水平决定了到达像面的高频信息的传输情况，从而直接影响该模组的成像清晰度；而从能量传输的角度来看，镜头结构和透过率决定了到达CIS的光照强弱和分布情况，从而直接影响到CIS的信噪比表现。
5、动态范围
动态范围(Dynamic range,DR)是指图像传感器获取的一副图像中能够同时体现高光部分和阴影部分内容的能力，公式为：DR＝20*log(Imax/Imin)，其中，Imax是指图像传感器的最大不饱和电流，即，图像传感器刚刚饱和时候的电流，Imin是指图像传感器的底电流(blacklevel)。高动态范围成像(High Dynamic Range Imaging，HDR)技术是一种可以实现更大的动态范围的成像技术。
并且，动态范围还被定位为图像传感器的满阱容量(Full well capacity,FWC)和本底噪声之间的比值。满阱容量是指图像传感器的光电二极管的电容能够积累的最大电荷量。本底噪声又名读出噪声，其定义是读出电路产生的噪声，它不包括检测器中产生的噪声。在CMOS图像传感器中，读出电路包括像素内部的放大器。因此，通过增大满阱容量或者减小本底噪声能够提高图像传感器的动态范围，使图像传感器可以实现高动态范围成像的成像要求。可以理解的是，当图像传感器的动态范围较小时，通过图像传感器获取的图像会出现高亮区域或昏暗区域，高亮区域会由于曝光过度导致该区域亮度过大，昏暗区域会由于曝光不足导致细节丢失，影响图像传感器采集的图像的质量。
6、硅基液晶芯片
硅基液晶芯片(Liquid Crystal on Silicon,LCoS)是一种结合了液晶和硅芯片技术的光学元件。它可以将电信号通过微小的互连引线输入到半导体芯片上，驱动液晶阵列变换像素状态，从而改变反射光的强弱。
近年来，摄像头模组作为获取视觉信息、进行艺术创作的重要工具，成为了智能手机、平板电脑等终端设备的标配模块。由于移动终端具有携带方便和算力强大的优势，使得消费者对移动终端的成像质量和拍摄功能的要求越来越高。其中，移动终端对摄像头模组的动态范围的要求越来越高，但是，由于移动终端的内部空间受限，使得移动终端中摄像头模组的图像传感器的尺寸难以进一步增大，CIS的满阱容量受到极大限制，导致摄像头模组无法实现高动态范围成像的要求，影响摄像头模组的成像质量。因此，如何进一步提升摄像头模组的动态范围已经成为本领域技术人员亟待解决的问题。
通常，摄像设备在同一场景中对高亮区域和昏暗区域的成像表现是存在局限的，高亮区域可能因为曝光过度，成像后呈现白色，昏暗区域可能因为曝光不足，成像后呈现黑色，这种局限就是动态范围不足导致的。
传统设备为了实现高动态范围成像，通常采用多重曝光HDR技术，即通过不同曝光策略拍摄多帧图像，然后将多帧图像融合为一张高动态图像，因为融合后的高动态图像曝光正常，因此可以避免图像中的高亮区域过度曝光，昏暗区域曝光不足，从而可以实现高动态范围成像的要求。但是，由于采用多重曝光HDR技术拍摄图像时存在时间差，因此导致多帧图像融合形成的高动态图像中，可能会存在运动模糊的问题，影响摄像设备的成像质量。
另外，传统设备为了实现高动态范围成像，还可以采用基于双转换增益(Dual Conversion Gain，DCG)和数字重叠读出(Digital Overlap，DOL)等HDR技术，双转换增益技术是一种增加两个具有不同放大功率的光电转换放大电路的技术，数字重叠技术是一种对不同曝光时间的图像进行重叠读出，并进行融合的技术。采用上述技术可以实现高动态范围成像的要求，但是上述技术增加了图像传感器电路设计的复杂程度和制造成本。
本申请实施例为了解决上述问题，采用了一种摄像头模组，该摄像头模组包括第一透镜组件、全反射镜、调光组件、图像传感器以及反馈电路，第一透镜组件、全反射镜和调光组件依次设置，图像传感器与全反射镜相对设置；入射光线经第一透镜组件汇聚后经全反射镜进入调光组件后，调光组件将入射光线调制后反射至全反射镜，全反射镜将入射光线反射至图像传感器；图像传感器包括至少一个感光区域，调光组件包括至少一个调光区域，一个感光区域与一个调光区域对应；反馈电路分别与图像传感器和调光组件连接；反馈电路，用于基于图像传感器中第一感光区域采集的图像数据得到反馈信号，并传输至调光组件；调光组件，用于基于反馈信号调节调光组件中与第一感光区域对应的第一调光区域的反射率。
由于图像传感器可以采集摄像头模组所处环境的图像数据，反馈电路可以基于图像传感器中第一感光区域采集的图像数据得到反馈信号；调光组件可以基于反馈信号调节调光组件中与第一感光区域对应的第一调光区域的反射率。因此反馈电路可以基于第一感光区域的亮度值得到反馈信号并传输至调光组件，调光组件可以基于反馈信号减小或增强第一调光区域的反射率，从而改变经由第一调光区域反射的光线的强度，使得光线经过调光组件的第一调光区域反射至全反射镜，再经全反射镜反射至图像传感器的第一感光区域后，图像传感器能够得到曝光正常的图像，从而可以避免第一感光区域由于光线强度过高而造成过度曝光，进而可以实现高动态范围成像的要求，提高摄像头模组的成像质量。并且，采用本申请上述摄像头模组时，由于无需采用多重曝光HDR技术进行成像，因此使得摄像头模组拍摄图像时无需将多帧图像融合为一张图像，从而避免了多帧图像存在时间差而导致融合的图像存在运动模糊的问题，进而提高摄像头模组的成像质量。并且，本申请图像传感器的电路结构简单，制造成本较低。同时本申请摄像头模组可以可搭配不同型号的图像传感器使用，在主摄、长焦、广角、前置等模组上均可以实现高动态范围功能，可以实现全场景的HDR的拍照和录像功能，有利于聚量复用进而降低成本。
下面结合附图，通过具体的实施例及其应用场景对本申请实施例提供的摄像头模组100进行详细地说明。图1至图6示出了本申请实施例提供的一种摄像头模组100可能的结构示意图。
如图1所示，该摄像头模组100包括第一透镜组件1、全反射镜2、调光组件3、图像传感器4以及反馈电路5，第一透镜组件1、全反射镜2和调光组件3依次设置，图像传感器4与全反射镜2相对设置；入射光线经第一透镜组件1汇聚后经全反射镜2进入调光组件3后，调光组件3将入射光线调制后反射至全反射镜2，全反射镜2将入射光线反射至图像传感器4；图像传感器4包括至少一个感光区域41，调光组件3包括至少一个调光区域31，一个感光区域41与一个调光区域31对应；反馈电路5分别与图像传感器4和调光组件3连接；反馈电路5，用于基于图像传感器4中第一感光区域采集的图像数据得到反馈信号，并传输至调光组件3；调光组件3，用于基于反馈信号调节调光组件3中与第一感光区域对应的第一调光区域的反射率。
在本申请的一些实施例中，第一透镜组件1由多片非球面透镜组成，其可以等效为一个凸透镜，具有汇聚入射光线的作用，，便于光线经过第一透镜组件1和全反射镜2汇聚至调光组件3上。
在本申请的一些实施例中，光线经过第一透镜组件1和全反射镜2后可以实现第一次成像，即，可以生成中间像面。调光组件3可以设置于中间像面的位置。
在本申请的一些实施例中，全反射镜2又叫内全反射棱镜，是一种基于全反射原理制造的棱镜。本申请实施例中全反射镜2的作用是对经调光组件3调制后的光线进行全反射，使得全反射后的光线进入图像传感器4，避免光线反射时发生损耗，实现光线的无损传输。
在本申请的一些实施例中，通过控制经由全反射镜2反射的入射光线的入射角和出射光线的出射角之间的比例关系，可以确保经调光组件3调制后的光线经过全反射镜2时，能够全部反射至图像传感器4，避免光线反射时发生损耗。其中，由全反射原理及公式sinC＝1/n，C为全反射角，n为棱镜的折射率，可知，通过控制经由全反射镜2反射的入射光线的入射角大于全反射角C，可以保证经调光组件3调制后的光线经过全反射镜2时，能够全部反射至图像传感器4。
在本申请的一些实施例中，如图1所示，全反射镜2包括相对设置的第一镜体21和第二镜体22，第一镜体21与第一透镜组件1相对设置，第二镜体22具有反射面；经由第一透镜组件1的入射光线，依次经过第一镜体21和第二镜体22透射至调光组件3，经调光组件3调制后反射至第二镜体22的反射面，再经反射面反射至图像传感器4。
可以理解的是，当入射光线经第一透镜组件1透射至第一镜体21时，第一镜体21可以对光线起到矫正和汇聚作用，避免入射光线的传输方向发生偏差。当入射光线经调光组件3调制后反射至第二镜体22的反射面时，入射光线可以实现全反射并反射至图像传感器4，使得图像传感器4可以采集到摄像头模组100所处环境的光线信息，实现光线的无损传输。
在本申请的一些实施例中，第一镜体21上可以镀设透射膜，以提高第一镜体21的透射率，减少入射光线经由第一镜体21传输时的损耗。
在本申请的一些实施例中，摄像头模组100还包括驱动装置，驱动装置用于驱动调光组件3运动，以调节调光组件3的出射面与第一透镜组件1的光轴之间的夹角。
可以理解的是，通过驱动装置驱动调光组件3运动，以调节调光组件3的出射面与第一透镜组件1的光轴之间的夹角，从而可以调节经由全反射镜2反射的入射光线的入射角，使得经调光组件3调制后的入射光线从调光组件3的出射面射出并照射至第二镜体22的反射面时，可以确保经由全反射镜2反射的入射光线的入射角大于全反射角，进而保证经调光组件3调制后的光线经过全反射镜2时，能够全部反射至图像传感器4，实现光线的无损传输。
在本申请的一些实施例中，驱动装置可以为线性致动器，例如齿轮齿条机构，丝杆螺母机构等；驱动装置还可以为旋转机构等。本申请实施例在此处不作限定。
在本申请的一些实施例中，驱动装置可以驱动调光组件3在垂直于第一透镜组件1光轴的方向上的一侧相对于另一侧运动，以调节调光组件3的倾斜角度，进而调节调光组件3的出射面与第一透镜组件1的光轴之间的夹角，即，调节调光组件3的出射面和第二镜体22的反射面之间的夹角。
在本申请的一些实施例中，调光组件3包括两个或两个以上调光区域31，不同的调光区域31可以分别调节不同入射角度的入射光线。
在本申请的一些实施例中，图像传感器4包括两个或两个以上感光区域41，一个感光区域41与一个调光区域31对应，不同的调光区域31可以单独调节与其对应的感光区域41的亮度值，从而使调光组件3能够精确调节图像传感器4采集的图像中单个像素点的亮度值，避免图像中的部分区域光线强度过大造成曝光过度，进而实现高动态范围成像的要求，提高摄像头模组100的成像质量。
在本申请的一些实施例中，图像传感器4中第一感光区域采集的图像数据可以为第一感光区域的亮度值、位置信息等。
在本申请的一些实施例中，如图2所示，图像传感器4包括像素阵列，像素阵列包括至少一个像素单元8；调光组件3包括调光阵列，调光阵列包括至少一个调光单元9；像素阵列中的每个像素单元8与调光阵列中的一个调光单元9对应。
可以理解的是，反馈电路5可以基于图像传感器4中目标像素单元8采集的图像数据生成反馈信号，并传输至调光组件3；调光组件3可以基于反馈信号调节调光组件3中目标调光单元9的反射率，从而可以调节经由该目标调光单元9反射的光线的强度，进而使经由该目标调光单元9反射的光线，通过全反射镜2反射进入目标像素单元8时，可以避免光线强度过大造成过度曝光，从而使调光组件3能够精确调节图像传感器4采集的图像中单个像素点的亮度值，进而使摄像头模组100可以实现高动态范围的要求。
在本申请的一些实施例中，像素阵列中的每个像素单元8与调光阵列中的一个调光单元9对应是指，像素阵列中的目标像素单元8与调光阵列中目标调光单元9对应，即入射光线经目标调光单元9反射至全反射镜2后，通过全反射镜2反射进入图像传感器4的目标像素单元8。
在本申请的一些实施例中，调光阵列包括两个或两个以上调光单元9，不同的调光单元9可以分别调节不同入射角度的光线。
在本申请的一些实施例中，图像传感器4包括两个或两个以上像素单元8，一个像素单元8与一个调光单元9对应，不同的调光单元9可以单独调节与其对应的像素单元8的亮度值，从而使调光组件3能够精确调节图像传感器4采集的图像中单个像素点的亮度值，避免图像中的部分区域光线强度过大造成曝光过度，进而实现高动态范围成像的要求，提高摄像头模组100的成像质量。
在本申请的实施例中，由于图像传感器4可以采集摄像头模组100所处环境的图像数据，反馈电路5可以基于图像传感器4中第一感光区域采集的图像数据得到反馈信号，并传输至调光组件3；调光组件3可以基于反馈信号调节调光组件3中与第一感光区域对应的第一调光区域的反射率。因此反馈电路5可以基于第一感光区域的亮度值得到反馈信号并传输至调光组件3，调光组件3可以基于反馈信号减小或增强第一调光区域的反射率，从而改变经由第一调光区域反射的光线的强度，使得光线经过调光组件3的第一调光区域反射至全反射镜2，再经全反射镜2反射至图像传感器4的第一感光区域后，图像传感器4能够得到曝光正常的图像，从而可以避免第一感光区域由于光线强度过高而造成过度曝光，进而可以实现高动态范围成像的要求，提高摄像头模组100的成像质量。并且，采用本申请上述摄像头模组100时，由于无需采用多重曝光HDR技术进行成像，因此使得摄像头模组100拍摄图像时无需将多帧图像融合为一张图像，从而避免了多帧图像存在时间差而导致合成的图像存在运动模糊的问题，进而提高摄像头模组100的成像质量。并且，本申请图像传感器4的电路结构简单，制造成本较低。同时本申请摄像头模组100可以可搭配不同型号的图像传感器4使用，在主摄、长焦、广角、前置等模组上均可以实现高动态范围功能，可以实现全场景的HDR的拍照和录像功能，有利于聚量复用进而降低成本。
在本申请的一些实施例中，当第一感光区域为高亮区域时，第一感光区域的亮度值较大，反馈电路5可以基于第一感光区域的亮度值生成反馈信号并传输至调光组件3，调光组件3可以基于反馈信号减小第一调光区域的反射率，从而改变经由第一调光区域反射的光线的强度，使得入射光线经过调光组件3的第一调光区域反射至全反射镜2，再经全反射镜2反射至图像传感器4的第一感光区域后，第一感光区域的亮度值对应降低，使得图像传感器4能够得到曝光正常的图像，避免第一感光区域为高亮区域时由于光线强度过高而造成过度曝光。
一种可能的示例中，如图3所示，调光单元9包括第一偏振件91、第二偏振件92和液晶模块93，液晶模块93包括微透镜931、电极层932、液晶层933、反射层934、电路层935和基板936；反馈信号包括第一电压信号；反馈电路5，具体用于为第一调光单元9的电极层932和电路层935之间施加第一电压信号，以调节第一调光单元9的反射率，第一调光单元9为第二区域中的调光单元9；进入调光组件3的入射光线，依次经过第一偏振件91、微透镜931和液晶层933透射至反射层934，经反射层934反射后依次经过液晶层933、微透镜931和第二偏振件92射出。
可以理解的是，反馈电路5通过为第一调光单元9的电极层932和电路层935之间施加第一电压信号，可以通过控制电极层932和电路层935之间的电压，以控制液晶层933内液晶分子的偏转，进而调节第一调光单元9的反射率。通过第一偏振件91、液晶层933和第二偏振件92可以调制光线的偏振态，进而调制光线的振幅，使得入射光线经过调光组件3时，调光组件3可以通过调制光线的振幅以调节入射光线的强度，避免入射光线的强度过大造成过度曝光，从而使摄像头模组100可以实现高动态范围成像的要求。同时，由于微透镜931具备良好的聚光能力，使得微透镜931可以汇聚更多的光线，进一步减少光线的损耗，提高摄像头模组100的成像质量。
在本申请的一些实施例中，基板936可以为印刷电路板(printed circuit board，PCB)。
在本申请的一些实施例中，电极层932可以为透明电极。如此，能够保证光线可以穿过电极层932进行传输，避免电极层932阻碍光线的传输。
在本申请的一些实施例中，电路层935可以为硅基电路层。
另一种可能的示例中，如图4所示，调光单元9包括第一偏振件91、第二偏振件92和液晶模块93，液晶模块93包括玻璃盖板937、电极层932、液晶层933、反射层934、电路层935和基板936；反馈信号包括第一电压信号；反馈电路5，具体用于为第一调光单元9的电极层932和电路层935之间施加第一电压信号，以调节第一调光单元9的反射率，第一调光单元9为第二区域中的调光单元9；进入调光组件3的入射光线，依次经过第一偏振件91、玻璃盖板937和液晶层933透射至反射层934，经反射层934反射后依次经过液晶层933、玻璃盖板937和第二偏振件92射出。
一种可能的示例中，电极层932设置于液晶层933的边缘位置。
可以理解的是，当电极层932设置于液晶层933的边缘位置时，由于靠近液晶层933的中间位置未设置电极层932，使得入射光线经过微透镜931进入液晶层933时，可以不经过电极层932，从而可以避免光线穿过透明电极时发生光能损耗，进而可以进一步减少光线经过调光组件3时的损耗，提高摄像头模组100的成像质量。同时，电极层932和电路层935之间可以形成驱动液晶层933内液晶分子运动的驱动电压，使得调光组件3可以通过调节电极层932和电路层935之间电压值的方式，调节调光组件3的反射率。
在本申请的一些实施例中，电极层932可以为环形电极，液晶层933的边缘位置可以开设环形槽，环形电极嵌套于环形槽内。
另一种可能的示例中，电极层932覆盖于所述液晶层933上。
可以理解的是，当电极层932覆盖于所述液晶层933上时，电极层932和电路层935之间可以形成驱动液晶层933内液晶分子运动的驱动电压，使得调光组件3可以通过调节电极层932和电路层935之间电压值的方式，调节调光组件3的反射率。
在本申请的一些实施例中，反射层934为高反射涂层。
可以理解的是，高反射涂层为一种具有高反射率的涂层结构，当反射层934为高反射涂层时，能够提高反射层934的反射率，避免在反射过程中造成光能损失，从而进一步减少光线经过调光组件3时的损耗，提高摄像头模组100的成像质量。
在本申请的一些实施例中，调光组件3为硅基液晶LCoS芯片、空间光调制器、微反射镜阵列中的一个。
在本申请的一些实施例中，LCoS芯片是一种硅基液晶芯片，该芯片具有液晶层933，通过该芯片的液晶层933能够调控光线的振幅，进而调节光线的强度，使得调光组件3可以调节入射光线的强度，避免入射光线的强度过大造成过度曝光，从而使摄像头模组100可以实现高动态范围成像的要求。
在本申请的一些实施例中，空间光调制器是一种对光波的空间分布进行调制的器件，在电驱动信号的控制下，改变空间上光分布的振幅或强度、相位、偏振态等。空间光调制器是实时光学信息处理，自适应光学和光计算等现代光学领域的关键器件。如此，通过空间光调制器能够调控光线的振幅，进而调节光线的强度，使得调光组件3可以调节入射光线的强度，避免入射光线的强度过大造成过度曝光，从而使摄像头模组100可以实现高动态范围成像的要求。
在本申请的一些实施例中，微反射镜阵列又叫数字微镜器件(Digital Micromirror Devices，DMD)，该微反射镜阵列包括多个呈阵列分布的反射镜单元，每个反射镜单元包括反射镜和驱动反射镜偏转的机械结构，通过机械结构控制反射镜的偏转角度，可以控制经反射镜反射的光线的传输方向，进而可以控制反射至全反射镜2的光束数量，从而调节反射镜单元的反射率，使得调光组件3可以调节入射光线的强度，避免入射光线的强度过大造成过度曝光，从而使摄像头模组100可以实现高动态范围成像的要求。
在本申请的一些实施例中，如图1所示，摄像头模组100还包括第二透镜组件7，第二透镜组件7设置于全反射镜2和图像传感器4之间；经全反射镜2反射后的入射光线，经第二透镜组件7汇聚并透射至图像传感器4。
可以理解的是，通过第二透镜组件7汇聚光线，可以使经全反射镜2反射后的入射光线穿过第二透镜组件7时，能够汇聚至图像传感器4上进行成像，提高图像传感器4的成像质量。同时，第二透镜组件7可以补偿第一透镜组的像差，提升成像系统的解析力。例如，当第一透镜组件1的某一项像差(如彗差、像散等)为+A时，可以通过改变第二透镜组件7的曲率、厚度、透镜间隔等变量，使其产生－A的像差，从而通过第一透镜组件1和第二透镜组件7相互叠加能够实现对像差的补偿。另外，第二透镜组件7还可以实现主光角(chief ray angle，CRA)匹配。例如，通过改变第二透镜组的曲率分布，实现对主光线入射角度的控制，使其满足图像传感器4的主光角匹配要求，避免主光角不匹配时导致图像传感器4的像素单元8之间发生串扰，产生偏色等现象。
在本申请的一些实施例中，摄像头模组100还包括红外截止滤光片6，红外截止滤光片6设置于第二透镜组件7和图像传感器4之间，经第二透镜组件7透射的入射光线，经红外截止滤光片6过滤后进入图像传感器4。如此，红外截止滤光片6可以滤除人眼不可见的红外波段，提高摄像头模组100的成像效果。
在本申请的一些实施例中，如图5所示，反馈电路5包括计算模块51，计算模块51用于基于图像传感器4中第一感光区域采集的图像数据，计算得到反馈信号的反馈值。
在本申请的一些实施例中，如图6所示，计算模块51可以包括时钟电路、计数器、反馈信号映射单元、矩阵乘法计算单元以及存储器(EEPROM)。计算模块51的计算过程可以为：首先，通过图像传感器4的模数转换器读出的第一感光区域的电信号，并将电信号传输至反馈信号映射单元，反馈信号映射单元根据映射关系计算得出反馈信号的反馈值。其次，在图像传感器4的列模数转换器读取的第一感光区域的过程中，时钟电路获取时钟信号，计数器根据时钟信号获取第一感光区域的位置信息，并将该位置信息传输给矩阵乘法计算单元，矩阵乘法计算单元可以根据设定的求解矩阵得出第一调光区域的位置信息，即坐标信息。反馈信号的反馈值和第一调光区域的位置信息可以存储至存储器中。
在本申请的一些实施例中，如图5所示，反馈电路5还可以包括编码模块52，编码模块52与计算模块51连接，编码模块52可以对计算模块51计算得出的反馈信号的反馈值和第一调光区域的位置信息压缩为若干个字节进行编码，得到编码数据。
在本申请的一些实施例中，如图5所示，反馈电路5还可以包括译码模块53，译码模块53可以对编码模块52生成的编码数据进行译码，得到译码数据。该译码数据包括计算模块51计算得出的反馈信号的反馈值和第一调光区域的位置信息。
在本申请的一些实施例中，反馈电路5还可以包括传输线，传输线用于将编码数据传输至译码模块53。例如，编码模块52和译码模块53之间可以通过8bit总线进行数据传输。
可以理解的是，通过对计算模块51计算得出的反馈信号的反馈值和第一调光区域的位置信息进行编码和译码处理，可以提升反馈信号的传输速度，实现快速实时反馈。
在本申请的一些实施例中，如图5所示，反馈电路5还可以包括驱动模块54，即，驱动IC，驱动模块54与译码模块53连接，驱动模块54可以基于译码数据得到反馈信号。其中，驱动模块54可以包括行选择器和列选择器。驱动模块54可以接收译码模块53生成的译码数据，并根据译码数据中第一调光区域的位置信息，通过行选择器和列选择器在调光组件3中找到第一调光区域的位置。并根据译码数据中反馈信号的反馈值得到反馈信号，并将反馈信号传输给调光组件3。其中，当调光组件3包括电极层932、液晶层933以及电路层935时，反馈信号为施加于电极层932和电路层935之间的电压信号。
在本申请的一些实施例中，如图6所示，图像传感器4中一个感光区域41的电路可以包括寄生电容FD、复位开关RST、模拟开关TG、电压跟随器SF、行选开关RSL以及光电二极管。复位开关RST的第一端与电压跟随器SF的第一端连接，复位开关RST的第二端与模拟开关TG的第一端连接，模拟开关TG的第二端与光电二极管连接，电压跟随器SF的第二端与行选开关RSL的第一端连接，RSL的第二端接地。电压跟随器SF的第三端连接于复位开关RST的第二端和模拟开关TG的第一端之间，寄生电容FD的第一端连接于电压跟随器SF的第三端和复位开关RST的第二端之间，感光电容FD的第二端接地。如此，当光线照射到光电二极管上后，光电二极管会产生电子空穴对，并且电子空穴对会在光电二极管的电场的作用下分开，即，电子移向二极管的n区，空穴移向二极管的p区，从而能够生成电流并传输至模拟开关TG。模拟开关TG可以控制电流流向寄生电容FD，使得电荷能够存储于寄生电容FD内。复位开关RST可以控制寄生电容FD复位至高电平，便于读出寄生电容FD内的电荷。寄生电容FD内的电荷读出后可以传输至电压跟随器SF，通过电压跟随器SF进行信号放大并传输至行选开关RSL，通过行选开关RSL输出电信号，从而能够实现光信号转换为电信号。
本申请实施例还提供的一种电子设备，该电子设备包括：上述实施例中的摄像头模组100。
本申请实施例提供一种电子设备，该电子设备包括上述实施例中的摄像头模组100。由于该摄像头模组100的图像传感器可以采集摄像头模组所处环境的图像数据，反馈电路可以基于图像传感器中第一感光区域采集的图像数据生成反馈信号，并传输至调光组件；调光组件可以基于反馈信号调节调光组件中与第一感光区域对应的第一调光区域的反射率，使得电子设备可以实现高动态范围成像的要求，提高电子设备的成像质量。
本申请实施例提供的图像处理方法，执行主体可以为摄像头模组，或者图像处理装置，或者电子设备，或者电子设备中的功能模块或实体。其中，该电子设备可以为手机、平板电脑、笔记本电脑、掌上电脑、车载电子设备等设备，该电子设备中包含拍摄头模组。本申请实施例中以图像处理装置执行图像处理方法为例，说明本申请实施例提供的图像处理方法。
图7示出了本申请实施例提供的一种图像处理方法的示意图，如图7所示，本申请实施例提供的图像处理方法可以包括下述的步骤101至步骤104。
步骤101、图像处理装置控制摄像头模组的反馈电路获取摄像头模组中图像传感器在第一感光区域采集的第一图像数据。
在本申请的一些实施例中，光线进入图像传感器并照射到第一感光区域时，第一感光区域可以将光信号转化为电信号，电信号可以通过信号放大电路进行放大，放大后的电信号可以通过模数转换电路转化为数字信号，数字信号可以通过移动行业处理器接口(Mobile Industry Processor Interface，MIPI)传输给图像传感器的处理模块。
在本申请的一些实施例中，上述图像传感器在第一感光区域采集的图像数据可以包括第一感光区域的亮度值和第一位置信息。其中，上述第一位置信息包括第一感光区域行坐标和列坐标。应注意的是，第一感光区域行坐标和列坐标是指上述图像传感器的像素阵列中单个像素单元的坐标。
步骤102、图像处理装置控制摄像头模组中的反馈电路基于所述第一图像数据，得到第一反馈信号；
在本申请的一些实施例中，针对图3和图4所示的调光组件的调光单元的结构，图像处理装置会基于第一感光区域的第一位置信息，生成第一调光区域的第二位置信息，然后，基于第一感光区域的亮度值，生成第二位置信息对应的反馈值。即，图像处理装置传输至调光组件的反馈信号中携带有第一调光区域的第二位置信息和第二位置信息对应的反馈值。
可以理解的是，图像处理装置基于第一感光区域的图像数据，生成反馈信号，并传输至调光组件，使得调光组件可以基于第一感光区域的反馈信号调整第一调光区域的反射率，从而使调光组件可以调整第一感光区域的亮度值，避免第一感光区域曝光过度，进而使图像处理装置可以实现高动态范围成像的要求，提高图像处理装置的成像质量。
在一些实施例中，如图8所示，上述步骤102中的图像处理装置基于图像数据，生成反馈信号，具体可以通过下述的步骤102a至步骤102c实现。
步骤102a、图像处理装置基于第一图像数据确定第一感光区域的平均亮度值。
在本申请的一些实施例中，入射光线进入图像传感器并照射到第一感光区域时，第一感光区域可以将光信号转化为电信号，电信号可以通过信号放大电路进行放大，放大后的电信号可以通过模数转换电路转化为数字信号，此时，图像处理装置可以通过计算该数字信号的平均值，得到平均亮度值。
步骤102b、图像处理装置基于平均亮度值和第一函数关系，生成第一数字信号。
在本申请的一些实施例中，上述第一函数关系可以为线性函数关系，上述第一函数关系用于表征图像传感器的感光区域的信号均值，与反馈信号的反馈值之间的映射关系。即，上述第一函数关系用于表征图像传感器的感光区域的亮度值，与相应调光区域需要施加的电压值之间的映射关系。
在本申请的一些实施例中，图9示出了图像传感器的感光区域的信号均值，与反馈信号的反馈值之间的映射关系的示意图。
步骤102c、图像处理装置基于第一数字信号得到第一反馈信号。
可以理解的是，图像处理装置基于平均亮度值和第一函数关系，确定第一电压值并生成第一数字信号，图像处理装置基于第一数字信号得到第一反馈信号，使得图像处理装置可以基于第一图像数据，得到第一反馈信号。
步骤103、图像处理装置控制摄像头模组中的调光组件基于第一反馈信号调节调光组件中与第一感光区域对应的第一调光区域的反射率；
步骤104、图像处理装置控制图像传感器采集第二图像数据。
可以理解的是，图像处理装置基于平均亮度值和第一函数关系，确定第一电压值并生成第一数字信号，图像处理装置基于第一数字信号得到第一反馈信号，图像处理装置控制摄像头模组中的调光组件基于第一反馈信号调节调光组件中与第一感光区域对应的第一调光区域的反射率，从而使调光组件可以调节经由第一调光区域反射的入射光线的强度，使得入射光线经过调光组件的第一调光区域反射至全反射镜，再经全反射镜反射至图像传感器的第一感光区域后，图像传感器能够得到曝光正常的第二图像数据，可以避免第一感光区域由于光线强度过高而造成过度曝光，实现高动态范围成像的要求，提高摄像头模组的成像质量。
在一些实施例中，如图10所示，本申请实施例提供的图像处理方法可以通过下述的步骤S101至S104实现，以图像处理装置为摄像头模组为例。
S101、摄像头模组对第一感光区域的第一位置信息和第一调光区域的第二位置信息进行模组标定。
在本申请的一些实施例中，对第一感光区域的第一位置信息和第一调光区域的第二位置信息进行模组标定，具体包括：建立第一感光区域的第一位置信息(x，y)和第一调光区域的第二位置信息(u，v)之间的空间映射关系，确定该空间映射关系可以基于下述公式1进行计算：
其中，x为第一感光区域的行坐标，y为第一感光区域列坐标，u为第一调光区域的行坐标，v为第一调光区域的列坐标，T为求解矩阵，t11为求解矩阵T第一行第一列的值，t12为求解矩阵T第一行第二列的值，t13为求解矩阵T第一行第三列的值，t21为求解矩阵T第二行第一列的值，t22为求解矩阵T第二行第二列的值，t23为求解矩阵T第二行第三列的值，t31为求解矩阵T第三行第一列的值，t32为求解矩阵T第三行第二列的值，t33为求解矩阵T第三行第三列的值。
由公式1可知，当第一感光区域的第一位置信息(x，y)以及求解矩阵T为已知量时，可以得到第一感光区域对应的第一调光区域的第二位置信息(u，v)，便于反馈电路根据第二位置信息向第一调光区域传输反馈信号。因此，上述模组标定的关键在于计算求解矩阵T的值。
在本申请的一些实施例中，如图11所示，上述模组标定的方法可以为棋盘格投影法，通过棋盘格投影法可以计算出求解矩阵T的值。
示例性地，棋盘格法是一种采用张正友标定法获取相机的内部参数，利用棋盘格平面在两个坐标系的一致性，建立约束方程组，采用线性方法求解两个坐标系的外部参数初始解，再用非线性优化方法进一步优化的方法。
一般地，采用棋盘格投影法进行标定的具体过程可以为：首先驱动调光组件显示出特定的棋盘格图案，经过第二透镜组间成像后经由图像传感器读出。通过成熟的检测算法计算出角点坐标，进而得到角点之间的映射关系，并基于公式1求解出矩阵T。同时将解出矩阵T的数值烧录到存储器(EEPROM)中，供反馈电路的计算模块使用。
S102、图像传感器感光并进行数据处理。
在本申请的一些实施例中，图像传感器感光后将光信号转换为电信号，电信号可以通过信号放大电路进行放大，放大后的电信号可以通过模数转换电路转化为数字信号，数字信号可以通过移动行业处理器接口(Mobile Industry Processor Interface，MIPI)传输给图像传感器的处理模块，处理模块处理得到图像数据。
S103、摄像头模组的反馈电路基于图像数据，生成反馈信号，并传输至调光组件。
在本申请的一些实施例中，摄像头模组的反馈电路包括计算模块，上述处理模块可以将图像的当前帧的读出数据传输至反馈电路的计算模块，计算模块可以对RAW格式的图像进行分块处理，计算每个像素块(block)的位置坐标(x,y)和信号均值SIG_MEAN，即计算出第一感光区域的第一位置信息(x，y)和平均亮度值。进而，计算模块可以根据上述公式1可以计算出第一感光区域对应的第一调光区域的第二位置信息(u，v)，同时，计算模块可以根据信号均值SIG_MEAN和第一函数关系计算反馈信号SIG_FEEDBACK的大小。第一函数关系用于表征图像传感器的不同感光区域的亮度值，与相应调光区域需要施加的电压值之间的映射关系。
在本申请的一些实施例中，如图12所示，摄像头模组的反馈电路还包括编码模块和译码模块，编码模块可以对第二位置信息(u，v)和反馈信号SIG_FEEDBACK进行编码并打包为2字节数据，并通过数据总线传输给译码模块。其中，2字节数据包括依次分布的起始标识符、第二位置信息(u，v)，反馈信号SIG_FEEDBACK以及结束标识符。
在本申请的一些实施例中，摄像头模组的反馈电路还包括驱动模块，驱动模块根据译码模块的译码数据向调光组件的第一调光区域传输电压，针对图3和图4所示的调光组件的调光单元的结构，驱动模块可以根据译码数据向电极层和电路层之间施加电压，以通过调节电极层和电路层之间的极间电压，调节第一调光区域的反射率。即，当反馈信号的信号值较小时，驱动模块向电极层和电路层之间施加更大的电压，以提高第一调光区域的反射率；当反馈信号的信号值较大时，驱动模块向电极层和电路层之间施加更小的电压，以降低第一调光区域的反射率，从而实现对图像传感器曝光的自适应控制，提高摄像头模组的动态范围。
S104、调光组件调节反射率后，光线再次进入图像传感器并生成目标图像，通过图像的图像信号处理(ISP)模块处理目标图像，并将目标图像进行压缩。
在本申请的一些实施例中，由于图像传感器的感光特性和人眼存在显著差异，因此需要将RAW格式的目标图像进一步处理使之满足人眼的偏好。其中，图像传感器生成目标图像后，可以将目标图像送入ISP模块处理，经降噪、白平衡、色彩校准、gamma变换等操作后压缩为格式为JPEG的图像进行存储或传输至显示器。gamma变换是一种调整图像的对比度，增强暗部或亮部的细节的图像增强方法。
在本申请的一些实施例中，如图13所示，上述图像处理方法的具体过程可以为：
首先，通过上述模组标定放法确定第一感光区域和第一调光区域的位置映射关系，并将该位置映射关系存储至存储器(EEPROM)中。
其次，图像传感器获取第一感光区域的第一位置信息和亮度平均值，计算模块基于第一位置信息和位置映射关系计算得出第一调光区域的第二位置信息，并基于亮度平均值和第一函数关系计算得出第二位置信息对应的反馈信号的反馈值。然后通过编码模块进行编码，通过译码模块进行译码，使得反馈信号传输至驱动模块，驱动模块根据第二位置信息和第二位置信息对应的反馈信号的反馈值，调节对调光组件的电极层和电路层之间的电压值，以调节调光组件的反射率，进而调节经调光组件的光线的强度，调节后的光线经全反射镜再次反射至图像传感器的第一感光区域，使得第一感光区域能够采集到曝光正常的图像数据，进而使图像传感器可以采集到曝光正常的目标图像。
最后，目标图像通过移动行业处理器接口(Mobile Industry Processor Interface，MIPI)传输给ISP模块，通过ISP模块处理目标图像，并将目标图像进行压缩，得到符合人眼偏好的图像。
本申请实施例提供的图像处理方法，执行主体可以为图像处理装置。本申请实施例中以图像处理装置执行图像处理方法为例，说明本申请实施例提供的图像处理装置。
图14示出了本申请实施例中涉及的拍摄装置的一种可能的结构示意图。如图14所示，图像处理装置300可以包括上述实施例中的摄像头模组100，该图像处理装置300还可以包括：
处理模块301，用于控制所述摄像头模组的反馈电路获取所述摄像头模组中图像传感器在第一感光区域采集的第一图像数据；
处理模块301，还用于控制所述摄像头模组中的反馈电路基于所述第一图像数据，得到第一反馈信号；
处理模块301，还用于控制所述摄像头模组中的调光组件基于所述第一反馈信号调节所述调光组件中与所述第一感光区域对应的第一调光区域的反射率；
处理模块301，还用于控制所述图像传感器采集第二图像数据。
本申请实施例提供一种图像处理装置300，该图像处理装置300包括上述实施例中的摄像头模组100。由于该摄像头模组100的图像传感器可以采集摄像头模组所处环境的图像数据，反馈电路可以基于图像传感器中第一感光区域采集的图像数据生成反馈信号，并传输至调光组件；调光组件可以基于反馈信号调节调光组件中与第一感光区域对应的第一调光区域的反射率，使得电子设备可以实现高动态范围成像的要求，提高电子设备的成像质量。
在本申请的一些实施例中，处理模块301具体用于：基于所述第一图像数据确定所述第一感光区域的平均亮度值；基于所述平均亮度值和第一函数关系，生成第一数字信号；基于所述第一数字信号得到所述第一反馈信号。
本申请实施例中的图像处理装置300可以是电子设备，也可以是电子设备中的部件，例如集成电路或芯片。该电子设备可以是终端，也可以为除终端之外的其他设备。示例性地，电子设备可以为手机、平板电脑、笔记本电脑、掌上电脑、车载电子设备、移动上网装置(mobile internet device，MID)、增强现实(augmented reality，AR)/虚拟现实(virtual reality，VR)设备、机器人、可穿戴设备、超级移动个人计算机(ultra-mobile personal computer，UMPC)、上网本或者个人数字助理(personal digital assistant，PDA)等，还可以为服务器、网络附属存储器(network attached storage，NAS)、个人计算机(personal computer，PC)、电视机(television，TV)、柜员机或者自助机等，本申请实施例不作具体限定。
本申请实施例中的图像处理装置300可以为具有操作系统的装置。该操作系统可以为安卓(Android)操作系统，可以为iOS操作系统，还可以为其他可能的操作系统，本申请实施例不作具体限定。
本申请实施例提供的拍摄装置能够实现图1至图13的方法实施例实现的各个过程，达到相同的技术效果，为避免重复，这里不再赘述。
在一些实施例中，如图15所示，本申请实施例还提供一种电子设备400，包括处理器401和存储器402，存储器402上存储有可在所述处理器401上运行的程序或指令，该程序或指令被处理器401执行时实现上述拍摄方法实施例的各个过程步骤，且能达到相同的技术效果，为避免重复，这里不再赘述。
需要说明的是，本申请实施例中的电子设备包括上述的移动电子设备和非移动电子设备。
图16为实现本申请实施例的一种电子设备的硬件结构示意图。
该电子设备500包括但不限于：射频单元501、网络模块502、音频输出单元503、输入单元504、传感器505、显示单元506、用户输入单元507、接口单元508、存储器509、以及处理器510等部件。此外，该电子设备500还包括摄像头模组100。需要说明的是，上述摄像头模组100中各模块的功能以及连接关系可以参照上文的描述，此处不再赘述。
本领域技术人员可以理解，电子设备500还可以包括给各个部件供电的电源(比如电池)，电源可以通过电源管理系统与处理器510逻辑相连，从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。图13中示出的电子设备结构并不构成对电子设备的限定，电子设备可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置，在此不再赘述。
其中，处理器510，用于控制摄像头模组100的反馈电路获取摄像头模组100中图像传感器在第一感光区域采集的第一图像数据；还用于控制所摄像头模组100中的反馈电路基于第一图像数据，得到第一反馈信号；还用于控制摄像头模组100中的调光组件基于第一反馈信号调节调光组件中与第一感光区域对应的第一调光区域的反射率；还用于控制图像传感器采集第二图像数据。
本申请实施例提供一种电子设备500，该电子设备500包括上述实施例中的摄像头模组100。由于该摄像头模组100的图像传感器可以采集摄像头模组所处环境的图像数据，反馈电路可以基于图像传感器中第一感光区域采集的图像数据生成反馈信号，并传输至调光组件；调光组件可以基于反馈信号调节调光组件中与第一感光区域对应的第一调光区域的反射率，使得电子设备500可以实现高动态范围成像的要求，提高电子设备500的成像质量。
在本申请的一些实施例中，处理器510，具体用于基于第一图像数据确定第一感光区域的平均亮度值；基于平均亮度值和第一函数关系，生成第一数字信号；基于第一数字信号得到第一反馈信号。
在本申请的一些实施例中，处理器510，具体用于基于图像数据确定第一感光区域的平均亮度值；基于平均亮度值和第一函数关系，确定第一电压值并生成反馈信号；第一函数关系用于表征图像传感器的不同感光区域的亮度值，与相应调光区域需要施加的电压值之间的映射关系。
应理解的是，本申请实施例中，输入单元504可以包括图形处理器(graphics processing unit，GPU)5041和麦克风5042，图形处理器5041对在视频捕获模式或图像捕获模式中由图像捕获装置(如摄像头)获得的静态图片或视频的图像数据进行处理。显示单元506可包括显示面板5061，可以采用液晶显示器、有机发光二极管等形式来配置显示面板5061。用户输入单元507包括触控面板5071以及其他输入设备5072中的至少一种。触控面板5071，也称为触摸屏。触控面板5071可包括触摸检测装置和触摸控制器两个部分。其他输入设备5072可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆，在此不再赘述。
存储器509可用于存储软件程序以及各种数据。存储器509可主要包括存储程序或指令的第一存储区和存储数据的第二存储区，其中，第一存储区可存储操作系统、至少一个功能所需的应用程序或指令(比如声音播放功能、图像播放功能等)等。此外，存储器509可以包括易失性存储器或非易失性存储器，或者，存储器509可以包括易失性和非易失性存储器两者。其中，非易失性存储器可以是只读存储器(Read-Only Memory，ROM)、可编程只读存储器(Programmable ROM，PROM)、可擦除可编程只读存储器(Erasable PROM，EPROM)、电可擦除可编程只读存储器(Electrically EPROM，EEPROM)或闪存。易失性存储器可以是随机存取存储器(Random Access Memory，RAM)，静态随机存取存储器(Static RAM，SRAM)、动态随机存取存储器(Dynamic RAM，DRAM)、同步动态随机存取存储器(Synchronous DRAM，SDRAM)、双倍数据速率同步动态随机存取存储器(Double Data Rate SDRAM，DDRSDRAM)、增强型同步动态随机存取存储器(Enhanced SDRAM，ESDRAM)、同步连接动态随机存取存储器(Synch Link DRAM，SLDRAM)和直接内存总线随机存取存储器(Direct Rambus RAM，DRRAM)。本申请实施例中的存储器509包括但不限于这些和任意其它适合类型的存储器。
处理器510可包括一个或多个处理单元；在一些实施例中，处理器510集成应用处理器和调制解调处理器，其中，应用处理器主要处理涉及操作系统、用户界面和应用程序等的操作，调制解调处理器主要处理无线通信信号，如基带处理器。可以理解的是，上述调制解调处理器也可以不集成到处理器510中。
本申请实施例还提供一种可读存储介质，所述可读存储介质上存储有程序或指令，该程序或指令被处理器执行时实现上述对焦方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
其中，所述处理器为上述实施例中所述的电子设备中的处理器。所述可读存储介质，包括计算机可读存储介质，如计算机只读存储器ROM、随机存取存储器RAM、磁碟或者光盘等。
本申请实施例另提供了一种芯片，所述芯片包括处理器和通信接口，所述通信接口和所述处理器耦合，所述处理器用于运行程序或指令，实现上述对焦方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
应理解，本申请实施例提到的芯片还可以称为系统级芯片、系统芯片、芯片系统或片上系统芯片等。
本申请实施例提供一种计算机程序产品，该程序产品被存储在存储介质中，该程序产品被至少一个处理器执行以实现如上述对焦方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。此外，需要指出的是，本申请实施方式中的方法和装置的范围不限按示出或讨论的顺序来执行功能，还可包括根据所涉及的功能按基本同时的方式或按相反的顺序来执行功能，例如，可以按不同于所描述的次序来执行所描述的方法，并且还可以添加、省去、或组合各种步骤。另外，参照某些示例所描述的特征可在其他示例中被组合。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以计算机软件产品的形式体现出来，该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台终端(可以是手机，计算机，服务器，或者网络设备等)执行本申请各个实施例所述的方法。
上面结合附图对本申请的实施例进行了描述，但是本申请并不局限于上述的具体实施方式，上述的具体实施方式仅仅是示意性的，而不是限制性的，本领域的普通技术人员在本申请的启示下，在不脱离本申请宗旨和权利要求所保护的范围情况下，还可做出很多形式，均属于本申请的保护之内。

Claims (17)

  1. 一种摄像头模组，包括第一透镜组件、全反射镜、调光组件、图像传感器以及反馈电路，所述第一透镜组件、全反射镜和调光组件依次设置，所述图像传感器与所述全反射镜相对设置；入射光线经所述第一透镜组件汇聚后经所述全反射镜进入所述调光组件，所述调光组件将所述入射光线调制后反射至所述全反射镜，所述全反射镜将所述入射光线反射至所述图像传感器；
    所述图像传感器包括至少一个感光区域，所述调光组件包括至少一个调光区域，一个所述感光区域与一个所述调光区域对应；
    所述反馈电路分别与所述图像传感器和所述调光组件连接；
    所述反馈电路，用于基于所述图像传感器中第一感光区域采集的图像数据得到反馈信号；
    所述调光组件，用于基于所述反馈信号调节所述调光组件中与所述第一感光区域对应的第一调光区域的反射率。
  2. 根据权利要求1所述的摄像头模组，其中，所述图像传感器包括像素阵列，所述像素阵列包括至少一个像素单元；
    所述调光组件包括调光阵列，所述调光阵列包括至少一个调光单元；
    所述像素阵列中的每个所述像素单元与所述调光阵列中的一个所述调光单元对应。
  3. 根据权利要求2所述的摄像头模组，其中，所述调光单元包括第一偏振件、第二偏振件和液晶模块，所述液晶模块包括微透镜、电极层、液晶层、反射层、电路层和基板；
    所述反馈信号包括第一电压信号；
    所述反馈电路，具体用于为第一调光单元的所述电极层和所述电路层之间施加所述第一电压信号，以调节第一调光单元的反射率，所述第一调光单元为所述第一调光区域中的调光单元；
    进入所述调光组件的入射光线，依次经过所述第一偏振件、所述微透镜和所述液晶层透射至所述反射层，经所述反射层反射后依次经过所述液晶层、所述微透镜和所述第二偏振件射出。
  4. 根据权利要求3所述的摄像头模组，其中，所述电极层设置于所述液晶层的边缘位置；或者，所述电极层覆盖于所述液晶层上。
  5. 根据权利要求1或2所述的摄像头模组，其中，所述调光组件为硅基液晶LCoS芯片、空间光调制器、微反射镜阵列中的一个。
  6. 根据权利要求1所述的摄像头模组，其中，所述全反射镜包括相对设置的第一镜体和第二镜体，所述第一镜体与所述第一透镜组件相对设置，所述第二镜体具有反射面；
    经由所述第一透镜组件的入射光线，依次经过所述第一镜体和第二镜体透射至所述调光组件，经所述调光组件调制后反射至所述第二镜体的反射面，再经所述反射面反射至所述图像传感器。
  7. 根据权利要求6所述的摄像头模组，其中，所述摄像头模组还包括驱动装置，所述驱动装置用于驱动所述调光组件运动，以调节所述调光组件的出射面与所述第一透镜组件的光轴之间的夹角。
  8. 根据权利要求1所述的摄像头模组，其中，所述摄像头模组还包括第二透镜组件，所述第二透镜组件设置于所述全反射镜和所述图像传感器之间；
    经所述全反射镜反射后的入射光线，经所述第二透镜组件汇聚并透射至所述图像传感器。
  9. 根据权利要求1所述的摄像头模组，其中，所述反馈电路包括依次连接的计算模块、编码模块、传输线、译码模块以及驱动模块；
    所述计算模块，用于基于所述图像传感器中第一感光区域采集的图像数据，计算得到所述反馈信号的反馈值；
    所述编码模块，用于对所述反馈值进行编码，得到编码数据；
    所述传输线，用于将所述编码数据传输至所述译码模块；
    所述译码模块，用于对所述编码数据进行译码，得到译码数据；
    所述驱动模块，用于基于所述译码数据得到反馈信号。
  10. 一种电子设备，包括如权利要求1至9中任一项所述的摄像头模组。
  11. 一种图像处理方法，由电子设备执行，所述电子设备包括如权利要求1至9中任一项所述的摄像头模组；
    所述方法包括：
    控制所述摄像头模组的反馈电路获取所述摄像头模组中图像传感器在第一感光区域采集的第一图像数据；
    控制所述摄像头模组中的反馈电路基于所述第一图像数据，得到第一反馈信号；
    控制所述摄像头模组中的调光组件基于所述第一反馈信号调节所述调光组件中与所述第一感光区域对应的第一调光区域的反射率；
    控制所述图像传感器采集第二图像数据。
  12. 根据权利要求11所述的图像处理方法，其中，所述控制所述摄像头模组中的反馈电路基于所述第一图像数据，得到第一反馈信号，包括：
    基于所述第一图像数据确定所述第一感光区域的平均亮度值；
    基于所述平均亮度值和第一函数关系，生成第一数字信号；
    基于所述第一数字信号得到所述第一反馈信号。
  13. 一种图像处理装置，包括如权利要求1至9中任一项所述的摄像头模组；
    所述图像处理装置还包括：
    处理模块，用于控制所述摄像头模组的反馈电路获取所述摄像头模组中图像传感器在第一感光区域采集的第一图像数据；
    处理模块，还用于控制所述摄像头模组中的反馈电路基于所述第一图像数据，得到第一反馈信号；
    处理模块，还用于控制所述摄像头模组中的调光组件基于所述第一反馈信号调节所述调光组件中与所述第一感光区域对应的第一调光区域的反射率；
    处理模块，还用于控制所述图像传感器采集第二图像数据。
  14. 根据权利要求13所述的图像处理装置，其中，所述处理模块具体用于：
    基于所述第一图像数据确定所述第一感光区域的平均亮度值；
    基于所述平均亮度值和第一函数关系，生成第一数字信号；
    基于所述第一数字信号得到所述第一反馈信号。
  15. 一种电子设备，包括处理器和存储器，所述存储器存储可在所述处理器上运行的程序或指令，所述程序或指令被所述处理器执行时实现如权利要求11或12所述的图像处理方法的步骤。
  16. 一种计算机可读存储介质，所述计算机可读存储介质上存储计算机程序，所述计算机程序被处理器执行时实现如权利要求11或12所述的信息处理方法的步骤。
  17. 一种芯片，所述芯片包括处理器和通信接口，所述通信接口和所述处理器耦合，所述处理器用于运行程序或指令，实现如权利要求11或12所述的方法。
PCT/CN2025/088602 2024-04-17 2025-04-11 摄像头模组、电子设备、拍摄方法及装置 Pending WO2025218599A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202410464340.3A CN118301484A (zh) 2024-04-17 2024-04-17 摄像头模组、电子设备、拍摄方法及装置
CN202410464340.3 2024-04-17

Publications (1)

Publication Number Publication Date
WO2025218599A1 true WO2025218599A1 (zh) 2025-10-23

Family

ID=91684528

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2025/088602 Pending WO2025218599A1 (zh) 2024-04-17 2025-04-11 摄像头模组、电子设备、拍摄方法及装置

Country Status (2)

Country Link
CN (1) CN118301484A (zh)
WO (1) WO2025218599A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118301484A (zh) * 2024-04-17 2024-07-05 维沃移动通信有限公司 摄像头模组、电子设备、拍摄方法及装置
TWI908357B (zh) * 2024-09-26 2025-12-11 點晶科技股份有限公司 強化顯示器像素受光能量系統的應用方法
CN120529210A (zh) * 2025-04-28 2025-08-22 西安信飞特信息科技有限公司 一种图像传感器、成像模组及电子设备

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060093234A (ko) * 2005-02-21 2006-08-24 엘지전자 주식회사 주변조명밝기 조절장치
KR20070054874A (ko) * 2005-11-24 2007-05-30 엘지전자 주식회사 촬상 장치 및 방법
JP2008042607A (ja) * 2006-08-08 2008-02-21 Fujifilm Corp 撮影装置、撮影システム
CN102944962A (zh) * 2012-11-15 2013-02-27 深圳市华星光电技术有限公司 液晶透镜组件以及立体影像显示器
CN107003121A (zh) * 2014-12-09 2017-08-01 巴斯夫欧洲公司 光学检测器
CN218332172U (zh) * 2022-09-23 2023-01-17 舜宇光学（浙江）研究院有限公司 分光组件、景深扩展式成像装置和内窥镜
WO2023185293A1 (zh) * 2022-04-01 2023-10-05 华为技术有限公司 一种图像生成装置、显示设备和交通工具
CN116954045A (zh) * 2022-04-13 2023-10-27 华为技术有限公司 成像装置以及打印设备
CN118301484A (zh) * 2024-04-17 2024-07-05 维沃移动通信有限公司 摄像头模组、电子设备、拍摄方法及装置

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060093234A (ko) * 2005-02-21 2006-08-24 엘지전자 주식회사 주변조명밝기 조절장치
KR20070054874A (ko) * 2005-11-24 2007-05-30 엘지전자 주식회사 촬상 장치 및 방법
JP2008042607A (ja) * 2006-08-08 2008-02-21 Fujifilm Corp 撮影装置、撮影システム
CN102944962A (zh) * 2012-11-15 2013-02-27 深圳市华星光电技术有限公司 液晶透镜组件以及立体影像显示器
CN107003121A (zh) * 2014-12-09 2017-08-01 巴斯夫欧洲公司 光学检测器
WO2023185293A1 (zh) * 2022-04-01 2023-10-05 华为技术有限公司 一种图像生成装置、显示设备和交通工具
CN116954045A (zh) * 2022-04-13 2023-10-27 华为技术有限公司 成像装置以及打印设备
CN218332172U (zh) * 2022-09-23 2023-01-17 舜宇光学（浙江）研究院有限公司 分光组件、景深扩展式成像装置和内窥镜
CN118301484A (zh) * 2024-04-17 2024-07-05 维沃移动通信有限公司 摄像头模组、电子设备、拍摄方法及装置

Also Published As

Publication number Publication date
CN118301484A (zh) 2024-07-05

Similar Documents

Publication Publication Date Title
WO2025218599A1 (zh) 摄像头模组、电子设备、拍摄方法及装置
US9077916B2 (en) Improving the depth of field in an imaging system
JP5784642B2 (ja) 低解像度画像を用い高解像度画像を生成する方法及び装置
US8502877B2 (en) Image pickup apparatus electronic device and image aberration control method
US11729500B2 (en) Lowpass filter control apparatus and lowpass filter control method for controlling variable lowpass filter
GB2435942A (en) Automatic focusing.
KR101626447B1 (ko) 렌즈 왜곡과 색수차를 보정하는 장치, 방법, 및 컴퓨터 프로그램을 저장하는 컴퓨터 판독가능 매체
US8872932B2 (en) Apparatus and method for removing lens distortion and chromatic aberration
CN113113439B (zh) 图像传感器和摄像设备
US20140022420A1 (en) Information processing apparatus, imaging apparatus, and method for correcting images
JP5525109B2 (ja) 撮像装置
JP6941011B2 (ja) 撮像装置及びその制御方法、プログラム、記憶媒体
JP2011232615A (ja) 撮像装置
CN115278001B (zh) 图像传感器、摄像头模组、电子设备及拍摄方法
JP7631244B2 (ja) 画像処理装置、画像処理方法、及びプログラム
JP7655316B2 (ja) 撮像装置、撮像方法
JP2015128226A (ja) 撮像装置、その制御方法及びプログラム
CN115278057A (zh) 图像采集方法、装置、电子设备及存储介质
JP2016206455A (ja) 焦点検出装置、撮像装置、焦点検出方法、プログラム、及び記憶媒体
JP2004201203A (ja) 撮像素子及びそれを備えたデジタル撮影装置
US20260006344A1 (en) Image sensor with stacked color filters or multi-state tunable color filter
US20250097591A1 (en) Photographing device and control method thereof
JP5679718B2 (ja) 撮像装置
CN117528239A (zh) 摄像模组、对焦方法、装置、电子设备及介质
JP5375471B2 (ja) 撮像装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 25789843

Country of ref document: EP

Kind code of ref document: A1