WO2023179589A1 - Camera module and electronic device - Google Patents

Camera module and electronic device Download PDF

Info

Publication number
WO2023179589A1
WO2023179589A1 PCT/CN2023/082707 CN2023082707W WO2023179589A1 WO 2023179589 A1 WO2023179589 A1 WO 2023179589A1 CN 2023082707 W CN2023082707 W CN 2023082707W WO 2023179589 A1 WO2023179589 A1 WO 2023179589A1
Authority
WO
WIPO (PCT)
Prior art keywords
light
camera module
photosensitive
pixel unit
waveband
Prior art date
Application number
PCT/CN2023/082707
Other languages
French (fr)
Chinese (zh)
Inventor
黄长峰
Original Assignee
维沃移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 维沃移动通信有限公司 filed Critical 维沃移动通信有限公司
Publication of WO2023179589A1 publication Critical patent/WO2023179589A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/54Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/55Optical parts specially adapted for electronic image sensors; Mounting thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/79Arrangements of circuitry being divided between different or multiple substrates, chips or circuit boards, e.g. stacked image sensors

Definitions

  • This application belongs to the technical field of terminal equipment, and specifically relates to a camera module and electronic equipment.
  • the size of the photosensitive chip in the camera module is subject to certain restrictions.
  • the two points of large number of pixel units and large area of a single pixel unit are incompatible.
  • This application aims to provide a camera module and electronic equipment to solve the problems of poor imaging quality and single imaging function of existing camera modules.
  • inventions of the present application provide a camera module.
  • the camera module includes:
  • a pixel unit the pixel unit includes a plurality of stacked photosensitive layers, each of the photosensitive layers is used to receive light in a wavelength band corresponding to the photosensitive layer;
  • An adjustable spectrum filter the adjustable spectrum filter is arranged opposite to the pixel unit;
  • the tunable spectral filter is switchable between a first state and a second state
  • the tunable spectrum filter When the tunable spectrum filter is in the first state, it can transmit the first waveband light and cut off the second waveband light.
  • the photosensitive layer corresponding to the first waveband light receives the first waveband light. After the light is emitted, the first photosensitive electrical signal is generated;
  • the tunable spectrum filter When the tunable spectrum filter is in the second state, it can transmit light in the second waveband and cut off light in the first waveband.
  • the photosensitive layer corresponding to the second waveband light receives the second waveband light. After the light is emitted, a second photosensitive electrical signal is generated.
  • inventions of the present application provide an electronic device.
  • the electronic device includes the camera module as described above.
  • a photosensitive stack structure as a pixel unit for photosensitivity and using an adjustable spectrum filter
  • multispectral imaging with high pixels and high photosensitivity performance is achieved on the camera module.
  • the stacked pixel units can reduce the power consumption of the camera module to a certain extent and improve the resolution, and combined with the adjustable spectral filter can expand the application scope of the camera module.
  • Figure 1 is a schematic structural diagram of a camera module provided according to an embodiment of the present application.
  • Figure 2 is a schematic diagram of the principle of the photosensitive layer of the camera module provided according to an embodiment of the present application
  • Figure 3 is a schematic diagram of the spectral transmittance of the electrically tunable spectral filter of the camera module provided according to an embodiment of the present application;
  • Figure 4 is a schematic structural diagram of an embodiment of an electrically tunable spectral filter of a camera module provided according to an embodiment of the present application;
  • FIG. 5 is one of the flow charts of the control method of the camera module provided according to the embodiment of the present application.
  • Figure 6 is the second flow chart of the control method of the camera module provided according to the embodiment of the present application.
  • Figure 7 is the third flow chart of the control method of the camera module provided according to the embodiment of the present application.
  • first and second features in the description and claims of this application may include one or more of these features, either explicitly or implicitly.
  • plural means two or more.
  • and/or in the description and claims indicates at least one of the connected objects, and the character “/” generally indicates that the related objects are in an “or” relationship.
  • connection should be understood in a broad sense.
  • connection or integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium; it can be an internal connection between two components.
  • connection or integral connection
  • connection or integral connection
  • connection can be a mechanical connection or an electrical connection
  • it can be a direct connection or an indirect connection through an intermediate medium
  • it can be an internal connection between two components.
  • specific meanings of the above terms in this application can be understood on a case-by-case basis.
  • a camera module is provided, which can be applied to various forms of electronic equipment.
  • the camera module provided by the embodiment of the present application is, for example, a CMOS camera module (CMOS Camera Module, CCM), which is a camera module that is currently widely used in smart mobile terminal devices.
  • CMOS Camera Module CCM
  • the camera modules provided by the embodiments of the present application include but are not limited to the above-mentioned CMOS camera module, and the embodiments of the present application are not limited here.
  • the camera module includes a pixel unit 1.
  • the pixel unit 1 includes a plurality of photosensitive layers arranged in a stack. Each photosensitive layer can be used to receive light in a wavelength band corresponding to the photosensitive layer;
  • the camera module also includes an adjustable spectrum filter 2, which is arranged opposite to the pixel unit 1;
  • the tunable spectral filter 2 is switchable between the first state and the second state;
  • the tunable spectrum filter 2 When the tunable spectrum filter 2 is in the first state, it can transmit the first waveband light and cut off the second waveband light. After receiving the first waveband light, the photosensitive layer of the waveband corresponding to the first waveband light generates a third waveband light. One senses photoelectric signals;
  • the tunable spectrum filter 2 When the tunable spectrum filter 2 is in the second state, it can transmit light of the second waveband and cut off the light of the first waveband. After receiving the light of the second waveband, the photosensitive layer of the waveband corresponding to the second waveband light generates a third waveband light. 2. Sensing photoelectric signals.
  • the pixel unit 1 includes a plurality of photosensitive layers of different photosensitive colors (for example, red, green, blue, or RGB), and each photosensitive layer is stacked in sequence, forming a stack.
  • photosensitive layers for example, red, green, blue, or RGB
  • the pixel unit 1 provided in the embodiment of the present application is a stacked pixel structure, which can utilize the principle that light of different wavelengths has different penetrating powers (the longer the wavelength, the greater the penetration depth, that is, the penetration depth is such as: red light>green light>blue light ), so that each pixel unit 1 can obtain the real light intensity of three wavelengths of light at the pixel unit at the same time. Therefore, when restoring the color information at the pixel unit, that is, when doing three-color synthesis, there is no need to perform algorithmic filtering and interpolation. It can reduce false colors and better show the true color information of the pixel unit. information, which can have better resolution compared to the conventional RGB pixel structure.
  • the pixel unit 1 since the pixel unit 1 does not need to perform color difference, it can obtain more realistic colors and reduce the difference calculation, so the power consumption will be greatly reduced; on the other hand, the pixel unit 1 does not need to go through Algorithmic interpolation and analytical power will also be significantly improved.
  • Figure 2 shows a schematic diagram of the internal circuit structure of the pixel unit 14T.
  • the pixel unit 1 includes three photosensitive areas, that is, a three-layer stacked pixel structure, and also includes four transistors.
  • the four transistors are the reset tube RST, the switch TG, and the row selector SET. and signal amplifier SF.
  • an adjustable spectrum filter 2 is also used, which is different from the infrared filter (IR Filter) used in traditional camera modules.
  • the tunable spectrum filter 2 can adjust the type of filtered spectrum by controlling the voltage applied thereto, for example. That is, under different voltage controls, the tunable spectrum filter 2 is configured to transmit spectra of different wavelength bands. In this way, the types of imaging spectra can be expanded, and the shooting function of the camera module can be expanded.
  • the first band of light is set to visible light (400nm ⁇ 700nm), and the second band of light is set to infrared light (greater than 700nm).
  • the voltage applied to the adjustable spectrum filter 2 it can be achieved Allow visible light to pass through and infrared light to be cut off, or to cut off visible light and infrared light to pass through.
  • the transmittance of the visible light spectrum is high and the transmittance of the infrared spectrum is low.
  • the transmittance of the visible light spectrum is low and the transmittance of the infrared spectrum is high.
  • the camera module uses infrared spectrum imaging (that is, the tunable spectrum filter 2 allows infrared light to pass through and visible light to cut off), it can perform night vision, detect human body temperature, etc., and can achieve this through infrared imaging in cloud and fog environments. Imaging through clouds and fog.
  • the stacked pixel unit 1 can reduce the power consumption of the camera module to a certain extent and improve the resolution, and combined with the adjustable spectrum filter 2 can expand the application range of the camera module.
  • the camera module also includes an image processing device.
  • the image processing device is electrically connected to the pixel unit 1.
  • the image processing device is configured to perform at least one of the following functions based on different photosensitive electrical signals generated by the pixel unit:
  • a second target image is generated according to the second photosensitive electrical signal.
  • the camera module provided by the embodiment of the present application can have at least two different shooting modes, and can correspondingly generate two different images.
  • the image processing device may include, for example, an amplifier, an analog-to-digital converter (Analog-to-digital converter, ADC), an image signal processor (mage Signal Processing, ISP), etc.
  • the pixel unit 1 is electrically connected to an amplifier, a digital-to-analog converter and an image signal processor in sequence.
  • the photosensitive electrical signal generated by the pixel unit 1 can be passed through an amplification circuit, an AD conversion circuit, etc. in sequence to form a digital signal matrix ( image).
  • the user selects a first band of light spectrum imaging, and the first band of light is, for example, visible light. That is, in the visible light spectrum imaging mode, the tunable spectrum filter 2 is controlled to be in the first state, visible light can pass through the tunable spectrum filter 2, and the pixel unit 1 can receive light of different colors in the visible light for imaging.
  • the light is sensed and processed by an analog-to-digital converter (ADC), and then image signal processing is performed by an image signal processor (ISP), and then a visible light spectrum imaging picture is output.
  • ADC analog-to-digital converter
  • ISP image signal processor
  • the pixel unit 1 Since the pixel unit 1 is designed as a stacked structure, it avoids the problem of conventional pixel plane structures occupying a large space; and, under the condition of having a large number of pixel units, each pixel unit can still have a large photosensitive area. At the same time, the stacked structure There is no need to perform filtering and interpolation during pixel synthesis and imaging, reducing false colors.
  • the user selects a second waveband light spectrum for imaging, and the second waveband light is, for example, infrared light. That is, in the infrared spectrum imaging mode, the tunable spectrum filter 2 is controlled to be in the second state, infrared light can pass through the tunable spectrum filter 2, and the pixel unit 1 can directly receive the infrared light and perform imaging.
  • the corresponding photosensitivity is processed by the analog-to-digital converter, and then the image signal processor performs image signal processing, and then outputs the infrared spectrum imaging picture.
  • the pixel unit 1 is a stacked structure, It avoids the problem of large space occupied by conventional pixel planar structures; and, with a large number of pixel units, each pixel unit can still have a large photosensitive area. At the same time, there is no need for filtering and interpolation during the stacked structure pixel synthesis imaging process. , reduce false colors.
  • the user when using the camera module, the user can flexibly select at least one of the visible light spectrum and the infrared light spectrum for imaging according to specific shooting needs.
  • the camera module also includes an image processing device.
  • the image processing device is electrically connected to the pixel unit 1.
  • the image processing device is used to perform the following functions according to different photosensitive electrical signals generated by the pixel unit 1:
  • the camera module provided by the embodiment of the present application can also operate in the first-band light and second-band light dual-spectrum imaging mode, and then realize the imaging function through multi-frame fusion technology.
  • the tunable spectral filter 2 can transmit the first waveband light and cut off the second waveband light.
  • the pixel unit 1 receives the first waveband light for photosensitization, and then passes through the image. After processing by the processing device, the imaging photos under the first waveband light are output; wherein, the first waveband light is visible light and the second waveband light is infrared light, then the visible light imaging photos are output in this step;
  • the tunable spectral filter 2 cuts off the first waveband light and transmits the second waveband light.
  • the pixel unit 1 receives the second waveband light for photosensitization. After being processed by the image processing device, the imaging photos under the second waveband light are output; wherein the first waveband light is visible light and the second waveband light is infrared light, then in this step, the infrared light imaging photos are output;
  • first-band light and second-band light imaging photos are fused and output, achieving dual-spectrum imaging, that is, dual-spectrum imaging photos of visible light and infrared light.
  • the pixel unit 1 can provide high photosensitivity performance for these two spectral imaging conditions. There is no need to perform filtering and interpolation during the synthetic imaging process of pixel unit 1, which provides convenient implementation conditions for image fusion.
  • this dual-spectrum imaging mode can be used to achieve perspective imaging through clouds and fog.
  • the tunable spectral filter 2 includes a filter for transmitting The first light-transmitting area 201 for transmitting light of one wavelength band and the second light-transmitting area 202 for transmitting light of the second wave band; the first light-transmitting areas 201 and the second light-transmitting area 202 are arranged alternately and arranged to form a set transmission area. Light array; each first light-transmitting area 201 is connected, and each second light-transmitting area 202 is connected.
  • the tunable spectral filter 2 provided in the embodiment of the present application can be designed to perform filter adjustment by regional control.
  • the sub-regions here refer to two regions, namely:
  • Area 1 is an area that can transmit light of the first waveband and cut off light of the second waveband, that is, the plurality of first light-transmitting areas 201 mentioned above.
  • the plurality of first light-transmitting areas 201 are connected to each other to form area 1;
  • Region two is a region that can transmit light of the second wavelength band and cut off light of the first wavelength band, that is, the plurality of second light-transmitting regions 202 mentioned above.
  • the plurality of second light-transmitting regions 202 are connected to each other to form region two.
  • the first light-transmitting areas 201 and the second light-transmitting areas 202 are arranged alternately, see the structure shown in FIG. 4, which is beneficial to performing two different wavelength band light fusion imaging.
  • first light-transmitting areas 201 are arranged at intervals, they are indeed connected together, so that they can form a whole, which is beneficial to power supply control.
  • the plurality of second light-transmitting areas 202 are also connected.
  • each pixel unit 1 includes three photosensitive layers arranged in a stack, and the photosensitive layers are made of silicon material. Photodiode.
  • the number and arrangement of the pixel units 1 can be flexibly adjusted according to specific needs, and this is not limited in the embodiments of the present application.
  • Each photosensitive layer in each pixel unit 1 is a photodiode of silicon material, which can detect light in the corresponding band respectively, so that one pixel unit can have a variety of pixel information; at the same time, each photosensitive layer in each pixel unit 1
  • the layer may also be photosensitive to, for example, infrared light.
  • each pixel unit 1 includes a first photosensitive layer 101 , a second photosensitive layer 102 and a third photosensitive layer 103 that are stacked sequentially from bottom to top, where the first photosensitive layer 101 is configured as a red photosensitive layer. , the second photosensitive layer 102 is configured as a green photosensitive layer, and the third photosensitive layer 103 is configured as a green photosensitive layer, forming a stacked RGB pixel structure.
  • the pixel unit 1 can form a stacked pixel structure with a red photosensitive layer located on the bottom layer, a green photosensitive layer located on the middle layer, and a blue photosensitive layer located on the upper layer.
  • This stacking sequence takes advantage of the principle that light of different wavelengths has different penetrating power. The longer the wavelength, the greater the penetration depth. According to the penetration depth: red light>green light>blue light, see Figure 1. This allows each pixel unit 1 to simultaneously obtain the real light intensity of three wavelengths of light at the pixel point.
  • the first waveband light is visible light
  • each pixel unit 1 can receive light of multiple colors in the visible light for photosensitization.
  • the first band of light is a visible light spectrum with a wavelength between 400nm and 700nm.
  • each pixel unit 1 When the visible light passes through the tunable spectrum filter 2, the visible light is incident on each pixel unit 1 below. Since each pixel unit 1 includes multiple photosensitive layers, each pixel unit 1 can simultaneously obtain the real image at that point. The light intensity of the three wavelengths of red, green, and blue light, in this way, each pixel unit 1 can realize a large area of light sensitivity, which can improve the quality of visible spectrum imaging.
  • the camera module performs visible spectrum imaging and can be used to detect the color of object images within human vision and in line with human vision.
  • the second waveband light is infrared light
  • each pixel unit 1 can receive infrared light for photosensitization.
  • the second band of light is an infrared light spectrum with a wavelength greater than 700nm.
  • the camera module can perform imaging only in the infrared spectrum.
  • each photosensitive layer of each pixel unit 1 is based on a photosensitive diode made of silicon material, so that it can directly sense infrared light. This realizes infrared spectrum imaging of the camera module.
  • Infrared spectrum imaging can be used to detect object image information beyond human vision.
  • the second waveband light is ultraviolet light
  • each pixel unit 1 can receive ultraviolet light for photosensitization.
  • the camera module can also be used to perform imaging under ultraviolet light.
  • the tunable spectrum filter 2 is provided with an electrode structure 3; the electrode The structure 3 is electrically connected to the tunable spectrum filter 2, and the electrode structure 3 is used to provide a driving voltage for the tunable spectrum filter 2 to drive the tunable spectrum filter 2 to be adjustable between the first state and the second state. switch.
  • the tunable spectrum filter 2 by controlling the voltage applied thereto, the selective transmission of the spectrum by the tunable spectrum filter 2 can be achieved.
  • the tunable spectrum filter 2 when no voltage is applied to the tunable spectrum filter 2, it is in the first state, allowing visible light to pass through and infrared light to be cut off; when the tunable spectrum filter 2 is subject to a voltage, , it is in the second state, allowing infrared light to pass through and visible light to be cut off.
  • the tunable spectrum filter 2 is different from a conventional infrared filter. It has an electrode structure.
  • the material of the tunable spectrum filter 2 is an electrotropic material.
  • the electrode structure 3 is arranged on the tunable spectrum filter 2, and a voltage can be applied to the tunable spectrum filter 2, see Figure 1.
  • the electrode structure 3 is made of transparent material electrodes. In this way, full spectrum transparency can be achieved without affecting imaging.
  • the electrode structure 3 is made of indium tin oxide (ITO).
  • This electrode material is transparent and can transmit the full spectrum without affecting imaging.
  • the position of the electrode structure 3 on the tunable spectrum filter 2 can be flexibly adjusted according to specific needs, and is not limited in the embodiments of the present application.
  • the electrode structure 3 is disposed on the surface of the tunable spectral filter 2 facing away from the pixel unit 1 .
  • the electrode structure 3 is disposed on the surface of the tunable spectral filter 2 facing the pixel unit 1 .
  • the electrode structure 3 is provided on both surfaces of the tunable spectrum filter 2 .
  • the electrode structure 3 can be disposed on the edge area of a surface of the tunable spectrum filter 2 .
  • the electrode structure 3 can be provided on the tunable spectrum filter 2 through coating or conductive adhesive bonding.
  • the shape of the electrode structure 3 can also be flexibly set, such as a ring-shaped structure, etc., which is not specifically limited in the embodiments of the present application.
  • the camera module also includes a microlens layer 4.
  • the microlens layer 4 is disposed between the tunable spectrum filter 2 and the pixel unit 1, and covers the pixel unit 1. above.
  • a micro lens layer 4 (Micro Lens) is provided on the uppermost layer of the pixel unit 1.
  • This micro lens layer 4 is mainly used to condense light to obtain more light input.
  • the camera module also includes a camera lens, and the tunable spectrum filter 2 is disposed between the camera lens and the pixel unit 1 .
  • the camera lens can be flexibly set to one or more as needed.
  • the first band of light is a visible light spectrum with a wavelength between 400nm and 700nm
  • the second band of light is an infrared light spectrum with a wavelength greater than 700nm.
  • the pixel unit 1 includes a red photosensitive layer and a green photosensitive layer stacked sequentially from bottom to top. Taking the green photosensitive layer as an example, the control method involved in the camera module provided by the embodiment of the present application will be further explained.
  • the camera module provided by the embodiment of this application has three imaging functions, corresponding to three different imaging control methods: visible light spectrum imaging control method, infrared light spectrum imaging control method, and visible light and infrared light spectrum dual spectrum imaging control method.
  • the user can select a photo imaging mode.
  • the camera module performs different control methods in different camera modes.
  • the control method for imaging of the camera module in visible light spectrum mode includes the following steps:
  • the camera module needs to take pictures under visible light. At this time, for example, no voltage is applied to the tunable spectrum filter. That is, the tunable spectral filter is in the first state.
  • Unit 1 When external light is incident on the tunable spectrum filter 2, it can only allow visible light to pass through, while infrared light is intercepted and cannot pass through. At this time, it can be avoided that infrared light in visible light imaging is also transmitted to the lower pixels. Unit 1 is sensitive to light, causing photos taken under visible light to appear reddish.
  • the pixel unit 1 is photosensitive and can form a corresponding photosensitive electrical signal
  • Each pixel unit 1 located in the lower layer can receive red, green, and blue light in visible light for photosensitivity, and form a corresponding photosensitive electrical signal, such as a first photosensitive electrical signal.
  • the image processing device can respond to the photosensitive electrical signal output in S503 and control the generation of visible light spectrum imaging photos for output, so that the user can obtain the pictures he wants to take.
  • Visible spectrum imaging is used to detect the color of object images within human vision and in line with human vision.
  • the method of controlling the imaging of the camera module in the infrared light spectrum includes the following steps:
  • the camera module needs to shoot under infrared light.
  • a certain voltage is applied to the tunable spectrum filter, that is, the tunable spectrum filter is in the second state.
  • infrared light can be transmitted and visible light can be cut off;
  • the tunable spectrum filter 2 When external light is incident on the tunable spectrum filter 2, it can only transmit infrared light, while visible light is intercepted and cannot pass through.
  • the pixel unit is photosensitive and can form a corresponding photosensitive electrical signal
  • Each pixel unit 1 located in the lower layer can receive infrared light and perform photosensitization, and form a corresponding photosensitive electrical signal, such as a second photosensitive electrical signal.
  • the image processing device responds to the photosensitive electrical signal output in S603 and generates an infrared spectrum imaging photo for output.
  • Infrared spectrum imaging can be used to detect human body temperature, detect the composition of plastic waste, night vision, etc.
  • the dual-spectrum imaging control method of the camera module in the visible light and infrared light spectrum includes the following steps:
  • the camera module needs to take pictures under visible light. At this time, for example, no voltage is applied to the tunable spectrum filter. That is, the tunable spectral filter is in the first state.
  • Unit 1 When external light is incident on the tunable spectrum filter 2, it can only allow visible light to pass through, while infrared light is intercepted and cannot pass through. At this time, it can be avoided that infrared light in visible light imaging is also transmitted to the lower pixels. Unit 1 is sensitive to light, causing photos taken under visible light to appear reddish.
  • the pixel unit is photosensitive and can form corresponding photosensitive electrical signals
  • Each pixel unit 1 located in the lower layer can receive red, green, and blue light in visible light for photosensitivity, and form a corresponding photosensitive electrical signal, such as a first photosensitive electrical signal.
  • the image processing device can respond to the photosensitive electrical signal output by S7013 and control the generation of visible light spectrum imaging photos for output, so that the user can obtain the pictures they want to take.
  • the camera module needs to take pictures under infrared light.
  • a certain voltage is applied to the tunable spectrum filter, that is, the tunable spectrum filter is in the second state.
  • infrared light can be transmitted and visible light can be cut off;
  • the tunable spectrum filter 2 When external light is incident on the tunable spectrum filter 2, it can only transmit infrared light, while visible light is intercepted and cannot pass through.
  • the pixel unit is photosensitive and can form corresponding photosensitive electrical signals
  • Each pixel unit 1 located in the lower layer can receive infrared light and perform photosensitization, and form a corresponding photosensitive electrical signal, such as a second photosensitive electrical signal.
  • the image processing device responds to the photosensitive electrical signal output by S7023 and generates an infrared spectrum imaging photo for output.
  • S701 and S702 are performed alternately, but there is no strict order restriction.
  • Multi-frame visible light and infrared spectrum imaging photos are fused and output to realize dual spectrum imaging of visible light and infrared spectrum.
  • an electronic device is provided.
  • Electronic equipment includes the above camera module.
  • the electronic device may be a terminal or other devices other than a terminal.
  • the electronic device may be a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a vehicle-mounted electronic device, a mobile Internet device (MID), or augmented reality.
  • AR /virtual reality (VR) equipment, robots, wearable devices, ultra-mobile personal computers (UMPC), netbooks or personal digital assistants (PDA), etc.
  • NAS Network Attached Storage
  • personal computer personal computer, PC
  • television television

Abstract

Disclosed in embodiments of the present application are a camera module and an electronic device. The camera module comprises a pixel unit and an adjustable spectral filter; the pixel unit comprises a plurality of photosensitive layers which are stacked, and each photosensitive layer is used for receiving light in a waveband corresponding to the photosensitive layer; the adjustable spectral filter is provided opposite to the pixel unit; the adjustable spectral filter can be switched between a first state and a second state; when the adjustable spectral filter is in the first state, first waveband light can be transmitted, and second waveband light is cut off, and a photosensitive layer in a waveband corresponding to the first waveband light generates a first photosensitive electrical signal after receiving the first waveband light; when the adjustable spectral filter is in the second state, the second waveband light can be transmitted, and the first waveband light is cut off, and a photosensitive layer in a waveband corresponding to the second waveband light generates a second photosensitive electrical signal after receiving the second waveband light.

Description

摄像模组以及电子设备Camera modules and electronic equipment
相关申请的交叉引用Cross-references to related applications
本申请主张在2022年03月22日在中国提交的中国专利申请202210292242.7的优先权,其全部内容通过引用包含于此。This application claims priority to Chinese patent application 202210292242.7 filed in China on March 22, 2022, the entire content of which is incorporated herein by reference.
技术领域Technical field
本申请属于终端设备技术领域,具体涉及一种摄像模组以及电子设备。This application belongs to the technical field of terminal equipment, and specifically relates to a camera module and electronic equipment.
背景技术Background technique
随智能移动终端的薄型化、轻量化的发展趋势,摄像模组内的感光芯片的尺寸受到了一定的限制,像素单元数量多与单个像素单元面积大这两点是不可兼得的。With the development trend of thinner and lighter smart mobile terminals, the size of the photosensitive chip in the camera module is subject to certain restrictions. The two points of large number of pixel units and large area of a single pixel unit are incompatible.
在相关的技术中,在感光芯片的尺寸受到限制的条件下,若要实现更高的分辨率就需要增加像素单元的数量,但这会减小单个像素单元的尺寸,从而可能会导致感光性能降低,影响成像质量。现有的摄像模组中,为了避免红外光导致可见光成像偏红通常需要配设红外滤光片(IR Filter),用以将红外光完全滤除,摄像模组只能在可见光光谱下成像,成像功能较为单一。In related technologies, under the condition that the size of the photosensitive chip is limited, to achieve higher resolution, it is necessary to increase the number of pixel units, but this will reduce the size of a single pixel unit, which may result in poor photosensitive performance. Reduced, affecting image quality. In existing camera modules, in order to prevent infrared light from causing the visible light image to appear reddish, an IR filter is usually required to completely filter out the infrared light. The camera module can only image under the visible light spectrum. The imaging function is relatively simple.
发明内容Contents of the invention
本申请旨在提供一种摄像模组以及电子设备,解决现有摄像模组的成像质量不佳、成像功能单一的问题。This application aims to provide a camera module and electronic equipment to solve the problems of poor imaging quality and single imaging function of existing camera modules.
第一方面,本申请实施例提出了一种摄像模组。所述摄像模组包括:In the first aspect, embodiments of the present application provide a camera module. The camera module includes:
像素单元,所述像素单元包括多个层叠设置的感光层,每一个所述感光层用于接收与该感光层对应波段的光;以及 A pixel unit, the pixel unit includes a plurality of stacked photosensitive layers, each of the photosensitive layers is used to receive light in a wavelength band corresponding to the photosensitive layer; and
可调光谱滤光片,所述可调光谱滤光片与所述像素单元相对设置;An adjustable spectrum filter, the adjustable spectrum filter is arranged opposite to the pixel unit;
所述可调光谱滤光片在第一状态与第二状态之间可切换;The tunable spectral filter is switchable between a first state and a second state;
当所述可调光谱滤光片处于第一状态时,能供第一波段光透过、第二波段光截止,与所述第一波段光对应波段的感光层在接收到所述第一波段光之后,生成第一感光电信号;When the tunable spectrum filter is in the first state, it can transmit the first waveband light and cut off the second waveband light. The photosensitive layer corresponding to the first waveband light receives the first waveband light. After the light is emitted, the first photosensitive electrical signal is generated;
当所述可调光谱滤光片处于第二状态时,能供第二波段透过光、第一波段光截止,与所述第二波段光对应波段的感光层在接收到所述第二波段光之后,生成第二感光电信号。When the tunable spectrum filter is in the second state, it can transmit light in the second waveband and cut off light in the first waveband. The photosensitive layer corresponding to the second waveband light receives the second waveband light. After the light is emitted, a second photosensitive electrical signal is generated.
第二方面,本申请实施例提出了一种电子设备。所述电子设备包括如上所述的摄像模组。In a second aspect, embodiments of the present application provide an electronic device. The electronic device includes the camera module as described above.
在本申请的实施例中,通过将用于感光的像素单元采用了感光堆叠结构,并配合使用了可调光谱滤光片,在摄像模组上实现了高像素、高感光性能的多光谱成像;堆叠的像素单元可在一定程度上降低摄像模组的功耗、提升解析力,再结合可调光谱滤光片能够扩展摄像模组的应用范围。In the embodiment of the present application, by using a photosensitive stack structure as a pixel unit for photosensitivity and using an adjustable spectrum filter, multispectral imaging with high pixels and high photosensitivity performance is achieved on the camera module. ; The stacked pixel units can reduce the power consumption of the camera module to a certain extent and improve the resolution, and combined with the adjustable spectral filter can expand the application scope of the camera module.
本申请的附加方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本申请的实践了解到。Additional aspects and advantages of the application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the application.
附图说明Description of the drawings
本申请的上述和/或附加的方面和优点从结合下面附图对实施例的描述中将变得明显和容易理解,其中:The above and/or additional aspects and advantages of the present application will become apparent and readily understood from the description of the embodiments in conjunction with the following drawings, in which:
图1是根据本申请实施例提供的摄像模组的结构示意图;Figure 1 is a schematic structural diagram of a camera module provided according to an embodiment of the present application;
图2是根据本申请实施例提供的摄像模组的感光层的原理示意图;Figure 2 is a schematic diagram of the principle of the photosensitive layer of the camera module provided according to an embodiment of the present application;
图3是根据本申请实施例提供的摄像模组的电致可调光谱滤光片的光谱透过率示意图;Figure 3 is a schematic diagram of the spectral transmittance of the electrically tunable spectral filter of the camera module provided according to an embodiment of the present application;
图4是根据本申请实施例提供的摄像模组的电致可调光谱滤光片的一种实施例结构示意图;Figure 4 is a schematic structural diagram of an embodiment of an electrically tunable spectral filter of a camera module provided according to an embodiment of the present application;
图5是根据本申请实施例提供的摄像模组的控制方法流程图之一; Figure 5 is one of the flow charts of the control method of the camera module provided according to the embodiment of the present application;
图6是根据本申请实施例提供的摄像模组的控制方法流程图之二;Figure 6 is the second flow chart of the control method of the camera module provided according to the embodiment of the present application;
图7是根据本申请实施例提供的摄像模组的控制方法流程图之三。Figure 7 is the third flow chart of the control method of the camera module provided according to the embodiment of the present application.
具体实施方式Detailed ways
下面将详细描述本申请的实施例,所述实施例的示例在附图中示出,其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的,仅用于解释本申请,而不能理解为对本申请的限制。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。Embodiments of the present application will be described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements with the same or similar functions. The embodiments described below with reference to the drawings are exemplary and are only used to explain the present application and cannot be understood as limiting the present application. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of this application.
本申请的说明书和权利要求书中的术语“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本申请的描述中,除非另有说明,“多个”的含义是两个或两个以上。此外,说明书以及权利要求中“和/或”表示所连接对象的至少其中之一,字符“/”,一般表示前后关联对象是一种“或”的关系。The terms "first" and "second" features in the description and claims of this application may include one or more of these features, either explicitly or implicitly. In the description of this application, unless otherwise stated, "plurality" means two or more. In addition, "and/or" in the description and claims indicates at least one of the connected objects, and the character "/" generally indicates that the related objects are in an "or" relationship.
在本申请的描述中,需要理解的是,术语“中心”、“纵向”、“横向”、“长度”、“宽度”、“厚度”、“上”、“下”、“前”、“后”、“左”、“右”、“竖直”、“水平”、“顶”、“底”“内”、“外”、“顺时针”、“逆时针”、“轴向”、“径向”、“周向”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述本申请和简化描述,而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本申请的限制。In the description of this application, it needs to be understood that the terms "center", "longitudinal", "transverse", "length", "width", "thickness", "upper", "lower", "front", " "Back", "Left", "Right", "Vertical", "Horizontal", "Top", "Bottom", "Inside", "Outside", "Clockwise", "Counterclockwise", "Axis", The orientation or positional relationship indicated by "radial direction", "circumferential direction", etc. is based on the orientation or positional relationship shown in the drawings, and is only for the convenience of describing the present application and simplifying the description, and does not indicate or imply the device or element to which it refers. Must have a specific orientation, be constructed and operate in a specific orientation and therefore should not be construed as a limitation on this application.
在本申请的描述中,需要说明的是,除非另有明确的规定和限定,术语“安装”、“相连”、“连接”应做广义理解,例如,可以是固定连接,也可以是可拆卸连接,或一体地连接;可以是机械连接,也可以是电连接;可以是直接相连,也可以通过中间媒介间接相连,可以是两个元件内部的连通。对于本领域的普通技术人员而言,可以具体情况理解上述术语在本申请中的具体含义。 In the description of this application, it should be noted that, unless otherwise clearly stated and limited, the terms "installation", "connection" and "connection" should be understood in a broad sense. For example, it can be a fixed connection or a detachable connection. Connection, or integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium; it can be an internal connection between two components. For those of ordinary skill in the art, the specific meanings of the above terms in this application can be understood on a case-by-case basis.
下面结合附图,通过具体的实施例及其应用场景对本申请实施例提供的摄像模组以及电子设备进行详细地说明。The camera module and electronic equipment provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios.
根据本申请的一个实施例,提供了一种摄像模组,该摄像模组可应用于多种形式的电子设备中。According to an embodiment of the present application, a camera module is provided, which can be applied to various forms of electronic equipment.
本申请实施例提供的摄像模组例如为CMOS摄像模组(CMOS Camera Module,CCM),其是目前智能移动终端设备上使用较广泛的摄像模组。The camera module provided by the embodiment of the present application is, for example, a CMOS camera module (CMOS Camera Module, CCM), which is a camera module that is currently widely used in smart mobile terminal devices.
当然,本申请实施例提供的摄像模组包括但不限于为上述的CMOS摄像模组,本申请实施例在此不做限制。Of course, the camera modules provided by the embodiments of the present application include but are not limited to the above-mentioned CMOS camera module, and the embodiments of the present application are not limited here.
本申请实施例提供的摄像模组,参见图1,摄像模组包括像素单元1,像素单元1包括多个层叠设置的感光层,每一个感光层可用于接收与该感光层对应波段的光;摄像模组还包括可调光谱滤光片2,可调光谱滤光片2与像素单元1相对设置;Refer to Figure 1 for the camera module provided by the embodiment of the present application. The camera module includes a pixel unit 1. The pixel unit 1 includes a plurality of photosensitive layers arranged in a stack. Each photosensitive layer can be used to receive light in a wavelength band corresponding to the photosensitive layer; The camera module also includes an adjustable spectrum filter 2, which is arranged opposite to the pixel unit 1;
可调光谱滤光片2在第一状态与第二状态之间可切换;The tunable spectral filter 2 is switchable between the first state and the second state;
当可调光谱滤光片2处于第一状态时,能供第一波段光透过、第二波段光截止,与第一波段光对应波段的感光层在接收到第一波段光之后,生成第一感光电信号;When the tunable spectrum filter 2 is in the first state, it can transmit the first waveband light and cut off the second waveband light. After receiving the first waveband light, the photosensitive layer of the waveband corresponding to the first waveband light generates a third waveband light. One senses photoelectric signals;
当可调光谱滤光片2处于第二状态时,能供第二波段透过光、第一波段光截止,与第二波段光对应波段的感光层在接收到第二波段光之后,生成第二感光电信号。When the tunable spectrum filter 2 is in the second state, it can transmit light of the second waveband and cut off the light of the first waveband. After receiving the light of the second waveband, the photosensitive layer of the waveband corresponding to the second waveband light generates a third waveband light. 2. Sensing photoelectric signals.
在本申请的实施例中,像素单元1包括多个不同感光颜色(例如,红、绿、蓝,即RGB)的感光层,且各个感光层之间为依次层叠设置,其形成了一种堆叠的像素结构设计,参见图1。In the embodiment of the present application, the pixel unit 1 includes a plurality of photosensitive layers of different photosensitive colors (for example, red, green, blue, or RGB), and each photosensitive layer is stacked in sequence, forming a stack. The pixel structure design, see Figure 1.
本申请实施例提供的像素单元1为堆叠像素结构,其可利用不同波长光具有不同穿透力的原理(波长越长穿透深度越大,即穿透深度如:红光>绿光>蓝光),使得每一个像素单元1可以同时获取该像素单元处真实的三种波长光的光强度,因此,在还原该像素单元处的色彩信息,即做三色合成时,无需进行算法滤波插值,可减少伪色,能够更好的展现出该像素单元处真实的色彩信 息,这与常规RGB像素结构相比,可以具有更好的解析力。The pixel unit 1 provided in the embodiment of the present application is a stacked pixel structure, which can utilize the principle that light of different wavelengths has different penetrating powers (the longer the wavelength, the greater the penetration depth, that is, the penetration depth is such as: red light>green light>blue light ), so that each pixel unit 1 can obtain the real light intensity of three wavelengths of light at the pixel unit at the same time. Therefore, when restoring the color information at the pixel unit, that is, when doing three-color synthesis, there is no need to perform algorithmic filtering and interpolation. It can reduce false colors and better show the true color information of the pixel unit. information, which can have better resolution compared to the conventional RGB pixel structure.
可以理解的是,由于像素单元1无需进行颜色差值,即可得到更为真实的色彩,减少了差值计算,这样功耗方明会大大降低;另一方面,像素单元1因为不需要经过算法插值,解析力方面也会有明显的提升。It can be understood that since the pixel unit 1 does not need to perform color difference, it can obtain more realistic colors and reduce the difference calculation, so the power consumption will be greatly reduced; on the other hand, the pixel unit 1 does not need to go through Algorithmic interpolation and analytical power will also be significantly improved.
在本申请的实施例中,参见图2,其示出了像素单元1 4T内部电路结构示意图。从图2中可以看出:像素单元1如包括有三个感光区,即三层堆叠像素结构,其还包括有4个晶体管,该4个晶体管分别为复位管RST、开关TG、行选择器SET以及信号放大器SF。In the embodiment of the present application, see Figure 2, which shows a schematic diagram of the internal circuit structure of the pixel unit 14T. It can be seen from Figure 2 that the pixel unit 1 includes three photosensitive areas, that is, a three-layer stacked pixel structure, and also includes four transistors. The four transistors are the reset tube RST, the switch TG, and the row selector SET. and signal amplifier SF.
在本申请的实施例中,同时采用了可调光谱滤光片2,这与传统的摄像模组中所采用的红外滤光片(IR Filter)是不同的。该可调光谱滤光片2例如可通过控制施加在其上的电压就可以调节过滤光谱的类型。也即,在不同的电压控制下,可调光谱滤光片2被配置为可以供不同波段的光谱进行透过,这样,就能扩展成像光谱的种类,进而可以扩展摄像模组的拍摄功能。In the embodiment of the present application, an adjustable spectrum filter 2 is also used, which is different from the infrared filter (IR Filter) used in traditional camera modules. The tunable spectrum filter 2 can adjust the type of filtered spectrum by controlling the voltage applied thereto, for example. That is, under different voltage controls, the tunable spectrum filter 2 is configured to transmit spectra of different wavelength bands. In this way, the types of imaging spectra can be expanded, and the shooting function of the camera module can be expanded.
例如,第一波段光设置为可见光(400nm~700nm),第二波段光设置为红外光(大于700nm),在此基础上,通过控制施加到可调光谱滤光片2的电压,就可实现让可见光透过、而红外光截止,或者实现使可见光截止、而红外光透过。这使得本申请实施例提供的摄像模组可同时兼具可见光成像和红外光成像的双重成像功能,使用者就可以根据需要灵活选择两种摄像功能中的任意一种功能进行成像操作。For example, the first band of light is set to visible light (400nm~700nm), and the second band of light is set to infrared light (greater than 700nm). On this basis, by controlling the voltage applied to the adjustable spectrum filter 2, it can be achieved Allow visible light to pass through and infrared light to be cut off, or to cut off visible light and infrared light to pass through. This allows the camera module provided by the embodiment of the present application to have dual imaging functions of visible light imaging and infrared light imaging at the same time, and the user can flexibly select either of the two camera functions for imaging operations according to needs.
参见图3,可调光谱滤光片2在处于第一状态时,可见光光谱透过率高,而红外光谱透过率低。可调光谱滤光片2在处于第二状态时,可见光光谱透过率低,而红外光谱透过率高。Referring to Figure 3, when the tunable spectrum filter 2 is in the first state, the transmittance of the visible light spectrum is high and the transmittance of the infrared spectrum is low. When the tunable spectrum filter 2 is in the second state, the transmittance of the visible light spectrum is low and the transmittance of the infrared spectrum is high.
当摄像模组利用红外光谱成像(也即可调光谱滤光片2供红外光透过、可见光截止),就可以进行夜视、检测人体温度等,并且,在云雾环境下通过红外成像可以实现穿透云雾成像。When the camera module uses infrared spectrum imaging (that is, the tunable spectrum filter 2 allows infrared light to pass through and visible light to cut off), it can perform night vision, detect human body temperature, etc., and can achieve this through infrared imaging in cloud and fog environments. Imaging through clouds and fog.
在本申请的实施例中,通过将用于感光的像素单元1采用了感光堆叠结构,并配合使用了可调光谱滤光片2,在摄像模组上实现了高像素、高感光 性能的多光谱成像;堆叠的像素单元1可在一定程度上降低摄像模组的功耗、提升解析力,再结合可调光谱滤光片2能够扩展摄像模组的应用范围。In the embodiment of the present application, by adopting a photosensitive stack structure for the pixel unit 1 used for photosensitivity, and using an adjustable spectrum filter 2, high pixels and high photosensitivity are achieved on the camera module. High-performance multispectral imaging; the stacked pixel unit 1 can reduce the power consumption of the camera module to a certain extent and improve the resolution, and combined with the adjustable spectrum filter 2 can expand the application range of the camera module.
在本申请的一些例子中,摄像模组还包括图像处理装置,图像处理装置与像素单元1电连接,图像处理装置用于根据像素单元生成的不同感光电信号执行如下至少之一的功能:In some examples of this application, the camera module also includes an image processing device. The image processing device is electrically connected to the pixel unit 1. The image processing device is configured to perform at least one of the following functions based on different photosensitive electrical signals generated by the pixel unit:
根据第一感光电信号生成第一目标图像;Generate a first target image according to the first photosensitive electrical signal;
根据第二感光电信号生成第二目标图像。A second target image is generated according to the second photosensitive electrical signal.
也就是说,本申请实施例提供的摄像模组可以具有至少两种不同的拍摄模式,能够对应的能够生成两种不同的图像。That is to say, the camera module provided by the embodiment of the present application can have at least two different shooting modes, and can correspondingly generate two different images.
其中,图像处理装置例如可包括有放大器、模数转换器(Analog-to-digital converter,ADC)及图像信号处理器(mage Signal Processing,ISP)等。在此基础上,将像素单元1依次与放大器、数模转换器电连接及图像信号处理器电连接,像素单元1生成的感光电信号可依次通过放大电路、AD转换电路等形成数字信号矩阵(图像)。Among them, the image processing device may include, for example, an amplifier, an analog-to-digital converter (Analog-to-digital converter, ADC), an image signal processor (mage Signal Processing, ISP), etc. On this basis, the pixel unit 1 is electrically connected to an amplifier, a digital-to-analog converter and an image signal processor in sequence. The photosensitive electrical signal generated by the pixel unit 1 can be passed through an amplification circuit, an AD conversion circuit, etc. in sequence to form a digital signal matrix ( image).
例如,用户选择第一波段光光谱成像,第一波段光如为可见光。也即,在可见光光谱成像模式下,控制将可调光谱滤光片2调整为处于第一状态,可见光可以透过可调光谱滤光片2,像素单元1可接收可见光中不同颜色的光进行感光,经模数转换器(ADC)进行处理,然后由图像信号处理器(ISP)进行图像信号处理,之后输出可见光光谱成像图片。由于像素单元1设计为堆叠结构,避免了常规像素平面结构占用空间大的问题;并且,在拥有较多像素单元数量的条件下,每个像素单元仍能够具有大的感光面积,同时,堆叠结构像素合成成像过程中无需进行滤波插值,减少伪色。For example, the user selects a first band of light spectrum imaging, and the first band of light is, for example, visible light. That is, in the visible light spectrum imaging mode, the tunable spectrum filter 2 is controlled to be in the first state, visible light can pass through the tunable spectrum filter 2, and the pixel unit 1 can receive light of different colors in the visible light for imaging. The light is sensed and processed by an analog-to-digital converter (ADC), and then image signal processing is performed by an image signal processor (ISP), and then a visible light spectrum imaging picture is output. Since the pixel unit 1 is designed as a stacked structure, it avoids the problem of conventional pixel plane structures occupying a large space; and, under the condition of having a large number of pixel units, each pixel unit can still have a large photosensitive area. At the same time, the stacked structure There is no need to perform filtering and interpolation during pixel synthesis and imaging, reducing false colors.
例如,用户选择第二波段光光谱成像,第二波段光如为红外光。也即,在红外光光谱成像模式下,控制将可调光谱滤光片2调整为处于第二状态,红外光可以透过可调光谱滤光片2,像素单元1可以直接接收红外光并进行相应的感光,经模数转换器进行处理,然后由图像信号处理器进行图像信号处理,之后输出红外光光谱成像图片。同样地,其中的像素单元1为堆叠结构, 避免了常规像素平面结构占用空间大的问题;并且,在拥有较多的像素单元数量条件下,每个像素单元仍能够具有大的感光面积,同时,堆叠结构像素合成成像过程中无需进行滤波插值,减少伪色。For example, the user selects a second waveband light spectrum for imaging, and the second waveband light is, for example, infrared light. That is, in the infrared spectrum imaging mode, the tunable spectrum filter 2 is controlled to be in the second state, infrared light can pass through the tunable spectrum filter 2, and the pixel unit 1 can directly receive the infrared light and perform imaging. The corresponding photosensitivity is processed by the analog-to-digital converter, and then the image signal processor performs image signal processing, and then outputs the infrared spectrum imaging picture. Similarly, the pixel unit 1 is a stacked structure, It avoids the problem of large space occupied by conventional pixel planar structures; and, with a large number of pixel units, each pixel unit can still have a large photosensitive area. At the same time, there is no need for filtering and interpolation during the stacked structure pixel synthesis imaging process. , reduce false colors.
对于本申请实施例提供的摄像模组,用户在使用该摄像模组时,可以根据具体的拍摄需要灵活选择可见光光谱和红外光光谱中的至少一者进行成像。For the camera module provided by the embodiment of the present application, when using the camera module, the user can flexibly select at least one of the visible light spectrum and the infrared light spectrum for imaging according to specific shooting needs.
在本申请的一些例子中,摄像模组还包括图像处理装置,图像处理装置与像素单元1电连接,图像处理装置用于根据像素单元1生成的不同感光电信号执行如下功能:In some examples of this application, the camera module also includes an image processing device. The image processing device is electrically connected to the pixel unit 1. The image processing device is used to perform the following functions according to different photosensitive electrical signals generated by the pixel unit 1:
交替在第一感光电信号下获取一帧图像数据、在第二感光电信号下获取下一帧图像数据,并将获取的至少两帧图像数据进行融合,以合成第三目标图像。Alternately acquire one frame of image data under the first photosensitive electrical signal, acquire the next frame of image data under the second photosensitive electrical signal, and fuse at least two acquired frames of image data to synthesize a third target image.
也就是说,本申请实施例提供的摄像模组还可以在第一波段光、第二波段光双光谱成像模式下运行,再通过多帧融合技术实现成像功能。That is to say, the camera module provided by the embodiment of the present application can also operate in the first-band light and second-band light dual-spectrum imaging mode, and then realize the imaging function through multi-frame fusion technology.
例如,将一帧图像采用第一波段光进行成像,即可调光谱滤光片2使第一波段光透过、第二波段光截止,像素单元1接收第一波段光进行感光,再经过图像处理装置处理之后输出第一波段光下的成像照片;其中,第一波段光为可见光,第二波段光为红外光,则在该步骤输出可见光成像照片;For example, when a frame of image is imaged using the first waveband light, the tunable spectral filter 2 can transmit the first waveband light and cut off the second waveband light. The pixel unit 1 receives the first waveband light for photosensitization, and then passes through the image. After processing by the processing device, the imaging photos under the first waveband light are output; wherein, the first waveband light is visible light and the second waveband light is infrared light, then the visible light imaging photos are output in this step;
接着将下一帧图像调整为使用第二波段光进行成像,即可调光谱滤光片2使第一波段光截止、第二波段光透过,像素单元1接收第二波段光进行感光,再经过图像处理装置处理之后输出第二波段光下的成像照片;其中,第一波段光为可见光,第二波段光为红外光,则在该步骤输出红外光成像照片;Then the next frame image is adjusted to use the second waveband light for imaging. The tunable spectral filter 2 cuts off the first waveband light and transmits the second waveband light. The pixel unit 1 receives the second waveband light for photosensitization. After being processed by the image processing device, the imaging photos under the second waveband light are output; wherein the first waveband light is visible light and the second waveband light is infrared light, then in this step, the infrared light imaging photos are output;
最后将多帧第一波段光、第二波段光成像照片融合之后输出,实现了双光谱成像,也即可见光、红外光双光谱成像照片。Finally, multiple frames of first-band light and second-band light imaging photos are fused and output, achieving dual-spectrum imaging, that is, dual-spectrum imaging photos of visible light and infrared light.
其中,像素单元1可为这两种光谱成像条件提供了高感光性能。像素单元1合成成像过程中无需进行滤波插值,这为图像融合提供了便利的实施条件。Among them, the pixel unit 1 can provide high photosensitivity performance for these two spectral imaging conditions. There is no need to perform filtering and interpolation during the synthetic imaging process of pixel unit 1, which provides convenient implementation conditions for image fusion.
例如,可以通过这种双光谱成像模式,实现穿透云雾的透视成像等。For example, this dual-spectrum imaging mode can be used to achieve perspective imaging through clouds and fog.
在本申请的一些例子中,参见图4,可调光谱滤光片2包括用于透过第 一波段光的第一透光区域201和用于透过第二波段光的第二透光区域202;第一透光区域201和第二透光区域202为交替设置,并排列形成设定透光阵列;各第一透光区域201连接,各第二透光区域202连接。In some examples of the present application, referring to Figure 4, the tunable spectral filter 2 includes a filter for transmitting The first light-transmitting area 201 for transmitting light of one wavelength band and the second light-transmitting area 202 for transmitting light of the second wave band; the first light-transmitting areas 201 and the second light-transmitting area 202 are arranged alternately and arranged to form a set transmission area. Light array; each first light-transmitting area 201 is connected, and each second light-transmitting area 202 is connected.
本申请实施例提供的可调光谱滤光片2,其可以设计为分区域控制进行滤光调整。这里的分区域指的是两个区域,分别为:The tunable spectral filter 2 provided in the embodiment of the present application can be designed to perform filter adjustment by regional control. The sub-regions here refer to two regions, namely:
区域一、可供第一波段光透过、第二波段光截止的区域,即上述的多个第一透光区域201,将多个第一透光区域201相互连接以形成区域一;Area 1 is an area that can transmit light of the first waveband and cut off light of the second waveband, that is, the plurality of first light-transmitting areas 201 mentioned above. The plurality of first light-transmitting areas 201 are connected to each other to form area 1;
区域二、可供第二波段光透过、第一波段光截止的区域,即上述的多个第二透光区域202,将多个第二透光区域202相互连接以形成区域二。Region two is a region that can transmit light of the second wavelength band and cut off light of the first wavelength band, that is, the plurality of second light-transmitting regions 202 mentioned above. The plurality of second light-transmitting regions 202 are connected to each other to form region two.
例如,在可调光谱滤光片2上,第一透光区域201与第二透光区域202为交替设置,可参见图4示出的结构,这有利于进行两个不同波段光融合成像。For example, on the tunable spectrum filter 2, the first light-transmitting areas 201 and the second light-transmitting areas 202 are arranged alternately, see the structure shown in FIG. 4, which is beneficial to performing two different wavelength band light fusion imaging.
需要说明的是,多个第一透光区域201虽然是间隔设置的,但确是连接在一起的,这样可以形成一个整体,有利于对其进行供电控制。同理,多个第二透光区域202之间也是相连的。It should be noted that although the plurality of first light-transmitting areas 201 are arranged at intervals, they are indeed connected together, so that they can form a whole, which is beneficial to power supply control. In the same way, the plurality of second light-transmitting areas 202 are also connected.
在本申请的一些例子中,像素单元1设置为多个,多个像素单元1排列成设定像素阵列;其中,每一个像素单元1包括三个层叠设置的感光层,感光层为硅材料的光电二极管。In some examples of this application, there are multiple pixel units 1 arranged into a set pixel array; each pixel unit 1 includes three photosensitive layers arranged in a stack, and the photosensitive layers are made of silicon material. Photodiode.
其中,像素单元1的设置数量和排布方式可以根据具体需要灵活调整,本申请实施例对此不作限制。The number and arrangement of the pixel units 1 can be flexibly adjusted according to specific needs, and this is not limited in the embodiments of the present application.
每一个像素单元1中的各感光层均为硅材料的光电二极管,可以分别对相应波段的光进行感光,使得一个像素单元可以具有多种像素信息;同时,每一个像素单元1中的各个感光层还可以对例如红外光进行感光处理。Each photosensitive layer in each pixel unit 1 is a photodiode of silicon material, which can detect light in the corresponding band respectively, so that one pixel unit can have a variety of pixel information; at the same time, each photosensitive layer in each pixel unit 1 The layer may also be photosensitive to, for example, infrared light.
例如,参见图1,每一个像素单元1包括自下而上依次层叠设置的第一感光层101、第二感光层102及第三感光层103,其中,第一感光层101设置为红色感光层,第二感光层102设置为绿色感光层,第三感光层103设置为绿色感光层,形成了堆叠设置的RGB像素结构。 For example, referring to FIG. 1 , each pixel unit 1 includes a first photosensitive layer 101 , a second photosensitive layer 102 and a third photosensitive layer 103 that are stacked sequentially from bottom to top, where the first photosensitive layer 101 is configured as a red photosensitive layer. , the second photosensitive layer 102 is configured as a green photosensitive layer, and the third photosensitive layer 103 is configured as a green photosensitive layer, forming a stacked RGB pixel structure.
也就是说,像素单元1可由位于底层的红色感光层,位于中层的绿色感光层及位于上层的蓝色感光层构成了堆叠像素结构。这一堆叠顺序是利用不同波长光具有不同穿透力的原理,波长越长穿透深度越大。按照穿透深度:红光>绿光>蓝光,参见图1。这使得每一个像素单元1可以同时获取该像素点处真实的三种波长光的光强度。That is to say, the pixel unit 1 can form a stacked pixel structure with a red photosensitive layer located on the bottom layer, a green photosensitive layer located on the middle layer, and a blue photosensitive layer located on the upper layer. This stacking sequence takes advantage of the principle that light of different wavelengths has different penetrating power. The longer the wavelength, the greater the penetration depth. According to the penetration depth: red light>green light>blue light, see Figure 1. This allows each pixel unit 1 to simultaneously obtain the real light intensity of three wavelengths of light at the pixel point.
在本申请的一些例子中,第一波段光为可见光,每一个像素单元1能接收可见光中的多个颜色的光进行感光。In some examples of this application, the first waveband light is visible light, and each pixel unit 1 can receive light of multiple colors in the visible light for photosensitization.
其中,第一波段光为波长在400nm~700nm的可见光光谱。Among them, the first band of light is a visible light spectrum with a wavelength between 400nm and 700nm.
当可见光透过可调光谱滤光片2之后,可见光入射到下方的各个像素单元1,由于每一个像素单元1包括多个感光层,使得每一个像素单元1可以同时获取该点处真实的如红、绿、蓝三种波长光的光强度,这样,每一个像素单元1均能实现大面积的感光,能提升可见光谱成像的质量。When the visible light passes through the tunable spectrum filter 2, the visible light is incident on each pixel unit 1 below. Since each pixel unit 1 includes multiple photosensitive layers, each pixel unit 1 can simultaneously obtain the real image at that point. The light intensity of the three wavelengths of red, green, and blue light, in this way, each pixel unit 1 can realize a large area of light sensitivity, which can improve the quality of visible spectrum imaging.
摄像模组进行可见光谱成像,能用于探测人眼视力以内,符合人眼视觉的物体图像色彩。The camera module performs visible spectrum imaging and can be used to detect the color of object images within human vision and in line with human vision.
在本申请的一些例子中,第二波段光为红外光,每一个像素单元1能接收红外光进行感光。In some examples of this application, the second waveband light is infrared light, and each pixel unit 1 can receive infrared light for photosensitization.
第二波段光为波长在大于700nm的红外光光谱。也就是说,摄像模组可以仅在红外光谱下进行成像。The second band of light is an infrared light spectrum with a wavelength greater than 700nm. In other words, the camera module can perform imaging only in the infrared spectrum.
当将可调光谱滤光片2调整为处于第二状态时,红外光可直接透过可调光谱滤光片2,此时可见光被截止而无法通过,红外光入射到下方的各个像素单元1,每一个像素单元1的各个感光层基于为硅材料的感光二极管,使其可以直接感应到红外光线。这就实现了摄像模组的红外光谱成像。When the tunable spectrum filter 2 is adjusted to the second state, infrared light can directly pass through the tunable spectrum filter 2. At this time, the visible light is cut off and cannot pass through, and the infrared light is incident on each pixel unit 1 below. , each photosensitive layer of each pixel unit 1 is based on a photosensitive diode made of silicon material, so that it can directly sense infrared light. This realizes infrared spectrum imaging of the camera module.
红外光谱成像能用于探测人眼视力以外的物体图像信息。Infrared spectrum imaging can be used to detect object image information beyond human vision.
在本申请的一些例子中,第二波段光为紫外光,每一个像素单元1能接收紫外光进行感光。In some examples of this application, the second waveband light is ultraviolet light, and each pixel unit 1 can receive ultraviolet light for photosensitization.
当然,本申请实施例中还可以使摄像模组在紫外光线下进行成像。Of course, in the embodiment of the present application, the camera module can also be used to perform imaging under ultraviolet light.
在本申请的一些例子中,可调光谱滤光片2上设置有电极结构3;电极 结构3与可调光谱滤光片2电连接,电极结构3用于为可调光谱滤光片2提供驱动电压,以驱使可调光谱滤光片2在第一状态与第二状态之间可切换。In some examples of this application, the tunable spectrum filter 2 is provided with an electrode structure 3; the electrode The structure 3 is electrically connected to the tunable spectrum filter 2, and the electrode structure 3 is used to provide a driving voltage for the tunable spectrum filter 2 to drive the tunable spectrum filter 2 to be adjustable between the first state and the second state. switch.
在本申请实施例提供的方案中,对于可调光谱滤光片2,通过控制施加于其上的电压,可实现可调光谱滤光片2对光谱的选择性透过。In the solution provided by the embodiment of the present application, for the tunable spectrum filter 2, by controlling the voltage applied thereto, the selective transmission of the spectrum by the tunable spectrum filter 2 can be achieved.
例如,当可调光谱滤光片2在未被施加电压的情况下,其处于第一状态,使可见光能够透过,而红外光截止;当可调光谱滤光片2在被施加电压的情况下,其处于第二状态,使红外光能够透过,而可见光截止。For example, when no voltage is applied to the tunable spectrum filter 2, it is in the first state, allowing visible light to pass through and infrared light to be cut off; when the tunable spectrum filter 2 is subject to a voltage, , it is in the second state, allowing infrared light to pass through and visible light to be cut off.
基于其电特性,可调光谱滤光片2与常规的红外滤光片是不同的,其是具有电极结构的,该可调光谱滤光片2的材质为一种电致材料。Based on its electrical characteristics, the tunable spectrum filter 2 is different from a conventional infrared filter. It has an electrode structure. The material of the tunable spectrum filter 2 is an electrotropic material.
其中,电极结构3设置在可调光谱滤光片2上,可以为可调光谱滤光片2施加电压,参见图1。Among them, the electrode structure 3 is arranged on the tunable spectrum filter 2, and a voltage can be applied to the tunable spectrum filter 2, see Figure 1.
其中,电极结构3采用透明材料电极制作。这样,可以形成全光谱可透,进而不会对成像造成影响。Among them, the electrode structure 3 is made of transparent material electrodes. In this way, full spectrum transparency can be achieved without affecting imaging.
可选的是,电极结构3的材质为氧化铟锡(ITO)。Optionally, the electrode structure 3 is made of indium tin oxide (ITO).
这种电极材料透明,全光谱可透,不会对成像有影响。This electrode material is transparent and can transmit the full spectrum without affecting imaging.
关于电极结构3在可调光谱滤光片2上的设置位置,可根据具体需要灵活调整,本申请实施例中对此不作限制。The position of the electrode structure 3 on the tunable spectrum filter 2 can be flexibly adjusted according to specific needs, and is not limited in the embodiments of the present application.
例如,电极结构3设置在可调光谱滤光片2背离像素单元1的表面上。For example, the electrode structure 3 is disposed on the surface of the tunable spectral filter 2 facing away from the pixel unit 1 .
又例如,电极结构3设置在可调光谱滤光片2朝向像素单元1的表面上。For another example, the electrode structure 3 is disposed on the surface of the tunable spectral filter 2 facing the pixel unit 1 .
再例如,电极结构3分设在可调光谱滤光片2的两个表面上。For another example, the electrode structure 3 is provided on both surfaces of the tunable spectrum filter 2 .
进一步地,电极结构3可设置在可调光谱滤光片2一表面的边缘区域上。Further, the electrode structure 3 can be disposed on the edge area of a surface of the tunable spectrum filter 2 .
此外,电极结构3可以通过涂覆或者导电胶粘接等方式设置在可调光谱滤光片2。并且,电极结构3的形状也可以灵活设置,例如呈环状结构等,本申请实施例中对此不作具体限制。In addition, the electrode structure 3 can be provided on the tunable spectrum filter 2 through coating or conductive adhesive bonding. Moreover, the shape of the electrode structure 3 can also be flexibly set, such as a ring-shaped structure, etc., which is not specifically limited in the embodiments of the present application.
在本申请的一些例子中,参见图1,摄像模组还包括微透镜层4,微透镜层4设置于可调光谱滤光片2与像素单元1之间,并覆盖在像素单元1 之上。In some examples of this application, referring to Figure 1, the camera module also includes a microlens layer 4. The microlens layer 4 is disposed between the tunable spectrum filter 2 and the pixel unit 1, and covers the pixel unit 1. above.
参见图1,在像素单元1的最上层上设置有微透镜层4(Micro Lens),该微透镜层4主要用于汇聚光线,以获得更多的进光量。Referring to Figure 1, a micro lens layer 4 (Micro Lens) is provided on the uppermost layer of the pixel unit 1. This micro lens layer 4 is mainly used to condense light to obtain more light input.
此外,在本申请的一些例子中,摄像模组还包括摄像镜头,可调光谱滤光片2设置在摄像镜头与像素单元1之间。In addition, in some examples of this application, the camera module also includes a camera lens, and the tunable spectrum filter 2 is disposed between the camera lens and the pixel unit 1 .
其中,摄像镜头可以根据需要灵活设置为一个或者多个。Among them, the camera lens can be flexibly set to one or more as needed.
以第一波段光为波长在400nm~700nm的可见光光谱,第二波段光为波长在大于700nm的红外光光谱,同时,像素单元1包括自下而上依次叠设的红色感光层、绿色感光层及绿色感光层为例,对本申请实施例提供的摄像模组中涉及的控制方法进行进一步说明。The first band of light is a visible light spectrum with a wavelength between 400nm and 700nm, and the second band of light is an infrared light spectrum with a wavelength greater than 700nm. At the same time, the pixel unit 1 includes a red photosensitive layer and a green photosensitive layer stacked sequentially from bottom to top. Taking the green photosensitive layer as an example, the control method involved in the camera module provided by the embodiment of the present application will be further explained.
本申请实施例提供的摄像模组,具有三种成像功能,对应三种不同的成像控制方法:可见光光谱成像控制方法、红外光光谱成像控制方法及可见光、红外光光谱双光谱成像控制方法。The camera module provided by the embodiment of this application has three imaging functions, corresponding to three different imaging control methods: visible light spectrum imaging control method, infrared light spectrum imaging control method, and visible light and infrared light spectrum dual spectrum imaging control method.
使用者在开启本申请实施例的摄像模组之后,可选择拍照成像模式。摄像模组在不同的摄像模式下执行不同的控制方法。After turning on the camera module according to the embodiment of the present application, the user can select a photo imaging mode. The camera module performs different control methods in different camera modes.
摄像模组在可见光光谱模式下成像的控制方法,参见图5,包括如下步骤:The control method for imaging of the camera module in visible light spectrum mode, see Figure 5, includes the following steps:
S501、将可调光谱滤光片调整为处于可见光光谱成像模式。S501. Adjust the adjustable spectrum filter to be in the visible light spectrum imaging mode.
也就是说,摄像模组需要在可见光下进行拍摄,此时,例如不对可调光谱滤光片施加电压。也即,可调光谱滤光片处于第一状态。That is to say, the camera module needs to take pictures under visible light. At this time, for example, no voltage is applied to the tunable spectrum filter. That is, the tunable spectral filter is in the first state.
S502、可见光透过、红外光截止;S502, visible light transmission, infrared light cutoff;
当外部的光线入射到可调光谱滤光片2上,其仅能供可见光透过,而红外光就被拦截住而无法透过,此时可以避免可见光成像中红外光也被下层的各个像素单元1所感光,导致可见光下拍摄的照片偏红。When external light is incident on the tunable spectrum filter 2, it can only allow visible light to pass through, while infrared light is intercepted and cannot pass through. At this time, it can be avoided that infrared light in visible light imaging is also transmitted to the lower pixels. Unit 1 is sensitive to light, causing photos taken under visible light to appear reddish.
S503、像素单元1进行感光,并能够形成相应的感光电信号;S503. The pixel unit 1 is photosensitive and can form a corresponding photosensitive electrical signal;
位于下层的每一个像素单元1可接收可见光中的红、绿、蓝光进行感光,并形成相应的感光电信号,如第一感光电信号。Each pixel unit 1 located in the lower layer can receive red, green, and blue light in visible light for photosensitivity, and form a corresponding photosensitive electrical signal, such as a first photosensitive electrical signal.
S504、可见光谱成像照片输出。 S504. Visible spectrum imaging photo output.
图像处理装置可响应于S503输出的感光电信号,并控制生成可见光光谱成像照片进行输出,以使使用者可以获得想要拍摄的图片。The image processing device can respond to the photosensitive electrical signal output in S503 and control the generation of visible light spectrum imaging photos for output, so that the user can obtain the pictures he wants to take.
可见光谱成像用于探测人眼视力以内、符合人眼视觉的物体图像色彩。Visible spectrum imaging is used to detect the color of object images within human vision and in line with human vision.
摄像模组在红外光光谱成像的控制方法,参见图6,包括如下步骤:The method of controlling the imaging of the camera module in the infrared light spectrum, see Figure 6, includes the following steps:
S601、将可调光谱滤光片调整为处于红外光光谱成像模式。S601. Adjust the adjustable spectrum filter to be in the infrared spectrum imaging mode.
也就是说,摄像模组需要在红外光下进行拍摄,此时,例如对可调光谱滤光片施加一定的电压,也即可调光谱滤光片处于第二状态。That is to say, the camera module needs to shoot under infrared light. At this time, for example, a certain voltage is applied to the tunable spectrum filter, that is, the tunable spectrum filter is in the second state.
S602、红外光可透过、可见光截止;S602, infrared light can be transmitted and visible light can be cut off;
当外部的光线入射到可调光谱滤光片2上,其仅能供红外光透过,而可见光就被拦截住而无法透过。When external light is incident on the tunable spectrum filter 2, it can only transmit infrared light, while visible light is intercepted and cannot pass through.
S603、像素单元进行感光,并能够形成相应的感光电信号;S603. The pixel unit is photosensitive and can form a corresponding photosensitive electrical signal;
位于下层的每一个像素单元1可接收红外光并进行感光,并形成相应的感光电信号,如第二感光电信号。Each pixel unit 1 located in the lower layer can receive infrared light and perform photosensitization, and form a corresponding photosensitive electrical signal, such as a second photosensitive electrical signal.
S604、红外光谱成像照片输出。S604. Infrared spectrum imaging photo output.
图像处理装置响应于S603输出的感光电信号,并生成红外光光谱成像照片进行输出。The image processing device responds to the photosensitive electrical signal output in S603 and generates an infrared spectrum imaging photo for output.
红外光谱成像可用于检测人体体温、检测塑料垃圾成分、夜视等。Infrared spectrum imaging can be used to detect human body temperature, detect the composition of plastic waste, night vision, etc.
摄像模组在可见光、红外光光谱双光谱成像控制方法,参见图7,包括如下步骤:The dual-spectrum imaging control method of the camera module in the visible light and infrared light spectrum, see Figure 7, includes the following steps:
S701、将一帧图像使用可见光谱成像,具体按照以下步骤实施:S701. Imaging a frame of image using the visible spectrum. Specifically, follow the following steps:
S7011、将可调光谱滤光片调整为处于可见光光谱成像模式;S7011. Adjust the adjustable spectrum filter to be in the visible light spectrum imaging mode;
也就是说,摄像模组需要在可见光下进行拍摄,此时,例如不对可调光谱滤光片施加电压。也即,可调光谱滤光片处于第一状态。That is to say, the camera module needs to take pictures under visible light. At this time, for example, no voltage is applied to the tunable spectrum filter. That is, the tunable spectral filter is in the first state.
S7012、可见光透过、红外光截止;S7012, visible light transmission, infrared light cutoff;
当外部的光线入射到可调光谱滤光片2上,其仅能供可见光透过,而红外光就被拦截住而无法透过,此时可以避免可见光成像中红外光也被下层的各个像素单元1所感光,导致可见光下拍摄的照片偏红。 When external light is incident on the tunable spectrum filter 2, it can only allow visible light to pass through, while infrared light is intercepted and cannot pass through. At this time, it can be avoided that infrared light in visible light imaging is also transmitted to the lower pixels. Unit 1 is sensitive to light, causing photos taken under visible light to appear reddish.
S7013、像素单元进行感光,并能够形成相应的感光电信号;S7013, the pixel unit is photosensitive and can form corresponding photosensitive electrical signals;
位于下层的每一个像素单元1可接收可见光中的红、绿、蓝光进行感光,并形成相应的感光电信号,如第一感光电信号。Each pixel unit 1 located in the lower layer can receive red, green, and blue light in visible light for photosensitivity, and form a corresponding photosensitive electrical signal, such as a first photosensitive electrical signal.
S7014、可见光谱成像照片输出。S7014, visible spectrum imaging photo output.
图像处理装置可响应于S7013输出的感光电信号,并控制生成可见光光谱成像照片进行输出,以使使用者可以获得想要拍摄的图片。The image processing device can respond to the photosensitive electrical signal output by S7013 and control the generation of visible light spectrum imaging photos for output, so that the user can obtain the pictures they want to take.
702、将下一帧图像使用红外光谱成像,具体按照以下步骤实施:702. Use infrared spectrum imaging for the next frame of image. Specifically, follow the following steps:
S7021、将可调光谱滤光片2调整为处于红外光光谱成像模式;S7021. Adjust the adjustable spectrum filter 2 to be in the infrared spectrum imaging mode;
也就是说,摄像模组需要在红外光下进行拍摄,此时,例如对可调光谱滤光片施加一定的电压,也即可调光谱滤光片处于第二状态。That is to say, the camera module needs to take pictures under infrared light. At this time, for example, a certain voltage is applied to the tunable spectrum filter, that is, the tunable spectrum filter is in the second state.
S7022、红外光可透过、可见光截止;S7022, infrared light can be transmitted and visible light can be cut off;
当外部的光线入射到可调光谱滤光片2上,其仅能供红外光透过,而可见光就被拦截住而无法透过。When external light is incident on the tunable spectrum filter 2, it can only transmit infrared light, while visible light is intercepted and cannot pass through.
S7023、像素单元进行感光,并能够形成相应的感光电信号;S7023, the pixel unit is photosensitive and can form corresponding photosensitive electrical signals;
位于下层的每一个像素单元1可接收红外光并进行感光,并形成相应的感光电信号,如第二感光电信号。Each pixel unit 1 located in the lower layer can receive infrared light and perform photosensitization, and form a corresponding photosensitive electrical signal, such as a second photosensitive electrical signal.
S7024、红外光谱成像照片输出。S7024, infrared spectrum imaging photo output.
图像处理装置响应于S7023输出的感光电信号,并生成红外光光谱成像照片进行输出。The image processing device responds to the photosensitive electrical signal output by S7023 and generates an infrared spectrum imaging photo for output.
其中,S701和S702为交替进行,但并没有严格的顺序限制。Among them, S701 and S702 are performed alternately, but there is no strict order restriction.
S703、多帧可见光、红外光谱成像照片融合输出,实现可见光、红外光谱双光谱成像。S703. Multi-frame visible light and infrared spectrum imaging photos are fused and output to realize dual spectrum imaging of visible light and infrared spectrum.
根据本申请的另一个实施例,提供了一种电子设备。According to another embodiment of the present application, an electronic device is provided.
电子设备包括如上摄像模组。Electronic equipment includes the above camera module.
电子设备可以为终端,也可以为终端之外的其他设备。示例性的,电子设备例如可以为手机、平板电脑、笔记本电脑、掌上电脑、车载电子设备、移动上网装置(Mobile Internet Device,MID)、增强现实(augmented reality, AR)/虚拟现实(virtual reality,VR)设备、机器人、可穿戴设备、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本或者个人数字助理(personal digital assistant,PDA)等,还可以为服务器、网络附属存储器(Network Attached Storage,NAS)、个人计算机(personal computer,PC)、电视机(television,TV)、柜员机或者自助机等,本申请实施例在此不作具体限定。The electronic device may be a terminal or other devices other than a terminal. For example, the electronic device may be a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a vehicle-mounted electronic device, a mobile Internet device (MID), or augmented reality. AR)/virtual reality (VR) equipment, robots, wearable devices, ultra-mobile personal computers (UMPC), netbooks or personal digital assistants (PDA), etc., can also be used for Server, network attached storage (Network Attached Storage, NAS), personal computer (personal computer, PC), television (television, TV), teller machine or self-service machine, etc., the embodiments of the present application are not specifically limited here.
根据本申请实施例的电子设备的其他构成以及操作对于本领域普通技术人员而言都是已知的,这里不再详细描述。Other structures and operations of electronic devices according to embodiments of the present application are known to those of ordinary skill in the art and will not be described in detail here.
在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示意性实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本申请的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不一定指的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任何的一个或多个实施例或示例中以合适的方式结合。In the description of this specification, reference to the terms "one embodiment," "some embodiments," "illustrative embodiments," "examples," "specific examples," or "some examples" or the like is intended to be incorporated into the description of the implementation. An example or example describes a specific feature, structure, material, or characteristic that is included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
尽管已经示出和描述了本申请的实施例,本领域的普通技术人员可以理解:在不脱离本申请的原理和宗旨的情况下可以对这些实施例进行多种变化、修改、替换和变型,本申请的范围由权利要求及其等同物限定。 Although the embodiments of the present application have been shown and described, those of ordinary skill in the art will understand that various changes, modifications, substitutions and modifications can be made to these embodiments without departing from the principles and purposes of the present application. The scope of the application is defined by the claims and their equivalents.

Claims (11)

  1. 一种摄像模组,包括:A camera module including:
    像素单元(1),所述像素单元(1)包括多个层叠设置的感光层,每一个所述感光层用于接收与该感光层对应波段的光;以及Pixel unit (1), the pixel unit (1) includes a plurality of photosensitive layers arranged in a stack, each of the photosensitive layers is used to receive light in a wavelength band corresponding to the photosensitive layer; and
    可调光谱滤光片(2),所述可调光谱滤光片(2)与所述像素单元(1)相对设置;An adjustable spectrum filter (2), which is arranged opposite to the pixel unit (1);
    所述可调光谱滤光片(2)在第一状态与第二状态之间可切换;The tunable spectral filter (2) is switchable between a first state and a second state;
    当所述可调光谱滤光片(2)处于第一状态时,能供第一波段光透过、第二波段光截止,与所述第一波段光对应波段的感光层在接收到所述第一波段光之后,生成第一感光电信号;When the tunable spectrum filter (2) is in the first state, it can transmit the first waveband light and cut off the second waveband light. The photosensitive layer corresponding to the first waveband light receives the said After the first band of light, a first photosensitive electrical signal is generated;
    当所述可调光谱滤光片(2)处于第二状态时,能供第二波段透过光、第一波段光截止,与所述第二波段光对应波段的感光层在接收到所述第二波段光之后,生成第二感光电信号。When the tunable spectrum filter (2) is in the second state, it can transmit light in the second band and cut off light in the first band. The photosensitive layer corresponding to the second band light receives the light. After the second waveband light, a second photosensitive electrical signal is generated.
  2. 根据权利要求1所述的摄像模组,所述摄像模组还包括图像处理装置,所述图像处理装置与所述像素单元(1)电连接,所述图像处理装置用于根据所述像素单元(1)生成的不同感光电信号执行如下至少之一的功能:The camera module according to claim 1, further comprising an image processing device, the image processing device being electrically connected to the pixel unit (1), and the image processing device being configured to operate according to the pixel unit. (1) The different photosensitive electrical signals generated perform at least one of the following functions:
    根据所述第一感光电信号生成第一目标图像;Generate a first target image according to the first photosensitive electrical signal;
    根据所述第二感光电信号生成第二目标图像。A second target image is generated according to the second photosensitive electrical signal.
  3. 根据权利要求1所述的摄像模组,所述摄像模组还包括图像处理装置,所述图像处理装置与所述像素单元(1)电连接,所述图像处理装置用于根据所述像素单元(1)生成的不同感光电信号执行如下功能:The camera module according to claim 1, further comprising an image processing device, the image processing device being electrically connected to the pixel unit (1), and the image processing device being configured to operate according to the pixel unit. (1) The different photosensitive electrical signals generated perform the following functions:
    交替在所述第一感光电信号下获取一帧图像数据、在所述第二感光电信号下获取下一帧图像数据,并将获取的至少两帧图像数据进行融合,以合成第三目标图像。 Alternately acquire one frame of image data under the first photosensitive electrical signal, acquire the next frame of image data under the second photosensitive electrical signal, and fuse the acquired at least two frames of image data to synthesize a third target image .
  4. 根据权利要求1所述的摄像模组,其中,所述可调光谱滤光片(2)包括用于透过第一波段光的第一透光区域(201)和用于透过第二波段光的第二透光区域(202);The camera module according to claim 1, wherein the tunable spectrum filter (2) includes a first light-transmitting area (201) for transmitting the first wave band light and a first light-transmitting area (201) for transmitting the second wave band light. The second light-transmitting area (202) of light;
    所述第一透光区域(201)和所述第二透光区域(202)为交替设置,并排列形成设定透光阵列;The first light-transmitting areas (201) and the second light-transmitting areas (202) are arranged alternately and arranged to form a set light-transmitting array;
    各所述第一透光区域(201)连接,各所述第二透光区域(202)连接。The first light-transmitting areas (201) are connected, and the second light-transmitting areas (202) are connected.
  5. 根据权利要求1所述的摄像模组,其中,所述像素单元(1)设置为多个,多个所述像素单元(1)排列成设定像素阵列;The camera module according to claim 1, wherein the pixel units (1) are provided in multiple numbers, and the plurality of pixel units (1) are arranged into a set pixel array;
    其中,每一个像素单元(1)包括三个层叠设置的感光层,所述感光层为硅材料的光电二极管。Each pixel unit (1) includes three photosensitive layers arranged in a stack, and the photosensitive layers are photodiodes made of silicon material.
  6. 根据权利要求5所述的摄像模组,其中,所述第一波段光为可见光,每一个所述像素单元(1)能接收可见光中的多个颜色的光进行感光。The camera module according to claim 5, wherein the first waveband light is visible light, and each of the pixel units (1) can receive light of multiple colors in the visible light for photosensitization.
  7. 根据权利要求5所述的摄像模组,其中,所述第二波段光为红外光,每一个所述像素单元(1)能接收红外光进行感光。The camera module according to claim 5, wherein the second waveband light is infrared light, and each of the pixel units (1) can receive infrared light for photosensitization.
  8. 根据权利要求5所述的摄像模组,其中,所述第二波段光为紫外光,每一个所述像素单元(1)能接收紫外光进行感光。The camera module according to claim 5, wherein the second waveband light is ultraviolet light, and each of the pixel units (1) can receive ultraviolet light for photosensitization.
  9. 根据权利要求1所述的摄像模组,其中,所述可调光谱滤光片(2)上设置有电极结构(3);The camera module according to claim 1, wherein the adjustable spectrum filter (2) is provided with an electrode structure (3);
    所述电极结构(3)与所述可调光谱滤光片(2)电连接,所述电极结构(3)用于为所述可调光谱滤光片(2)提供驱动电压,以驱使所述可调光谱滤光片(2)在所述第一状态与所述第二状态之间可切换。 The electrode structure (3) is electrically connected to the tunable spectrum filter (2), and the electrode structure (3) is used to provide a driving voltage for the tunable spectrum filter (2) to drive the The tunable spectral filter (2) is switchable between the first state and the second state.
  10. 根据权利要求1所述的摄像模组,所述摄像模组还包括微透镜层(4),所述微透镜层(4)设置于所述可调光谱滤光片(2)与所述像素单元(1)之间,并覆盖在所述像素单元(1)之上。The camera module according to claim 1, further comprising a microlens layer (4), the microlens layer (4) being disposed between the adjustable spectrum filter (2) and the pixel. between the units (1) and covering the pixel unit (1).
  11. 一种电子设备,包括如权利要求1-10中任意一项所述摄像模组。 An electronic device, including the camera module according to any one of claims 1-10.
PCT/CN2023/082707 2022-03-22 2023-03-21 Camera module and electronic device WO2023179589A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210292242.7 2022-03-22
CN202210292242.7A CN114650359A (en) 2022-03-22 2022-03-22 Camera module and electronic equipment

Publications (1)

Publication Number Publication Date
WO2023179589A1 true WO2023179589A1 (en) 2023-09-28

Family

ID=81994773

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/082707 WO2023179589A1 (en) 2022-03-22 2023-03-21 Camera module and electronic device

Country Status (2)

Country Link
CN (1) CN114650359A (en)
WO (1) WO2023179589A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114650359A (en) * 2022-03-22 2022-06-21 维沃移动通信有限公司 Camera module and electronic equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150381907A1 (en) * 2014-06-26 2015-12-31 Semiconductor Components Industries, Llc Imaging systems for infrared and visible imaging with patterned infrared cutoff filters
CN107517340A (en) * 2017-09-22 2017-12-26 信利光电股份有限公司 A kind of camera module and electronic equipment
CN113905149A (en) * 2020-06-22 2022-01-07 华为技术有限公司 Optical filter structure, lens, sensor, camera, electronic apparatus, and control method
CN113992868A (en) * 2021-11-30 2022-01-28 维沃移动通信有限公司 Image sensor, camera module and electronic equipment
CN215934943U (en) * 2021-07-20 2022-03-01 荣耀终端有限公司 Camera module and electronic equipment
CN114650359A (en) * 2022-03-22 2022-06-21 维沃移动通信有限公司 Camera module and electronic equipment

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106791734A (en) * 2016-12-27 2017-05-31 珠海市魅族科技有限公司 The method of device, electronic installation and IMAQ for IMAQ
CN207557552U (en) * 2017-04-14 2018-06-29 光宝电子(广州)有限公司 Lens mount and camera lens module
CN107359174B (en) * 2017-07-11 2023-07-25 展谱光电科技(上海)有限公司 Multispectral image pickup device
CN110365878B (en) * 2019-07-04 2022-05-17 华为技术有限公司 Camera device and method
CN113259546B (en) * 2020-02-11 2023-05-12 华为技术有限公司 Image acquisition device and image acquisition method
CN113489865A (en) * 2021-06-11 2021-10-08 浙江大华技术股份有限公司 Monocular camera and image processing system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150381907A1 (en) * 2014-06-26 2015-12-31 Semiconductor Components Industries, Llc Imaging systems for infrared and visible imaging with patterned infrared cutoff filters
CN107517340A (en) * 2017-09-22 2017-12-26 信利光电股份有限公司 A kind of camera module and electronic equipment
CN113905149A (en) * 2020-06-22 2022-01-07 华为技术有限公司 Optical filter structure, lens, sensor, camera, electronic apparatus, and control method
CN215934943U (en) * 2021-07-20 2022-03-01 荣耀终端有限公司 Camera module and electronic equipment
CN113992868A (en) * 2021-11-30 2022-01-28 维沃移动通信有限公司 Image sensor, camera module and electronic equipment
CN114650359A (en) * 2022-03-22 2022-06-21 维沃移动通信有限公司 Camera module and electronic equipment

Also Published As

Publication number Publication date
CN114650359A (en) 2022-06-21

Similar Documents

Publication Publication Date Title
WO2022143280A1 (en) Image sensor, camera module, and electronic device
US10032810B2 (en) Image sensor with dual layer photodiode structure
US9374512B2 (en) Thin form factor computational array cameras and modular array cameras
CN101281921B (en) Solid-state imaging device and imaging apparatus
KR101641382B1 (en) Solid-state image capture device and image capture apparatus
WO2023179527A1 (en) Camera module, control method for camera module, and electronic device
EP4161061A1 (en) Image acquisition method, camera assembly, and mobile terminal
US8035710B2 (en) Solid-state imaging device and signal processing method
KR101572020B1 (en) Multi scene depth photo sensitive device, system thereof, scene depth expanding method, and optical imaging system
EP1871091A2 (en) Camera Module
US20220130882A1 (en) Image sensor, camera assembly, and mobile terminal
WO2021233040A1 (en) Control method, camera assembly, and mobile terminal
JPS60137059A (en) 3-layer 4-stage structure solid state image sensor
US20220075104A1 (en) Image sensor and electronic camera
CN110784634B (en) Image sensor, control method, camera assembly and mobile terminal
JP2016219767A (en) Imaging sensor using infrared transmission filter for green subtraction
WO2022218222A1 (en) Pixel structure and image sensor
WO2023179589A1 (en) Camera module and electronic device
US11626436B2 (en) Imaging device and image sensor
WO2022036817A1 (en) Image processing method, image processing system, electronic device, and readable storage medium
JPH06217079A (en) Image sensor and picture information processor
WO2021159944A1 (en) Image sensor, camera assembly, and mobile terminal
US7655998B2 (en) Single plate system color solid-state image pick-up device has microlenses in red pixels set to be smaller than microlenses in green pixel
JP2002519853A (en) Pixel structure without infrared filter
US20220139974A1 (en) Image sensor, camera assembly, and mobile terminal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23773836

Country of ref document: EP

Kind code of ref document: A1