WO2024027434A1

WO2024027434A1 - Multispectral module and electronic device

Info

Publication number: WO2024027434A1
Application number: PCT/CN2023/105341
Authority: WO
Inventors: 郭利德; 周勇; 陈锴; 陈洪福
Original assignee: 华为技术有限公司
Priority date: 2022-08-01
Filing date: 2023-06-30
Publication date: 2024-02-08
Also published as: CN117560563A

Abstract

The present application provides a multispectral module and an electronic device. The multispectral module comprises a driving assembly, a lens assembly, an optical filter assembly and an image sensor. The lens assembly, the optical filter assembly and the image sensor are arranged in sequence. The optical filter assembly comprises at least one row of a plurality of optical filter sets arranged in a first direction. Each optical filter set comprises at least one row of a plurality of optical filters arranged in the first direction. The optical filters at the same position in each optical filter set have the same allowable wavelength range, and at least two of the plurality of optical filters have different allowable wavelength ranges. The driving assembly is connected to one or two of the lens assembly, the optical filter assembly and the image sensor, and used for driving one or two of the lens assembly, the optical filter assembly and the image sensor to move in the first direction. By means of the present application, the size of the multispectral module can be reduced while meeting the amount of light input and not affecting the spatial resolution.

Description

Multispectral modules and electronic equipment

This application claims priority to the Chinese patent application filed with the China Patent Office on August 1, 2022, with the application number 202210914386.1 and the invention name "Multispectral Modules and Electronic Devices", the entire content of which is incorporated into this application by reference. .

Technical field

This application relates to the field of imaging technology, and in particular to a multispectral module and electronic equipment.

Background technique

The multispectral module can obtain the radiation or reflection information of multiple spectral bands of the subject through spectroscopic technology, and then obtain the characteristic spectrum of the subject. By identifying the characteristic spectrum of the photographed target, a wide range of target chemical components can be identified, and can be used in food testing, environmental monitoring, biochemical analysis, lighting detection, biometric identification and other fields. As a type of multispectral module, the filter-type multispectral camera mainly uses the filtering characteristics of the filter to obtain multiple spectral information of the photographed target.

In the related technology, as shown in Figure 3a, the multispectral module uses a multi-lens multi-filter module, that is, the multi-spectral module includes multiple lenses, multiple different filters and multiple image sensors, each of which Each lens, each filter and each image sensor are located on the same optical axis in one-to-one correspondence. In this way, the incident light incident on each lens can pass through different filters and be irradiated onto different image sensors, thereby obtaining multiple images of the same subject, where each image has different spectral information.

However, in multispectral modules of related technologies, multiple lenses, multiple filters and multiple image sensors will occupy a large volume, making it difficult to integrate multispectral modules with this structure into installation spaces such as mobile phones. Smaller electronic devices. When a short focal length lens and a small image sensor are used to achieve a smaller size, the amount of light and spatial resolution of the multispectral module will be affected.

Contents of the invention

In order to solve the above technical problems, this application provides a multispectral module and electronic equipment, which can reduce the volume of the multispectral module while ensuring that the amount of light input and spatial resolution are not affected.

This application provides a multispectral module, including: a driving component, a lens component, a filter component and an image sensor. The lens component, the filter component and the image sensor are arranged in sequence. The image sensor is used to receive the lens component and the image sensor in sequence. The incident light of the filter assembly, wherein: the filter assembly includes at least one row of multiple filter groups arranged along the first direction, and each filter group includes at least one row of multiple filters arranged along the first direction. filters, the filters with the same position in each filter group have the same pass wavelength range, and at least two of the multiple filters have different pass wavelength ranges, and the pass wavelength range is the one that can transmit the filtered light. Among the light in the film, the wavelength range of the light with the highest transmittance; the driving component is connected to one or both of the lens component, the filter component and the image sensor, and the driving component is used to drive the lens component, the filter component and the image sensor. One or both of the image sensors move in a first direction.

When the multispectral module of the present application is used, the incident light passes through the lens assembly and the filter assembly in sequence to the image sensor, and forms an image on the image sensor. When the lens assembly, the filter assembly and the image sensor are all in motion, the incident light in one of the field of view ranges within the entire field of view of the lens assembly can illuminate a part of the image sensor after passing through a filter. Area, this partial area is an imaging unit, corresponding to a pixel of the final image obtained, and the pixel has the same spectral information.

When the driving component drives the lens assembly to move in the first direction, or the driving component drives the filter component and the image sensor to move in the first direction, since at least one row of filters in the filter set is also arranged along the first direction, therefore, The incident light in the aforementioned field of view range will be illuminated on a different filter than before the movement, so that after the incident light in the field of view range is illuminated on the imaging unit, the image pixels obtained will have different spectral information than before the movement. This enables the multispectral module to obtain multiple spectral information of the photographed target.

When the driving component drives the filter assembly to move in the first direction, or the driving component drives the lens assembly and the image sensor to move in the first direction, since at least one row of filters in the filter set is also arranged along the first direction, , the incident light in the aforementioned field of view range will be illuminated on a different filter than before the movement, so that after the incident light in the field of view range is illuminated on the imaging unit, the image pixels obtained will have different spectral information than before the movement. , thus enabling the multispectral module to obtain multiple spectral information of the photographed target.

When the driving assembly drives the image sensor to move in the first direction, or the driving assembly drives the lens assembly and the filter assembly to move in the first direction, since at least one row of filters in the filter set is also arranged along the first direction, , the incident light within the aforementioned field of view will be illuminated on a different filter than before the movement, so that after the incident light within the field of view is illuminated on the imaging unit, the image obtained The pixels have different spectral information than before movement, which enables the multispectral module to obtain multiple spectral information of the photographed target.

Since in this application, multiple spectral information of the photographed target is obtained by driving at least one of the lens assembly, the filter assembly and the image sensor to move, without the need to set up multiple lens assemblies and multiple image sensors, therefore , which can reduce the size of the multispectral module while ensuring that the amount of light input and spatial resolution are not affected.

In addition, within the entire field of view of the lens assembly, the field of view corresponding to the same filter will obtain an image with the same spectral information. When the driving assembly drives one of the lens assembly, the filter assembly and the image sensor, or When the two move, their movement distance along the first direction can be the distance between the first filter and the last filter among multiple filters located in the same row in a filter group, and There is no need to move from the first filter of the first filter set to the last filter of the last filter set in multiple filter sets located in the same row, thus greatly reducing the drive components movement distance. Since the driving component needs to move periodically when shooting a video, the number of motion cycles of the driving component per unit time can be increased, thereby increasing the frame rate of the video being shot.

In some possible implementation methods, the number of rows of filters in each filter group is multiple rows, and there are at least two rows of filters. The column direction of the multiple rows of filters is the second direction, and one row of filters The pass wavelength band of at least one filter in the film is different from the pass wavelength band of at least one filter in another row of filters; the driving component is also used to drive the lens assembly, the filter assembly and the image sensor. One or both move in a second direction, and the second direction has an included angle with the first direction. In this way, the image obtained after the incident light in one of the multiple fields of view ranges along the second direction is irradiated to the image sensor may have different spectral information along the second direction at different times. In addition, since the pass wavelength band of at least one filter in one row of filters is different from the pass wavelength band of at least one filter in another row of filters, therefore, for the incident light within the same field of view, The image pixels obtained after reaching the image sensor can have more spectral information. As a result, the multispectral module can obtain a larger number of spectral information of the photographed target.

In some possible implementation methods, the number of rows of the filter set is multiple rows, the filters with the same position in each row of filter sets all have the same pass wavelength range, and the column direction of the multi-row filter set is Second direction. In this way, within the entire field of view of the lens assembly, the field of view corresponding to the same filter will obtain an image with the same spectral information. When the driving assembly drives one of the lens assembly, the filter assembly and the image sensor, or When the two move, their moving distance can be the distance between the first filter and the last filter among multiple filters located in the same row of a filter group, without having to move from the first filter to the last filter located in the same row. The first filter of the first filter group in the plurality of filter groups moves to the last filter of the last filter group in the row, thereby greatly reducing the movement distance of the driving assembly. Since the driving component needs to move periodically when shooting a video, the number of motion cycles of the driving component per unit time can be increased, thereby increasing the frame rate of the video being shot.

In some possible implementations, in each filter group, each filter in at least one row of filters has a different pass wavelength band. In this way, when the driving component drives the lens component so that the light within a field of view of the lens component is sequentially irradiated to a row of filters in a filter group, the amount of spectral information in the image of the subject is equal to each row. The number of filters in the filter can thereby increase the amount of spectral information obtained by the multispectral module.

In some possible implementation methods, the pass wavelength range of each filter in each filter group is different. In this way, when the driving component drives the lens component so that the light within a field of view of the lens component is sequentially irradiated to each filter in a filter group, the amount of spectral information in the image of the subject is equal to the filter. The number of filters in the light plate set can increase the amount of spectral information obtained by the multispectral module.

In some possible implementation methods, the number of rows of filters in each filter group is multiple rows, the column direction of the multiple rows of filters is the second direction, and the pass wavelength range of the filters along the second direction is are all the same; the positions of the lens assembly, the filter assembly and the image sensor remain unchanged in the second direction, and the second direction has an included angle with the first direction. Since the passing wavelength bands of the filters along the second direction are all the same, when the light in a field of view range of the lens assembly moves along the second direction and passes through different filters along the second direction, the spectrum obtained The information is the same. Therefore, in this solution, the positions of the lens assembly, filter assembly and image sensor in the second direction can remain unchanged. That is to say, the driving assembly does not need to drive the lens assembly, filter assembly and image. The sensor moves in the second direction, thereby simplifying the structure.

In some possible implementations, the first direction is perpendicular to the second direction. In this way, the driving component can drive one or both of the lens component, the filter component and the image sensor to move respectively along two mutually perpendicular directions, and the filter sets are arranged in a matrix, and each filter The filters in the film set are also arranged in a matrix, making this solution easy to implement.

In some possible implementations, the ratio of the distance L between the center of the surface of the filter assembly facing the image sensor and the photosensitive surface of the image sensor to the focal length f of the lens assembly satisfies: L/f ≤ 0.1. When L/f>0.1, because the driving component drives the filter component or the image sensor to move, when the light within a field of view of the lens component irradiates two adjacent filters, that is, part of The light irradiates one of the filters, and the other part of the light irradiates the other filter. Therefore, the image pixels obtained by the imaging unit of the image sensor corresponding to the field of view have two spectral information, that is, there are two spectral information. crosstalk between. When L/f ≤ 0.1, it indicates that the distance L between the filter assembly and the image sensor is small, thereby reducing the crosstalk between different spectral information.

In some possible implementations, the ratio of the distance L between the surface center of the filter assembly toward the image sensor and the photosensitive surface of the image sensor to the back focal length BFL of the lens assembly satisfies: L/BFL ≤ 0.1. When L/BFL>0.1, since the driving component is driving the filter component or the image sensor to move, when the light within a field of view of the lens component irradiates two adjacent filters, that is, part of The light irradiates one of the filters, and the other part of the light irradiates the other filter. Therefore, the image pixels obtained by the imaging unit of the image sensor corresponding to the field of view have two spectral information, that is, there are two spectral information. crosstalk between. When L/f ≤ 0.1, it indicates that the distance L between the filter assembly and the image sensor is small, thereby reducing the crosstalk between different spectral information.

In some possible implementations, the optical filter assembly is located on the image sensor, and each optical filter corresponds to an imaging unit on the image sensor. In this way, the light irradiating the same imaging unit on the image sensor all passes through the same optical filter, thereby avoiding crosstalk between different spectral information.

In some possible implementations, the driving component includes an optical anti-shake system OIS. The OIS includes a magnet, a coil and a bracket. The bracket is fixedly connected to one or both of the lens assembly, the filter assembly and the image sensor; the coil is used to After being energized, a force is generated between the magnet and the bracket to drive one or both of the bracket, the lens assembly, the filter assembly and the image sensor to move in the first direction; and/or the coil is used to, after being energized, A force is generated with the magnet to drive the bracket, one or both of the lens assembly, the filter assembly and the image sensor to move in the second direction. Since electronic devices such as mobile phones are usually equipped with OIS, the present application can use the OIS equipped in the electronic device as the driving component of the present application to drive one or both of the lens assembly, the filter assembly and the image sensor. movement, thereby avoiding the increase in the volume of the multispectral module caused by setting up a separate driving component. Therefore, the present application can further reduce the volume of the multispectral module.

In some possible implementations, the lens assembly includes a reflective element. The reflective element is used to reflect incident light to the lens assembly. The driving assembly is used to drive the reflective element to rotate. The rotation axis of the reflective element extends along the first direction or the second direction. In this way, at different times, the angle between the reflective element and the first direction is different, and the incident light in the same direction can be reflected by the reflective element to different positions of the lens assembly, and thereby transmitted to different filters on the filter assembly. Thereby, by rotating the reflective element, different spectral information of the image corresponding to the light within the same field of view is obtained, and then multiple different spectral information of the photographed target are obtained.

In some possible implementations, the relationship between the first maximum movement distance A1 of the bracket along the first direction, the first number N ₁ of the filter set arranged along the first direction, and the image height IH satisfies: 5IH/N ₁ ≥A1≥IH/2N ₁ . When A1<IH/2N ₁ , the incident light within a field of view will illuminate a smaller number of filters in the filter set, resulting in a lower utilization of the filter assembly. When A1>5IH/N ₁ , the first maximum moving distance of the driving component is too large. Since when taking photos, the driving component needs to drive the filter component and the image sensor to move until the incident light within a field of view reaches each filter in the filter group, then when shooting video, the driving component needs to be driven The filter assembly and the image sensor move periodically. When the first maximum movement distance of the driving assembly is small, the number of movement cycles of the driving assembly per unit time can be increased, thereby increasing the frame rate of the captured video.

In some possible implementation methods, the relationship between the second maximum movement distance A2 of the bracket along the second direction, the second number N ₂ of the filter set arranged along the second direction, and the image height IH satisfies: 5IH/N ₂ ≥A2≥IH/2N ₂ . When A2<IH/2N ₂ , the incident light within a field of view will illuminate a smaller number of filters in the filter set, resulting in a lower utilization of the filter assembly. When A2>5IH/N ₂ , the second maximum moving distance of the driving component is too large. Because when taking photos, the driving component needs to drive the filter When the component and the image sensor move to a field of view, the incident light irradiates each filter in the filter group. Then when shooting a video, the driving component needs to drive the filter component and the image sensor to make periodic movements. When When the second maximum movement distance of the driving component is small, the number of motion cycles of the driving component per unit time can be increased, thereby increasing the frame rate of the captured video.

In some possible implementations, the image sensor is a black and white image sensor. Since the black-and-white image sensor has a high response to light in various bands, the multispectral module of the present application can capture the subject with higher accuracy.

In some possible implementations, each filter is a narrowband filter. Because the narrow-band filter has better filtering effect and higher transmittance, it can reduce interference information.

This application also provides an electronic device, including a housing and any of the above multispectral modules. The housing has a receiving cavity, and the multispectral module is fixed to the housing and located in the receiving cavity. Electronics enable all the effects of multispectral modules.

Description of drawings

In order to explain the technical solutions of the embodiments of the present application more clearly, the drawings needed to be used in the description of the embodiments of the present application will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application. , for those of ordinary skill in the art, other drawings can also be obtained based on these drawings without exerting creative labor.

Figure 1a is a schematic structural diagram of a multispectral module in related technology;

Figure 1b is a schematic structural diagram of a multispectral module in another related technology;

Figure 2a is a schematic structural diagram of a multispectral module in another related technology;

Figure 2b is a schematic structural diagram of a multispectral module in another related technology;

Figure 3a is a schematic structural diagram of a multispectral module in another related technology;

Figure 3b is a schematic structural diagram of a multispectral module in another related technology;

Figure 3c is a schematic structural diagram of a multispectral module in another related technology;

Figure 4a is a schematic structural diagram of a multispectral module in an embodiment of the present application;

Figure 4b is a top view of Figure 4a;

Figure 5 is a schematic structural diagram of the filter assembly in the multispectral module shown in Figure 4a;

Figure 6a is a schematic structural diagram of the multispectral module shown in Figure 4a, with the filter assembly and the image sensor located at the same position;

Figure 6b is a schematic structural diagram of the multispectral module shown in Figure 4a, with the filter assembly and image sensor located at another position;

Figure 6c is a schematic structural diagram of the multispectral module shown in Figure 4a, with the filter assembly and image sensor located at another position;

Figure 7 is a schematic structural diagram of a multispectral module in another embodiment of the present application;

Figure 8 is a schematic structural diagram of a multispectral module in another embodiment of the present application;

Figure 9 is a schematic structural diagram of a multispectral module in another embodiment of the present application;

Figure 10 is a schematic structural diagram of a multispectral module in another embodiment of the present application;

Figure 11 is a schematic structural diagram of a multispectral module in another embodiment of the present application;

Figure 12 is a schematic structural diagram of a multispectral module in another embodiment of the present application;

Figure 13a is a schematic structural diagram of the reflective element of the multispectral module located at one position in another embodiment of the present application;

Figure 13b is a schematic structural diagram of the reflective element of the multispectral module located at another position in another embodiment of the present application;

Figure 14 is a schematic structural diagram of a filter assembly in another embodiment of the present application.

Reference signs: 11-entrance slit; 12-collimating lens; 13-grating; 14-image sensor; 15-first reflector; 16-prism; 17-second reflector; 18-semi-transparent and semi-reflective lens ; 19-First coupler; 20-Manual optical fiber delay line; 21-Electric optical fiber delay line; 22-Second coupler; 23-Lens; 24-Wheel; 25-Adjustable filter; 30-Light filter Film assembly; 31-Filter set; 311-Optical filter; 40-Lens assembly; 41-First optical lens; 42-Second optical lens; 50-Drive assembly; 51-OIS; 511-Bracket; 5112- Bracket body; 5113-extension part; 512-magnet; 513-coil; 5131-first coil; 5132-second coil; 61-incident light; 70-reflective element.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in this application, ordinary people in the art All other embodiments obtained by skilled personnel without creative efforts fall within the scope of protection of this application.

The term "and/or" in this article is just an association relationship that describes related objects, indicating that three relationships can exist. For example, A and/or B can mean: A exists alone, A and B exist simultaneously, and they exist alone. B these three situations.

The terms “first” and “second” in the description and claims of the embodiments of this application are used to distinguish different objects, rather than to describe a specific order of objects. For example, the first target object, the second target object, etc. are used to distinguish different target objects, rather than to describe a specific order of the target objects.

In the embodiments of this application, words such as "exemplary" or "for example" are used to represent examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "such as" in the embodiments of the present application is not to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the words "exemplary" or "such as" is intended to present the concept in a concrete manner.

In the description of the embodiments of this application, unless otherwise specified, the meaning of “plurality” refers to two or more. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.

The multispectral module can obtain the radiation or reflection information of multiple spectral bands of the subject through spectroscopic technology, and then obtain the characteristic spectrum of the subject. By identifying the characteristic spectrum of the photographed target, a wide range of target chemical components can be identified, and can be used in food testing, environmental monitoring, biochemical analysis, lighting detection, biometric identification and other fields.

The multispectral module includes imaging optical system and spectroscopic optical system. According to the spectroscopic principle of the spectroscopic optical system, multispectral modules can be divided into dispersion type multispectral modules, interference type multispectral modules and filter type multispectral modules.

The dispersive multispectral module mainly implements light splitting based on the principle of grating dispersion or prism dispersion. The multispectral module shown in Figure 1a realizes light splitting based on grating dispersion light splitting distance, and the multispectral module shown in Figure 1b realizes light splitting based on the prism dispersion light splitting principle. As shown in Figure 1a, the incident light first passes through the entrance slit 11 and then irradiates the collimating lens 12 to become parallel light. When the parallel light irradiates the grating 13, due to the Bragg diffraction effect of the grating 13, the light of different wavelengths is reflected in different directions. The light is emitted at an exit angle and is converged and imaged at different positions on the image sensor 14, thereby achieving separation of multiple spectral information, that is, multiple different spectral information for the same photographed target can be obtained. As shown in Figure 1b, when the light is reflected to the prism 16 through the first reflector 15, since the material of the prism 16 itself has a dispersion effect, that is, the refractive index of the light of different wavelengths is different during the propagation in the prism 16, so that different wavelengths The light rays emerge at different exit angles and are finally converged and imaged at different positions on the image sensor 14, thereby achieving separation of multiple spectral information, that is, multiple different spectral information for the same photographed target can be obtained.

Interference multispectral modules mainly use light of different wavelengths to have different interference effects to achieve light splitting. For example, Figure 2a shows a Fabry-Perot (FP) interferometer, in which the incident light 61 becomes parallel light after passing through the collimating lens 12 and is emitted. After passing through the semi-transparent and semi-reflective lens 18, a part of The light is reflected to the first reflector 16 and then reflected to the half-reflective lens 18 again. The other part of the light passes through the half-reflective lens 18 and is reflected to the half-reflective lens 18 through the second reflector 17 and reflected to There is an optical path difference between the two beams of light at the semi-transparent lens 18, thereby causing interference, thereby obtaining multiple different spectral information of the photographed target. As another example, Figure 2b shows a fiber interferometer, in which the incident light 61 is divided into two beams of light after passing through the first coupler 19. The two beams of light propagate to the manual fiber delay line 20 and the electric fiber delay line 21 respectively. , and respectively delay the two beams of light for different lengths of time. After the delay, the two beams of light enter the second coupler 22. There is an optical path difference between the two delayed beams of light, thus causing interference in the second coupler 22. Then it enters the image sensor 14 to obtain multiple different spectral information of the photographed target.

The filter-type multispectral module mainly uses the filtering characteristics of the filter to obtain multiple spectral information of the photographed target. In a related technology, as shown in Figure 3a, the multispectral module uses a multi-lens multi-filter module 311, that is, the multi-spectral module includes multiple lenses 23, multiple different filters 311 and multiple There are three image sensors 14 , wherein each lens 23 , each filter 311 and each image sensor 14 are located on the same optical axis in one-to-one correspondence. In this way, the incident light 61 incident on each lens 23 can be illuminated on different image sensors 14 through different filters 311, thereby obtaining multiple images of the same object, wherein each image has different spectral information.

However, in the multispectral module of this related technology, the multiple lenses 23 , the multiple filters 311 and the multiple image sensors 14 will occupy a larger volume, making it difficult to integrate the multispectral module with this structure. Mobile phones and other electronic devices with small installation space. When a short focal length lens and a small image sensor 14 are used in order to reduce the size of the multispectral module, the amount of light and spatial resolution of the multispectral module will be affected.

In another related technology, as shown in Figure 3b, a wheel-type switching filter 311 structure is used to collect different spectral information of the photographed target at different times. Specifically, the multispectral module includes a rotating wheel 24, a plurality of different optical filters 311 fixed on the rotating wheel 24, a lens assembly 40 and an image sensor 14 (not shown in Figure 3b). When in use, the external power is used to drive the rotation of the wheel 24 to drive the optical filters 311 to rotate, so that different optical filters 311 and the lens assembly 40 are located on the same optical axis at different times. In this way, the incident light incident on the lens assembly 40 The light 61 can be incident on different filters 311 at different times, thereby obtaining the same photographed target. of multiple images, where the spectral information in each image is different.

However, in the multispectral module of this related art, while the runner 24 is provided, a driving device for driving the rotation of the runner 24 is also required. This will result in the multispectral module having a complex structure and occupying a large volume, making it difficult to Integrated into mobile phones and other electronic devices with small installation space.

In another related technology, as shown in Figure 3c, the multispectral module includes a modulatable filter 25, a lens assembly 40 and an image sensor 14. This related technology is mainly based on modulating the refractive index of the modulatable filter 25 in different time periods, thereby achieving different spectral information of the photographed target in different time periods. The modulated filter 25 can usually be an acousto-optic modulation filter, a liquid crystal modulation filter or an angle modulation filter. However, no matter what kind of modulation filter 311 is used, its size is larger than that of current mobile phones, etc. Electronic equipment that requires less space to install.

It can be seen from Figure 3a, Figure 3b and Figure 3c that multispectral modules in related technologies all have technical problems such as occupying a large volume and being difficult to integrate into electronic devices with small installation spaces such as mobile phones.

Based on this, embodiments of the present application provide a multispectral module that can be applied to electronic devices. The electronic devices can be mobile phones, cameras, tablets, wearable devices, vehicle-mounted devices, augmented reality (Augmented Reality, AR) devices, Laptops, super mobile personal computers (Personal Digital Assistant, PDA), etc. In addition to the multispectral module, the electronic device may also include a housing. The housing has a receiving cavity, and the multispectral module is fixed to the housing and located in the receiving cavity.

For convenience of description, three directions can be defined, namely the first direction (X direction), the second direction (Y direction) and the third direction (Z direction), where the Z direction is the direction of the optical path of the multispectral module, Both the X direction and the Y direction are perpendicular to the optical path of the multispectral module.

As shown in Figure 4a, the multispectral module provided by the embodiment of the present application includes a driving component 50, a lens component 40, a filter component 30 and an image sensor 14 arranged in sequence along the optical axis. Among them, the optical axis extends along the Z direction.

As shown in Figure 4a, the driving assembly 50 includes an optical image stabilizer (OIS). The OIS 51 includes a bracket 511, a plurality of magnets 512 and a plurality of coils 513. The plurality of magnets 512 are fixed on the casing of the electronic device. As shown in Figure 4b, the bracket 511 includes a bracket body 5112 and a plurality of extension portions 5113 extending outward from the outer periphery of the bracket body 5112. The number of magnets 512, coils 513 and extension parts 5113 is four. The four magnets 512 and the four extension parts 5113 are arranged in a rectangular or circular array. Each coil 513 is wound around each coil in a one-to-one correspondence. The outer periphery of the extension 5113. Each two opposite coils 513 is a group of coils 513, and a group of coils 513 are connected in series. For the convenience of description, the two coils 513 with the axis extending along the X direction are named the first coil 5131, and the two coils 513 with the axis extending along the Y direction are named The first coil 513 is named the second coil 5132. Then, the two first coils 5131 are connected in series with each other, and the two second coils 5132 are connected in series with each other.

When the driving assembly 50 is used, since the two first coils 5131 are connected in series with each other, when the two first coils 5131 are energized, a Lorentz force along the X direction is generated between the two first coils 5131 and the magnet 512. Lentz force can drive the bracket 511 to move in the X direction. And when the direction of the current on the first coil 5131 is different, the direction of the Lorentz force is different, and the movement direction of the bracket 511 is different. For example, two first coils 5131 connected in series have two pins, namely the first pin and the second pin (not shown in Figure 4b). When the current flows from the first pin, the current flows from the second pin. When the foot flows out, the direction of the Lorentz force is in the direction of the X direction; when the current flows in from the second pin and flows out from the first pin, the direction of the Lorentz force and the movement direction of the bracket 511 are in the direction of the X direction. Opposite Direction.

When the two second coils 5132 are energized, a Lorentz force along the Y direction is generated between the two second coils 5132 and the magnet 512, and the Lorentz force drives the bracket 511 to move in the Y direction. And when the current directions on the second coil 5132 are different, the movement directions of the bracket 511 are different. For example, the two first coils 5131 connected in series have two pins, the third pin and the fourth pin (not shown in Figure 4b). When the current flows from the third pin, the current flows from the fourth pin. When the pin flows out, the direction of the Lorentz force is in the Y direction; when the current flows in from the fourth pin and flows out from the third pin, the direction of the Lorentz force and the movement direction of the bracket 511 are in the Y direction. Opposite Direction.

The lens assembly 40 includes at least two optical lenses arranged along the optical axis. The optical lenses may be lenses with positive optical power or lenses with negative optical power. Illustratively, as shown in Figure 4a, in this embodiment, the lens assembly 40 includes two optical lenses. For the convenience of subsequent description, the two optical lenses are named the first optical lens 41 and the second optical lens respectively. 42, wherein the first optical lens 41 is an optical lens close to the object side, which may be a lens with positive optical power. Among them, positive refractive power refers to having a positive focal length and the effect of condensing light. The object side refers to the direction in which the incident light 61 enters the lens assembly 40 . The image side refers to the direction in which the incident light 61 emerges from the lens assembly 40 .

For example, in this embodiment, the image sensor 14 may be a black and white image sensor. Since the black-and-white image sensor has a higher response to light in various bands, the multispectral module according to the embodiment of the present application can capture the subject with higher accuracy. In other embodiments, the image sensor 14 may also be a color image sensor.

As shown in Figure 4b, the bracket 511 in the OIS 51 is connected to the image sensor 14, so that when the first coil 5131 is energized, the first The Lorentz force generated between the coil 5131 and the magnet 512 can drive the bracket 511 and drive the image sensor 14 to move in the X direction. When the second coil 5132 is energized, the Lorentz force generated between the second coil 5132 and the magnet 512 can drive the bracket 511 and drive the image sensor 14 to move in the Y direction.

As shown in FIG. 4 a , the filter assembly 30 is located between the lens assembly 40 and the image sensor 14 , and the filter assembly 30 is located on the side of the lens assembly 40 where the second optical lens 42 is located. In one possible implementation manner, the filter assembly 30 is in contact with the second optical lens 42 , thereby reducing the volume of the multispectral module and making it better applicable to electronic devices such as mobile phones with smaller installation space. In another possible implementation, there is a certain distance between the filter assembly 30 and the second optical lens 42 .

As shown in FIG. 5 , the filter assembly 30 includes a plurality of filter groups 31 arranged in a matrix, where the row direction of the matrix is the X direction and the column direction of the matrix is the Y direction. In this embodiment, the number of rows and columns of the plurality of filter groups 31 are the same, that is, the first number N 1 of the filter groups 31 arranged along the X direction is the same as the number N ₁ of the filter groups 31 arranged along the Y direction. The second number N ₂ can be the same. For example, as shown in FIG. 5 , the first number N ₁ and the second number N ₂ are both 3, that is to say, the plurality of filter groups 31 are arranged in a 3×3 matrix. In other embodiments, the first number N ₁ and the second number N ₂ may be different. That is to say, the plurality of filter groups 31 are arranged in an M×N matrix, and M and N are different.

As shown in FIG. 5 , each filter group 31 includes a plurality of filters 311 , and the plurality of filters 311 are arranged in a matrix, where the row direction of the matrix is the X direction and the column direction of the matrix is the Y direction. In this embodiment, the number of rows and columns of the plurality of filters 311 in each filter group 31 is the same, that is, the third of the filters 311 arranged along the X direction in each filter group 31 The number may be the same as the fourth number of optical filters 311 arranged along the Y direction. For example, as shown in FIG. 5 , the third number and the fourth number are both 3, that is to say, the filter set 31 includes 9 filters 311 , and the 9 filters 311 are arranged in a 3×3 matrix. The arrangement includes: filter 311a, filter 311b, filter 311c, filter 311d, filter 311e, filter 311f, filter 311g, filter 311h and filter 311i. In other embodiments, the third number and the fourth number may be different. That is to say, the plurality of filter groups 31 are arranged in an M×N matrix, and M and N are different.

In one embodiment, the pass wavelength ranges of the filters 311 with the same position in each filter set 31 are the same. Exemplarily, each filter set 31 includes a filter 311a, a filter 311b, a filter 311c, a filter 311d, a filter 311e, a filter 311f, a filter 311g, a filter There are 9 filters 311, namely plate 311h and filter 311i, and the positions of these 9 filters 311 in each filter group 31 are the same, that is to say, the 9 filters 311 in each filter group 31 The filters 311a are located in the first row and first column of each filter group 31, and the filters 311b in each filter group 31 are located in the first row and second column of each filter group 31. , the filter 311c in each filter group 31 is located in the first row and third column of each filter group 31, and the filter 311d in each filter group 31 is located in each filter group 31. In the second row and first column of the group 31, the filters 311e in each filter group 31 are located in the second row and second column of each filter group 31. The filters 311e in each filter group 31 are The filters 311f are located in the second row and third column of each filter group 31, and the filters 311g in each filter group 31 are located in the third row and first column of each filter group 31. , the filter 311h in each filter group 31 is located in the third row and second column of each filter group 31, and the filter 311i in each filter group 31 is located in each filter group 31. Third row and third column in group 31. It should be noted that the pass wavelength range of the filter 311 is the wavelength range of the light with the highest transmittance among the light that can pass through the filter 311 .

As shown in FIG. 5 , in order to clearly display the structure of the filter set 31 , two filters 311 with different pass wavelength bands are distinguished by different patterns, and two filters 311 with the same pass wavelength band are distinguished. The pattern is the same. Illustratively, the pass wavelength bands of the filters 311 in each filter group 31 are different. Therefore, as can be seen from Figure 5, the filters 311a, 311b, 311c, 311d, 311e, 311f, 311g, 311h and 311i have different patterns; the pass wavelength ranges of the filters 311a in the first row and first column of each filter set 31 are the same, so the filters 311a in the first row and first column of each filter set 31 The patterns of the light sheets 311a are all the same.

In addition, it should be noted that the nine filter groups 31 shown in Figure 5 can be the entire filter assembly 30; the nine filter groups 31 shown in Figure 5 can also be the filter assembly 30 part of The structures of the filter sets 31 can be the same or different.

In this embodiment, the optical filter 311 may be a bandpass filter, and the bandpass filter 311 is a filter 311 whose two sides of the transmission band of the spectral characteristic curve are adjacent to the cutoff band. In one implementation, the optical filter 311 may be a broadband filter 311; in another implementation, the optical filter 311 may be a narrow-band filter 311, because the narrow-band filter 311 has a relatively poor filtering effect. Good, and the transmittance is high, so it can reduce interference information.

In this embodiment, as shown in FIG. 5 , in each filter group 31 , the plurality of filters 311 in each row have different pass wavelength bands. Exemplarily, as shown in Figure 5, the filter set 31 includes three rows of filters 311, and each row of filters 311 includes three filters 311. Then, the three filters 311 in each row of filters 311 all have different pass wavelength bands. For example, the three filters 311 in the first row of filters 311 all have different pass wavelength bands, and the pass wavelength bands of the three filters 311 in the second row are different. The three filters 311 in the filter 311 all have different pass wavelength bands, and the three filters 311 in the third row of filters 311 all have different pass wavelength bands. In other embodiments, some of the filters 311 in a row of filters 311 have different pass wavelength bands, and the rest of the filters 311 have the same pass wavelength band.

In the filter set 31 , the pass wavelength range of each row of filters 311 is different from the pass wavelength ranges of other rows of filters 311 . In this way, in this embodiment, the pass wavelength ranges of each filter 311 in the filter set 31 are different. For example, as shown in FIG. 5 , the filter set 31 includes a total of nine filters 311 , and the passing wavelength ranges of the nine filters 311 are different.

As shown in Figure 4b, the bracket 511 in the OIS51 is connected to the filter assembly 30. In this way, when the first coil 5131 is energized, the Lorentz force generated between the first coil 5131 and the magnet 512 can drive the bracket 511, and The filter assembly 30 is driven to move along the X direction. When the second coil 5132 is energized, the Lorentz force generated between the second coil 5132 and the magnet 512 can drive the bracket 511 and drive the filter assembly 30 to move in the Y direction.

As shown in FIG. 6a , when the multispectral module according to the embodiment of the present application is used, the incident light 61 passes through the lens assembly 40 and the filter assembly 30 in order to illuminate the image sensor 14 and form an image on the image sensor 14 . For example, at the first moment, the incident light 61 in one of the field of view ranges within the entire field of view angle range of the lens assembly 40 can illuminate a part of the area on the image sensor 14 after passing through the first filter 311a. A partial area is an imaging unit, corresponding to a pixel of the final image, which has the same spectral information.

When the driving assembly 50 drives the filter assembly 30 and the image sensor 14 to move along the X direction, for example at the second moment, since at least one row of filters 311 in the filter group 31 is also arranged along the X direction, and the lens assembly 40 does not move, therefore, as shown in Figure 6b, the incident light 61 within the aforementioned field of view will illuminate the second filter 311b along the X direction, and the second filter 311b along the The first filter 311a illuminated by the incident light 61 at a moment has different passing wavelength ranges, so it can pass light in different wavelength ranges, so that after the incident light 61 in the field of view reaches the imaging unit of the image sensor 14, The obtained image pixels have different spectral information from the first moment, that is, multiple different spectral information of the image pixels corresponding to the incident light 61 in the same field of view can be obtained, thereby enabling the multispectral module to obtain the image of the subject. Multiple different spectral information.

When the driving assembly 50 drives the filter assembly 30 and the image sensor 14 to move in the Y direction, for example at the third moment, since at least one row of filters 311 in the filter group 31 is also arranged in the Y direction, and the lens assembly 40 is not moving, therefore, as shown in Figure 6c, the incident light 61 within the aforementioned field of view will illuminate the second filter 311d along the Y direction, and the second filter 311d along the Y direction is different from The first filter 311a that the incident light 61 irradiates at the first moment has different passing wavelength ranges, so it can pass light of different wavelengths, so that the incident light 61 in this field of view range irradiates the imaging unit of the image sensor 14 , the obtained image pixels have different spectral information from the first moment, that is, multiple different spectral information of the image pixels corresponding to the incident light 61 in the same field of view can be obtained, thereby enabling the multispectral module to obtain the photographed target of multiple different spectral information.

In the embodiment of the present application, multiple spectral information of the photographed target is obtained by driving at least one of the lens assembly 40, the filter assembly 30 and the image sensor 14 to move, without the need to set up multiple lens assemblies 40 and Therefore, the multiple image sensors 14 can reduce the volume of the multispectral module while ensuring that the amount of light input and spatial resolution are not affected.

In addition, since electronic devices such as mobile phones are usually equipped with OIS51, the present application can use the OIS51 equipped in the electronic device as the driving component 50 of the present application to drive the lens assembly 40, the filter assembly 30 and the image sensor 14. One or both of the multispectral modules can move, thereby avoiding the situation where a separate driving component 50 is provided, resulting in an increase in the volume of the multispectral module. Therefore, the present application can further reduce the volume of the multispectral module.

As shown in FIG. 5 , since the plurality of filter groups 31 in the filter assembly 30 are arranged in a matrix, the plurality of filters 311 in each filter group 31 are also arranged in a matrix, and the row direction is X direction, and the column direction is both Y direction, when each filter 311 in the filter set 31 has a different pass wavelength band, and the filters 311 with the same position in the filter set 31 in the same row are When the pass wavelength bands are all the same, then for each of the three filter groups 31 located in the first row: the pass wavelength bands of the filters 311a in the first row and the first column are all the same, and the first The pass wavelength ranges of the filters 311b in the second row and the second column are all the same, the pass wavelength ranges of the filters 311c in the first row and the third column are all the same, and the pass wavelength ranges of the filters 311d in the second row and the first column are all the same. The pass wavelength ranges of the filters 311e in the second row and the second column are all the same, the pass wavelength ranges of the filters 311f in the second row and the third column are all the same, and the pass wavelength ranges of the filters 311g in the third row and the first column are all the same. The segments are all the same, the pass wavelength segments of the filters 311h in the third row and the second column are all the same, and the pass wavelength segments of the filters 311i in the third row and the third column are all the same, which is equivalent to 9 of a filter group 31 The filters 311 are periodically arranged along the X direction. In the same way, the nine filters 311 of a filter group 31 are periodically arranged along the Y direction. In this way, within the entire field of view of the lens assembly 40, the field of view corresponding to the same filter 311 will obtain an image with the same spectral information. When the driving assembly 50 drives the filter assembly 30 and the image sensor 14 to move When , its movement distance along the The distance between the pieces 311 (that is, the filters 311c), that is, the distance between the center of the filter 311a and the center of the filter 311c among the plurality of filters 311 located in the same row, without having to start from The filter 311a of the first filter group 31 in the plurality of filter groups 31 located in the same row moves to the filter 311c of the last filter group 31, thereby greatly reducing the load of the driving assembly 50. Movement distance. Since when taking photos, the driving assembly 50 needs to drive the filter assembly 30 and the image sensor 14 to move to a field of view range where the incident light 61 irradiates each filter 311 in the filter set 31 , then when taking a video , the bracket 511 of the driving assembly 50 needs to move periodically, so that the incident light 61 in the same field of view can illuminate each filter 311 in a filter group 31 in one or part of the period. Therefore, , when the movement distance of the driving component 50 is small, the number of movement cycles of the driving component 50 per unit time can be increased, thereby increasing the frame rate of the captured video. In the same way, the number of motion cycles of the driving component 50 in the Y direction per unit time can also be increased, thereby increasing the frame rate of the captured video.

In this embodiment, in the filter set 31 , each filter 311 in each row of filters 311 has a different pass wavelength range. In order to allow the incident light 61 in the same field of view to illuminate each filter 311 of the same filter group 31 at different times, in this way, when the driving assembly 50 drives the lens assembly 40, one of the lens assembly 40 When the light within the field of view sequentially irradiates a row of filters 311 in a filter group 31, the amount of spectral information in the image of the subject is equal to the number of filters 311 in each row of filters 311. , thus, the amount of spectral information obtained by the multispectral module can be increased.

In this embodiment, as shown in FIG. 5 , the X direction is perpendicular to the Y direction, then the driving component 50 can drive the filter component 30 and the image sensor 14 to move respectively in two directions perpendicular to each other, for example, along the direction perpendicular to each other. The X- and Y-directions move separately, and this solution is easy to implement.

In this embodiment, as shown in FIG. 4a , the ratio of the distance L between the center of the surface of the filter assembly 30 toward the image sensor 14 and the photosensitive surface of the image sensor 14 and the focal length f of the lens assembly 40 satisfies: L/ f≤0.1. The distance L between the filter assembly 30 and the image sensor 14 may refer to the distance between the surface of the filter assembly 30 facing the image sensor 14 and the surface of the image sensor 14 facing the filter 311 . When L/f>0.1, since the driving component 50 drives the filter component 30 or the image sensor 14 to move, the light within a field of view of the lens component 40 irradiates two adjacent filters 311 When, that is, part of the light irradiates one of the filters 311, and another part of the light irradiates the other filter 311, therefore, the image pixels obtained by the imaging unit of the image sensor 14 corresponding to the field of view range have two spectral information. , that is, there is crosstalk between different spectral information. When L/f≤0.1, it indicates that the distance L between the filter assembly 30 and the image sensor 14 is small, thereby reducing the crosstalk between different spectral information.

In this embodiment, as shown in FIG. 4a , the ratio of the distance L between the center of the surface of the filter assembly 30 toward the image sensor 14 and the photosensitive surface of the image sensor 14 to the back focus length BFL of the lens assembly 40 satisfies: L /BFL≤0.1. Among them, the back focal length refers to the distance between the focal point at the rear of the optical system and the center point of the last optical surface, where the rear refers to the image side, and the last optical surface refers to the first optical surface from the image side. surface. When L/BFL>0.1, since the driving component 50 drives the filter component 30 or the image sensor 14 to move, the light within a field of view of the lens component 40 irradiates two adjacent filters 311 When, that is, part of the light irradiates one of the filters 311, and another part of the light irradiates the other filter 311, therefore, the image pixels obtained by the imaging unit of the image sensor 14 corresponding to the field of view range have two spectral information. , that is, there is crosstalk between different spectral information. When L/f≤0.1, it indicates that the distance L between the filter assembly 30 and the image sensor 14 is small, thereby reducing the crosstalk between different spectral information.

In some possible implementations, as shown in FIG. 7 , the filter assembly 30 is located on the image sensor 14 , and each filter 311 corresponds to an imaging unit on the image sensor 14 . In this way, the light irradiating the same imaging unit on the image sensor 14 all passes through the same filter 311 , thereby avoiding crosstalk between different spectral information.

In this embodiment, the relationship between the optical angle β1, the field of view θ of the lens assembly 40 and the first number N ₁ of the filter set 31 arranged along the X direction satisfies: 6θ/N ₁ ≥ β1 ≥ 2θ/N ₁ ; The optical angle β1 is the sandwich between the line connecting the center of the driving assembly 50 at the first position and the center of the lens assembly 40, and the line connecting the center of the driving assembly 50 at the second position and the center of the lens assembly 40. horn. The field of view angle represents the angle formed by taking the center of the surface of the lens assembly 40 closest to the object side as the vertex and the two edges of the maximum range through which the object image of the measured target can pass. The first position is the position closest to any magnet arranged along the X direction during the movement of the bracket 511, and the second position is the position furthest away from the magnet. In this way, the movement distance of the drive assembly 50 is reduced. Since the driving component 50 needs to move periodically when shooting a video, the number of motion cycles of the driving component 50 per unit time can be increased, thereby increasing the frame rate of the captured video.

In this embodiment, the optical angle β2, the field of view θ of the lens assembly 40 and the second number N ₂ of the filter set 31 arranged along the Y direction The relationship between them satisfies: 6θ/N ₂ ≥ β2 ≥ 2θ/N ₂ ; the optical angle β2 is the line connecting the center of the driving assembly 50 at the first position and the center of the lens assembly 40 , and the driving assembly 50 at the second position. The angle between the center of the lens assembly 40 and the center of the lens assembly 40 . The first position is the position closest to any magnet arranged along the X direction during the movement of the bracket 511, and the second position is the position furthest away from the magnet. In this way, the movement distance of the drive assembly 50 is reduced. Since the driving component 50 needs to move periodically when shooting a video, the number of motion cycles of the driving component 50 per unit time can be increased, thereby increasing the frame rate of the captured video.

In this embodiment, the relationship between the first maximum movement distance A1 of the bracket 511 along the X direction, the first number N ₁ of the filter set 31 arranged along the X direction, and the image height IH satisfies: 5IH/N ₁ ≥ A1 ≥IH/2N ₁ . The first maximum movement distance may refer to the distance between the position closest to any magnet 512 arranged along the X direction and the position furthest away from the magnet 512 during the movement of the bracket 511 .

When A1<IH/2N ₁ , the incident light 61 within a field of view will illuminate a smaller number of filters 311 in the filter set 31, resulting in a lower utilization of the filter assembly 30. . When A1>5IH/N ₁ , the first maximum moving distance of the driving assembly 50 is too large. Since when taking photos, the driving assembly 50 needs to drive the filter assembly 30 and the image sensor 14 to move to a field of view range where the incident light 61 irradiates each filter 311 in the filter set 31 , then when taking a video , then the driving component 50 needs to drive the filter component 30 and the image sensor 14 to make periodic movements. When the first maximum movement distance of the driving component 50 is small, the number of movement cycles of the driving component 50 per unit time can be increased, thereby improving the The frame rate of the captured video.

Since the incident light 61 for each field of view reaches each filter 311 in the filter set 31 , the utilization rate of the filter assembly 30 is high. In a possible implementation, the first maximum moving distance of the bracket 511 is the size of the filter set 31 along the X direction.

In this embodiment, the relationship between the second maximum movement distance A2 of the bracket 511 along the Y direction, the second number N ₂ of the filter set 31 arranged along the Y direction, and the image height IH satisfies: 5IH/N ₂ ≥ A2 ≥IH/2N ₂ . The second maximum movement distance A2 may refer to the distance between the position closest to any magnet 512 arranged along the Y direction and the position furthest away from the magnet 512 during the movement of the bracket 511 .

When A2<IH/2N ₂ , the incident light 61 within a field of view will illuminate a smaller number of filters 311 in the filter set 31, resulting in a lower utilization of the filter assembly 30. . When A2>5IH/ _N2 , the second maximum moving distance of the driving assembly 50 is too large. Since when taking photos, the driving assembly 50 needs to drive the filter assembly 30 and the image sensor 14 to move to a field of view range where the incident light 61 irradiates each filter 311 in the filter set 31 , then when taking a video , then the driving component 50 needs to drive the filter component 30 and the image sensor 14 to make periodic movements. When the second maximum movement distance of the driving component 50 is small, the number of movement cycles of the driving component 50 per unit time can be increased, thereby improving the The frame rate of the captured video. In a possible implementation, the second maximum moving distance of the bracket 511 is the size of the filter set 31 along the Y direction.

The difference between the embodiment shown in Fig. 8 and the embodiment shown in Fig. 4a is that in the embodiment shown in Fig. 4a, the bracket 511 of the driving assembly 50 is connected with the image sensor 14 and the filter assembly 30 Connection, in this embodiment, the bracket 511 of the driving assembly 50 is only connected to the image sensor 14 and not to the filter assembly 30 . In this way, the bracket 511 of the driving assembly 50 can drive the image sensor 14 to move in the X direction and the Y direction. Since each row of filters 311 in the filter set 31 is also arranged along the X direction, when the bracket 511 of the driving assembly 50 moves along the X direction, the incident light 61 within a field of view will sequentially illuminate different On the filter 311, the obtained image pixels have multiple different spectral information, thereby allowing the multispectral module to obtain multiple spectral information of the photographed target.

In the embodiment shown in FIG. 9 , the difference from the embodiment shown in FIG. 4 a is that in the embodiment shown in FIG. 4 a , the bracket 511 of the driving assembly 50 is connected with the image sensor 14 and the filter assembly 30 Connection, in this embodiment, the bracket 511 of the driving assembly 50 is only connected to the filter assembly 30 and not to the image sensor 14 . In this way, the components of the driving assembly 50 can drive the filter assembly 30 to move in the X direction and in the Y direction.

In the embodiment shown in FIG. 10 , the difference from the embodiment shown in FIG. 4 a is that in the embodiment shown in FIG. 4 a , the bracket 511 of the driving assembly 50 is connected with the image sensor 14 and the filter assembly 30 Connection, in this embodiment, the bracket 511 of the driving assembly 50 is connected with the lens assembly 40 but not with the image sensor 14 and the filter assembly 30 . For example, in this embodiment, the bracket 511 of the driving assembly 50 is connected to the first optical lens 41 and the second optical lens 42 in the lens assembly 40 . In this way, the bracket 511 of the driving assembly 50 can drive the lens assembly 40 to move in the X direction and the Y direction.

The difference between the embodiment shown in Fig. 11 and the embodiment shown in Fig. 4a is that in the embodiment shown in Fig. 4a, the bracket 511 of the driving assembly 50 is connected with the image sensor 14 and the filter assembly 30. Connect, in this embodiment, the bracket 511 of the drive assembly 50, Connected to lens assembly 40 and filter assembly 30 but not to image sensor 14 . For example, in this embodiment, the bracket 511 of the driving assembly 50 is connected to the image sensor 14 and the first optical lens 41 and the second optical lens 42 in the lens assembly 40 . In this way, the bracket 511 of the driving assembly 50 can drive the lens assembly 40 and the filter assembly 30 to move in the X direction and in the Y direction.

In the embodiment shown in FIG. 12 , the difference from the embodiment shown in FIG. 4 a is that in the embodiment shown in FIG. 4 a , the bracket 511 of the driving assembly 50 is connected with the image sensor 14 and the filter assembly 30 Connection, in this embodiment, the bracket 511 of the driving assembly 50 is connected to the lens assembly 40 and the image sensor 14 , but not to the filter assembly 30 . For example, in this embodiment, the bracket 511 of the driving assembly 50 is connected to the image sensor 14 and the first optical lens 41 and the second optical lens 42 in the lens assembly 40 . In this way, the bracket 511 of the driving assembly 50 can drive the lens assembly 40 and the image sensor 14 to move in the X direction and in the Y direction.

In the embodiment shown in Figure 13a, the difference from the embodiment shown in Figure 4a is that the lens assembly 40 includes a reflective element 70, which is used to deflect the light incident on the lens assembly 40 to the filter. Component 30. In one possible implementation, as shown in Figures 13a and 13b, the reflective element 70 is located on the side of the first optical lens 41 away from the second optical lens 42; in another possible implementation, the reflective element 70 Located between the first optical lens 41 and the second optical lens 42 ; in another possible implementation, the reflective element 70 is located on the side of the second optical lens 42 away from the first optical lens 41 .

The reflective element 70 may be a reflective mirror. In one possible implementation, the reflective element 70 may be a plane reflective mirror; in another possible implementation, the reflective element 70 may be the reflective prism 16 . Since the reflective element 70 can deflect the light incident on the lens assembly 40, when the distance between the lens assembly 40 and the image sensor 14 is too large, the reflective element 70 can be used to reduce the length of the optical path, thereby reducing the size of the multispectral module. Along the length.

As shown in Figure 13a, the bracket 511 of the driving assembly 50 is connected to the reflective element 70 and can drive the reflective element 70 to rotate. In a possible implementation, the two first coils 5131 have different positions along the Y direction, and the two first coils 5131 are respectively connected to the power supply of the electronic device. During application, currents in different directions are applied to the two first coils 5131 respectively. In this way, the Lorentz force F generated between the two first coils 5131 and the magnet 512 has different directions, one of which is the direction of the X direction. , the other is in the opposite direction to the X direction. Since the two first coils 5131 have a height difference along the Y direction, the two first coils 5131 will rotate under the action of two opposite Lorentz forces. As a result, the bracket 511 and the reflective element 70 are driven to rotate.

The rotation axis of the reflective element 70 extends along the X direction or the Y direction. When the rotation axis of the reflective element 70 extends along the X direction, the incident light 61 is reflected by the reflective element 70 and passes through the first optical lens 41 and the second optical lens 42 in sequence, and the position where it strikes the filter assembly 30 moves along the Y direction. . When the rotation axis of the reflective element 70 extends along the Y direction, the incident light 61 is reflected by the reflective element 70 and passes through the first optical lens 41 and the second optical lens 42 in sequence, and the position where it strikes the filter assembly 30 moves along the X direction. . For example, as shown in Figure 13a, the angle between the reflective element 70 and the to filter 311e. As shown in Figure 13b, when the driving assembly 50 drives the reflective element 70 to rotate until the angle between the reflective element 70 and the X direction is a2, the angle between the reflective element 70 and the X direction is a1, and the incident light 61 is reflected After reflection by the element 70, it passes through the first optical lens 41 and the second optical lens 42 in sequence, and is irradiated to the filter 311e. It can be seen that at different times, the angle between the reflective element 70 and the X direction is different, and the light incident on the lens assembly 40 is reflected by the reflective element 70 to different filters 311 on the filter assembly 30, thereby obtaining the same view. The light within the field range corresponds to different spectral information of the image, thereby obtaining multiple different spectral information of the photographed target. In addition, since the reflective element 70 can deflect the light incident on the lens assembly 40, when the distance between the lens assembly 40 and the image sensor 14 is too large, the reflective element 70 can be used to reduce the length of the optical path, thereby reducing the multispectral The length of the module edge.

In the embodiment shown in FIG. 14 , the difference from the embodiment shown in FIG. 5 is that the structure of the filter assembly 30 is different. In the embodiment shown in 5, in the filter assembly 30, the filter group 31 includes a plurality of filters 311, and the plurality of filters 311 are arranged in a 3×3 matrix. Each filter group The pass wavelength ranges of the optical filters 311 along the Y direction in 31 are all different. In this embodiment, the pass wavelengths of the filters 311 along the Y direction in each filter group 31 are the same, that is to say, the pass wavelengths of the filters 311 located in the same column in the filter assembly 30 The segments are all the same. It should be noted that during actual production, when the pass wavelength ranges of the filters 311 located in the same column are all the same, multiple filters 311 located in the same column can be produced as a whole, that is, as shown in FIG. 14 The structure shown can also be regarded as that the filter set 31 includes a row of filters 311, and the filters 311 are strip-shaped structures, that is, three filter sets 31 are arranged along the X direction, and each filter The film set 31 includes three strip-shaped optical filters 311 extending along the Y direction. Correspondingly, the positions of the lens assembly 40, the filter assembly 30 and the image sensor 14 in the Y direction remain unchanged.

The embodiments of the present application have been described above in conjunction with the accompanying drawings. However, the present application is not limited to the above-mentioned specific implementations. The above-mentioned specific implementations are only illustrative and not restrictive. Those of ordinary skill in the art will Inspired by this application, many forms can be made without departing from the purpose of this application and the scope protected by the claims, all of which fall within the protection of this application.

Claims

A multispectral module, characterized in that it includes: a driving component, a lens component, a filter component and an image sensor. The lens component, the filter component and the image sensor are arranged in order. The image sensor Used to receive incident light that passes through the lens assembly and the filter assembly in sequence, wherein:

The filter assembly includes at least one row of multiple filter groups arranged along the first direction, and each filter group includes at least one row of multiple filter groups arranged along the first direction, each of which The pass wavelength segments of the filters with the same position in the filter set are all the same, and the pass wavelength segments of at least two of the plurality of filters are different, and the pass wavelength segments are different. The wavelength range is the wavelength range of the light with the highest transmittance among the light that can pass through the filter;

The driving component is connected to one or both of the lens component, the filter component and the image sensor, and is used to drive the lens component, the filter component and the image sensor. One or both of the image sensors move along the first direction.
The multispectral module according to claim 1, wherein the number of rows of said filters in each said filter group is multiple rows, and the column direction of said multiple rows of filters is a second direction, there are at least two rows of said filters, wherein the pass wavelength segment of at least one of said filters in one row is different from that of at least one of said filters in another row. The passing wavelength range of the light sheet is different;

The driving assembly is also used to drive one or both of the lens assembly, the filter assembly and the image sensor to move in the second direction, which is different from the first direction. Has an angle.
The multispectral module according to claim 1 or 2, characterized in that the number of rows of the filter set is multiple rows, and the filters in each row of the filter set have the same position. The wavelength bands are all the same, and the column direction of the filter sets in multiple rows is the second direction.
The multispectral module according to any one of claims 1 to 3, characterized in that in each of the filter groups, the passage of each of the filters in at least one row of filters is The wavelength ranges are all different.
The multispectral module according to any one of claims 1 to 4, wherein the pass wavelength range of each filter in each filter group is different.
The multispectral module according to claim 1 or 3, characterized in that the number of rows of said filters in each said filter group is multiple rows, and the column direction of said multiple rows of filters is In the second direction, the pass wavelength ranges of the optical filters along the second direction are all the same;

The positions of the lens assembly, the filter assembly and the image sensor remain unchanged in the second direction, and the second direction has an included angle with the first direction.
The multispectral module according to claim 2, 3 or 6, wherein the first direction is perpendicular to the second direction.
The multispectral module according to any one of claims 1 to 7, wherein the distance L between the center of the surface of the filter assembly toward the image sensor and the photosensitive surface of the image sensor is, The ratio of the focal length f of the lens assembly satisfies:
L/f≤0.1.
The multispectral module according to any one of claims 1 to 8, wherein the distance L between the center of the surface of the filter assembly toward the image sensor and the photosensitive surface of the image sensor is, The ratio of the back focal length BFL of the lens assembly satisfies:
L/BFL≤0.1.
The multispectral module according to any one of claims 1 to 8, characterized in that the optical filter assembly is located on the image sensor, and each optical filter corresponds to a component on the image sensor. imaging unit.
The multispectral module according to claim 2, 3, 6 or 7, characterized in that the driving component includes an optical anti-shake system OIS, the OIS includes a magnet, a coil and a bracket. The coil is wound around the bracket. The bracket is fixed to one or both of the lens assembly, the filter assembly and the image sensor. connect;

The coil is used to generate force between the magnet and the magnet after being energized to drive the bracket, one or both of the lens assembly, the filter assembly and the image sensor along the first direction movement;

And/or, the coil is used to generate force between the magnet and the magnet after being energized to drive the bracket and one of the lens assembly, the filter assembly and the image sensor, or Both move in the second direction.
The multispectral module according to claim 2, 3, 6, 7 or 11, wherein the lens assembly includes a reflective element, and the reflective element is used to reflect the incident light to the lens assembly, The driving component is used to drive the reflective element to rotate, and the rotation axis of the reflective element extends along the first direction or the second direction.
The multispectral module according to claim 11, characterized in that the first maximum moving distance A1 of the bracket along the first direction, the first number of the filter groups arranged along the first direction The relationship between N 1 and high IH satisfies:
5IH/N 1 ≥A1≥IH/2N 1 .
The multispectral module according to claim 11 or 13, characterized in that the second maximum movement distance A2 of the bracket along the second direction, the second maximum movement distance A2 of the filter group arranged along the second direction, The relationship between the two quantities N 2 and like high IH satisfies:
5IH/N 2 ≥A2 ≥IH/2N 2 .
The multispectral module according to any one of claims 1 to 14, wherein the image sensor is a black and white image sensor.
The multispectral module according to any one of claims 1 to 15, characterized in that each of the optical filters is a narrow-band optical filter.
An electronic device, characterized by comprising a housing and the multispectral module according to any one of claims 1 to 16, the housing having a receiving cavity, the multispectral module being fixed to the housing, and located in the containing cavity.