TW202226818A - Image processing device, method and lens module with the same - Google Patents

Abstract

The present disclosure provides an image processing device, a method and a lens module with the same. The image processing device includes an image sensor and an image signal processor. The image sensor includes a pixel array and a filter array. The filter array is positioned corresponding to the pixel array. The filter array includes a number of filter units. The filter units divide the pixel array into a number of pixel units. Each pixel unit includes a number of pixels. Each filter unit corresponds to one pixel unit and allows a colored light to be incident on the pixel unit to generate a first Bayer image. The image signal processor receives and processes the first Bayer image, to output a first image or a second image.

Description

Image processing device, method and lens module having the same

The present invention relates to the technical field of image processing, and in particular, to an image processing device, a method and a lens module having the image processing device.

Because the lens module can fold the light path through the reflective prism, it can improve the zoom capability without increasing the thickness of the mobile phone, so that the mobile phone camera can shoot farther. However, the setting of the reflecting prism makes the scattering and dispersion problems of the lens module serious, which affects the image quality.

Please refer to FIG. 1 and FIG. 2 together. Generally, the photosensitive area of a large pixel is larger than that of a small pixel. Therefore, under the same aperture, when the same beam of incident light is irradiated, when the incident light is incident on a large pixel, less of the incident light enters adjacent pixels. Therefore, the use of large pixels can effectively reduce the problem of color crosstalk between pixels. On the other hand, by limiting the amount of incoming light to reduce the incident angle of the incident light, the influence of large-angle scattered light and scattered light on adjacent pixels can also be effectively reduced. Therefore, the conventional periscope lens module uses larger-sized pixels and smaller apertures to reduce color crosstalk between pixels, thereby avoiding the effects of large-angle scattered light and chromatic light. However, if large-sized pixels are selected, the number of pixels will be reduced under the condition of the same size of the image sensor, which will affect the image clarity. If a smaller aperture is used, the image brightness will be affected, which is not conducive to shooting in dark scenes. For example, the aperture value of the periscope lens module mounted on the conventional mobile phone is mostly in the range of F5.0-F3.0, and the unit area of each pixel is mostly in the range of 1.0-1.12 microns. Obviously, this configuration makes the imaging quality of the conventional lens module poor.

In view of the above, the present invention provides an image processing apparatus, a method, and a lens module having the image processing apparatus, so as to effectively improve the imaging quality.

A first aspect of the present invention provides an image processing device, including an image sensor and an image signal processor, the image sensor including a pixel array and a filter array, the filter array corresponding to the pixel array It is arranged that the filter array includes a plurality of filter units, the filter units divide the pixel array into a plurality of pixel units, each pixel unit includes a plurality of pixels, and each of the filter units corresponds to a pixel unit, and allowing a colored light to be incident on the pixel unit to generate a first Bayer image, the image signal processor is electrically connected to the image sensor for receiving the output of the image sensor and processing the first Bayer image to output the first image or the second image.

Further, the image sensor further includes a microlens array, the microlens array includes a plurality of microlenses, each of the microlenses corresponds to one filter unit of the filter array and one of the pixel arrays Pixel unit settings.

Further, the number of the plurality of filter units is four, and the four filter units are arranged adjacent to each other to form a 2*2 filter array, and the pixel array is divided into four pixel units. .

Further, the image signal processor includes a switching module, a first processing module and a second processing module, the switching module is used for receiving the first Bayer image output by the image sensor, and according to the current mode of the image signal processor, select or trigger the first processing module or the second processing module, so that the first processing module or the second processing module The first Bayer image is processed to output the first image or the second image.

Further, when the image signal processor is in the first mode, the first processing module receives the first Bayer image transmitted by the switching module, and performs pixel rearrangement on the first Bayer image , to obtain a second Bayer image, and then perform demosaic processing on the second Bayer image to obtain the first image.

Further, the image signal processor further includes a filtering unit, and the filtering unit is configured to perform mean filtering on each pixel unit in the first Bayer image before generating the second Bayer image .

Further, when the image signal processor is in the second mode, the second processing module receives the first Bayer image transmitted by the switching module, and performs pixel combination processing on the first Bayer image , to obtain a third Bayer image, and then perform demosaic processing on the third Bayer image to obtain the second image.

A second aspect of the present invention further provides a lens module, including a periscope lens, and the lens module further includes the above-mentioned image processing device.

A third aspect of the present invention provides an image processing method, the image processing method comprising:

acquiring a first Bayer image;

According to the current mode, switch to the corresponding processing module;

Image processing is performed on the first Bayer image to obtain a first image or a second image.

Further, when in the first mode, pixel rearrangement is performed on the first Bayer image to obtain a second Bayer image, and then demosaicing is performed on the second Bayer image to obtain the first image image; when in the second mode, pixel binning is performed on the first Bayer image to obtain a third Bayer image, and then demosaicing is performed on the third Bayer image to obtain the second image.

The image processing device, method and lens module provided by the present invention can adapt to various focal lengths and scenes, and overcome the image resolution caused by the small aperture and large pixel area of the conventional periscope lens. Low brightness and low brightness, as well as color crosstalk caused by scattered light and chromatic light between pixels, effectively improve imaging quality.

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work shall fall within the protection scope of the present invention.

It should be noted that when an element is referred to as being "electrically connected" to another element, it can be directly on the other element or an intervening element may also be present. When an element is considered to be "electrically connected" to another element, it can be connected by contact, eg, by wire connection, or by non-contact connection, eg, by non-contact coupling.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terms used herein in the description of the present invention are for the purpose of describing specific embodiments only, and are not intended to limit the present invention.

Some embodiments of the present invention will be described in detail below with reference to the accompanying drawings. The embodiments described below and the features of the embodiments may be combined with each other without conflict.

Referring to FIG. 3 , a preferred embodiment of the present invention provides an image processing apparatus 100 , which can be applied to a lens module 200 to improve the imaging quality of the lens module 200 . The image processing device 100 includes an image sensor (CMOS Image Sensor, CIS) 40 and an image signal processor (Image Signal Processor, ISP) 80 . The image sensor 40 is used for converting the collected optical signals into electrical signals and outputting a first Bayer image. The image signal processor 80 is electrically connected to the image sensor 40 for receiving the first Bayer image, and processing the first Bayer image to output the first image or the first image correspondingly. Second image.

Please also refer to FIG. 4 , the image sensor 40 includes a pixel array 10 , a filter array 20 and a microlens array 30 .

The pixel array 10 includes a plurality of pixels 11 . A plurality of the pixels 11 constitute the array in the form of N*M. Among them, N and M are both positive integers, and the values of N and M may be equal or unequal. For example, in this embodiment, the N and M are both 4, that is, the pixels 11 form a 4*4 array. It can be understood that, in this embodiment, the unit area of each pixel 11 may be less than 1 micrometer. In one embodiment, the unit area of each of the pixels 11 is 0.8 microns.

The filter array 20 is disposed corresponding to the pixel array 10 . In this embodiment, the shape and size of the filter array 20 are corresponding to the pixel array 10 , which includes a plurality of filter units. Each filter unit includes at least one filter for filtering the incident light, so that a colored light is incident to the corresponding pixel 11 through the filter array 20 .

In this embodiment, the filter array 20 includes four filter units, namely a first filter unit 21 , a second filter unit 22 , a third filter unit 23 and a fourth filter unit 24 . The first filter unit 21 , the second filter unit 22 , the third filter unit 23 and the fourth filter unit 24 are disposed adjacent to each other and form a 2*2 filter array.

It can be understood that, in this embodiment, each of the filter units only allows one type of colored light to pass through. For example, the first filter unit 21 and the fourth filter unit 24 located at the upper left corner and the lower right corner of the filter array 20 only allow light of the first color, such as green light, to pass through. The second filter unit 22 located at the upper right corner of the filter array 20 only allows light of the second color, such as red light, to pass through. The third filter unit 23 located at the lower left corner of the filter array 20 only allows light of a third color, such as blue light, to pass through. In this way, the first filter unit 21 , the second filter unit 22 , the third filter unit 23 and the fourth filter unit 24 can form a four-Bayer color filter array in the form of a GRBG. Of course, in other embodiments, the fourth Bayer color filter array formed by the filter array 20 is not limited to the above-mentioned GRBG form, and may also be in other forms, such as RGGB form or BGGR form. In addition, the arrangement of the filter units in the filter array 20 is not limited to the arrangement of the 2*2 filter units in this embodiment. In other embodiments, the filter units of the filter array can also be adjusted according to actual needs. For example, the filter units on the filter array 20 can also be arranged in an arrangement of 3*3 filter units.

Referring to FIG. 7 , it can be understood that in this embodiment, the plurality of filter units divide the pixel array 10 into a plurality of pixel units 12 . Each pixel unit 12 includes a plurality of said pixels 11 . Each filter unit is disposed corresponding to the corresponding pixel unit 12 in the pixel array 10 , and allows a colored light to be incident on the pixel unit 12 . That is, in this embodiment, four of the filter units correspond to four pixel units 12 , and the number of the pixel units 12 corresponds to the number of the filter units.

It can be understood that the shape and size of the filter array 20 correspond to the pixel array 10 , and each filter unit corresponds to one pixel unit 12 . Therefore, the pixel array 10 is divided into a corresponding number of pixel units 12 according to the number of the pixel units 12 , that is, divided into four pixel units 12 . Wherein, each of the pixel units 12 constitutes a sub-array of M1*M2. Wherein, M1 and M2 are both positive integers greater than 1, and they may be the same or different. For example, in this embodiment, both M1 and M2 are 2.

In this embodiment, since the first filter unit 21 , the second filter unit 22 , the third filter unit 23 and the fourth filter unit 24 correspond to four adjacent pixels on the pixel array 10 respectively The units 12 are arranged such that each of the pixel units 12 includes 2*2 pixels 11, and each pixel 11 in each pixel unit 12 filters light of the same color.

Specifically, in this embodiment, when the filter array 20 is arranged according to the four Bayer color filter array of GRBG, light of a specific wavelength (such as red light, green light or blue light) can be transmitted, thereby making the pixel Array 10 outputs a first Bayer image (see Figure 7). Wherein, the first Bayer images are arranged in a 4*4 array. Among them, the pixel value of each pixel 11 in the pixel unit 12 located in the upper left corner is the pixel value of the G color channel, and the pixel value of each pixel 11 in the pixel unit 12 located in the upper right corner is the pixel value of the R color channel, located in the lower left The pixel value of each pixel 11 in the pixel unit 12 at the corner is the pixel value of the B color channel, and the pixel value of each pixel 11 in the pixel unit 12 at the lower right corner is the pixel value of the G color channel. That is, each pixel in the first Bayer image has only one pixel value of three color channels of RGB.

Please refer to FIG. 4 and FIG. 8 together. The microlens array 30 is used to focus the incident light, so that the focused incident light is projected onto the filter array 20 . The microlens array 30 is disposed on a side of the filter array 20 away from the pixel array 10 . The microlens array 30 includes a plurality of microlenses 31 . Each of the microlenses 31 is disposed corresponding to one filter unit of the filter array 20 . That is, each of the microlenses 31 is disposed corresponding to one pixel unit 12 . In this way, each of the pixel units 12 on the pixel array 10 can use filters of the same color and share the same microlens 31 .

It can be understood that, in the conventional pixel array, since each pixel is correspondingly provided with a microlens, a gap exists between the microlenses between each pixel. When the incident light enters the gap between the microlens and the microlens, part of the incident light cannot be converted into electrical signals, which will reduce the utilization rate of the incident light. In this case, by arranging the microlenses 31 corresponding to the filter unit and the pixel unit 12, that is, a plurality of pixels 11 constitute a pixel unit and share a microlens 31, which can effectively reduce the difference between the microlens and the microlens. The interval between them, thereby improving the utilization rate of incident light.

Referring to FIG. 5 to FIG. 6 together, it can be understood that each pixel 11 on the pixel array 10 is further provided with a photodiode (PD) 13 and a readout circuit 14 . The photodiode 13 is used for photoelectric conversion of the light absorbed by each of the pixels 11 to obtain a corresponding electrical signal. The readout circuit 14 is used for reading out the electrical signal to obtain the light intensity value of the default wavelength corresponding to each of the pixels 11 . In this way, according to the light intensity value of each pixel, the first Bayer image can be obtained.

It can be understood that when incident light enters, the incident light will pass through the microlens array 30 , the filter array 20 and the pixel array 10 in sequence. The incident light is first condensed by the microlens array 30, and then each filter unit in the filter array 20 filters the condensed incident light and enters the pixel array 10, so that the The pixel unit 12 corresponding to each filter unit is illuminated by one of the three color lights of RGB. The photodiode 13 and the readout circuit 14 on each of the pixels 11 then obtain the light intensity value of the colored light corresponding to each of the pixels 11 to generate the first Bayer image.

Please refer to FIG. 3 again, the image signal processor 80 is electrically connected to the image sensor 40 for acquiring the first Bayer image generated by the image sensor 40, and according to the image The current mode of the image signal processor 80 performs corresponding processing on the first Bayer image to output the first image or the second image.

In this embodiment, the image signal processor 80 includes a switching module 50 , a first processing module 60 and a second processing module 70 . The switching module 50 is electrically connected to the image sensor 40 . The first processing module 60 and the second processing module 70 are both electrically connected to the switching module 50 . The switching module 50 is used for receiving the first Bayer image output by the image sensor 40 and selecting or triggering the first processing module 60 according to the current mode of the image signal processor 80 or the second processing module 70, so that the first processing module 60 or the second processing module 70 processes the first Bayer image, and then outputs the first image or the first Bayer image. Second image.

For example, when the switching module 50 receives the first Bayer image and determines that the image signal processor 80 is in the first mode, the first processing module 60 is selected or triggered. The first processing module 60 receives the first Bayer image transmitted by the switching module 50, and performs pixel rearrangement (Remosaic) processing on the first Bayer image to obtain a second Bayer image (please Refer to FIG. 9 ), and then perform demosaic processing on the second Bayer image to obtain the first image.

Please also refer to FIG. 9 , the pixel rearrangement refers to processing the first Bayer image shown in FIG. 7 into the second Bayer image (see FIG. 9 ), that is, processing a four-Bayer color filter array image is a Bayer image with a standard Bayer filter array. Obviously, compared with the four Bayer color filter array shown in FIG. 7, the standard Bayer color filter array shown in FIG. In addition to the green pixels, 2 red pixels, 2 blue pixels and 4 green pixels are distributed around each green pixel in the second Bayer image. It can be understood that the second Bayer image is also a Bayer image, that is, each pixel in the second Bayer image only has a pixel value of any one color channel of the three RGB channels.

The demosaic processing refers to processing the second Bayer image into an RGB image, that is, the first image. Obviously, the first image is an RGB image in which each pixel has pixel values of three color channels of RGB. The pixel rearrangement processing and the demosaicing processing can be implemented by different interpolation algorithms, such as linear interpolation, mean interpolation and other algorithms, which will not be repeated here.

It can be understood that, in this embodiment, the image signal processor 80 further includes a filtering unit 61 . The filtering unit 61 is electrically connected to the first processing module 60 . The filtering unit 61 is used to perform mean filtering on each pixel unit 12 in the first Bayer image before generating the second Bayer image. In this way, the influence of scattered light and chromatic light on the first Bayer image is reduced, thereby effectively reducing the noise of the pixels in the generated second Bayer image.

It can be understood that when the switching module 50 receives the first Bayer image and determines that the image signal processor 80 is in the second mode, the second processing module 70 will be selected or triggered. The second processing module 70 receives the first Bayer image transmitted by the switching module 50, and performs pixel combination processing on the first Bayer image to obtain a third Bayer image (refer to FIG. 10 ). , and then perform demosaic processing on the third Bayer image to obtain the second image.

It can be understood that, referring to FIG. 10 , in this embodiment, the third Bayer image is also a Bayer image. In one embodiment, after pixel binning, the number of pixels in the third Bayer image is the same as the number of pixel units 12, and the area of each pixel in the third Bayer image is the The area of the pixel unit 12 .

It can be understood that, since the first image is obtained from the first Bayer image through pixel rearrangement and demosaicing, that is, pixel merging is not performed during the generation of the first image, the The number of pixels in an image is the same as the number of pixels in the first Bayer image, and the area of each pixel in the first image is equal to the area of each pixel in the first Bayer image. The second image is obtained by combining four pixels of the first Bayer image. The number of pixels in the second image is the same as the number of pixel units in the first Bayer image. The area of each pixel in the image is the same as the area of each pixel unit of the first Bayer image. Thus, the number of pixels of the first image is four times that of the second image, but the second image is the same size as the first image. Generally, for images of the same size, the more pixels, the higher the resolution and the clearer the image. Similarly, for images of the same size, the larger the area of each pixel, the more light signals will be absorbed. Therefore, the image resolution of the first image is higher than that of the second image. And the brightness of the second image is higher than that of the first image.

Obviously, in this embodiment, the first mode is the Remosaic mode, and the second mode is the Binning mode. The Remosaic mode is processed based on each pixel of the first Bayer image, the output first image has a higher resolution, and the first Bayer image is filtered by the filtering unit 61 processing to improve stray light margin and reduce pixel-to-pixel color crosstalk.

The Binning mode is processed by combining the plurality of pixels of each pixel unit 12 corresponding to each filter unit into one pixel for processing, increasing the area of each pixel, thereby improving the sensitivity, improving the stray light margin, reducing Color crosstalk between pixels.

It can be understood that in the image processing apparatus 100 of the present invention, each filter unit corresponds to one pixel unit 12 , each filter unit only allows one type of colored light to pass through, and each microlens corresponds to a filter unit and A pixel unit setting. Combined with the Remosaic mode of the image signal processor 80, the arrangement of the pixel array 10 is restored to the Bayer array arrangement, and through filtering processing, the stray light margin is improved, and the color crosstalk between pixels is reduced, so that it can be used with small Size pixels are used to output high-resolution images. Combined with the binning mode of the image signal processor 80, it is equivalent to the light incident on a larger area of pixels, improving the stray light margin and sensitivity, so that a larger aperture lens can be used. That is to say, the image processing device 100 provided by the present invention can adapt to various focal lengths and scenes, and overcomes the low image resolution and low brightness caused by the small aperture and large pixel area of the conventional periscope lens, and the scattered light and the brightness between the pixels. The problem of color crosstalk caused by scattered light can effectively improve the image quality.

Please refer to FIG. 1 again, the lens module 200 further includes a periscope lens 90 . The periscope lens 90 is used for accommodating incident light to pass through, so as to optically image on the image sensor 40 .

The periscope lens 90 may be a telephoto end and/or a wide-angle end. It can be understood that when the periscope lens 90 is the telephoto end or the wide-angle end, the image processing apparatus 100 can output the first image or the second image.

It can be understood that when the periscope lens 90 is at the telephoto end, the focusing distance is long, the angle of incident light is small, and the amount of incoming light is small. When the image signal processor 80 is in the first mode, the pixel arrangement of the outputted first image is restored to a general Bayer array, and the resolution of the first image is improved. When the image signal processor 80 is in the second mode, through pixel binning, stray light is reduced and the sensitivity of the output second image is improved, and the output second image has less crosstalk noise few.

It can be understood that when the periscope lens 90 is at the wide-angle end, the focusing distance is short, the incident light angle is relatively large, and the incident light amount is relatively large. When the image signal processor 80 is in the first mode, the pixel arrangement of the output first image is restored to a normal Bayer array, the resolution of the first image is improved, and the mean filter is performed Less pixel-to-pixel color crosstalk, so the first mode is more suitable for bright scenes. When the image signal processor 80 is in the second mode, the sensitivity of the output second image is improved by pixel binning, so that the second mode is more suitable for dark scenes.

Apparently, the lens module 200 can effectively overcome the problems of low resolution and low brightness of the image obtained by the conventional periscope lens through the configuration of the image processing device 100 .

Please also refer to FIG. 11 , the present invention further provides an image processing method, and the image processing method at least includes the following steps.

Step S1, acquiring a first Bayer image.

It can be understood that, in step S1, the first Bayer image can be obtained by the image sensor 40 described above. The specific structure and working principle of the image sensor 40 are referred to above, and will not be repeated here.

Step S2, according to the current mode, switch to the corresponding processing module.

It can be understood that in step S2, the image signal processor 80 is as described above, and details are not repeated here. When the switching module 50 receives the first Bayer image and determines that the image signal processor 80 is in the first mode, the first processing module 60 is selected or triggered. When the switching module 50 receives the first Bayer image and determines that the image signal processor 80 is in the second mode, the second processing module 70 is selected or triggered.

Step S3, performing image processing on the first Bayer image to obtain a first image or a second image.

Wherein, when the image signal processor 80 operates in the first mode, the first processing module 60 receives the first Bayer image transmitted by the switching module 50, and processes the first Bayer image Perform pixel rearrangement to obtain a second Bayer image, and then perform demosaic processing on the second Bayer image to obtain the first image.

When the image signal processor 80 is in the second mode, the second processing module 70 receives the first Bayer image transmitted by the switching module 50 and performs pixel combination on the first Bayer image processing to obtain a third Bayer image, and then performing demosaic processing on the third Bayer image to obtain the second image.

The above embodiments are only used to illustrate the technical solutions of the present invention and not to limit them. Although the present invention has been described in detail with reference to the above preferred embodiments, those of ordinary skill in the art should understand that the technical solutions of the present invention can be modified or equivalently replaced. Neither should depart from the spirit and scope of the technical solutions of the present invention. Those skilled in the art can also make other changes within the spirit of the present invention for the design of the present invention, as long as it does not deviate from the technical effect of the present invention. These changes made according to the spirit of the present invention should be included within the scope of the claimed protection of the present invention.

100: Image processing device 10: Pixel array 11: Pixels 12: Pixel unit 13: Photodiode 14: Readout circuit 20: Filter array 21: The first filter unit 22: The second filter unit 23: The third filter unit 24: Fourth filter unit 30: Micro lens array 31: Micro lens 40: Image sensor 50: Switch modules 60: The first processing module 61: Filter unit 70: Second processing module 80: Image signal processor 200: Lens Module 90: Periscope Lens

FIG. 1 is a schematic diagram of stray light entering a small pixel in the prior art.

FIG. 2 is a schematic diagram of stray light entering a large pixel in the prior art.

FIG. 3 is a functional block diagram of a lens module provided by a preferred embodiment of the present invention.

FIG. 4 is an exploded schematic view of the image sensor in the lens module shown in FIG. 3 .

FIG. 5 is an assembly schematic diagram of the image sensor shown in FIG. 4 .

FIG. 6 is a cross-sectional view taken along line VI-VI of the image sensor shown in FIG. 5 .

FIG. 7 is a schematic diagram of the image sensor shown in FIG. 5 outputting a first Bayer image.

FIG. 8 is a schematic diagram of the arrangement of filter units in the filter array after the microlens array shown in FIG. 4 is arranged.

FIG. 9 is a schematic diagram of outputting a second Bayer image by the first processing module in the lens module shown in FIG. 3 .

FIG. 10 is a schematic diagram of outputting a third Bayer image by the second processing module in the lens module shown in FIG. 3 .

FIG. 11 is a flowchart of an image processing method provided by a preferred embodiment of the present invention.

none

200: Lens Module

100: Image processing device

40: Image sensor

50: Switch modules

60: The first processing module

61: Filter unit

70: Second processing module

80: Image signal processor

90: Periscope Lens

Claims (10)

An image processing device, comprising an image sensor and an image signal processor, the improvement is that the image sensor includes a pixel array and a filter array, the filter array is arranged corresponding to the pixel array, The filter array includes a plurality of filter units, the filter units divide the pixel array into a plurality of pixel units, each pixel unit includes a plurality of pixels, each of the filter units corresponds to a pixel unit, and allows A colored light is incident on the pixel unit to generate a first Bayer image, and the image signal processor is electrically connected to the image sensor for receiving the first output of the image sensor. a Bayer image, and processing the first Bayer image to output the first image or the second image. The image processing device according to claim 1, wherein the image sensor further comprises a microlens array, the microlens array comprises a plurality of microlenses, each of the microlenses corresponds to one of the filter arrays One filter unit and one pixel unit of the pixel array are arranged. The image processing device according to claim 2, wherein the number of the plurality of filter units is four, and the four filter units are arranged adjacent to each other to form a 2*2 filter array, and the The pixel array is divided into four of the pixel units. The image processing device according to claim 1, wherein the image signal processor comprises a switching module, a first processing module and a second processing module, and the switching module is used for receiving the image The first Bayer image output by the sensor, and according to the current mode of the image signal processor, select or trigger the first processing module or the second processing module, so that the first processing module Or the second processing module processes the first Bayer image, and then outputs the first image or the second image. The image processing device according to claim 4, wherein when the image signal processor is in the first mode, the first processing module receives the first Bayer image transferred by the switching module, and processes the image Pixel rearrangement is performed on the first Bayer image to obtain a second Bayer image, and then demosaicing is performed on the second Bayer image to obtain the first image. The image processing device according to claim 5, wherein the image signal processor further comprises a filtering unit, and the filtering unit is used for firstly processing the first Bayer image before generating the second Bayer image. Mean filtering is performed on each pixel unit in the image. The image processing device according to claim 4, wherein when the image signal processor is in the second mode, the second processing module receives the first Bayer image transmitted by the switching module, and processes the image Pixel binning is performed on the first Bayer image to obtain a third Bayer image, and then demosaicing is performed on the third Bayer image to obtain the second image. A lens module, which is improved in that the lens module further includes the image processing device according to any one of claims 1 to 7. An image processing method, which is improved in that the image processing method comprises: acquiring a first Bayer image; According to the current mode, switch to the corresponding processing module; Image processing is performed on the first Bayer image to obtain a first image or a second image. The image processing method according to claim 9, wherein when in the first mode, the first Bayer image is received, and the pixels of the first Bayer image are rearranged to obtain a second Bayer image, Then perform demosaic processing on the second Bayer image to obtain the first image; when in the second mode, receive the first Bayer image, perform pixel combination on the first Bayer image, A third Bayer image is obtained, and then demosaicing is performed on the third Bayer image to obtain the second image.

Images