CN115866380A - Method for improving image resolution of image surface sensor with large pixel spacing - Google Patents

Abstract

The invention relates to the field of image information processing, in particular to a method for improving image resolution of an image sensor with large pixel spacing. The method comprises the steps of arranging the micro-oscillating mirror between the image sensor with large pixel spacing and a lens of the optical system, controlling the bidirectional micro-oscillating mirror to perform micro-oscillation, and respectively completing pixel data supplement in the X direction, pixel data supplement in the Y direction and field data supplement of diagonal lines of the X direction and the Y direction. According to the invention, the bidirectional micro-oscillating mirror is arranged between the optical system and the large-spacing image sensor, and the blank between the adjacent pixels is filled up through the bidirectional micro-oscillating mirror, so that the image sensor with large pixel spacing supplements object space field data missing between the adjacent pixels, the image resolution of the image data obtained by the image sensor with large pixel spacing is improved by 4 times of that of the original image data, the image resolution of the sensor with large pixel spacing is improved, and the image quality of the acquired image is improved.

Description

Method for improving image resolution of image surface sensor with large pixel spacing

Technical Field

The invention relates to the field of image information processing, in particular to a method for improving image resolution of an image plane sensor with large pixel spacing.

Background

Images are a major source of information acquired by humans. Statistically, 75% of the information received by humans is from the visual sense. Visual information has the advantages of intuition, detail, liveness, etc. compared with other information forms such as hearing, taste, touch, smell, etc., and therefore, image/video capture is one of the indispensable key technologies in digital image processing systems. The image sensor is a core component in digital image processing systems such as various industrial and monitoring cameras, portable recorders, digital cameras, scanners and the like. The image sensor images an external scene on an image surface of the objective lens through the imaging objective lens to form light intensity distribution in a two-dimensional space, and then converts an optical image of the two-dimensional light intensity distribution into a one-dimensional time sequence electric signal. At present, with further improvement of image sensors, rapidly growing markets have been extended to the fields of toys, mobile phones, automobiles, and living beings.

The image sensor is a two-dimensional area array sensor, and is formed by photosensitive pixels densely distributed in a two-dimensional plane. The pixel size is an important parameter influencing the resolution of the image sensor, and the pixel pitch is also an important parameter influencing the resolution of the image sensor, and in practical application, the pixel pitch of the manufactured image sensor is large due to the limitation of technical conditions of a design technology and a processing technology manufacturing process, the resolution of an image obtained by the image sensor with the large pixel pitch is relatively low, the image data in an object space view field is lost, and an image with the relatively low resolution is obtained.

Disclosure of Invention

The invention provides a method for improving image resolution of an image plane sensor with large pixel spacing, which aims to solve the problems of the prior art that partial image information in a view field is lost and the image resolution is low due to large pixel spacing.

The invention aims to provide a method for improving the image resolution of an image sensor with a large pixel pitch, which is characterized in that a micro-oscillating mirror is arranged between the image sensor with the large pixel pitch and a lens of an optical system, a bidirectional micro-oscillating mirror is controlled to perform micro-oscillation, after the micro-oscillating mirror oscillates a design angle around the Y-axis direction in an XOZ plane, data which is not acquired between adjacent pixels in the X direction in an original object space is supplemented, and the field data of the micro-oscillating mirror is supplemented between two adjacent pixels in the X direction of the image sensor, so that the pixel data supplement in the X direction is completed; after swinging for a design angle by taking an X axis as an axis, supplementing data which is not acquired between adjacent pixels in a Y direction in an original object space, supplementing field data between two adjacent pixels in the Y direction of an image sensor, and completing pixel data supplementation in the Y direction; after the bidirectional micro-oscillating mirror swings for a designed angle around the Y-axis direction and the X-axis as axes, the data which is not acquired between the adjacent pixels at the positions offset in the X direction and the Y direction in the original object space is supplemented, the view field data of the bidirectional micro-oscillating mirror is supplemented between the adjacent pixels in the X direction and the Y direction of the image sensor, and the view field data supplement of the diagonal line of the X direction and the Y direction is completed.

Further, the design swing angle alpha of the bidirectional micro-swing mirror is

Wherein d is the pixel spacing, and L is the distance between the bidirectional micro-oscillating mirror and the large pixel spacing image sensor.

Compared with the prior art, the invention has the following advantages and effects:

1) According to the invention, the bidirectional micro-oscillating mirror is arranged between the optical system and the large-spacing image sensor, and the bidirectional micro-oscillating mirror fills the blank between the adjacent pixels, so that the image resolution of the large-pixel-spacing image sensor is improved by 4 times of the original image resolution, and the large-pixel-spacing image sensor improves the resolution of the image obtained by the large-pixel-spacing image sensor by supplementing missing object space field data between the adjacent pixels.

2) The bidirectional micro-oscillating mirror supplements the field-of-view data of object space loss caused by large pixel spacing between two adjacent pixels on the target surface of the image sensor after controlling the oscillating of a micro angle, so that the resolution of the image sensor is greatly increased by increasing the number of pixels of the image obtained by the image sensor, and the resolution of the acquired and processed image is improved.

3) The method is suitable for obtaining the high-resolution images by the large pixel spacing image sensor used in various special working scenes or special wave bands, and has strong practicability.

Drawings

FIG. 1 is a schematic diagram of the calculation of the swing angle of a bidirectional micro-oscillating mirror and a schematic diagram of the position of a pixel.

FIG. 2 is a schematic diagram of the original position of a pixel on a target surface of a sensor.

FIG. 3 is a schematic diagram of the pixel position supplement in the X direction after the oscillating mirror oscillates around the Y axis direction in the XOZ plane.

FIG. 4 is a schematic diagram showing the complementary positions of the swing mirror in the Y direction of the pixel after swinging around the X axis direction in the YOZ plane.

FIG. 5 is a schematic diagram showing the pixel supplement positions after the oscillating mirror oscillates around the Y-axis direction in the XOZ plane and around the X-axis direction in the YOZ plane simultaneously.

FIG. 6 is a schematic diagram of a large pixel pitch sensor target surface pixel original pixel data sample

FIG. 7 is a schematic diagram of a large pixel pitch sensor oscillating mirror oscillating around the Y-axis direction in the XOZ plane and around the X-axis direction in the YOZ plane simultaneously to supplement pixel data.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments.

The device applied by the method provided by the invention comprises a lens of an optical system, a bidirectional micro-oscillating mirror and a large pixel interval image sensor, wherein the bidirectional micro-oscillating mirror is added on an optical path between the optical system and the large pixel interval image sensor, as shown in figure 1 (a). The design idea of the invention is as follows: the invention aims to improve the resolution of the large pixel pitch image sensor, and supplements pixel data between two spaced pixels on the target surface of the image sensor by controlling the bidirectional micro-oscillating mirror to swing a specific angle so as to improve the resolution of the large pixel pitch image sensor.

The swing angle alpha of the bidirectional micro-oscillating mirror is related to the pixel spacing d of the image sensor with large pixel spacing and the distance L between the image sensor with large pixel spacing and the bidirectional micro-oscillating mirror. The setting of the swing angle is shown as coordinates in fig. 1 (b) where the Y-axis is out of the paper at point o.

As shown in fig. 2, the original position diagram of the large-pitch image element image sensor is shown, the pitch between adjacent image elements is large, and the resolution is low.

According to the reflection law, when the micro-oscillating mirror swings at an angle of alpha, light can deflect at an angle of 2 alpha, when the distance between the pixels is d, the distance between the pixel data supplemented between two adjacent pixels and the position of the original pixel is d/2, and the distance between the bidirectional micro-oscillating mirror and the large pixel distance image sensor is L, so that the method can be obtained:

therefore, the swing angle α of the bidirectional micro-swing mirror is designed as follows:

based on the principle analysis, the invention provides a method for improving the image resolution of an image sensor with large pixel spacing, which is characterized in that a bidirectional micro-oscillating mirror is arranged between the image sensor with large pixel spacing and a lens of an optical system, the bidirectional micro-oscillating mirror is controlled to carry out micro-oscillation, and then data supplement comprising the following three parts is carried out:

firstly, as shown in fig. 3, after the micro-oscillating mirror swings a specific angle α around the Y-axis direction in the XOZ plane, field data which is not acquired between adjacent pixels in the original object space in the X direction is supplemented, the field data is supplemented between two adjacent pixels in the X direction of the large pixel pitch image sensor, and pixel data supplementation in the X direction is completed, wherein the supplemented pixel data is (1,1) ', (1,2)', and … ….

And (II) as shown in fig. 4, after the micro-oscillating mirror swings a certain angle alpha around the X-axis direction in the YOZ plane, field data which are not acquired between adjacent pixels in the original object space in the Y direction are supplemented, the field data are supplemented between two adjacent pixels in the Y direction of the image sensor with large pixel pitch, and direction pixel data supplementation is completed, wherein the supplemented pixel data are (1,1), (2,1) ", and … ….

As shown in fig. 5, after the micro-oscillating mirror simultaneously oscillates by a specific angle α in the Y-axis direction and the X-axis direction, field data not acquired between adjacent pixels in the X and Y diagonal directions is supplemented, and the field data is supplemented between two adjacent pixels in the diagonal direction of the large pixel pitch image sensor, thereby completing the supplementation of the pixel data in the diagonal direction, and the supplemented pixel data is (1,1) ", (1,2)", (2,1) ", (2,2)",', and … …

The bidirectional micro-oscillating mirror improves the number of the original pixels from the number of the original n pixels to the number of the existing 4n pixels by supplementing X-direction pixel data, Y-direction pixel data and X-and Y-diagonal-direction field-of-view data under the target surface size of the large-pixel-interval image sensor.

As shown in fig. 6, it is a schematic diagram of an original pattern obtained by a large-pitch image element image sensor, and it can be seen from the diagram that the image is a low-resolution image with partial field data loss due to an excessively large pitch between adjacent image elements.

As shown in fig. 7, the image sensor with large-pitch pixels is a high-resolution image of the supplementary data obtained after the image sensor passes through the three-time mirror-swinging micro-pendulum, and the data supplement of the other three fields of view is completed. And restoring and reproducing the supplementary data image to obtain the high-resolution pattern schematic diagram. The first micro-swing is implemented by swinging around a Y axis in an XOZ plane by a specific angle, supplementing field data which is not acquired between adjacent pixels in an original object space in the X direction, and supplementing the field data between two adjacent pixels in the X direction of the image sensor to complete pixel data supplementation in the X direction; the second micro-swing is to supplement field data which is not acquired between adjacent pixels in the original object space in the Y direction after swinging a specific angle around the X axis in the YOZ plane, and supplement the field data between two adjacent pixels in the Y direction of the image sensor to complete pixel data supplement in the Y direction; and the third bidirectional micro-oscillating mirror simultaneously oscillates around the Y axis and the X axis, field data which are not acquired between adjacent pixels in the X direction and the Y direction of the original object space are supplemented, and the field data are supplemented between adjacent pixels in the X direction and the Y direction of the image sensor, so that the field data in the diagonal directions of the X direction and the Y direction are supplemented.

The invention adopts a mode of adding a two-dimensional swing mirror between the objective lens and the image sensor with large pixel spacing to supplement the missing view field image data to increase the data quantity of the image obtained by the image sensor with large pixel spacing. Therefore, the resolution of the image obtained by the image plane sensor with large pixel spacing is greatly improved. After the method is completed, the number of the pixels with the same target surface size is increased from the original n pixels to the current 4n pixels, and the field data supplement between two adjacent pixels on the target surface of the image sensor with large pixel spacing is realized.

The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention.

Claims (2)

1. A method for improving image resolution of an image sensor with large pixel spacing is characterized in that a micro-oscillating mirror is arranged between the image sensor with large pixel spacing and a lens of an optical system, a bidirectional micro-oscillating mirror is controlled to perform micro-oscillation, after the bidirectional micro-oscillating mirror oscillates a design angle around a Y-axis direction in an XOZ plane, data which are not acquired between adjacent pixels in an X direction in an original object space are supplemented, and field data of the data are supplemented between two adjacent pixels in the X direction of the image sensor, so that pixel data supplement in the X direction is completed; after swinging for a design angle by taking an X axis as an axis, supplementing data which is not acquired between adjacent pixels in a Y direction in an original object space, supplementing field data between two adjacent pixels in the Y direction of an image sensor, and completing pixel data supplementation in the Y direction; after the bidirectional micro-oscillating mirror simultaneously oscillates a design angle around the Y axis and the X axis, the data which is not acquired between adjacent pixels at the offset positions in the X direction and the Y direction in the original object space is supplemented, and the field data of the bidirectional micro-oscillating mirror is supplemented between adjacent pixels in the X direction and the Y direction of the image sensor, so that the field data supplement of the diagonal lines in the X direction and the Y direction is completed.

2. The method for improving the image resolution of the image sensor with large pixel pitch according to claim 1, wherein: the design swing angle alpha of the bidirectional micro-swing mirror is

Wherein d is the pixel spacing, and L is the distance between the bidirectional micro-oscillating mirror and the large pixel spacing image sensor.

Images