TWI545951B - Sensors and sensing methods - Google Patents

Description

Sensor and sensing method

The present invention relates to a sensor, and more particularly to a sensing method for a sensor, which can perform sensing operations using different numbers of sub-pixels in different states to obtain different sensitivities. .

In the conventional image sensing technology, in order to obtain a better quality image, the sensitivity of the sensing pixel is improved. A higher sensitivity means that the sensing pixel has a shorter integration time during operation under the same ambient light conditions. When this integration time is shorter than one-half of the working period of the light source, it will cause the image obtained by the sensing to flicker. Nowadays, a number of methods for changing the sensitivity according to different ambient light intensities are proposed, and the occurrence of image flicker can be avoided. However, the sensing array in an image sensor employing these methods takes up a large area. In addition, the color arrangement of the sensing pixels is asymmetrical, so that the resulting image quality is degraded.

The invention provides a sensor for sensing an image of a target. The sensor includes a plurality of sensing pixels. The sensing pixels are configured in a plurality of first sensing lines extending in a first direction and a plurality of second sensing lines extending in a second direction to form a sensing array. The first direction is interleaved with the second direction. Each sensing pixel has a plurality of sub-pixels. At least two sub-pixels are adjacent in each of the sensing pixels. The first part of each sensing pixel when the sensor is in a first mode The sub-pixel performs a sensing operation to sense an image of the object. When the sensor is in the second mode, the sub-pixel of the second portion of each of the sensing pixels performs a sensing operation to sense an image of the object.

The present invention provides a sensing method for a sensor to sense an image of a target. The sensing method includes configuring a plurality of sensing pixels on a plurality of first sensing lines extending in a first direction and a plurality of second sensing lines extending in a second direction to form a sensing array. The first direction is interleaved with the second direction. The sensing method further includes: dividing each sensing pixel into a plurality of sub-pixels. At least two sub-pixels are adjacent in each of the sensing pixels. The sensing method further includes performing a sensing operation by the sub-pixels of the first portion of each of the sensing pixels to sense an image of the target when the sensor is in the first mode; and when the sensor is at In the second mode, a sensing operation is performed by a sub-pixel of the second portion of each of the sensing pixels to sense an image of the object.

1‧‧‧ sensor

10‧‧‧Sensor array

11‧‧‧Filter

12‧‧‧Reading device

20 _1,1 ...20 _8,6 ‧‧‧ Sense pixels

31, 41, 51, 61, 71‧‧‧ forms

50 _1,1 , 50 _2,1 , 50 _3,1 , 50 _4,1 , 50 _1,2 , 50 _2,2 , 50 _3,2 , 50 _4,2 ‧‧‧ Sense pixels

211A...211D, 221A...221D‧‧‧ sub-pixels

511A...511D, 521A...521D, 531A...531D, 541A...541D, 512A...512D, 522A...522D, 532A...532D, 542A...542D‧‧‧ pixels

LH21A, LH21B, LV21A, LV21B, LV22A, LV22B‧‧‧ configuration line

LH51A, LH51B, LV51A, LV51A, LV52A, LV52B, LV53A, LV53B, LV54A, LV54B‧‧‧ configuration line

SR21...SR26, SC21...SC28‧‧‧Sense line

SR51...SR56, SC51...SC58‧‧‧Sense line

Figure 1 shows a sensor in accordance with an embodiment of the present invention.

2A and 2B are diagrams showing a sensing array in accordance with a first embodiment of the present invention.

Figure 3 shows a sensing array in accordance with a second embodiment of the present invention.

Fig. 4 is a view showing a sensing array diagram according to a third embodiment of the present invention.

5A to 5C are diagrams showing a sensing array according to a fourth embodiment of the present invention.

Figure 6 is a diagram showing a sensing array in accordance with a fifth embodiment of the present invention.

7A and 7B are diagrams showing a sensing array in accordance with a sixth embodiment of the present invention.

In order to make the above objects, features and advantages of the present invention more obvious It is to be understood that the following detailed description of the preferred embodiments and the accompanying drawings are set forth below.

Figure 1 is a diagram showing a sensor in accordance with an embodiment of the present invention. Referring to FIG. 1, the sensor 1 includes a sensing array 10, a filter 11, and a reading device 12. The filter 11 is disposed above the sensing array 10. In order to simultaneously present the sensing array 10 and the filter 11, the arrangement of the sensing array 10 and the filter 11 is drawn in a stereoscopic manner in FIG. The sensing device 12 is coupled to the sensing array 10. When the sensor 1 performs image sensing on a target, the sensor 1 operates during a plurality of consecutive sensing periods. The sensing array 10 includes a plurality of sensing pixels. The sensing array 10 generates a complex sensing signal based on light from the target and through the filter 11 . The reading device 12 receives the sensing signal from the sensing array 10 and generates an image signal representing the image of the object based on the received sensing signal. Since the light from the target is transmitted through the filter 11 to the sensing array 10, the sensing signals generated by the sensing pixels in the sensing array 10 represent different color information, such as the red color of the three primary colors (R). , green (G), or blue (B) information, or grayscale. In the following description, the red (R), green (G), or blue (B) information of the three primary colors will be taken as an example.

2A and 2B are diagrams showing a sensing array 10 in accordance with a first embodiment of the present invention. Referring to FIG. 2A, the sensing array 10 includes a plurality of sensing pixels 20 _1,1 to 20 _8,6 . The sensing pixels 20 _1,1 to 20 _{8,6 are} arranged in six sensing lines SR21 to SR26 extending in the first direction and eight sensing lines SC21 to SC28 extending in the second direction. The number of the above sensing lines is only an example, and is not limited thereto. In this embodiment, the first direction refers to the horizontal direction and the second direction refers to the vertical direction. Referring to FIG. 2B, each sensing pixel is divided into four sub-pixels. In this embodiment, the inner four sub-pixels of each sensing pixel are adjacent to each other and are disposed in two configuration lines extending in the horizontal direction (ie, the first direction) and extending in the vertical direction (ie, the second direction). Two configuration lines. For example, the sensing pixel 20 _{1,1 is} divided into four sub-pixels 211A-211D, and the four sub-pixels 211A-211D are disposed on the horizontal alignment lines LH21A and LH21B and the vertical alignment lines LV21A and LV21B. . The sensing pixels 20 _{2, 1 are} divided into four sub-pixels 221A to 221D, and the four sub-pixels 221A to 221D are disposed on the horizontal alignment lines LH21A and LH21B and the vertical alignment lines LV22A and LV22B. The sub-pixels in the remaining sensing pixels are configured in the same manner as the sensing pixels 20 _1,1 and 20 _2,1 . In FIG. 2B, if a sensing signal generated by a sensing pixel represents a color information, the four sub-pixels therein are marked with corresponding color symbols. For example, when the sensing signal generated by the sensing pixel _{201, 1} indicates red information, the four sub-pixels 200A-211D divided by the corresponding color symbol "R"; the sensing pixel 20 _{2, When} the generated sensing signal is green information, the four sub-pixels 221A to 221D divided by the corresponding color symbol "G" are marked; the sensing signal generated by the sensing pixel 20 _{2, 2} is When the blue information is indicated, the four sub-pixels within it are marked with the corresponding color symbol "B".

The sensor 1 of the embodiment of the invention is operable in a plurality of modes. in In the embodiment of Figures 2A and 2B, the sensor 1 is operable in a general mode or a high dynamic range mode. Referring to FIG. 2B, when the sensor 1 operates in the normal mode, a part of the sub-pixels in each of the sensing pixels are combined to perform a sensing operation, and the remaining sub-pixels do not perform a sensing operation. For each pixel, the sensing operation described herein includes exposure of the photosensitive element within the sub-pixel (the length of the exposure period is referred to as exposure time or integration time) and the sense of charge signal generated by the exposure operation Transfer of optical components to floating nodes. In addition, the merging of the sub-pixels is accomplished by sharing a floating node and sharing a sustain capacitor coupled to the floating node. The sharing of a floating node by a plurality of sub-pixels and a sustain capacitor can be realized by designing various circuits, which will not be described in detail herein. In the following description, unless a specific number of pixels are combined to perform a sensing operation, the signal strength from each pixel is the same, for example, for the combination of two sub-pixels, from the two times. The signal strength of the pixels is 1:1.

For example, when the sensor 1 operates in the normal mode, the sub-pixels 211A and 211B on the configuration line LH21A in the sensing pixel 201, ₁ are merged (horizontal merged) to perform a sensing operation to generate a red sensing signal. At this time, the sub-pixels 211C and 211D on the configuration line LH21B do not perform the sensing operation. In order to clearly represent the operation of the sub-pixel, the form 21 is drawn in the 2B chart. It should be noted that the form 21 is not an element or device in the sensing device 1, but is an explanatory form for helping to explain the sensing operation of each sensing pixel in different mode lines. In the form 21, the item "general" indicates the general mode. Under the item "general", "V" corresponds to a configuration line (for example, configuration line LH21A) that performs a sensing operation in the normal mode, and "X" corresponds to a configuration line (for example, a configuration line) that does not perform a sensing operation in the normal mode. LH21B). For another example, when the sensor 1 operates in the normal mode, the sub-pixels 221A and 221B (horizontal merge) on the configuration line LH21A in the sensing pixel 20 ₂ , ₁ are combined to perform a sensing operation to generate green sensing. The signal, at this time, the sub-pixels 221C and 221D on the configuration line LH21B do not perform the sensing operation. Due to the above two pixel merging, in the normal mode, the conversion gain in the horizontal direction of each sensing pixel is twice the unit conversion gain. It is known to those of ordinary skill in the art that the conversion gain of a sensing pixel is proportional to sensitivity. The unit conversion gain described herein refers to the transfer gain of a single pixel without merging sub-pixels.

Referring to FIG. 2B, when the sensor 1 operates in the high dynamic range mode, all of the sub-pixels in each of the sensing pixels perform a sensing operation. In addition, in the high dynamic mode range, a part of the sub-pixels of each sensing pixel has a longer exposure time, and another part of the sub-pixels has a shorter exposure time. For example, in the high dynamic range mode, all the sensing pixels in the sub-pixel 20 _1,1 211A ~ 211D performing a sensing operation to produce a red sensing signal. Further, the sub-pixels 211A and 211B on the configuration line LH21A have a longer exposure time, and the sub-pixels 211C and 211D on the configuration line LH21B have a shorter exposure time. Referring to Figure 2B, in Form 21, the item "High Dynamics" indicates a high dynamic range mode. Under the item "High Dynamics", "L" corresponds to a configuration line with a long exposure time (eg, configuration line LH21A) at a high dynamic range, and "S" corresponds to a configuration line with a short exposure time at a high dynamic range (eg, Configuration line LH21B). For example, in the high dynamic range mode, all of the sub-pixels 221A-221D in the sensing pixel 20 ₂ , ₁ perform a sensing operation to generate a green sensing signal. Further, the sub-pixels 221A and 221B on the arrangement line LH21A have a longer exposure time, while the sub-pixels 221C and 221D on the arrangement line LH21B have a shorter exposure time. According to the above, for the same sensing pixel, the number of sub-pixels performing the sensing operation in the normal mode (two) is smaller than the number of sub-pixels performing the sensing operation in the high dynamic range mode (four )).

Figure 3 is a diagram showing a sensing array 10 in accordance with a second embodiment of the present invention. The pixel configuration of FIG. 3 and the sub-pixel configuration in each pixel are the same as in the first embodiment of FIGS. 2A and 2B. The first and second embodiments differ in the sub-pixel combining direction in the normal mode and the exposure time allocation in the high dynamic range mode. For example, when the sensor 1 operates in the normal mode, the sub-pixels 211A and 211C on the configuration line LV21A in the sensing pixel 201, ₁ are merged (vertically merged) to perform a sensing operation, and at this time, The sub-pixels 211B and 211D on the configuration line LV21B do not perform sensing operations. In the high dynamic range mode, all of the sub-pixels 211A to 211D in the sensing pixel 20 _1,1 perform a sensing operation. Further, the sub-pixels 211A and 211C on the configuration line LV21A have a longer exposure time, while the sub-pixels 211B and 211D on the configuration line LV21B have a shorter exposure time. In order to clearly show the operation of the sub-pixel, the form 31 is drawn in FIG. It should be noted that the form 31 is not an element or device within the sensing device 1, but is an explanatory form for helping to illustrate the sensing operation of each sensing pixel in different mode lines. In the form 31, the item "general" indicates the general mode. Under the item "general", "V" corresponds to a configuration line (for example, configuration line LVH21A) that performs a sensing operation in the normal mode, and "X" corresponds to a configuration line (for example, a configuration line) that does not perform a sensing operation in the normal mode. LV21B). In the form 31, the item "high dynamic" indicates a high dynamic range mode. Under the item "High Dynamics", "L" corresponds to a configuration line with a long exposure time (eg, configuration line LV21A) at a high dynamic range, and "S" corresponds to a configuration line with a short exposure time at a high dynamic range (eg, Configuration line LV21B).

Figure 4 is a diagram showing a sensing array 10 in accordance with a third embodiment of the present invention. The pixel configuration of FIG. 4 and the sub-pixel configuration in each pixel are the same as the first embodiment of FIGS. 2A and 2B. Differences between the first and third embodiments will be explained below. In the third embodiment of Fig. 4, the sensor 1 operates in different modes depending on the ambient light intensity. The following will be exemplified by ambient light having different sizes of first intensity, second intensity, and third intensity, wherein the first intensity is greater than the second intensity and the second intensity is greater than the third intensity. When the ambient light of the sensor 1 has a first intensity, the sensor 1 is in the first mode. In the first mode, a single sub-pixel in each of the sensing pixels performs a sensing operation. For example, in the first mode, the sensing pixels in the sub-pixels 20 _1,1 211A performing a sensing operation to produce a red sensing signal. The sensing circuits are not performed by the remaining sub-pixels 211B to 211C in the sensing pixel 20 _1,1 . At this time, the conversion gain of each of the sensing pixels is equal to the unit conversion gain. In order to clearly show the operation of the sub-pixel, the form 41 is drawn in FIG. It should be noted that the form 41 is not an element or device within the sensing device 1, but is a description form to help illustrate the sensing operation of each sensing pixel in different mode lines. In the form 41, the item "first mode" indicates the first mode. In the item "first mode", "merging 1" means that a single pixel is performed in each pixel to perform a sensing operation.

When the ambient light of the sensor 1 has a second intensity, the sensor 1 is in the second mode. In the second mode, sensing is performed by two sub-pixels in each of the sensing pixels. For example, in the second mode, the sensing pixel sub-pixel 20 _{1, 1} 211A and 211B to perform the merge operation to generate a sensing signal sensed red. The sensing circuits are not performed by the remaining sub-pixels 211C to 211D of the sensing pixels 20 _1,1 . At this time, the conversion gain of each of the sensing pixels is twice the unit conversion gain. In the form 41, the item "second mode" indicates the second mode. In the item "second mode", "merging 2" means that two sub-pixels are combined in each pixel to perform a sensing operation.

When the ambient light of the sensor 1 has a third intensity, the sensor 1 is in the third mode. In the third mode, sensing is performed for all of the sub-pixels in each of the sensing pixels. For example, in the third mode, all of the sub-pixels 211A-211D of the sensing pixel 201, ₁ are combined to perform a sensing operation to generate a red sensing signal. At this time, the conversion gain of each of the sensing pixels is four times the unit conversion gain. In the form 41, the item "third mode" indicates the third mode. In the item "third mode", "merging 4" means that four sub-pixels are combined in each pixel to perform a sensing operation. According to the above, for the same sensing pixel, in different modes, when the intensity of the ambient light is larger, the number of sub-pixels performing the sensing operation is smaller, and the conversion gain is smaller, so that the sensitivity is higher. low. Conversely, for the same sensing pixel, in different modes, when the intensity of the ambient light is smaller, the number of sub-pixels performing the sensing operation is larger, and the conversion gain is larger, so that the sensitivity is higher.

Figure 5A shows a sensing array 10 in accordance with a fourth embodiment of the present invention. The pixel configuration of FIG. 5A and the sub-pixel configuration in each pixel are different from the first embodiment of FIGS. 2A and 2B, which will be described below. Referring to Figure 5A, the sensing array 10 includes a plurality of sensing pixels. The sensing pixels are disposed in six sensing lines SR51 to SR56 extending in the first direction and eight sensing lines SC51 to SC58 extending in the second direction. The number of the above sensing lines is only an example, and is not limited thereto. In this embodiment, the first direction refers to the horizontal direction and the second direction refers to the vertical direction. Referring to FIG. 5A, each sensing pixel is divided into four sub-pixels. In this embodiment, two of the four sub-pixels in each of the sensing pixels are adjacent to each other and are disposed on two arrangement lines extending in the horizontal direction, and the other two sub-pixels are adjacent to each other and disposed in The above two arrangement lines extending in the horizontal direction. The configuration of the sensing pixels will be described below through the sensing pixels 50 _1,1 and 50 _2,1 . In this embodiment, it is assumed that the sensing signal generated by the sensing pixel 50 _1,1 represents red information, and the sensing signal generated by the sensing pixel 50 _2,1 represents green information. Refer to FIG. 5A, sensing pixels arranged on the sense line 50 _1,1 SR51 divided into four sub-pixel 511A ~ 511D. The sub-pixels 511A to 511D are represented by a color symbol "R". Among the four sub-pixels 511A to 511D, the sub-pixels 511A and 511C are located on the same arrangement line LV51A, and are respectively positioned on the arrangement lines LH51A and LH51B. Therefore, it can be known that the sub-pixels 511A and 511C are adjacent to each other. Further, among the four sub-pixels 511A to 511D, the sub-pixels 511B and 511D are located on the same arrangement line LV51B and are respectively positioned on the arrangement lines LH51A and LH51B. Therefore, it can be known that the sub-pixels 511B and 511D are adjacent to each other.

Referring to FIG. 5A, the sensing pixel 50 _2,1 disposed on the sensing line SR51 is divided into four sub-pixels 521A-521D. The sub-pixels 521A to 521D are represented by a color symbol "G". Among the four sub-pixels 521A to 521D, the sub-pixels 521A and 521C are located on the same arrangement line LV52A, and are respectively positioned on the arrangement lines LH51A and LH51B. Therefore, it can be known that the sub-pixels 521A and 521C are adjacent to each other. Further, among the four sub-pixels 521A to 521D, the sub-pixels 521B and 521D are located on the same arrangement line LV52B and are respectively positioned on the arrangement lines LH51A and LH51B. Therefore, it can be known that the sub-pixels 521B and 521D are adjacent to each other. According to the above configuration of the sensing pixel and the sub-pixel, the sensing pixels 50 _1,1 and 50 _{2,1 are} disposed on the same sensing line SR51 and adjacent to each other. The configuration lines LV51A and LV51B corresponding to the sensing pixels 50 _1,1 and the configuration lines LV52A and LV52B corresponding to the sensing pixels 50 _2,1 are alternately arranged. In other words, in the horizontal direction, the arrangement lines LV51A, LV52A, LV51B, and LV52B are sequentially arranged from left to right. As a result, the sub-pixels of the sensing pixels 50 _1,1 and 50 _2,1 are alternately arranged as shown in FIG. 5A.

In the embodiment of Figure 5A, the sensor 1 is operable in a general mode or a high dynamic range mode. Referring to FIG. 5A, when the sensor 1 operates in the normal mode, a part of the sub-pixels in each of the sensing pixels are combined to perform a sensing operation, and the remaining sub-pixels do not perform a sensing operation. In an embodiment, when the sensor 1 operates in the normal mode, the sub-pixels on the configuration line LH51A, that is, the sub-pixels 511A and 511B, are sensed in the pixel 50 _1,1 to perform a sensing operation to generate a red feeling. The signal is measured, and at this time, the sub-pixels 511C and 511D on the configuration line LH51B do not perform the sensing operation. Similarly, in the normal mode, the sub-pixels on the configuration line LH51A, that is, the sub-pixels 521A and 521B, are sensed in the pixel 50 _2,1 to perform a sensing operation to generate a green sensing signal, and at this time, in the configuration The sub-pixels 521C and 521D on the line LH51B do not perform sensing operations. In this case, for example, in the same sensing pixel (for example, the sensing pixel 50 _1,1 ), the sub-pixels 511A and 511B performing the sensing operation are individually generated to generate a corresponding signal component. After image processing via the reading device 12, the signal components produced by one of the sub-pixels (511A or 511B) are ignored and not used to obtain a corresponding red sensing signal. Therefore, the conversion gain of each of the sensing pixels can be obtained equal to the unit conversion gain and has twice the horizontal resolution. In order to clearly show the operation of the sub-pixel, the form 51 is drawn in FIG. 5A. It should be noted that the form 51 is not an element or device within the sensing device 1, but is a description form to help illustrate the sensing operation of each sensing pixel in different mode lines. Under the item "general operation" of the form 51, "V" corresponds to a configuration line (for example, the configuration line LH51A) that performs the sensing operation, and "X" corresponds to a configuration line (for example, the configuration line LH51B) that does not perform the sensing operation.

Referring to FIG. 5A, when the sensor 1 operates in the high dynamic range mode, all of the sub-pixels in each of the sensing pixels are combined to perform a sensing operation. In addition, in the high dynamic mode range, a part of the sub-pixels of each sensing pixel has a longer exposure time, and another part of the sub-pixels has a shorter exposure time. For example, in the high dynamic range mode, all of the sub-pixels 511A-511D in the sensing pixel 50 _1,1 perform a sensing operation to generate a red sensing signal. Further, the sub-pixels 511A and 511B on the arrangement line LH51A have a longer exposure time, and the sub-pixels 511C and 511D on the arrangement line LH51B have a shorter exposure time. Referring to Figure 5A, the item "High Dynamics" in Form 51 represents a high dynamic range mode. Under the item "high dynamics", "L" corresponds to a configuration line having a long exposure time (for example, configuration line LH51A), and "S" corresponds to a configuration line having a short exposure time (for example, configuration line LH51B). As another example of a, for example, in the high dynamic range mode, all the sensing pixels in the sub-pixels 50 _2,1 521A ~ 521D performing a sensing operation to produce a green sense signal. Further, the sub-pixels 521A and 521B on the arrangement line LH51A have a longer exposure time, and the sub-pixels 521C and 521D on the arrangement line LH51B have a shorter exposure time. In the embodiment of Fig. 5A above, the sensing operation of the general mode is only an example. Other embodiments of sensing operations in the general mode will be described below. In another embodiment, when the sensor 1 is operating in the normal mode, the sub-pixels 511A and 511C in the sensing pixel 50 _1,1 are combined (vertically merged) to perform a sensing operation to generate a red sensing signal, and The sub-pixels 511B and 511D are combined (vertically merged) to perform a sensing operation red sensing signal. Similarly, in the normal mode, the sub-pixels 521A and 521C of the sensing pixels 50 ₂ , ₁ are combined (vertically merged) to perform a sensing operation to generate a green sensing signal, and at this time, the sub-pixels 521B and 521D are executed. The operation is sensed to produce a green sensing signal. In this case, the conversion gain of each of the sensing pixels 50 is equal to twice the unit conversion gain.

In still another embodiment, referring to FIG. 5B, for the sensing line SR51, when the sensor 1 operates in the normal mode, the sub-pixels 511A-511D in the sensing pixel 50 _1,1 are combined to perform a sensing operation. To generate a red sensing signal (simple indication: 511A + 511B + 511C + 511D). Further, when the general mode, the sensing pixels in the sub-pixel 50 _2,1 521A ~ 521D and 541A of the sub-pixel 50 _4,1 sensing pixel 541C and combined to perform a sensing operation to produce a green sense signal. In this case, in the merging of the green sensing signals, the signal intensity ratio from the sub-pixels 521B and 521D is twice that of the other sub-pixels 521A, 521C, 541A, and 541C (simple indication: 521A+521C+2) *521B+2*521D+541A+541C). Furthermore, since the combined total signal strength with respect to the green sensing signal is twice the combined total signal strength with respect to the red sensing signal, the above-mentioned combination of the green sensing signals is required in the back-end signal processing. The intensity of the obtained rate sensory signal is divided by two (simple indication: (521A+521C+2*521B+2*521D+541A+541C)/2). Similarly, when the sensor 1 operates in the normal mode, the sub-pixels 531A-531D in the sensing pixel 50 ₃ , ₁ are combined to perform a sensing operation to generate a red sensing signal (simple indication: 531A+531B+531C) +531D). Further, when the general mode, the sensing pixels in the sub-pixel 50 _4,1 541A ~ 541D and the sub-pixel 50 sensing pixels 561A and 561C were combined in _6,1 to performing a sensing operation to produce a green sense signal (in The above ratios are combined in the same manner, and the simple illustration is: 541A+541C+2*541B+2*541D+561A+561C). In the back-end signal processing, the intensity of the green sensing signal obtained after the combination is divided by two (simple indication: (541A+541C+2*541B+2*541D+561A+561C)/2).

Referring to FIG. 5C, for the sensing line SR52, when the sensor 1 is operating in the normal mode, the sub-pixels 512A-512D in the sensing pixels 50 _{1, 2} are combined to perform a sensing operation to generate a green sensing signal ( The simple indication is: 512A+512B+512C+512D). Further, when the normal mode, the sub-pixel 50 _2,2 sensing pixels 522A ~ 522D and 542A of the sub-pixel sensing pixel _4,2 and 50 were combined to 542C performing a sensing operation to produce a blue sensing signals. In this case, in the merging of the blue sensing signals, the signal intensity ratio from the sub-pixels 522B and 522D is twice that of the other sub-pixels 522A, 522C, 542A, and 542C (simple indication: 522A+522C+ 2*522B+2*522D+542A+542C). Moreover, since the combined total signal strength with respect to the blue sensing signal is twice the combined total signal strength with respect to the green sensing signal, the blue sensation obtained after the combination is required at the back end signal processing. The intensity of the measured signal is divided by two (simple indication: (522A + 522C + 2 * 522B + 2 * 522D + 542A + 542C) / 2). Likewise, when the sensor 1 is operating in the normal mode, the sub-pixels 532A-532D of the sensing pixels 50 ₃ , ₂ are combined to perform a sensing operation to generate a green sensing signal (simple representation: 532A+532B+532C) +532D). Moreover, in the normal mode, the sub-pixels 542A-542D of the sensing pixels 50 ₄ , ₂ and the sub-pixels 562A and 562C of the sensing pixels 50 ₆ , ₂ are combined to perform a sensing operation to generate a green sensing signal (in The above ratios are combined in the same manner, and the simple illustration is: 542A+542C+2*542B+2*542D+562A+562C). In the back-end signal processing, the intensity of the blue sensing signal obtained after the combination is divided by two (simple indication: (542A+542C+2*542B+2*542D+562A+562C)/2).

In the embodiment of FIG. 5A above, the sensing operation of the high dynamic mode is only an exemplary example. Other embodiments of the sensing operation in the high dynamic mode will be described below. Referring to FIG. 5B, the sub-pixel on the sensing line SR51 will be taken as an example. When the sensor 1 is operating in the high dynamic mode, the sub-pixels on the configuration line LH51A have a longer exposure time. For example, in the high dynamic mode, the sub-pixels 511A and 511B disposed on the line LH51A in the sensing pixel 50 _1,1 are combined and perform a sensing operation with a longer exposure time to generate a red sensing signal (simple indication Is: 511A+511B). In addition, in the high dynamic mode, the sub-pixels 521A and 521B in the sensing pixel 50 _2,1 on the line LH51A are combined and the sub-pixel 541A in the sensing pixel 50 _4,1 is combined and executed with a longer exposure time. The operation is measured to produce a green sensing signal. In this case, in the merging of the green sensing signals, the signal intensity ratio from the sub-pixel 521B is twice that of the other sub-pixels 521A and 541A (simple indication: 521A+2*521B+541A). Furthermore, since the combined total signal strength with respect to the green sensing signal is twice the combined total signal strength with respect to the red sensing signal, the above-mentioned combination of the green sensing signals is required in the back-end signal processing. The intensity of the obtained green sensing signal is divided by two (simple indication: (521A+2*521B+541A)/2). Similarly, when the sensor 1 is operated in the high dynamic mode, the secondary pixels 531A and 531B in the sensing pixel 50 _3,1 on the configuration line LH51A are combined and the sensing operation is performed with a long exposure time to generate a red feeling. The signal is measured (simple indication: 531A+531B). Further, when the high dynamic sub-pixels arranged on a line 561A LH51A combined sensing pixels in the 50 sub-pixels 541A and 541B _4,1 and 50 _6,1 in the sensing pixels and to longer exposure times to perform sensing Operation to produce a green sensing signal (combined in the same ratio as described above, simply indicated as: 541A + 2 * 541B + 561A). In the back-end signal processing, the intensity of the green sensing signal obtained after the combination is divided by two (simple indication: (541A+2*541B+561A)/2).

Meanwhile, when the sensor 1 operates in the high dynamic mode, the sub-pixels on the configuration line LH51B have a shorter exposure time. For example, high dynamic mode, sensing pixels arranged in the sub-pixel 50 _1,1 511C and 511D combined on line LH51A and a shorter exposure time to perform the sensing operation sensing signal to generate red (simple schematic Is: 511C+511D). In addition, in the high dynamic mode, the sub-pixels 521C and 521D in the sensing pixel 50 _2,1 on the line LH51B are combined and the sub-pixel 541C in the sensing pixel 50 _4,1 is combined and executed with a short exposure time. The operation is measured to produce a green sensing signal. In this case, in the merging of the green sensing signals, the signal intensity ratio from the sub-pixel 521D is twice that of the other sub-pixels 521C and 541D (simple indication: 521C+2*521D+541C). Furthermore, since the combined total signal strength with respect to the green sensing signal is twice the combined total signal strength with respect to the red sensing signal, the above-mentioned combination of the green sensing signals is required in the back-end signal processing. The intensity of the obtained rate sensory signal is divided by two (simple indication: (521C + 2 * 521D + 541C) / 2). Similarly, when the sensor 1 is operated in the high dynamic mode, the secondary pixels 531C and 531D in the sensing pixel 50 _3,1 on the configuration line LH51B are combined and the sensing operation is performed with a shorter exposure time to generate a red color. Sensing signal (simple indication: 531C+531D). Further, when the high dynamic sub-pixels arranged on line 561C LH51B combined sensing pixels in the 50 sub-pixel 541C and 541D _4,1 and 50 _6,1 in the sensing pixels and a short exposure time to perform sensing Operation to produce a green sensing signal (combined in the same ratio as described above, simply indicated as: 541C+2*541D+561C). In the back-end signal processing, the intensity of the green sensing signal obtained after the combination is divided by two (simple indication: (541C+2*541D+561C)/2). The sensing operation of the sub-pixels on the other sensing lines SR52 to SR56 in the high dynamic mode is the same as the operation of the above-described sensing line SR51, and therefore the related description will be omitted.

Figure 6 is a diagram showing a sensing array 10 in accordance with a fifth embodiment of the present invention. The pixel configuration of Fig. 6 and the sub-pixel configuration in each pixel are the same as the fourth embodiment of Fig. 5A. Differences between the fifth and fourth embodiments will be explained below. In the fifth embodiment of Fig. 6, the sensor 1 operates in different modes depending on the ambient light intensity. The following will be exemplified by ambient light having different sizes of first intensity, second intensity, and third intensity, wherein the first intensity is greater than the second intensity and the second intensity is greater than the third intensity. When the ambient light of the sensor 1 has a first intensity, the sensor 1 is in the first mode. In the first mode, sensing is performed for a single sub-pixel in each of the sensing pixels. For example, in the first mode, the sub-pixels 511A and 511B in the sensing pixel 50 _1,1 perform (but do not combine to perform) a sensing operation to generate a red sensing signal. _1,1 sensing pixels 50 remaining sub-pixel 511C ~ 511D sensing operation is not performed. After image processing, unwanted signal components (eg, signal components generated by sub-pixels 511A or 511B) may be skipped unused to produce a corresponding red sensing signal. At this time, the conversion gain of each of the sensing pixels is equal to the unit conversion gain and has twice the horizontal resolution. In order to clearly show the operation of the sub-pixel, the form 61 is drawn in FIG. It should be noted that the form 61 is not an element or device within the sensing device 1, but is an explanatory form to help illustrate the sensing operation of each sensing pixel in different mode lines. In the form 61, the item "first mode" represents the first mode. In the item "first mode", "merging 1" means that in each pixel in the first mode but one sub-pixel performs a sensing operation.

When the ambient light of the sensor 1 has a second intensity, the sensor 1 is in the second mode. In the second mode, sensing is performed by two sub-pixels disposed on one sensing line in each sensing pixel. For example, in the second mode, the sub-pixels 511A and 511C of the sensing pixel 50 _1,1 on the configuration line LV51A are combined and the sub-pixels 511B and 511D are combined to perform a sensing operation to generate a red sensing signal. After the image processing, unnecessary signal components (for example, signal components generated by combining the sub-pixels 511A and 511C, or signal components generated by combining the sub-pixels 511B and 511D) may be skipped to generate a corresponding red color. Measuring signal. At this time, the conversion gain of each of the sensing pixels is twice the unit conversion gain and has twice the horizontal resolution. At this time, the conversion gain of each of the sensing pixels is twice the unit conversion gain. In the form 61, the item "second mode" represents the second mode. In the item "second mode", "merging 2" means that two sub-pixels are combined in each pixel to perform a sensing operation.

When the ambient light of the sensor 1 has a third intensity, the sensor 1 is in the third mode. In the third mode, sensing is performed for all of the sub-pixels in each of the sensing pixels. For example, in the third mode, all of the sub-pixels 511A-511D of the sensing pixel 50 _1,1 are combined to perform a sensing operation to generate a red sensing signal. At this time, the conversion gain of each of the sensing pixels is four times the unit conversion gain. In the form 61, the item "third mode" indicates the third mode. In the item "third mode", "merging 4" means that the sensing operation is performed for four sub-pixels in each pixel in the third mode. According to the above, for the same sensing pixel, in different modes, when the intensity of the ambient light is larger, the number of sub-pixels performing the sensing operation is smaller.

In the embodiment of FIG. 6, when the sensor 1 is in the third mode, the sub-pixels within the same sensing pixel are combined to perform a sensing operation to generate a sensing signal of a corresponding color. However, in other embodiments, when the sensor 1 is in the third mode, the sub-pixels within the different sensing pixels may be combined to perform the sensing operation. Figure 7A shows a sensing array 10 in accordance with a sixth embodiment of the present invention. Referring to FIG. 7A, the sensing pixels 50 _1,1 , 50 _2,1 , 50 _3,1 , and 50 _{4,1 are} all disposed on the same sensing line SR51, and are sequentially arranged from left to right in the horizontal direction. The sensing signals generated by the sensing pixels 50 _1,1 and 50 _3,1 represent red information, and the sensing signals generated by the sensing pixels 50 _2,1 and 50 _4,1 represent green information. In the third mode, all of the sub-pixels 511A-511D of the sensing pixel 50 _1,1 are combined to perform a sensing operation to generate a red sensing signal, and all of the sub-pixels 531A-531D of the sensing pixel 50 _3,1 are combined. A sensing operation is performed to generate a red sensing signal, indicated by the label "R22" of the field "SR51" in the form 71. It should be noted that the form 71 is not an element or device within the sensing device 1, but is an explanatory form to help illustrate the sensing operation of each sensing pixel in different mode lines. However, on the sensing line SR51, the generation of the green sensing signal is achieved by combining the sub-pixels within the two different sensing pixels. For example, the sub-pixels 521A and 521C of the sensing pixel 50 _2,1 on the configuration line LV52A and the sub-pixels 521B and 521D on the configuration line LV52B merge the sensing pixel 50 _4,1 in the configuration line. The sub-pixels 541A and 541C on the LV 54A perform sensing pixels to generate a green sensing signal, indicated by the label "G121" of the field "SR51" in the form 71.

The sensing pixels 50 ₁ , ₂ , 50 ₂ , ₂ , 50 ₃ , ₂ , and 50 _{4, 2 are} all disposed on the same sensing line SR52, and are sequentially arranged from left to right in the horizontal direction. For clarity of presentation, the sub-pixel configuration of the sensing pixels 50 ₁ , ₂ , 50 ₂ , ₂ , 50 ₃ , ₂ , and 50 ₄ , ₂ on the configuration sensing line SR52 is shown in FIG. 7B. Referring to FIG. 7B, the sensing signals generated by the sensing pixels 50 _{1, 2} and 50 ₃ , ₂ represent green information, and the sensing signals generated by the sensing pixels 50 _{2, 1} and 50 _{4, 1} represent blue. Color information. In the third mode, all of the sub-pixels 512A-512D of the sensing pixel 50 _1,2 are combined to perform a sensing operation to generate a green sensing signal, and all of the sub-pixels 532A - 532D of the sensing pixel 50 _{3, 2} are combined. A sensing operation is performed to generate a green sensing signal, indicated by the label "G22" of the field "SR52" in the form 71. However, on the sensing line SR52, the generation of the blue sensing signal is achieved by combining the sub-pixels within the two different sensing pixels. For example, the sensing pixels 50 ₂ , ₂ are sub-pixels 522A and 522C on the configuration line LV52A and the sub-pixels 522B and 522D on the configuration line LV52B, and the sensing pixels 50 ₄ , ₂ are in the configuration line. Sub-pixels 542A and 542C on LV 54A perform sensing pixels to produce a blue sensing signal, indicated by the label "B121" of field "SR52" in form 71.

In the embodiment of FIG. 7B, in the third mode, the sensing line SR53 And the sensing operation of the sensing pixel on the SR55 is the sensing operation of the sensing pixel on the sensing line SR51, and the sensing operation of the sensing pixel on the sensing lines SR54 and SR56 is like the sensing of the sensing pixel on the sensing line SR52 described above. The operation is omitted here.

According to the above embodiments, the sensor 1 of the present invention can be Operate in different modes. For a sensed pixel, a different number of sub-pixels can be combined in different modes, whereby an appropriate conversion gain can be obtained. In the embodiment of the present invention, the merging of the sub-pixels is performed by sharing a floating node and sharing a sustain capacitor coupled to the floating node. Therefore, the area of the sensing array 10 does not increase while achieving different conversion gains. Further, at least two pixels are adjacent to each other according to the configuration of the plurality of pixels in each of the sensing pixels. When the sensing pixel performs a sensing operation by combining a plurality of sub-pixels, the color arrangement on the sensing array is symmetric (as shown in FIG. 7), whereby the resulting image quality degradation can be improved.

Although the present invention has been disclosed above in the preferred embodiment, it is not The scope of the present invention is defined by those skilled in the art, and the scope of the invention is intended to be modified and modified. The definition is final.

10‧‧‧Sensor array

20 _1,1 ‧‧‧Sensing pixels

31‧‧‧Form

211A...211D‧‧‧ sub-pixel

LH21A, LH21B, LV21A, LV21B, LV22A, LV22B‧‧‧ configuration line

SR21...SR26, SC21...SC28‧‧‧Sense line

Claims (24)

A sensor for sensing an image of a target, comprising: a plurality of sensing pixels disposed in a plurality of first sensing lines extending in a first direction and a plurality of second sensing lines extending in a second direction, Forming a sensing array, the first direction is interlaced with the second direction; wherein each of the sensing pixels has a plurality of sub-pixels, and at least two of the sub-pixels are adjacent in each of the sensing pixels; Wherein, when the sensor is in a first mode, the sub-pixels of a first portion of each of the sensing pixels perform a sensing operation to sense an image of the target; and wherein, when When the sensor is in a second mode, the sub-pixels of a second portion of each of the sensing pixels perform the sensing operation to sense an image of the target. The sensor of claim 1, wherein the number of the sub-pixels of the first portion is smaller than the number of the sub-pixels of the second portion. The sensor of claim 1, wherein in each of the sensing pixels, the sub-pixels are adjacent to each other and disposed on two first configuration lines extending in the first direction. The sensor of claim 3, wherein, for each of the sensing pixels, in the first mode, the ones disposed on one of the two first configuration lines The sub-pixels are combined to perform the sensing operation, and the sub-pixels on the other of the two first configuration lines do not perform the sensing operation. As described in claim 4 of the patent scope, Wherein, in the second mode range mode, all of the sub-pixels of the sensing pixel perform the sensing operation; and wherein, for each of the sensing pixels, in the second mode, The sub-pixels on one of the two first configuration lines have a first exposure time, and the sub-pixels on the other of the two first configuration lines have a second exposure time, The first exposure time is longer than the second exposure time. The sensor of claim 5, wherein the first mode is a normal mode of the sensor, and the second mode is a high dynamic range mode of the sensor. The sensor of claim 3, wherein when the ambient light of the sensor has a first intensity, the sensor is in the first mode, and in each of the sensing pixels, A first number of the sub-pixels are combined to perform the sensing operation. The sensor of claim 7, wherein when the ambient light of the sensor has a second intensity, the sensor is in the second mode, and in each of the sensing pixels, A second number of the sub-pixels are combined to perform the sensing operation; and wherein the first intensity is greater than the second intensity and the first amount is less than the second amount. The sensor of claim 1, wherein, in each of the sensing pixels, the sub-pixels are further disposed in two first configuration lines extending in the first direction and the second direction Two second configuration lines extending; and The second configuration lines corresponding to the two sensing pixels adjacent to each other are staggered for the same sensing line disposed on the same first sensing line. The sensor of claim 9, wherein, for each of the sensing pixels, at least two of the two first configuration lines are in the first mode The sub-pixel performs the sensing operation, and the remaining sub-pixels do not perform the sensing operation. The sensor of claim 10, wherein, for each of the sensing pixels, in the first mode, the times on one of the two second configuration lines Pixel combining to perform the sensing operation, and the sub-pixels on the other of the two second configuration lines do not perform the sensing operation. The sensor of claim 10, wherein, in the second mode, all of the sub-pixels of each of the sensing pixels perform the sensing operation; and wherein, for each of the sensing a pixel, in the second mode, the sub-pixels on one of the two first configuration lines have a first exposure time, and the other of the two first configuration lines The upper sub-pixels have a second exposure time that is longer than the second exposure time. The sensor of claim 12, wherein the first mode is a normal mode of the sensor, and the second mode is a high dynamic range mode of the sensor. The sensor of claim 9, wherein when the ambient light of the sensor has a first intensity, the sensor is in the first mode, and Configuring, in each of the sensing pixels, the sub-pixels on one of the second configuration lines to perform the sensing operation, and configuring the sub-pixels on the other of the second configuration lines Merging to perform the sensing operation. The sensor of claim 14, wherein when the ambient light of the sensor has a second intensity, the sensor is in the second mode, and one of the sensing pixels In the first sensing pixel, all of the sub-pixels are combined to perform the sensing operation; and wherein the first intensity is higher than the second intensity. The sensor of claim 14, wherein a second sensing pixel of the sensing pixels is disposed on the same first sensing line as the first sensing pixel; When the ambient light of the sensor has a second intensity, the sensor is in the second mode, and the sub-pixels of the portion of the second sensing pixel are different from the other sensing lines located on the same first sensing line At least one of the sub-pixels in a sensing pixel is combined to perform the sensing operation. The sensor of claim 14, wherein a second sensing pixel, a third sensing pixel, and a fourth sensing pixel among the sensing pixels and the first sensing Measure pixels are disposed on the same first sensing line, and the first, second, third, and fourth sensing pixels are sequentially disposed on the same sensing line; wherein the first and third The sensing pixel corresponds to a first color, and the second and fourth sensing pixels correspond to a second color; wherein when the ambient light of the sensor has a second intensity, the sensor is in the second Mode, and three of the second sensing pixels Performing the sensing operation in combination with one of the fourth sensing pixels; and wherein the first intensity is higher than the second intensity. A sensing method for sensing a image of an object, comprising: configuring a plurality of first sensing lines extending in a first direction and a plurality of second sensing lines extending in a second direction Sensing pixels to form a sensing array, wherein the first direction is interlaced with the second direction; each of the sensing pixels is divided into a plurality of pixels, wherein at least two of each of the sensing pixels The sub-pixels are adjacent to each other; when the sensor is in a first mode, a sensing operation is performed by the sub-pixels of a first portion of each of the sensing pixels to sense the target And the sensing operation is performed by the second sub-pixels of a second portion of each of the sensing pixels to sense an image of the object when the sensor is in a second mode. The sensing method of claim 18, wherein the number of the sub-pixels of the first portion is smaller than the number of the sub-pixels of the second portion. The sensing method of claim 18, wherein when the sensor is in the first mode, the sub-pixels of the first portion of each of the sensing pixels perform the The step of sensing operation includes performing, for each of the sensing pixels, a first number of the sub-pixels to perform the sensing operation. The sensing method of claim 20, wherein the sensing method When the device is in the second mode, the step of performing the sensing operation by the sub-pixels of the second portion of each of the sensing pixels comprises: for each of the sensing pixels, a second quantity The sub-pixels perform the sensing operation. The sensing method of claim 21, wherein the first quantity is less than the second quantity. The sensing method of claim 21, wherein the first mode is a normal mode of the sensor, and the second mode is a high dynamic range mode of the sensor. The sensing method of claim 23, wherein, when the sensor is in the second mode, in each of the sensing pixels, a part of the merged sub-pixels has a first One exposure time and another portion has a second exposure time that is longer than the second exposure time.