CN111522455A - Image sensor including self-energy conversion pixels - Google Patents
Image sensor including self-energy conversion pixels Download PDFInfo
- Publication number
- CN111522455A CN111522455A CN202010294194.6A CN202010294194A CN111522455A CN 111522455 A CN111522455 A CN 111522455A CN 202010294194 A CN202010294194 A CN 202010294194A CN 111522455 A CN111522455 A CN 111522455A
- Authority
- CN
- China
- Prior art keywords
- pixels
- image
- self
- energy
- image sensor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03543—Mice or pucks
Abstract
An image sensor for operating on a work surface, comprising: an image frame buffer; an energy storage assembly; and an image sensing array for sensing reflected light from the work surface, the image sensing array comprising: a plurality of active sensing pixels for respectively outputting image data according to the sensed reflected light, each of the plurality of active sensing pixels including a read switch for controlling the image data to be output to the image frame buffer; and the self-energy conversion pixels are used for respectively outputting photocurrents according to the sensed reflected light, and each self-energy conversion pixel comprises an energy storage switch used for controlling the photocurrents to be output to the energy storage assembly so as to enable the energy storage assembly to store the electric energy of the photocurrents.
Description
The present application is a divisional application of the chinese patent application with the application number of 201610080041.5, 2016, 04, and entitled "self-powered optical mouse device and operating method thereof".
Technical Field
The present invention relates to an optical mouse device, and more particularly, to a self-powered optical mouse device and an operating method thereof.
Background
An optical mouse device generally includes a light source and an image sensor. The optical mouse device consumes the power of the light source in a maximum proportion. Therefore, how to reduce the power consumption of the light source is an important issue.
In the prior art, when the optical mouse device is not operated for a period of time, the overall power consumption can be reduced by reducing the brightness of the light source or reducing the data reading speed of the image sensor.
However, as mentioned above, the conventional optical mouse device is designed to reduce power consumption, and cannot feed back the light energy of the light source as the power for the optical mouse device to operate.
In view of the above, the present invention provides an optical mouse device, which can use part of energy of a system light source as power for operating the optical mouse, so as to improve energy utilization efficiency.
Disclosure of Invention
The invention provides an optical mouse device, which can convert part of optical energy of a system light source into electric energy which can be utilized by the optical mouse device.
The invention provides an image sensor comprising an image frame buffer, an energy storage component and an image sensing array. The image sensing array is used for sensing reflected light from the working surface and comprises a plurality of active sensing pixels and a plurality of self-energy conversion pixels. The active sensing pixels are used for respectively outputting image data according to the sensed reflected light, and each active sensing pixel comprises a reading switch used for controlling the image data to be output to the image frame buffer.
The invention also provides an image sensor comprising the image frame buffer, the energy storage assembly and the image sensing array. The image sensing array comprises a plurality of active sensing pixels and a plurality of self-energy conversion pixels. The plurality of self-energy conversion pixels are used for respectively outputting photocurrents according to the sensed reflected light, and each self-energy conversion pixel comprises an energy storage switch which is used for controlling the photocurrents to be output to the energy storage assembly, so that the energy storage assembly stores the electric energy of the photocurrents.
In order that the manner in which the above recited and other objects, features and advantages of the present invention are obtained will become more apparent, a more particular description of the invention briefly described below will be rendered by reference to the appended drawings. In the description of the present invention, the same components are denoted by the same reference numerals and are described in advance herein.
Drawings
Fig. 1 is a schematic diagram of an optical mouse device according to an embodiment of the invention.
Fig. 2A-2C are schematic diagrams of pixel arrangements of an image sensing array according to some embodiments of the invention, wherein the image sensing array includes self-powered pixels.
FIG. 3 is a flowchart illustrating an operating method of an optical mouse device according to an embodiment of the invention.
FIG. 4 is a first mode of operation of the optical mouse apparatus according to an embodiment of the present invention.
FIG. 5 is a diagram illustrating a second mode of operation of the optical mouse apparatus according to an embodiment of the invention.
Fig. 6 is a circuit diagram of a pixel circuit according to the present invention.
Description of the reference numerals
1 optical mouse device 11 light source
12 image sensing array 121 active sensing pixels
122 self-powered convertible Pixel 13 image frame buffer
14 energy storage assembly 15 processing unit
16. 16' analog-to-digital converter 17 switching assembly
61 photodiode 62 energy storage structure
631 reading switch 632 energy storage switch
64 readout line If image data
Ip photocurrent S working surface
Sr column select signal Sh tank signal
Detailed Description
In order that the manner in which the above recited and other objects, features, and advantages of the present invention are obtained will become more apparent, a more particular description of the invention briefly described below will be rendered by reference to the appended drawings. In the description of the present invention, the same components are denoted by the same reference numerals and are described in advance herein.
Fig. 1 is a schematic diagram of an optical mouse device 1 according to an embodiment of the invention, which includes a light source 11, an image sensor array 12, an image frame buffer 13, an energy storage device 14, and a processing unit 15. In some embodiments, the optical mouse device 1 operates on a working surface S to detect relative movement with respect to the working surface S.
The light source 11 is, for example, an active light source for emitting light with a distinguishable spectrum to illuminate the work surface S. In some embodiments, the light source 11 is, for example, a light emitting diode or a laser diode, and emits red light and/or infrared light. In some embodiments, the optical mouse device 1 further comprises an optical component, such as a lens, for adjusting the light emitting field (illumination field) of the light source 11.
The image sensor array 12 is, for example, included in an image sensor, and is used for sensing light energy of the light reflected by the light source 11 from the working surface S. The image sensor is, for example, an active sensor, which includes a substrate layer (substrate layer) fabricated by a semiconductor process, and having a plurality of active sensing pixels and a plurality of self-energy conversion pixels (described in detail later); the active sensing pixels are used for respectively outputting image data If according to the sensed light energy of the reflected light, and the self-energy conversion pixels are used for respectively outputting light current Ip according to the sensed light energy of the reflected light.
In the present invention, the image data If is used for the processing unit 15 to calculate a displacement, for example, the processing unit 15 calculates the displacement by comparing the image data If of two image frames; wherein, an image frame refers to the image data If outputted during a scanning period of scanning the plurality of active sensing pixels. The active sensing pixels may be of a known three-transistor (3T) or four-transistor (4T) pixel structure, and are not particularly limited. For example, the active sensing pixels may be pixel structures of known CMOS image sensors.
In the present invention, the photocurrent Ip is used for the light source 11 to emit light. For example, the self-energy conversion pixels are coupled to at least one energy storage element 14 for storing the electrical energy of the photocurrents Ip; the power is mainly provided to the light source 11, but not limited thereto. In some embodiments, the optical mouse apparatus 1 includes, for example, a capacitor (capacitor) as the energy storage component 14, and all of the self-energy-converting pixels are coupled to the capacitor. In some embodiments, the optical mouse device 1 includes a plurality of capacitors as the energy storage component 14, the plurality of self-energy-converting pixels are divided into a plurality of regions, and the self-energy-converting pixels of each region are respectively coupled to a capacitor, for example, each row/column of the self-energy-converting pixels is respectively coupled to a capacitor, but not limited thereto. The at least one energy storage component 14 is coupled to the light source 11 for providing the light source 11 with the stored electrical energy to emit light.
The processing unit 15 is, for example, a Digital Signal Processor (DSP), a microprocessor (microcontroller) or an Application Specific Integrated Circuit (ASIC), and is configured to calculate a displacement according to the image data If output by the active sensing pixels, for example, calculate a displacement according to a correlation between two image frames, and determine an operation mode. The first mode is maintained when the found displacement amount is larger than a displacement threshold value, and the second mode is entered when the displacement amount is smaller than the displacement threshold value. In the present invention, the first mode refers to a mode in which the processing unit 15 detects a displacement and outputs the displacement at a report rate, for example. The second mode refers to a mode in which the processing unit 15 detects that the optical mouse apparatus 1 is in a substantially stationary state and at least a part of components are lowered or stopped. It should be noted that the first mode may be a normal mode, and the second mode may be a sleep mode, but is not limited thereto, and this section is only used to illustrate the states of the different modes.
In the present invention, in the first mode, the plurality of active sensing pixels and the plurality of self-energy conversion pixels are both operated; in the second mode, the plurality of active sensing pixels are deactivated and the plurality of self-energy conversion pixels continue to operate. That is, the plurality of self-energy converting pixels output the plurality of photocurrents Ip in the first mode and the second mode, and the plurality of photocurrents Ip may have different functions in different modes. The plurality of active sensing pixels being deactivated (deactivated) in the second mode may refer to not outputting the plurality of image data If, for example, a transistor in a pixel circuit controlling to output the image data If is not turned on, and the plurality of active sensing pixels outputting the plurality of image data If only in the first mode.
The image frame buffer 13 is, for example, a volatile memory (volatile memory) or a buffer, and is used for storing the image data If output by the active sensing pixels or the intensity data related to the photocurrent Ip output by the self-powered converting pixels. More specifically, in the present invention, the image frame buffer 13 is coupled to the active sensing pixels and not coupled to the self-powered pixels in the first mode to store the image data If output by the active sensing pixels; the image frame buffer 13 is coupled to the plurality of self-powered switchable pixels and not coupled to the plurality of active sensing pixels in the second mode, for storing intensity data related to the photocurrent Ip output from the self-powered switchable pixels; wherein the intensity data may also be referred to as a gray scale value.
In one embodiment, the optical mouse apparatus 1 includes a multiplexer 17(multiplexer), for example, the multiplexer 17 is coupled between the image frame buffer 13 and the plurality of self-powered pixels and the plurality of active sensing pixels. When the processing unit 15 determines to enter the first mode, the processing unit 15 controls the multiplexer 17 to electrically couple the image frame buffer 13 and the active sensing pixels for temporarily storing the image data If; when the processing unit 15 determines to enter the second mode, the processing unit 15 controls the multiplexer 17 to electrically couple the image frame buffer 13 and the plurality of self-powered switchable pixels, so as to temporarily store the intensity data related to the photocurrent Ip. It should be noted that the use of the multiplexer is only an embodiment, but the present invention is not limited thereto, and other switches may be used as long as the purpose of switching can be achieved.
The processing unit 15 is configured to calculate the displacement amount according to the image data If of the image frame buffer 13, and determine whether to leave the second mode according to the value change of the intensity data in the image frame buffer 13. As mentioned above, in the second mode, the plurality of self-powered switchable pixels store the intensity data related to the photocurrent Ip in the image frame buffer 13, and the processing unit 15 compares the numerical changes of the intensity data related to the photocurrent Ip of the two image frames; one image frame refers to a photo current Ip output during one scanning period in which the plurality of self-energy conversion pixels are scanned. In the present invention, the image frame rate of the plurality of self-energy conversion pixels is lower than the image frame rate of the plurality of active sensing pixels. When the value change of the intensity data exceeds a change threshold, the optical mouse device 1 is indicated to move, and the processing unit 15 judges that the optical mouse device leaves the second mode; when the value change of the intensity data does not exceed the change threshold, it indicates that the optical mouse device 1 has not moved, and the processing unit 15 determines to maintain the second mode. In some embodiments, the processing unit 15 may also calculate a correlation (correlation) of intensity data related to the photocurrent Ip between two image frames, and when the correlation is lower than a preset threshold, it indicates that movement has occurred; conversely, no movement occurs. In addition, the numerical variation may also be determined by other known methods for determining the similarity between two image frames, without any specific limitation.
Fig. 2A to 2C are schematic diagrams illustrating pixel arrangements of the image sensor array 12 according to some embodiments of the invention. As mentioned above, the image sensing array 12 includes a plurality of active sensing pixels 121 and a plurality of self-energy converting pixels 122. In some embodiments, the self-energy-converting pixels 122 are arranged in a part of pixel columns (as shown in fig. 2B) or a part of pixel rows (as shown in fig. 2A) of the image sensing array 12, and the part of pixel columns or the part of pixel rows of the self-energy-converting pixels 122 are not adjacent to each other. As shown in fig. 2A and 2B, an active sensing pixel column (or row) is disposed between two self-energizing conversion pixel columns (or rows). In some embodiments, the active sensing pixels 121 and the self-energy converting pixels 122 may also be arranged in a checkerboard arrangement, as shown in fig. 2C.
As mentioned above, the processing unit 15 calculates the displacement amount according to the image data If output by the active sensing pixels 121, and in order to increase the calculation accuracy, the processing unit 15 further performs an interpolation operation (interpolation) on the image data If before calculating the displacement amount, and calculates the displacement amount according to the interpolated image data, since the active sensing pixels 121 are not completely adjacent to each other.
For example, when the pixels of the image sensor array 12 are arranged as shown in fig. 2C, the pixel data at the pixel position (1,2) can be interpolated from the pixel data at the pixel positions (1,1), (2,2) and (1, 3); the pixel data of the pixel position (1,4) can be obtained by interpolation of the pixel data of the pixel positions (1,3) and (2, 4); and so on. It should be noted that the interpolation method is not limited to the method described in the description of the present invention.
Referring to fig. 2A to 2C, the optical mouse device 1 includes a reading circuit, for example, the reading circuit is coupled to the image sensing array 12 for reading out pixel data of the active sensing pixels 121 and the self-energy conversion pixels 122, respectively. The readout circuit is, for example, a correlated double sampling (correlated double sampling) circuit, and is coupled to the two sets of readout lines. A set of readout lines is coupled to the active sensing pixels 121 and the image frame buffer 13 for outputting image data If. Another set of readout lines is coupled to the self-convertible pixels 122 and the image frame buffer 13 for outputting an output photocurrent Ip. In addition, the optical mouse apparatus 1 further includes a charging circuit, which is coupled to the plurality of self-energy conversion pixels 122 and the energy storage assembly 14, and is used for storing the photocurrent Ip to the energy storage assembly 14; the charging line forms a bus line, for example, to transmit part or all of the photocurrent Ip output from the energy conversion pixel 122. As mentioned above, the optical mouse apparatus 1 further comprises a switching component (e.g. the multiplexer 17) for switching different connection modes between the first mode and the second mode, so that the image frame buffer 13 is coupled to the plurality of self-powered conversion pixels 122 or to the plurality of active sensing pixels 121. In addition, an analog-to-digital converter (ADC)16, 16' may be provided between the reading circuit and the image frame buffer 13 for converting pixel data into digital signals for storage in the image frame buffer 13.
Fig. 3 is a flowchart illustrating an operating method of the optical mouse device according to an embodiment of the invention. The operation method is suitable for the optical mouse device 1 shown in FIG. 1. In the first mode, the light source 11 illuminates the working surface S, and the image sensor array 12 includes a plurality of active sensor pixels 121 and a plurality of self-energy conversion pixels 122 for sensing light energy of the reflected light from the working surface S. The active sensing pixels 121 are coupled to an image frame buffer 13 for storing image data If in the image frame buffer 13, and the processing unit 15 reads the image data If from the image frame buffer 13 for calculating a displacement amount. The self-energy conversion pixels 122 are coupled to at least one energy storage element 14 for storing electric energy of the photocurrent Ip to the energy storage element 14, and the energy storage element 14 is coupled to the light source 11 for providing the electric energy required by the light source 11 to emit light.
The operation method comprises the following steps: the light source emits light (step S30); calculating a displacement amount according to the image data output by the active sensing pixels (step S31); entering a second mode when the displacement amount is smaller than a displacement threshold (step S32); deactivating the plurality of active sensing pixels in the second mode (step S33); outputting photocurrents respectively by using the plurality of self-energy conversion pixels (step S34); and storing the electrical energy of the plurality of photocurrents to at least one energy storage component to provide light to the light source for illumination (step S35).
Referring to fig. 3 and 4, fig. 4 is a schematic diagram illustrating a first mode of operation of an optical mouse device according to an embodiment of the invention. In the first mode, the active sensing pixels 121 sense light energy of the light source 11 to respectively output image data If to the image frame buffer 13, and the processing unit 15 calculates a displacement amount according to the image data If (steps S30 and S31). As mentioned above, since the plurality of active sensing pixels 121 are not arranged consecutively, the processing unit 15 preferably performs interpolation operation on the plurality of image data If before calculating the displacement amount to obtain the displacement amount correctly. When the processing unit 15 determines that the displacement is greater than a displacement threshold, the operation is continued in the first mode; when the processing unit 15 determines that the displacement amount is smaller than the displacement threshold, it enters a second mode (step S32), such as deactivating the active sensing pixels (step S33) and reducing or turning off the operation of some components. After entering the second mode, the self-powered pixels 122 continue to operate.
In the first mode, the self-energy conversion pixels 122 sense the light energy of the light source 11 to output an optical current Ip to the at least one energy storage component 14 (steps S30, S34). The at least one energy storage component 14 stores the power from the photocurrents Ip for providing the power for the optical mouse (step S35), such as for the light source 11 to emit light, but not limited thereto, and can also provide the power to other components of the optical mouse apparatus 1.
Referring to fig. 5, it is a schematic diagram illustrating a second mode of operation of the optical mouse apparatus according to the embodiment of the invention, which is also applicable to the optical mouse apparatus 1 shown in fig. 1. In the second mode, the plurality of self-energy converting pixels 122 sense the light energy of the reflected light from the working surface S and generate a photocurrent Ip. As in the first mode of operation, the self-energy conversion pixels 122 are coupled to at least one energy storage element 14 for storing the generated photocurrent Ip. The energy storage assembly 14 is, for example, coupled to the light source 11 to provide the stored electrical energy to the light source 11. In addition, in the second mode, the plurality of self-powered pixels 122 can be further coupled to the image frame buffer 13, so as to store pixel data in the image frame buffer 13 for post-operation by the processing unit 15. More specifically, in the second mode, the self-powered pixels 122 may be coupled to only the image frame buffer 13, or to both the image frame buffer 13 and the at least one energy storage element 14.
In some embodiments, in the second mode, the intensity data associated with the output light current Ip of the self-convertible pixels 122 is stored in the image frame buffer 13, and the processing unit 15 calculates the intensity value change according to the intensity data to determine whether to leave the second mode. For example, the second mode is continued when the change in the value of the intensity data is less than a change threshold; when the change in the value of the intensity data is greater than a change threshold, the second mode is ended and the plurality of active sensing pixels 121 are reactivated (activated) to enter the first mode.
The value change is, for example, a value change of the intensity data of each same pixel (pixel-by-pixel) compared by the processing unit 15 in two consecutive image frames, and when the number of pixels whose value change is greater than a change threshold exceeds a preset number, it is determined that the second mode is ended.
In another embodiment, the processing unit 15 calculates an average value of the intensity data of each image frame, for example, and determines that the second mode is ended when the numerical variation of the average value is greater than a variation threshold.
In another embodiment, the processing unit 15 calculates a displacement amount (e.g. calculating a displacement amount according to the image data If) by using the intensity data, and determines that the second mode is ended when the displacement amount is greater than a predetermined displacement amount; when the processing unit 15 calculates the displacement according to the intensity data, interpolation operation can be performed before calculating the displacement.
For the purpose of saving more power, in the second mode, the light emitting brightness of the light source 11 may be lower than that of the first mode.
In the present invention, the image frame in the second mode refers to an image frame formed by pixel data output from the plurality of self-convertible pixels 122; and the image frame in the first mode refers to an image frame formed by pixel data output by the plurality of active sensing pixels 121.
As shown in fig. 4 and 5, the self-energy conversion pixels 122 are coupled to at least one energy storage device 14 in both the first mode and the second mode, and output the electric energy of the photocurrent Ip to the energy storage device 14. The energy storage component 14 is coupled to the light source 11, for example, and provides the electric energy required by the light source 11 to emit light. In the second mode, the plurality of self-convertible pixels 122 are further coupled to the image frame buffer 13 for the processing unit 15 to further operate on pixel data to determine whether to leave the second mode.
Fig. 6 is a circuit diagram of a pixel circuit according to the present invention. As mentioned above, the plurality of active sensing pixels 121 may have a known 3T or 4T pixel structure, and is not limited in particular. For example, the plurality of active sensing pixels 121 may include a photodiode 61, an energy storage structure 62 (e.g., without limitation, a capacitor, a storage node, a floating diffusion, or the like), and a read switch 631. The photodiode 61 is used to convert light energy into electric energy. The energy storage structure 62 is used for temporarily storing the electric energy converted by the photodiode 61. The readout switch 631 is used for controlling the output of the electrical energy (i.e. the image data If) in the energy storage structure 62 to the readout line 64 according to a row selection signal Sr. The readout line 64 is coupled to the readout circuit (as shown in fig. 2A-2C), for example, to store the output image data If to the image frame buffer 13.
The pixel structure of the self-energy converting pixels 122 is not particularly limited, and in addition to the photodiode 61, the energy storage structure 62 and the reading switch 631, the pixel structure further includes an energy storage switch 632, where the energy storage switch 632 is configured to output the photocurrent Ip converted by the photodiode 61 to the energy storage element 14 according to an energy storage signal Sh; the column selection signal Sr and the energy storage signal Sh are provided by a timing controller, for example, to be turned on simultaneously or individually. Similarly, the photodiode 61 is configured to convert light energy into a photocurrent Ip. The readout switch 631 is used to control the output of the photocurrent Ip to the readout line 64. The readout line 64 is coupled to the readout circuit (as shown in fig. 2A-2C), for example, to store the output photocurrent Ip to the image frame buffer 13. Therefore, the photocurrent Ip converted by the photodiode 61 can be output to the energy storage component 14 and/or the image frame buffer 13 in different operation modes.
It should be noted that, although the desktop mouse is taken as an example for the above description, the invention is not limited thereto. In some embodiments, the image sensing array 12 of the present invention can also be applied to an optical system including a system light source, such as an optical finger mouse, a proximity sensor, etc., for reusing a portion of the electrical energy.
The optical mouse device 1 further includes a timing controller (timing controller) or a signal generator (signal generator) for generating a timing signal to control the reading circuit to read pixel data (including the image data If and the photocurrent Ip) and control on/off of each switch element (e.g. 17, 631, 632).
The optical mouse device 1 further includes an output interface, for example, which outputs the displacement calculated by the processing unit 15 to the host (host) at a report rate (report) so as to control the cursor movement relatively. In some embodiments, the reporting rate may be adjusted based on the software currently being executed by the host.
As described above, the conventional optical mouse does not have a power feedback mechanism, so that the saving ratio of the whole power consumption still has an upper limit. Therefore, the present invention further provides a self-powered optical mouse device (as shown in fig. 1 and 2A-2C) and an operating method thereof, which can store part of energy of the light source and feed back the stored energy to the light source, so as to effectively improve the energy utilization efficiency of the optical mouse device.
Although the present invention has been described with reference to the foregoing embodiments, it should be understood that various changes and modifications may be made by those skilled in the art without departing from the spirit and scope of the invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (13)
1. An image sensor for operating on a work surface, comprising:
an image frame buffer;
an energy storage assembly; and
an image sensing array for sensing reflected light from the work surface, the image sensing array comprising:
a plurality of active sensing pixels for respectively outputting image data according to the sensed reflected light, each of the plurality of active sensing pixels including a read switch for controlling the image data to be output to the image frame buffer; and
the self-energy conversion pixels are used for respectively outputting photocurrents according to the sensed reflected light, and each self-energy conversion pixel comprises an energy storage switch used for controlling the photocurrents to be output to the energy storage assembly so that the energy storage assembly stores the electric energy of the photocurrents.
2. The image sensor of claim 1, wherein each of the plurality of self-powered switchable pixels further comprises another read switch for controlling the photocurrent output to the image frame buffer.
3. The image sensor of claim 2, wherein the image sensor further comprises a switch element for coupling the image frame buffer to the plurality of self-convertible pixels or the plurality of active sensing pixels.
4. The image sensor of claim 2, wherein the read switch and the another read switch are controlled by a select signal provided by a timing controller.
5. The image sensor as in claim 1, wherein the energy storage switch is controlled by an energy storage signal provided by a timing controller.
6. The image sensor of claim 1, wherein the plurality of self-energy-converting pixels are arranged in a partial pixel column or a partial pixel row of the image sensing array, and the partial pixel column or the partial pixel row of the plurality of self-energy-converting pixels are not adjacent to each other.
7. The image sensor of claim 1, wherein the plurality of active sensing pixels and the plurality of self-energy converting pixels are arranged in a checkerboard pattern.
8. The image sensor of claim 1, wherein the plurality of active sensing pixels output the image data in a mode of calculating a displacement amount and do not output the image data in a static state.
9. The image sensor of claim 8, wherein the plurality of self-convertible pixels are not coupled to the image frame buffer in the mode of calculating the amount of displacement.
10. The image sensor of claim 1, wherein the energy storage component is configured to provide the stored electrical energy to a light source.
11. The image sensor of claim 1, wherein the image sensor further comprises a readout circuit coupled to the plurality of active sensing pixels to read out the image data and coupled to the plurality of self-energy converting pixels to read out the photocurrent.
12. An image sensor, the image sensor comprising:
an image frame buffer;
an energy storage assembly; and
an image sensing array, the image sensing array comprising:
a plurality of active sensing pixels coupled to the image frame buffer through a read switch thereof; and
and the self-energy conversion pixels are coupled with the energy storage component through energy storage switches of the self-energy conversion pixels.
13. The image sensor of claim 12, further comprising a readout circuit for reading out pixel data of the plurality of active sensing pixels and reading out photocurrents of the plurality of self-energy converting pixels.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010294194.6A CN111522455B (en) | 2016-02-04 | 2016-02-04 | Image sensor comprising self-energy conversion pixels |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010294194.6A CN111522455B (en) | 2016-02-04 | 2016-02-04 | Image sensor comprising self-energy conversion pixels |
| CN201610080041.5A CN107037892B (en) | 2016-02-04 | 2016-02-04 | Self-powered optical mouse device and operation method thereof |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610080041.5A Division CN107037892B (en) | 2016-02-04 | 2016-02-04 | Self-powered optical mouse device and operation method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111522455A true CN111522455A (en) | 2020-08-11 |
| CN111522455B CN111522455B (en) | 2023-06-09 |
Family
ID=59532999
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610080041.5A Active CN107037892B (en) | 2016-02-04 | 2016-02-04 | Self-powered optical mouse device and operation method thereof |
| CN202010294194.6A Active CN111522455B (en) | 2016-02-04 | 2016-02-04 | Image sensor comprising self-energy conversion pixels |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610080041.5A Active CN107037892B (en) | 2016-02-04 | 2016-02-04 | Self-powered optical mouse device and operation method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN107037892B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200300908A (en) * | 2001-12-05 | 2003-06-16 | Em Microelectronic Marin Sa | Sensing device for optical pointing devices such as an optical mouse |
| CN1677431A (en) * | 2004-04-02 | 2005-10-05 | 原相科技股份有限公司 | Optical mouse and image fetching chip thereof |
| CN2847376Y (en) * | 2005-10-17 | 2006-12-13 | 达方电子股份有限公司 | Optical input device |
| CN103425275A (en) * | 2012-05-17 | 2013-12-04 | 原相科技股份有限公司 | Sensing module and sensing method both applied to optical mouse and provided with electricity-saving function |
| US20140210722A1 (en) * | 2013-01-30 | 2014-07-31 | Pixart Imaging Inc. | Optical mouse apparatus for adjusting exposure of sensed image output and related method thereof |
| CN103970300A (en) * | 2013-01-29 | 2014-08-06 | 原相科技股份有限公司 | Optical mouse device and data compression method used therein |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102033632B (en) * | 2010-12-28 | 2013-03-20 | 鸿富锦精密工业（深圳）有限公司 | Handwriting pen device with charging seat |
| US9300937B2 (en) * | 2014-06-26 | 2016-03-29 | Pixart Imaging (Penang) Sdn, Bhd. | Color image sensor and operating method thereof |
| TWI545951B (en) * | 2014-07-01 | 2016-08-11 | 晶相光電股份有限公司 | Sensors and sensing methods |
-
2016
- 2016-02-04 CN CN201610080041.5A patent/CN107037892B/en active Active
- 2016-02-04 CN CN202010294194.6A patent/CN111522455B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200300908A (en) * | 2001-12-05 | 2003-06-16 | Em Microelectronic Marin Sa | Sensing device for optical pointing devices such as an optical mouse |
| CN1677431A (en) * | 2004-04-02 | 2005-10-05 | 原相科技股份有限公司 | Optical mouse and image fetching chip thereof |
| CN2847376Y (en) * | 2005-10-17 | 2006-12-13 | 达方电子股份有限公司 | Optical input device |
| CN103425275A (en) * | 2012-05-17 | 2013-12-04 | 原相科技股份有限公司 | Sensing module and sensing method both applied to optical mouse and provided with electricity-saving function |
| CN103970300A (en) * | 2013-01-29 | 2014-08-06 | 原相科技股份有限公司 | Optical mouse device and data compression method used therein |
| US20140210722A1 (en) * | 2013-01-30 | 2014-07-31 | Pixart Imaging Inc. | Optical mouse apparatus for adjusting exposure of sensed image output and related method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107037892B (en) | 2020-05-12 |
| CN111522455B (en) | 2023-06-09 |
| CN107037892A (en) | 2017-08-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8462115B2 (en) | Motion estimation device and power saving method thereof | |
| KR101668869B1 (en) | Depth sensor, 3D image sensor and Depth sensing method there-of | |
| US9046935B2 (en) | Motion estimation device and power saving method thereof | |
| US11825229B2 (en) | Event-based vision sensor using on/off event and grayscale detection ramps | |
| US11812169B2 (en) | Dynamic vision sensor with in-pixel digital change detection | |
| TWI716453B (en) | Pixel circuit with low power consumption, image system including the same and operating method thereof | |
| US20230359264A1 (en) | Optical sensor device having sensing pixels and self-powered pixels | |
| US11327550B2 (en) | Sensor chip with reduced operation power | |
| JPH10222285A (en) | Image extracting device | |
| TWI530828B (en) | Optical mouse including thermal sensor | |
| CN107037892B (en) | Self-powered optical mouse device and operation method thereof | |
| KR20150068740A (en) | Image sensor for adjusting number of oversampling and image data processing system | |
| US10255687B2 (en) | Distance measurement system applicable to different reflecting surfaces and operating method thereof | |
| US20050206761A1 (en) | Photoelectric conversion apparatus and image reading apparatus | |
| JP2023099237A (en) | Imaging apparatus, method for controlling imaging apparatus, and shape measuring device | |
| WO2021157393A1 (en) | Rangefinder and rangefinding method | |
| US20240012424A1 (en) | Moving robot with improved identification accuracy of step distance | |
| US20230018095A1 (en) | Distance measuring device, method of controlling distance measuring device, and electronic apparatus | |
| KR20220010885A (en) | Apparatus for recognizing motion by using ToF sensor, and method for operating the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |