CN113301280B - Pixel circuit of photosensitive block, image processing method and device and electronic equipment - Google Patents
Pixel circuit of photosensitive block, image processing method and device and electronic equipment Download PDFInfo
- Publication number
- CN113301280B CN113301280B CN202110552874.8A CN202110552874A CN113301280B CN 113301280 B CN113301280 B CN 113301280B CN 202110552874 A CN202110552874 A CN 202110552874A CN 113301280 B CN113301280 B CN 113301280B
- Authority
- CN
- China
- Prior art keywords
- pixel
- charge storage
- electrically connected
- storage device
- block
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/57—Control of the dynamic range
- H04N25/59—Control of the dynamic range by controlling the amount of charge storable in the pixel, e.g. modification of the charge conversion ratio of the floating node capacitance
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
Abstract
The embodiment of the application provides a pixel circuit of a photosensitive block, an image processing method, an image processing device and electronic equipment. The pixel circuit of the photosensitive block comprises: at least three pixel cells and at least one charge storage device; each pixel unit comprises a photodiode for converting an optical signal into an electrical signal; the photodiodes of at least two pixel units are electrically connected with the same charge storage device and used for charging the charge storage device to obtain pixel information of the photosensitive block. The charge storage device is charged to the same charge storage device through the photodiodes of at least two pixel units, so that the charging time of the charge storage device is shortened, the time of exposure integration is greatly shortened, the image imaging and transmission speed are improved, the technical problem of poor display effect caused by display delay is avoided, and the user experience is improved.
Description
Technical Field
The present application relates to the field of image processing technologies, and in particular, to a pixel circuit of a photosensitive block, an image processing method and apparatus, and an electronic device.
Background
The Camera can replace human eyes to acquire places which cannot be reached by people, and is an extension of human vision. The large time delay from the information acquisition of the Camera end to the display of the display end exists, and the end-to-end time delay is greatly different from the characteristic of the information acquisition of the human eyes.
At present, the problem of display delay occurs from a camera end to a display end, so that the display effect is poor, and the user experience is reduced.
Disclosure of Invention
The application provides a pixel circuit of a photosensitive block, an image processing method, an image processing device and an electronic device aiming at the defects of the prior art, and aims to solve the technical problem of poor display effect caused by display delay in the prior art.
In a first aspect, an embodiment of the present application provides a pixel circuit of a photosensitive block, including: at least three pixel cells and at least one charge storage device;
each pixel unit comprises a photodiode for converting an optical signal into an electrical signal;
the photodiodes of at least two pixel units are electrically connected with the same charge storage device and used for charging the charge storage device to obtain pixel information of the photosensitive block.
In one possible implementation, the pixel circuit includes a charge storage device;
the photodiodes are all electrically connected to the same charge storage device.
In one possible implementation manner, each pixel unit is provided with a color filter layer with a preset color; the preset colors comprise a first color, a second color and a third color;
in the color filter layers with preset colors, the number of the color filter layers with two colors is the same.
In one possible implementation, the pixel circuit includes three charge storage devices;
and the photodiodes corresponding to the color filter layers of the same color are electrically connected with the same charge storage device.
In one possible implementation, the pixel circuit further includes: at least three first switching devices;
the first ends of the first switching devices are correspondingly and electrically connected with one photodiode, the second ends of the first switching devices are electrically connected with the first ends of the charge storage devices, and the control ends of the first switching devices are electrically connected with the same data signal line;
the second terminal of the charge storage device is grounded.
In one possible implementation, the pixel circuit further includes: at least one second switching device;
each row of pixel units is electrically connected with a first grid signal line;
the at least one second switching device is sequentially arranged, the first end of the first second switching device is electrically connected with the first voltage end, the second end of the previous second switching device is electrically connected with the first end of the next second switching device, the connecting node is electrically connected with a first grid signal line correspondingly, and the second end of the last second switching device is electrically connected with the first grid signal line corresponding to the last row of pixel units;
the control ends of the second switching devices are electrically connected with the same second grid signal line.
In a second aspect, an embodiment of the present application provides an image processing method, including:
when the moving target speed of the image area is detected to be larger than a preset speed threshold value, switching the first scanning mode into a block scanning mode; the block scanning mode adopts the pixel circuit of the photosensitive block as the first aspect;
and sequentially controlling the photodiodes of at least two pixel units of each photosensitive block to charge the same charge storage device to obtain pixel information of the image area.
In one possible implementation, the first scanning mode adopts a progressive scanning mode.
In a third aspect, an embodiment of the present application provides an image processing apparatus, including:
the first control module is used for switching the first scanning mode into a block scanning mode when the moving target speed of the image area is detected to be greater than a preset speed threshold; a block scanning mode adopts the pixel circuit of the photosensitive block of the first aspect;
and the second control module is used for sequentially controlling the photodiodes of at least two pixel units of each photosensitive block to charge the same charge storage device to obtain the pixel information of the image area.
In a fourth aspect, an embodiment of the present application provides an electronic device, including: a detection unit, a control unit, and the pixel circuit of the first aspect;
the detection unit is electrically connected with the control unit and used for detecting the moving target speed of the image area and sending the moving target speed to the control unit;
and the control unit is used for switching the first scanning mode into a block scanning mode when the moving target speed of the image area is detected to be greater than a preset speed threshold value, and sequentially controlling the photodiodes of at least two pixel units of each photosensitive block to charge the same capacitor to obtain the pixel information of the image area.
In a fifth aspect, the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by an electronic device to implement the image processing method according to the second aspect.
The beneficial technical effects brought by the technical scheme provided by the embodiment of the application comprise:
according to the embodiment of the application, when the moving target speed of the image area is detected to be greater than the preset speed threshold value, the first scanning mode is switched to the blocking scanning mode, the photodiodes of at least two pixel units of each photosensitive block are sequentially controlled to charge the same charge storage device, so that the charging time of the charge storage device is shortened, the time of exposure integration is greatly shortened, the image imaging and transmission speed is increased, the technical problem of poor display effect caused by display delay is avoided, and the user experience is improved.
Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a flowchart of an image processing method according to an embodiment of the present application;
fig. 2 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of a pixel circuit of a photosensitive block according to an embodiment of the present disclosure;
fig. 5 is a schematic arrangement diagram of a pixel unit of a pixel circuit of a photosensitive block according to an embodiment of the present disclosure;
fig. 6 is a schematic structural diagram of another pixel circuit of a photosensitive block corresponding to the pixel unit arrangement of fig. 5 according to an embodiment of the present disclosure.
Detailed Description
Reference will now be made in detail to the present application, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the same or similar parts or parts having the same or similar functions throughout. In addition, if a detailed description of the known art is not necessary for illustrating the features of the present application, it is omitted. The embodiments described below with reference to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application.
It will be understood by those within the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combinations of one or more of the associated listed items.
The inventor of the application researches and discovers that the Sensor is the core of the camera and is responsible for converting optical signals passing through Lens into electric signals and then converting the electric signals into digital signals through internal AD (digital-to-analog conversion). There are two kinds of pixel arrays, one is RGB array and the other is Bayer array (Bayer pattern), and Bayer array is currently used in the market.
An RGB (Red, green, blue, red, green, blue) array, i.e. each pixel has a different color filter added to filter out the color of the three RGB channels.
Bayer pattern (Bayer pattern) is used to solve the problem that it is too costly to filter out the three RGB channels by adding different color filters to each pixel. Instead of placing a three-color filter on each pixel of the bayer array, a single color filter is placed with a space between each pixel. Each channel results in a partially empty picture, and this empty value can be filled by various interpolation means. The three channels are ordered, for example: the bayer array is formed by repeatedly arranging 2x2 small lattices, because human vision is sensitive to green, 1R, 1B and 2G in four lattices. Ideally, each pixel should have three color values, and actually R and B are only 1/4, g is only 1/2, so that the image obtained by the bayer pattern has only 1/3 real content, and the others are obtained by interpolation, which also indicates that the natural image has a large amount of redundant information.
The inventor of the present application further researches and discovers that Camera can replace human eyes to acquire places which people cannot reach, and is an extension of human vision, in the current market, a great time delay is generated from information acquisition of a Camera end to display end display, the characteristic of the end-to-end time delay is greatly different from that of information acquisition of human eyes, and a new technical scheme is needed to reduce the end-to-end time delay so as to meet the requirements of human eyes.
The application provides a pixel circuit of a photosensitive block, an image processing method, an image processing device and an electronic device, and aims to solve the technical problems in the prior art.
The following describes the technical solution of the present application and how to solve the above technical problems in detail by specific embodiments.
An embodiment of the present application provides an image processing method, as shown in fig. 1, the image processing method includes: step S101 to step S102.
S101, when the moving target speed of an image area is detected to be larger than a preset speed threshold value, switching a first scanning mode into a block scanning mode; the pixel circuit of the photosensitive block according to any embodiment of the present application is adopted in a block scanning manner, and the specific structure of the pixel circuit of the photosensitive block is described in detail later.
Optionally, in the embodiment of the present application, when a high-speed moving object is captured, the sensor switches the integral exposure, and performs image processing by using the block scanning manner in the embodiment of the present application.
And S102, sequentially controlling the photodiodes 10 of at least two pixel units of each photosensitive block to charge the same charge storage device 20 to obtain pixel information of an image area. The specific structure of the pixel circuit of the photosensitive block is shown in fig. 4 and 6.
Alternatively, the photodiodes 10 of at least two pixel units of each photosensitive block are sequentially controlled to charge the same charge storage device 20, and pixel information of each photosensitive block is obtained correspondingly, so that pixel information of the whole image area is obtained.
According to the embodiment of the application, when the moving target speed of the image area is greater than the preset speed threshold value, the scanning mode is switched to the block scanning mode, the photodiodes 10 of at least two pixel units of each photosensitive block are sequentially controlled to charge the same charge storage device 20, so that the charging time of the charge storage device 20 is shortened, the time of exposure integration is greatly shortened, the image imaging and transmission speed are increased, the technical problem of poor display effect caused by display delay is avoided, and the user experience is improved.
The inventors of the present application consider that there are two sensor exposure scan modes, one is rolling exposure scan and the other is global exposure. At present, the rolling exposure scanning is an exposure mode with a higher utilization rate.
The rolling exposure scanning is that line-by-line exposure is read out line by line, the sensor line-by-line exposure starts from the first line, and the second line starts after one line period ends. And so on, the exposure is started on the Nth line after the N-1 line. After the first line exposure is finished, data reading is started, and one line period time (including line blanking time) is required for reading one line. After the first row is completely read out, the second row just starts to be read out, and so on, when the N-1 row is completely read out, the Nth row starts to be read out until the whole image is completely read out.
The global exposure scanning is frame exposure scanning, all the rows of the Sensor start exposure at the same time, the exposure is ended at the same time, after the exposure is ended, the Sensor transfers all the electrons from the photosensitive block to the storage area, and then pixel data is read out line by line. The advantage of this exposure is that the exposure time for each line of the image is relatively uniform, and the image will not be shifted or skewed when a moving object is captured.
The inventor of the present application further researches and discovers that the rolling exposure scanning is an exposure mode with a high utilization rate at present, and has the characteristics of long time consumption of line-by-line scanning and delayed picture imaging. The block scanning mode adopted by the embodiment of the application is to pack the pixel units in each frame of image according to blocks and then carry out exposure scanning, and the mode can reduce the line scanning time and the line blanking time at the same time, so that the exposure time and the imaging speed can be improved.
In some embodiments, the first scanning mode adopts a progressive scanning mode.
Alternatively, the progressive scanning mode, i.e. the conventional rolling exposure scanning mode, may also adopt other conventional exposure modes.
Compared with the conventional progressive scanning mode, the block scanning mode of the embodiment of the application reduces the scanning line number and saves line scanning and line blanking time.
The block scanning mode of the embodiment of the application can reduce end-to-end delay, can enable people to obtain external information at the first time, ensures the real-time performance of the information, and presets an acceptable upper limit threshold of the speed according to the response of human eyes under the condition that the speed of a moving target in an image area is detected to be greater than a preset speed threshold, namely, when the upper limit is exceeded, the scene picture can be basically ignored. When the head rotates rapidly, when the moving speed is detected to exceed a preset speed threshold value, the exposure mode is automatically switched into a block scanning mode, the characteristic that human eyes observe objects is that the requirements on the display speed and the image definition of a stop-motion image are high, and when the head rotates rapidly, the surrounding scene cannot be particularly concerned. Therefore, the scene resolution is reduced by the block scanning mode, and the data transmission speed of each frame is improved by reducing the display data amount, so that the problem of transmission delay is reduced.
Based on the same inventive concept, the embodiment of the present application provides an image processing apparatus, as shown in fig. 2, the image processing apparatus 200 includes: a first control module 210 and a second control module 220.
The first control module 210 is configured to switch the first scanning mode to the block scanning mode when it is detected that the moving target speed of the image area is greater than a preset speed threshold; the block scanning method adopts the pixel circuit of the photosensitive block according to any embodiment of the present application.
And the second control module 220 is configured to sequentially control the photodiodes 10 of at least two pixel units of each photosensitive block to charge the same charge storage device 20, so as to obtain pixel information of the image area.
Optionally, the first scanning mode adopts a progressive scanning mode.
Based on the same inventive concept, an embodiment of the present application provides an electronic device, and as shown in fig. 3, the electronic device 300 includes: a detection unit 310, a control unit 320 and a pixel circuit 330 of a photosensitive block of any embodiment of the present application.
The detection unit 310 is electrically connected to the control unit 320, and is configured to detect a moving target speed of the image area and send the moving target speed to the control unit 320.
The control unit 320 is configured to switch the first scanning mode to the block scanning mode when detecting that the moving target speed of the image area is greater than the preset speed threshold, and sequentially control the photodiodes 10 of at least two pixel units of each photosensitive block to charge the same capacitor, so as to obtain pixel information of the image area.
Optionally, the detection unit 310 comprises a sensor for detecting the moving object speed of the image area.
Optionally, the electronic device 300 may be an AR (Augmented Reality) glasses, and when a person rotates fast with the AR glasses, the image processing method of the embodiment of the present application is required, so that the display effect and the user experience are improved.
The embodiment of the application provides a pixel circuit of sensitization piece, includes: at least three pixel cells and at least one charge storage device 20.
Each pixel cell includes a photodiode 10 for converting an optical signal into an electrical signal.
The photodiodes 10 of at least two pixel units are electrically connected to the same charge storage device 20 for charging the charge storage device 20 to obtain pixel information of the photosensitive block.
The embodiment of the application is a pixel circuit corresponding to photosensitive blocks of two pixel arrays with a block exposure scanning mode for two pixel arrays of a current image sensor, namely an RGB pixel array and a Bayer array.
In some embodiments, referring to fig. 4, the pixel circuit includes one charge storage device 20; the photodiodes 10 are all electrically connected to the same charge storage device 20.
Referring to fig. 4, the charge storage device 20 is a first capacitor C1, and 9 photodiodes 10 are electrically connected to the first capacitor C1 to charge the first capacitor C1, so that the charging time is shortened, the exposure integration time is greatly reduced, and the image imaging and transmission speed is improved. Compared with the prior art that each photodiode 10 in the RGB pixel array is controlled by one capacitor unit, the embodiment of the present application shortens the charging time of the capacitor, and improves the image imaging and transmission speed.
Alternatively, the pixel circuit of each photosensitive block may also include 2, 4, 16, etc. pixel cells, and the photodiodes 10 connected to all the pixel cells are electrically connected to the same charge storage device 20.
In some embodiments, referring to fig. 6, each pixel unit is provided with a color filter layer with a predetermined color; the preset colors include a first color, a second color, and a third color.
In the color filter layers with preset colors, the number of the color filter layers with two colors is the same.
Optionally, the first color, the second color, and the third color are three colors of R red, G green, and B blue, respectively, the number of filter layers of red and blue is the same, and the number of filter layers of green is greater than that of filter layers of red and blue.
Alternatively, referring to fig. 5, the number of the first and third colors R and B is 2, and the number of the second colors G is 4. The arrangement of the color filter layers of the pixel cell shown in fig. 6 corresponds to the arrangement of the pixel cell of fig. 5.
In some embodiments, referring to fig. 6, the pixel circuit includes three charge storage devices 20. The photodiodes 10 corresponding to the color filter layers of the same color are electrically connected to the same charge storage device 20. The three charge storage devices 20 include a second capacitor C2, a third capacitor C3 and a fourth capacitor C4.
In some embodiments, as shown in conjunction with fig. 4 and 6, the pixel circuit further includes: at least three first switching devices 30. The embodiment of the present application has 9 first switching devices 30 in total, which are not all labeled.
First terminals of the first switching devices 30 are electrically connected to one photodiode 10, respectively, second terminals of the first switching devices 30 are electrically connected to first terminals of the charge storage devices 20, and control terminals of the first switching devices 30 are electrically connected to the same data signal line dataA. A second terminal of the charge storage device 20 is connected to ground.
In some embodiments, as shown in conjunction with fig. 4 and 6, the pixel circuit further includes: at least one second switching device 40. The embodiment of the present application has 3 second switching devices 40 in total.
Each row of pixel units is electrically connected with a first grid signal line gate.
The at least one second switching device 40 is sequentially arranged, a first end of the first second switching device 40 is electrically connected with the first voltage end, a second end of the previous second switching device 40 is electrically connected with a first end of the next second switching device 40, the connection node is electrically connected with a first gate signal line gate correspondingly, and a second end of the last second switching device 40 is electrically connected with a first gate signal line gate corresponding to the last row of pixel units.
The control terminals of the second switching devices 40 are all electrically connected to the same second gate signal line gateA.
Optionally, the first switching device 30 and the second switching device 40 are both switching transistors.
Alternatively, the anode of the photodiode 10 is electrically connected to the first gate signal line gate, and the cathode of the photodiode 10 is electrically connected to the first terminal of the first switching device 30.
Optionally, the pixel circuit further comprises: at least three third switching devices and at least three fifth capacitances. The first end of each third switching device is electrically connected with one photodiode 10 correspondingly, the second end of each third switching device is electrically connected with the first end of one fifth capacitor correspondingly, and the second end of the fifth capacitor is grounded. And the control end of the third switching device is connected with the control signal line. The third switching device is a switching transistor. Referring to fig. 4 and 6, the pixel circuit includes 9 third switching devices and 9 fifth capacitors.
As an example, referring to fig. 4, the embodiment of the present application uses a 3 × 3 photo-sensing block array of an RGB pixel array as a basic unit, connects first gate signal lines gate of the 3 × 3 photo-sensing blocks through a second switching device 40, and then controls the 3 × 3 photo-sensing block array to be simultaneously turned on through a second gate signal line gate a. In the integrated pixel circuit composed of a plurality of photosensitive blocks, the inside of a unit composed of every 3 × 3 photosensitive block array is connected together by nine first switching devices 30, one data signal line dataA is provided, 9 photodiodes 10 are simultaneously turned on and charge the first capacitor C1 intensively, and photoelectric conversion is completed.
As an example, referring to fig. 6, in the embodiment of the present application, a 3 × 3 array of photosensitive blocks of a Bayer array is used as a basic unit, pixel units are arranged as shown in fig. 5, and 9 pixel units are taken as a small whole, and the pixel units of color filter layers of the first color R, the second color G, and the third color B are respectively connected to each other, that is, the photodiode 10 of the pixel unit corresponding to the first color R in the 9 pixel units charges the third capacitor C3, the photodiode 10 of the pixel unit corresponding to the second color G charges the second capacitor C2, and the photodiode 10 of the pixel unit corresponding to the third color B charges the fourth capacitor C4.
Optionally, referring to fig. 6, the number of pixel units corresponding to the second color G is greater than the number of pixel units corresponding to the first color R and the third color B, so that when the display terminal uses RGB data, the display terminal divides G into two, that is, takes 1/2 value of G for use.
In the prior art, a Bayer array obtains a pixel unit which can only sense one of a first color R, a second color G and a third color B, so that Data stored in each pixel point is monochromatic light, that is, original Data Raw Data, the Data cannot be used for display end direct display, and an ISP module is required to convert the Raw Data into an RGB format.
In the Bayer array of the embodiment of the present application, 9 pixels are used as a basic unit, and all the photodiodes 10 corresponding to the first color R in the basic unit integrate charges into one third capacitor C3 at the same time, so that the integration time is increased to 2 times of the original integration time, and the data amount is 1/9 of the original integration time. The charging manner of the second capacitor C2 and the fourth capacitor C4 by the photodiode 10 corresponding to the second color G and the third color B is the same. Therefore, each basic unit finally has three integrated capacitors of R, G and B, and finally a large RGB pixel is formed, and the RGB pixel is directly used as a display end display. That is, in the embodiment of the present application, the pixel unit of the photosensitive block does not need to send the original value to the ISP, and the ISP calculates other color values of the photosensitive point according to another two values around a single photosensitive point value through interpolation, special effect processing, and the like, so as to restore the RGB step, and the RGB pixel can be directly obtained and directly used for display at the display end, so that the step of converting the display format in the ISP is omitted, the image imaging speed is increased, and the charging time is reduced, thereby reducing the end-to-end display delay from camera to display.
Based on the same inventive concept, embodiments of the present application further provide a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by an electronic device to implement the image processing method according to any embodiment of the present application.
It should be noted that the computer readable medium of the present application can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present application, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In this application, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
The computer-readable medium of the embodiments of the present application may be embodied in an electronic device; or may be present alone without being incorporated into the electronic device.
Those of skill in the art will appreciate that the various operations, methods, steps in the processes, acts, or solutions discussed in this application can be interchanged, modified, combined, or eliminated. Further, other steps, measures, or schemes in various operations, methods, or flows that have been discussed in this application can be alternated, altered, rearranged, broken down, combined, or deleted. Further, steps, measures, schemes in the prior art having various operations, methods, procedures disclosed in the present application may also be alternated, modified, rearranged, decomposed, combined, or deleted.
The terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present application, "a plurality" means two or more unless otherwise specified.
In the description herein, particular features, structures, materials, or characteristics may be combined in any suitable manner in any one or more embodiments or examples.
It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least a portion of the steps in the flow chart of the figure may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of execution is not necessarily sequential, but may be performed alternately or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
The foregoing is only a few embodiments of the present application and it should be noted that those skilled in the art can make various improvements and modifications without departing from the principle of the present application, and that these improvements and modifications should also be considered as the protection scope of the present application.
Claims (10)
1. A pixel circuit of a photosensitive block, comprising: at least three pixel cells, at least one charge storage device, and at least one second switching device;
each pixel unit comprises a photodiode for converting an optical signal into an electrical signal;
the photodiodes of the at least two pixel units are electrically connected with the same charge storage device and used for charging the same charge storage device when the moving target speed of the image area is detected to be greater than a preset speed threshold value, so that the pixel information of the photosensitive block is obtained;
each row of the pixel units is electrically connected with a first grid signal line; at least one second switching device is sequentially arranged, a first end of a first second switching device is electrically connected with a first voltage end, a second end of a previous second switching device is electrically connected with a first end of a next second switching device, a connecting node is electrically connected with a first grid signal line correspondingly, and a second end of a last second switching device is electrically connected with a first grid signal line corresponding to a last row of pixel units; and the control ends of the second switching devices are electrically connected with the same second grid signal line.
2. The pixel circuit of a photosensitive block of claim 1, wherein said pixel circuit comprises a charge storage device;
the photodiodes are all electrically connected to the same charge storage device.
3. A pixel circuit of a photosensitive block according to claim 1, wherein each pixel unit is provided with a color filter layer of a predetermined color; the preset colors comprise a first color, a second color and a third color;
in the color filter layers with the preset colors, the number of the color filter layers with two colors is the same.
4. A pixel circuit of a photosensitive block according to claim 3, wherein the pixel circuit includes three charge storage devices;
and the photodiodes corresponding to the color filter layers of the same color are electrically connected with the same charge storage device.
5. The pixel circuit of a photosensitive block of any one of claims 1-4, further comprising: at least three first switching devices;
the first ends of the first switching devices are correspondingly and electrically connected with one photodiode, the second ends of the first switching devices are electrically connected with the first ends of the charge storage devices, and the control ends of the first switching devices are electrically connected with the same data signal line;
the second terminal of the charge storage device is grounded.
6. An image processing method, characterized by comprising:
when the moving target speed of the image area is detected to be larger than a preset speed threshold value, switching the first scanning mode into a block scanning mode; the block scanning mode adopts the pixel circuit of the photosensitive block according to any one of claims 1 to 5;
and sequentially controlling the photodiodes of at least two pixel units of each photosensitive block to charge the same charge storage device to obtain pixel information of an image area.
7. The image processing method according to claim 6, wherein the first scanning mode is a progressive scanning mode.
8. An image processing apparatus characterized by comprising:
the first control module is used for switching the first scanning mode into a block scanning mode when the moving target speed of the image area is detected to be greater than a preset speed threshold; the block scanning mode adopts the pixel circuit of the photosensitive block as claimed in any one of claims 1 to 5;
and the second control module is used for sequentially controlling the photodiodes of at least two pixel units of each photosensitive block to charge the same charge storage device to obtain pixel information of an image area.
9. An electronic device, comprising: a detection unit, a control unit and a pixel circuit of the light sensing block according to any one of claims 1 to 5;
the detection unit is electrically connected with the control unit and is used for detecting the moving target speed of the image area and sending the moving target speed to the control unit;
the control unit is used for switching the first scanning mode into a block scanning mode when the moving target speed of the image area is detected to be greater than a preset speed threshold value, and sequentially controlling the photodiodes of at least two pixel units of each photosensitive block to charge the same capacitor to obtain pixel information of the image area.
10. A computer-readable storage medium, on which a computer program is stored, characterized in that the computer program, when executed by an electronic device, implements the image processing method according to any one of claims 6 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110552874.8A CN113301280B (en) | 2021-05-20 | 2021-05-20 | Pixel circuit of photosensitive block, image processing method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110552874.8A CN113301280B (en) | 2021-05-20 | 2021-05-20 | Pixel circuit of photosensitive block, image processing method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113301280A CN113301280A (en) | 2021-08-24 |
| CN113301280B true CN113301280B (en) | 2023-01-24 |
Family
ID=77323229
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110552874.8A Active CN113301280B (en) | 2021-05-20 | 2021-05-20 | Pixel circuit of photosensitive block, image processing method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113301280B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4692794A (en) * | 1985-02-18 | 1987-09-08 | Fuji Photo Film Co., Ltd. | Color image sensor with picture elements each comprising an M×N matrix of red, green, and blue photoelectric conversion elements featuring controllable charge storage time and selective readout for each color |
| CN101755463A (en) * | 2007-07-20 | 2010-06-23 | 伊斯曼柯达公司 | Multiple component readout of image sensor |
| CN102857708A (en) * | 2011-10-17 | 2013-01-02 | 北京瑞澜联合通信技术有限公司 | Image sensor, photographing device and image data generation method |
| CN112399113A (en) * | 2019-08-12 | 2021-02-23 | 天津大学青岛海洋技术研究院 | High-speed global exposure pixel structure for realizing intra-pixel correlated double sampling |
| CN112689073A (en) * | 2020-12-28 | 2021-04-20 | 维沃移动通信有限公司 | Image sensor, camera module and electronic equipment |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070131992A1 (en) * | 2005-12-13 | 2007-06-14 | Dialog Semiconductor Gmbh | Multiple photosensor pixel image sensor |
-
2021
- 2021-05-20 CN CN202110552874.8A patent/CN113301280B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4692794A (en) * | 1985-02-18 | 1987-09-08 | Fuji Photo Film Co., Ltd. | Color image sensor with picture elements each comprising an M×N matrix of red, green, and blue photoelectric conversion elements featuring controllable charge storage time and selective readout for each color |
| CN101755463A (en) * | 2007-07-20 | 2010-06-23 | 伊斯曼柯达公司 | Multiple component readout of image sensor |
| CN102857708A (en) * | 2011-10-17 | 2013-01-02 | 北京瑞澜联合通信技术有限公司 | Image sensor, photographing device and image data generation method |
| CN112399113A (en) * | 2019-08-12 | 2021-02-23 | 天津大学青岛海洋技术研究院 | High-speed global exposure pixel structure for realizing intra-pixel correlated double sampling |
| CN112689073A (en) * | 2020-12-28 | 2021-04-20 | 维沃移动通信有限公司 | Image sensor, camera module and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113301280A (en) | 2021-08-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP0954032B1 (en) | Image sensing apparatus and system including same | |
| US7440019B2 (en) | Solid-state image pick-up device | |
| US20150189249A1 (en) | Solid state imaging apparatus and imaging system using the same | |
| US8508641B2 (en) | Solid-state image sensor and imaging apparatus | |
| US11064138B2 (en) | High-dynamic image sensor | |
| KR20150060024A (en) | Pixel array and image sensor including the same | |
| US7336305B2 (en) | Solid-state image capturing device, smear correcting method thereof and digital still camera using the same | |
| CN114157818A (en) | Frame transfer CCD with multiple working modes and control method thereof | |
| US7223955B2 (en) | Solid-state imaging element and imaging device with dynamically adjustable sensitivities and method thereof | |
| US20040145668A1 (en) | MOS solid-state imaging element and imaging device provided with the same | |
| US7643079B2 (en) | Control circuit for reading out signal charges from main and subsidiary pixels of a solid-state image sensor separately from each other in interlace scanning | |
| JPH05252446A (en) | Charge coupled image sensor | |
| CN113301280B (en) | Pixel circuit of photosensitive block, image processing method and device and electronic equipment | |
| US7236194B2 (en) | Image signal processing apparatus | |
| US7492403B2 (en) | Solid state image sensing device and driving method with sub-sampling mode and improved dynamic range | |
| US8045025B2 (en) | Image pickup device adaptable to display fewer vertical pixels | |
| JP4738667B2 (en) | Imaging device | |
| CN112804435A (en) | Camera module and electronic equipment | |
| CN219938454U (en) | Image sensor and electronic device | |
| CN201854358U (en) | Image sensor and display device | |
| US20230268360A9 (en) | Pixel structure, image processing method and control method | |
| JPH1032758A (en) | Solid-state image pickup device and driving method therefor | |
| US20040252202A1 (en) | Image data processing methods, imaging apparatuses, and articles of manufacture | |
| JP2003153090A (en) | X-y scanning image pickup element and imaging device equipped with the same | |
| JP2012105059A (en) | Imaging device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |