CN107040730A - Image formation control method, the imaging sensor of imaging sensor, and imaging device - Google Patents
Image formation control method, the imaging sensor of imaging sensor, and imaging device Download PDFInfo
- Publication number
- CN107040730A CN107040730A CN201710295974.0A CN201710295974A CN107040730A CN 107040730 A CN107040730 A CN 107040730A CN 201710295974 A CN201710295974 A CN 201710295974A CN 107040730 A CN107040730 A CN 107040730A
- Authority
- CN
- China
- Prior art keywords
- array
- arrangement mode
- bayer
- arrangement
- bayer array
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 86
- 238000000034 method Methods 0.000 title claims abstract description 45
- 230000015572 biosynthetic process Effects 0.000 title abstract description 6
- 238000001914 filtration Methods 0.000 claims description 74
- 238000003491 array Methods 0.000 claims description 23
- 238000001514 detection method Methods 0.000 claims description 6
- 230000000694 effects Effects 0.000 abstract description 13
- 238000010586 diagram Methods 0.000 description 10
- 238000006243 chemical reaction Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 239000000463 material Substances 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Color Television Image Signal Generators (AREA)
- Studio Devices (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
Abstract
The invention discloses a kind of image formation control method of imaging sensor, imaging sensor, and imaging device, wherein, the image formation control method of imaging sensor includes：Detect current environment luminous intensity；When current environment luminous intensity is less than preset strength, control filter unit array is arranged in first order mode；Control photosensitive unit array is exposed, and reads the output valve of photosensitive unit array, to obtain the pixel value of photosensitive unit array so as to generate image.The image formation control method of the imaging sensor of the embodiment of the present invention, it can realize according to ambient light intensity, exchange the arrangement position of filter unit in filter unit array, ensure the imaging definition under compared with high ambient light intensity, the imaging effect of high s/n ratio under relatively low ambient light intensity, effectively lifting imaging sensor.
Description
Technical Field
The present invention relates to the field of electronic technologies, and in particular, to an imaging control method for an image sensor, and an imaging apparatus.
Background
With the continuous updating of electronics, more and more manufacturers are beginning to use image sensors of the 16M-4M architecture. In the related art, the 16M-4M sensor filter arrangement format is different from that of the conventional bayer array, and when the 16M-4M sensor works in a 16M resolution imaging mode, output data needs to be converted into bayer format data first, so that subsequent imaging processing can be performed.
In this way, the output value of the photosensitive cell array is converted into bayer pattern data by performing another data conversion subsequently, and the imaging effect of the image sensor is poor.
Disclosure of Invention
The object of the present invention is to solve at least to some extent one of the above mentioned technical problems.
Therefore, an object of the present invention is to provide an imaging control method for an image sensor, which can exchange arrangement positions of filter units in a filter unit array according to ambient light intensities, ensure imaging sharpness under higher ambient light intensities, and improve an imaging effect of the image sensor effectively due to a high signal-to-noise ratio under lower ambient light intensities.
Another object of the present invention is to provide an image sensor.
Another object of the present invention is to provide an image forming apparatus.
Another object of the present invention is to provide a mobile terminal.
In order to solve the above problem, an embodiment of a first aspect of the present invention provides an imaging control method for an image sensor, where the image sensor includes: the method comprises the following steps of: detecting the current ambient light intensity; when the current ambient light intensity is smaller than the preset intensity, controlling the light filtering unit array to be arranged in a first arrangement mode; and controlling the photosensitive unit array to perform exposure, and reading output values of the photosensitive unit array to obtain pixel values of the photosensitive unit array so as to generate an image.
In the imaging control method of the image sensor provided in the embodiment of the first aspect of the present invention, when the current ambient light intensity is smaller than the preset intensity, the filter unit arrays are controlled to be arranged in a first arrangement manner; the photosensitive unit array is controlled to be exposed, the output value of the photosensitive unit array is read, the pixel value of the photosensitive unit array is obtained, and therefore an image is generated, the arrangement positions of the filtering units in the filtering unit array can be exchanged according to the ambient light intensity, the imaging definition under high ambient light intensity is guaranteed, the high signal-to-noise ratio under low ambient light intensity is achieved, and the imaging effect of the image sensor is effectively improved.
In order to solve the above problem, an embodiment of a second aspect of the present invention provides an image sensor, including: an array of photosensitive cells; the light filtering unit array is arranged on the photosensitive unit array; a micro-mechanical structure for controlling the movement of the filter unit.
According to the image sensor provided by the embodiment of the second aspect of the invention, the micro-mechanical structure controls the filtering units in the filtering unit array to move, so that the arrangement positions of the filtering units in the filtering unit array can be exchanged according to the ambient light intensity, the imaging definition under higher ambient light intensity is ensured, the signal-to-noise ratio under lower ambient light intensity is high, and the imaging effect of the image sensor is effectively improved.
In order to solve the above problem, a third aspect of the present invention provides an image forming apparatus comprising: the image sensor provided by the embodiment of the second aspect, and the detection module, the detection module is configured to detect a current ambient light intensity; the control module is used for controlling the light filtering unit array to be arranged in a first arrangement mode when the current ambient light intensity is smaller than the preset intensity; and controlling the photosensitive unit array to perform exposure, and reading output values of the photosensitive unit array to obtain pixel values of the photosensitive unit array so as to generate an image.
In the imaging device provided by the third aspect of the present invention, when the current ambient light intensity is smaller than the preset intensity, the filter unit arrays are controlled to be arranged in a first arrangement manner; the photosensitive unit array is controlled to be exposed, the output value of the photosensitive unit array is read, the pixel value of the photosensitive unit array is obtained, and therefore an image is generated, the arrangement positions of the filtering units in the filtering unit array can be exchanged according to the ambient light intensity, the imaging definition under high ambient light intensity is guaranteed, the high signal-to-noise ratio under low ambient light intensity is achieved, and the imaging effect of the image sensor is effectively improved.
In order to solve the above problem, a fourth aspect of the present invention further provides a mobile terminal, which includes a housing, a processor, a memory, a circuit board, and a power circuit, wherein the circuit board is disposed inside a space enclosed by the housing, and the processor and the memory are disposed on the circuit board; the power supply circuit is used for supplying power to each circuit or device of the mobile terminal; the memory is used for storing executable program codes; the processor executes a program corresponding to the executable program code by reading the executable program code stored in the memory, for executing the imaging control method of the image sensor described above.
In the mobile terminal provided in the embodiment of the fourth aspect of the present invention, when the current ambient light intensity is smaller than the preset intensity, the filter unit arrays are controlled to be arranged in a first arrangement manner; the photosensitive unit array is controlled to be exposed, the output value of the photosensitive unit array is read, the pixel value of the photosensitive unit array is obtained, and therefore an image is generated, the arrangement positions of the filtering units in the filtering unit array can be exchanged according to the ambient light intensity, the imaging definition under high ambient light intensity is guaranteed, the high signal-to-noise ratio under low ambient light intensity is achieved, and the imaging effect of the image sensor is effectively improved.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The foregoing and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a flowchart illustrating an imaging control method of an image sensor according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a first arrangement in an embodiment of the present invention;
FIG. 3 is a diagram illustrating a second arrangement according to an embodiment of the present invention;
fig. 4 is a flowchart illustrating an imaging control method of an image sensor according to another embodiment of the present invention;
fig. 5 is a flowchart illustrating an imaging control method of an image sensor according to another embodiment of the present invention;
FIG. 6 is a diagram illustrating an arrangement conversion according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of an image sensor according to one embodiment of the invention;
FIG. 8 is a schematic structural view of an imaging apparatus according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative and intended to be illustrative of the invention and are not to be construed as limiting the invention.
An imaging method, an imaging apparatus, and a mobile terminal of an image sensor according to an embodiment of the present invention are described below with reference to the accompanying drawings.
Fig. 1 is a flowchart illustrating an imaging control method of an image sensor according to an embodiment of the present invention.
The imaging control method of the image sensor in the present embodiment may be configured in the imaging apparatus.
The imaging device may be disposed in a mobile terminal, which is not limited in this embodiment of the present invention.
The mobile terminal may be a hardware device with various operating systems, such as a smart phone, a tablet computer, a personal digital assistant, and an electronic book.
Wherein, the image sensor includes: the device comprises a photosensitive unit array, a light filtering unit array arranged on the photosensitive unit array and a micro-mechanical structure for controlling the movement of the light filtering unit.
In an embodiment of the present invention, the filter cell array is a Bayer Color Filter Array (CFA).
Referring to fig. 1, the method includes:
s11: the current ambient light intensity is detected.
In the embodiment of the present invention, the current ambient light signal may be detected by a sensor disposed in the imaging device, or the current ambient light signal may also be detected by a photodetector in the related art, and the current ambient light intensity is obtained by performing corresponding analysis Processing on the light signal by a Central Processing Unit (CPU) in the imaging device, which is not limited to this.
S12: and when the current ambient light intensity is smaller than the preset intensity, controlling the filter unit array to be arranged in a first arrangement mode.
In the embodiment of the present invention, the preset intensity may be preset by a factory program of the imaging apparatus, or the preset intensity may be set by a user of the imaging apparatus according to a requirement of the user, which is not limited thereto.
In an embodiment of the invention, the current ambient light intensity may be compared with the preset intensity, and when the current ambient light intensity is smaller than the preset intensity, the filter unit array is controlled to be arranged in a first arrangement manner.
The first arrangement mode is a large Bayer array consisting of 2 x 2 filter units with the same color. Referring to fig. 2, fig. 2 is a schematic diagram of a first arrangement mode in the embodiment of the invention. Fig. 2 includes 2 × 2 photosensitive cells, and it is understood that, based on the principle of the bayer array, the letter "R" represents a filter cell appearing red in the large bayer array, the letter "Gr" and "Gb" represent a filter cell appearing green in the large bayer array, and the letter "B" represents a filter cell appearing blue in the large bayer array.
In the embodiment of the present invention, before controlling the filter cell array to be arranged in the first arrangement manner, it may also be determined whether the arrangement manner of the current filter cell array is the first arrangement manner, and if not, the micromechanical structure may be used to control the filter cell array to switch from the second arrangement manner to the first arrangement manner, where the second arrangement manner is different from the first arrangement manner.
The second arrangement is 2 × 2 bayer arrays, see fig. 3, and fig. 3 is a schematic diagram of the second arrangement in the embodiment of the present invention.
S13: and controlling the photosensitive unit array to perform exposure, and reading output values of the photosensitive unit array to obtain pixel values of the photosensitive unit array so as to generate an image.
In the embodiment of the present invention, when the current ambient light intensity is less than the preset intensity, the filter unit array is directly controlled to be arranged in the first arrangement manner, so that the exposure is directly performed based on the 4M mode, that is, the mode of merging 2 × 2 light sensing units (as shown in fig. 2) to output, so as to read the output value of the light sensing unit array, without performing another data conversion on the output value of the light sensing unit array based on the 16M (as shown in fig. 3) mode, so as to convert the output value into bayer format data, thereby ensuring a high signal-to-noise ratio of imaging at a lower ambient light intensity.
In the embodiment, when the current ambient light intensity is smaller than the preset intensity, the filter unit arrays are controlled to be arranged in a first arrangement mode; the photosensitive unit array is controlled to be exposed, the output value of the photosensitive unit array is read, the pixel value of the photosensitive unit array is obtained, and therefore an image is generated, the arrangement positions of the filtering units in the filtering unit array can be exchanged according to the ambient light intensity, the imaging definition under high ambient light intensity is guaranteed, the high signal-to-noise ratio under low ambient light intensity is achieved, and the imaging effect of the image sensor is effectively improved.
Fig. 4 is a flowchart illustrating an imaging control method of an image sensor according to another embodiment of the present invention.
Wherein, the image sensor includes: the device comprises a photosensitive unit array, a light filtering unit array arranged on the photosensitive unit array and a micro-mechanical structure for controlling the movement of the light filtering unit.
Referring to fig. 4, the method includes:
s401: detecting the current ambient light intensity, and judging whether the current ambient light intensity is smaller than the preset intensity, if so, executing S402, otherwise, executing S405.
In the embodiment of the present invention, the current ambient light signal may be detected by a sensor disposed in the imaging device, or the current ambient light signal may also be detected by a photodetector in the related art, and the CPU in the imaging device performs corresponding analysis processing on the light signal to obtain the current ambient light intensity, which is not limited to this.
In the embodiment of the present invention, the preset intensity may be preset by a factory program of the imaging apparatus, or the preset intensity may be set by a user of the imaging apparatus according to a requirement of the user, which is not limited thereto.
By flexibly setting the preset intensity, the flexibility and the applicability of the method can be effectively improved.
S402: and judging whether the arrangement mode of the current filter unit array is the first arrangement mode, if so, executing S403, otherwise, executing 404.
S403: the current arrangement is maintained.
In the embodiment of the invention, whether the arrangement mode of the current filter unit array is the first arrangement mode can be judged in advance, if the arrangement mode of the current filter unit array is the first arrangement mode, the current arrangement mode is maintained without exchanging the arrangement positions of the filter units in the filter unit array, so that the resource consumption in the imaging process can be reduced, and the imaging efficiency of the image sensor can be ensured.
S404: when the arrangement mode of the filter unit arrays is the second arrangement mode, 2 x 2 Bayer arrays in the second arrangement mode are converted into a large Bayer array composed of 2 x 2 filter units with the same color in the first arrangement mode.
In the embodiment of the present invention, when the current ambient light intensity is less than the preset intensity, the filter unit array is directly controlled to be arranged in the first arrangement manner, so that the exposure is directly performed based on the 4M mode, that is, the mode of merging 2 × 2 light sensing units (as shown in fig. 2) to output, so as to read the output value of the light sensing unit array, without performing another data conversion on the output value of the light sensing unit array based on the 16M (as shown in fig. 3) mode, so as to convert the output value into bayer format data, thereby ensuring a high signal-to-noise ratio of imaging at a lower ambient light intensity.
S405: and judging whether the arrangement mode of the current filter unit array is the second arrangement mode, if so, executing S403, otherwise, executing 406.
In the embodiment of the present invention, when the current ambient light intensity is greater than or equal to the preset intensity, it may also be determined in advance whether the arrangement manner of the current filter unit array is the second arrangement manner, and if the arrangement manner of the current filter unit array is the second arrangement manner, the current arrangement manner is maintained without exchanging the arrangement positions of the filter units in the filter unit array, which may reduce resource consumption in the imaging process and ensure the imaging efficiency of the image sensor.
S406: and controlling the filter unit array to be switched from the first arrangement mode to the second arrangement mode by using the micro-mechanical structure.
S407: and controlling the photosensitive unit array to perform exposure, and reading output values of the photosensitive unit array to obtain pixel values of the photosensitive unit array so as to generate an image.
In the embodiment of the invention, when the current ambient light intensity is greater than or equal to the preset intensity, the filter unit array is directly controlled to be arranged in the second arrangement mode, so that exposure is directly carried out based on a 16M (as shown in fig. 3) output mode to read the output value of the photosensitive unit array, and the imaging definition under higher ambient light intensity is ensured.
In this embodiment, the flexibility and the applicability of the method can be effectively improved by flexibly setting the preset strength. When the current ambient light intensity is smaller than the preset intensity, whether the arrangement mode of the current light filtering unit array is the first arrangement mode or not is judged in advance, if the arrangement mode of the current light filtering unit array is the first arrangement mode, the current arrangement mode is maintained, the arrangement position of the light filtering units in the light filtering unit array does not need to be exchanged, the resource consumption in the imaging process can be reduced, and the imaging efficiency of the image sensor is guaranteed. If the array is not in the first arrangement mode, controlling the filter unit array to be arranged in the first arrangement mode; when present ambient light intensity is greater than or equal to preset intensity, direct control light filtering unit array arranges with the second arrangement, control light sensing unit array exposes to the sun, and read the output value of light sensing unit array, thereby the pixel value that obtains light sensing unit array generates the image, can realize according to ambient light intensity, the permutation position of light filtering unit in the exchange light filtering unit array, guarantee the formation of image definition under higher ambient light intensity, high signal-to-noise ratio under lower ambient light intensity, effectively promote image sensor's formation of image effect.
As an example, fig. 5 is a flowchart illustrating an imaging control method of an image sensor according to another embodiment of the present invention.
Referring to fig. 3, among the 2 × 2 bayer arrays, bayer array 31 located at the upper left is a first bayer array, bayer array 32 located at the upper right is a second bayer array, bayer array 33 located at the lower left is a third bayer array, and bayer array 34 located at the lower right is a fourth bayer array.
Referring to fig. 5, converting the 2 × 2 bayer arrays (as in fig. 3) in the second arrangement into a large bayer array (as in fig. 2) composed of 2 × 2 filter units of the same color in the first arrangement includes:
s51: and exchanging the filtering unit at the upper right position in the first Bayer array with the filtering unit at the upper left position in the second Bayer array.
S52: and exchanging the filter unit at the lower left position in the first Bayer array with the filter unit at the upper left position in the third Bayer array.
S53: and exchanging the filtering unit at the lower right position in the first Bayer array with the filtering unit at the upper left position in the fourth Bayer array.
S54: and exchanging the filtering unit at the lower right position in the second Bayer array with the filtering unit at the upper right position in the fourth Bayer array.
S55: and exchanging the filtering unit at the lower right position in the third Bayer array with the filtering unit at the lower left position in the fourth Bayer array.
Wherein, the steps in S51-S55 have no timing limit relationship.
Referring to fig. 6, fig. 6 is a schematic diagram illustrating arrangement conversion in an embodiment of the present invention, and an arrow 61 in fig. 6 indicates that the filter unit at the upper right position in the first bayer array is exchanged with the filter unit at the upper left position in the second bayer array; arrow 62 identifies interchanging the filter element in the lower left position in the first bayer array with the filter element in the upper left position in the third bayer array; arrow 63 identifies interchanging the filter element in the lower right position in the first bayer array with the filter element in the upper left position in the fourth bayer array; arrow 64 indicates that the filter element in the lower right position in the second bayer array is interchanged with the filter element in the upper right position in the fourth bayer array; arrow 65 identifies interchanging the filter element in the lower right position in the third bayer array with the filter element in the lower left position in the fourth bayer array.
It can be understood that, if it is required to switch from the first arrangement to the second arrangement, that is, to convert one large bayer array (as shown in fig. 2) composed of 2 × 2 filter units with the same color in the first arrangement into 2 × 2 bayer arrays (as shown in fig. 3) in the second arrangement, the reverse step in the embodiment of fig. 5 may be directly performed, which is not described herein again.
In the embodiment, the filter unit is controlled to move by utilizing the micro-mechanical structure, so that the filter unit array is directly controlled to be switched between the first arrangement mode and the second arrangement mode, and the subsequent additional data conversion of the output value of the photosensitive unit array is not needed, the imaging step of the image sensor is simplified, and the imaging efficiency of the image sensor is improved on the premise of ensuring the imaging effect of the image sensor.
Fig. 7 is a schematic structural diagram of an image sensor according to an embodiment of the present invention.
Referring to fig. 7, the image sensor 700 includes: a photosensitive cell array 701, a filter cell array 702, and a micro-mechanical structure 703. Wherein,
in one embodiment of the present invention, the image sensor 700 includes: the photosensitive cell array 701.
In one embodiment of the present invention, the image sensor 700 further comprises: and a filter unit array 702 disposed on the photosensitive unit array 701.
In one embodiment of the present invention, the image sensor 700 further comprises: a micromechanical structure 703 controlling the movement of the filter unit.
The arrangement of the filter unit array 702 includes a first arrangement including a plurality of large bayer arrays composed of 2 × 2 filter units of the same color, and a second arrangement including a plurality of 2 × 2 bayer arrays.
It should be noted that the foregoing explanations of the embodiments of fig. 1 to 6 for the imaging control method of the image sensor also apply to the image sensor 700 of this embodiment, and the implementation principles thereof are similar and will not be described herein again.
According to the image sensor provided by the embodiment, the filter units in the filter unit array are controlled to move through the micro-mechanical structure, the arrangement positions of the filter units in the filter unit array can be exchanged according to the ambient light intensity, the imaging definition under higher ambient light intensity is ensured, the signal-to-noise ratio under lower ambient light intensity is high, and the imaging effect of the image sensor is effectively improved.
Fig. 8 is a schematic structural view of an image forming apparatus according to an embodiment of the present invention.
Referring to fig. 8, the image forming apparatus 800 includes: an image sensor 801, a detection module 802, and a control module 803, wherein,
an image sensor 801.
A detection module 802, where the detection module 802 is configured to detect a current ambient light intensity.
The control module 803, the control module 803 is configured to control the filter unit array to be arranged in a first arrangement manner when the current ambient light intensity is smaller than the preset intensity; and controlling the photosensitive unit array to perform exposure, and reading output values of the photosensitive unit array to obtain pixel values of the photosensitive unit array so as to generate an image.
The control module 803 is specifically configured to: judging whether the arrangement mode of the current light filtering unit array is a first arrangement mode; when the arrangement mode of the light filtering unit array is the first arrangement mode, keeping the current arrangement mode; or when the arrangement mode of the filter unit array is the second arrangement mode, the micromechanical structure is used for controlling the filter unit array to be switched from the second arrangement mode to the first arrangement mode.
The second arrangement is a bayer array, and the control module 803 is specifically configured to:
and converting the 2 x 2 Bayer arrays in the second arrangement mode into a large Bayer array consisting of 2 x 2 filtering units with the same color in the first arrangement mode.
In 2 × 2 bayer arrays, the bayer array located at the upper left is a first bayer array, the bayer array located at the upper right is a second bayer array, the bayer array located at the lower left is a third bayer array, the bayer array located at the lower right is a fourth bayer array, and the control module 803 is specifically configured to:
exchanging the filtering unit at the upper right position in the first Bayer array with the filtering unit at the upper left position in the second Bayer array;
exchanging the filter unit at the lower left position in the first Bayer array with the filter unit at the upper left position in the third Bayer array;
exchanging the filtering unit at the lower right position in the first Bayer array with the filtering unit at the upper left position in the fourth Bayer array;
interchanging a filter unit at a lower right position in the second bayer array with a filter unit at an upper right position in the fourth bayer array;
and exchanging the filtering unit at the lower right position in the third Bayer array with the filtering unit at the lower left position in the fourth Bayer array.
The control module 803 is also configured to:
and when the current ambient light intensity is greater than the preset intensity, controlling the light filtering unit array to be arranged in a second arrangement mode.
The control module 803 is specifically configured to:
judging whether the arrangement mode of the current light filtering unit array is a second arrangement mode;
when the arrangement mode of the light filtering unit array is the second arrangement mode, the current arrangement mode is kept; or
When the arrangement mode of the filter unit array is the first arrangement mode, the micromechanical structure is used for controlling the filter unit array to be switched from the first arrangement mode to the second arrangement mode.
It should be noted that the foregoing explanations of the embodiments of fig. 1 to 6 for the imaging control method of the image sensor also apply to the imaging apparatus 800 of this embodiment, and the implementation principles thereof are similar and will not be described herein again.
In the imaging device in this embodiment, when the current ambient light intensity is smaller than the preset intensity, the filter unit arrays are controlled to be arranged in a first arrangement manner; the photosensitive unit array is controlled to be exposed, the output value of the photosensitive unit array is read, the pixel value of the photosensitive unit array is obtained, and therefore an image is generated, the arrangement positions of the filtering units in the filtering unit array can be exchanged according to the ambient light intensity, the imaging definition under high ambient light intensity is guaranteed, the high signal-to-noise ratio under low ambient light intensity is achieved, and the imaging effect of the image sensor is effectively improved.
Fig. 9 is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention. The mobile terminal can be a mobile phone, a tablet computer and the like.
Referring to fig. 9, the mobile terminal 90 of the present embodiment includes: the device comprises a shell 901, a processor 902, a memory 903, a circuit board 904 and a power circuit 905, wherein the circuit board 904 is arranged in a space surrounded by the shell 901, and the processor 902 and the memory 903 are arranged on the circuit board 904; a power supply circuit 905 for supplying power to each circuit or device of the mobile terminal 90; the memory 903 is used to store executable program code; the processor 902 executes a program corresponding to the executable program code by reading the executable program code stored in the memory 903, so as to execute the imaging method of the image sensor.
It should be noted that the foregoing explanations of the imaging control method embodiment of the image sensor in the embodiments of fig. 1 to 6 also apply to the mobile terminal of this embodiment, and the implementation principles thereof are similar and will not be described herein again.
In the mobile terminal in this embodiment, when the current ambient light intensity is smaller than the preset intensity, the filtering unit array is controlled to be arranged in a first arrangement manner; the photosensitive unit array is controlled to be exposed, the output value of the photosensitive unit array is read, the pixel value of the photosensitive unit array is obtained, and therefore an image is generated, the arrangement positions of the filtering units in the filtering unit array can be exchanged according to the ambient light intensity, the imaging definition under high ambient light intensity is guaranteed, the high signal-to-noise ratio under low ambient light intensity is achieved, and the imaging effect of the image sensor is effectively improved.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It should be noted that in the description of the present specification, reference to the description of the term "one embodiment", "some embodiments", "an example", "a specific example", or "some examples", etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.
Claims (15)
1. An imaging control method of an image sensor, characterized in that the image sensor comprises: the method comprises the following steps of:
detecting the current ambient light intensity;
when the current ambient light intensity is smaller than the preset intensity, controlling the light filtering unit array to be arranged in a first arrangement mode;
and controlling the photosensitive unit array to perform exposure, and reading output values of the photosensitive unit array to obtain pixel values of the photosensitive unit array so as to generate an image.
2. The method of claim 1, wherein said controlling said array of filter elements to be arranged in a first arrangement comprises:
judging whether the current arrangement mode of the light filtering unit array is a first arrangement mode;
when the arrangement mode of the light filtering unit array is a first arrangement mode, keeping the current arrangement mode; or
And when the arrangement mode of the light filtering unit array is a second arrangement mode, the micromechanical structure is used for controlling the light filtering unit array to be switched from the second arrangement mode to the first arrangement mode.
3. The method of claim 2, wherein the second arrangement is a bayer array, and the controlling the switching of the array of filter cells from the second arrangement to the first arrangement using the micromechanical structure comprises:
and converting the 2 x 2 Bayer arrays in the second arrangement into a large Bayer array consisting of 2 x 2 filtering units with the same color in the first arrangement.
4. The method of claim 3, wherein, of said 2 x 2 Bayer arrays, the top left Bayer array is the first Bayer array, the top right Bayer array is the second Bayer array, the bottom left Bayer array is the third Bayer array, and the bottom right Bayer array is the fourth Bayer array, and converting the 2 x 2 Bayer arrays in said second arrangement into one large Bayer array of 2 x 2 identical color filter elements in said first arrangement comprises:
interchanging a filter unit at an upper right position in the first Bayer array with a filter unit at an upper left position in the second Bayer array;
interchanging a filter unit at a lower left position in the first bayer array with a filter unit at an upper left position in the third bayer array;
interchanging a filter unit at a lower right position in the first bayer array with a filter unit at an upper left position in the fourth bayer array;
interchanging a filter unit at a lower right position in the second bayer array with a filter unit at an upper right position in the fourth bayer array;
and exchanging the filter unit at the lower right position in the third Bayer array with the filter unit at the lower left position in the fourth Bayer array.
5. The method of claim 1, wherein the method further comprises:
and when the current ambient light intensity is greater than the preset intensity, controlling the light filtering unit array to be arranged in a second arrangement mode.
6. The method of claim 5, wherein controlling the array of filter elements to be arranged in a second arrangement comprises:
judging whether the arrangement mode of the current light filtering unit array is a second arrangement mode;
when the arrangement mode of the light filtering unit array is a second arrangement mode, keeping the current arrangement mode; or
When the arrangement mode of the light filtering unit array is a first arrangement mode, the micro-mechanical structure is used for controlling the light filtering unit array to be switched from the first arrangement mode to a second arrangement mode.
7. An image sensor, comprising:
an array of photosensitive cells;
the light filtering unit array is arranged on the photosensitive unit array;
a micro-mechanical structure for controlling the movement of the filter unit.
8. The image sensor of claim 7, wherein the filter cell arrays are arranged in a first arrangement comprising a plurality of large bayer arrays of 2 x 2 filter cells of the same color, and in a second arrangement comprising a plurality of 2 x 2 bayer arrays.
9. An image forming apparatus, comprising:
the image sensor of any one of claims 7-8; and
the detection module is used for detecting the current ambient light intensity;
the control module is used for controlling the light filtering unit array to be arranged in a first arrangement mode when the current ambient light intensity is smaller than the preset intensity;
and controlling the photosensitive unit array to perform exposure, and reading output values of the photosensitive unit array to obtain pixel values of the photosensitive unit array so as to generate an image.
10. The imaging apparatus of claim 9, wherein the control module is specifically configured to:
judging whether the current arrangement mode of the light filtering unit array is a first arrangement mode;
when the arrangement mode of the light filtering unit array is a first arrangement mode, keeping the current arrangement mode; or
And when the arrangement mode of the light filtering unit array is a second arrangement mode, the micromechanical structure is used for controlling the light filtering unit array to be switched from the second arrangement mode to the first arrangement mode.
11. The imaging apparatus of claim 10, wherein the second arrangement is a bayer array, and the control module is specifically configured to:
and converting the 2 x 2 Bayer arrays in the second arrangement into a large Bayer array consisting of 2 x 2 filtering units with the same color in the first arrangement.
12. The imaging apparatus according to claim 11, wherein, of the 2 x 2 bayer arrays, the bayer array located at the upper left is a first bayer array, the bayer array located at the upper right is a second bayer array, the bayer array located at the lower left is a third bayer array, and the bayer array located at the lower right is a fourth bayer array, and the control module is specifically configured to:
interchanging a filter unit at an upper right position in the first Bayer array with a filter unit at an upper left position in the second Bayer array;
interchanging a filter unit at a lower left position in the first bayer array with a filter unit at an upper left position in the third bayer array;
interchanging a filter unit at a lower right position in the first bayer array with a filter unit at an upper left position in the fourth bayer array;
interchanging a filter unit at a lower right position in the second bayer array with a filter unit at an upper right position in the fourth bayer array;
and exchanging the filter unit at the lower right position in the third Bayer array with the filter unit at the lower left position in the fourth Bayer array.
13. The imaging apparatus of claim 9, wherein the control module is further to:
and when the current ambient light intensity is greater than the preset intensity, controlling the light filtering unit array to be arranged in a second arrangement mode.
14. The imaging apparatus of claim 13, wherein the control module is specifically configured to:
judging whether the arrangement mode of the current light filtering unit array is a second arrangement mode;
when the arrangement mode of the light filtering unit array is a second arrangement mode, keeping the current arrangement mode; or
When the arrangement mode of the light filtering unit array is a first arrangement mode, the micro-mechanical structure is used for controlling the light filtering unit array to be switched from the first arrangement mode to a second arrangement mode.
15. A mobile terminal comprises a shell, a processor, a memory, a circuit board and a power circuit, wherein the circuit board is arranged in a space enclosed by the shell, and the processor and the memory are arranged on the circuit board; the power supply circuit is used for supplying power to each circuit or device of the mobile terminal; the memory is used for storing executable program codes; the processor executes a program corresponding to the executable program code by reading the executable program code stored in the memory for executing the imaging control method of the image sensor according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710295974.0A CN107040730B (en) | 2017-04-28 | 2017-04-28 | Imaging control method of image sensor, and imaging apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710295974.0A CN107040730B (en) | 2017-04-28 | 2017-04-28 | Imaging control method of image sensor, and imaging apparatus |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107040730A true CN107040730A (en) | 2017-08-11 |
| CN107040730B CN107040730B (en) | 2020-05-08 |
Family
ID=59537854
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710295974.0A Active CN107040730B (en) | 2017-04-28 | 2017-04-28 | Imaging control method of image sensor, and imaging apparatus |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107040730B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109257463B (en) * | 2018-08-24 | 2020-11-17 | 维沃移动通信有限公司 | Terminal device, control method thereof and computer-readable storage medium |
| US11044410B2 (en) | 2018-08-13 | 2021-06-22 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Imaging control method and apparatus, electronic device, and computer readable storage medium |
| US11490024B2 (en) | 2018-08-13 | 2022-11-01 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method for imaging controlling, electronic device, and non-transitory computer-readable storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103531603A (en) * | 2013-10-30 | 2014-01-22 | 上海集成电路研发中心有限公司 | CMOS (complementary metal-oxide semiconductor) image sensor |
| CN105611122A (en) * | 2015-12-18 | 2016-05-25 | 广东欧珀移动通信有限公司 | Image sensor, output method, phase focusing method, imaging apparatus and terminal |
| US20170094210A1 (en) * | 2015-09-24 | 2017-03-30 | Qualcomm Incorporated | Mask-less phase detection autofocus |
-
2017
- 2017-04-28 CN CN201710295974.0A patent/CN107040730B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103531603A (en) * | 2013-10-30 | 2014-01-22 | 上海集成电路研发中心有限公司 | CMOS (complementary metal-oxide semiconductor) image sensor |
| US20170094210A1 (en) * | 2015-09-24 | 2017-03-30 | Qualcomm Incorporated | Mask-less phase detection autofocus |
| CN105611122A (en) * | 2015-12-18 | 2016-05-25 | 广东欧珀移动通信有限公司 | Image sensor, output method, phase focusing method, imaging apparatus and terminal |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11044410B2 (en) | 2018-08-13 | 2021-06-22 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Imaging control method and apparatus, electronic device, and computer readable storage medium |
| US11490024B2 (en) | 2018-08-13 | 2022-11-01 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method for imaging controlling, electronic device, and non-transitory computer-readable storage medium |
| US11765466B2 (en) | 2018-08-13 | 2023-09-19 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Imaging control method and apparatus, electronic device, and computer readable storage medium |
| CN109257463B (en) * | 2018-08-24 | 2020-11-17 | 维沃移动通信有限公司 | Terminal device, control method thereof and computer-readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107040730B (en) | 2020-05-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10764522B2 (en) | Image sensor, output method, phase focusing method, imaging device, and terminal | |
| JP4435343B2 (en) | Apparatus and method for capturing and automatically processing data obtained from optical codes | |
| CN107040730B (en) | Imaging control method of image sensor, and imaging apparatus | |
| JP2018502492A (en) | Imaging method, imaging apparatus, and electronic apparatus | |
| EP3396942A1 (en) | Image sensor, imaging method and electronic device | |
| US8466974B2 (en) | Apparatus and methods for controlling image sensors | |
| US10270988B2 (en) | Method for generating high-dynamic range image, camera device, terminal and imaging method | |
| US11108943B2 (en) | Image sensor, focusing control method, and electronic device | |
| EP3606027A1 (en) | Image sensor, camera module, and electronic device | |
| US7857232B2 (en) | Two-dimensional bar code, information processing device, information processing method, and program | |
| CN106210532B (en) | One kind is taken pictures processing method and terminal device | |
| CN105578079B (en) | Imaging sensor and picture quality regulation method, imaging device and method and mobile terminal | |
| CN105578076A (en) | Imaging method, imaging device and electronic device | |
| CN103096094A (en) | Vision recognition apparatus and method | |
| CN111953908B (en) | Imaging system for generating high dynamic range images | |
| JP2012195732A (en) | Method for controlling image processing device, image processing device, and program for controlling image processing device | |
| US9258483B2 (en) | Multi-purpose camera system supporting normal camera functionality and additional user input functionality | |
| US20180124334A1 (en) | Image sensor, control method, and electronic device | |
| US6980239B1 (en) | Imaging system with multiple boot options | |
| KR20210130972A (en) | Color filter array of an electronic deviceand the electronic | |
| JP7184072B2 (en) | IDENTIFICATION METHOD, IDENTIFICATION SYSTEM AND PROGRAM | |
| JP2008186487A (en) | Display method for two-dimensional information code | |
| KR20210021271A (en) | Method and system for reducing thermal shading in image sensor using on chip localized heat source | |
| WO2020101057A1 (en) | Photographing system and photographing system control method | |
| KR100607803B1 (en) | Method for color interpolation of image sensor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., Ltd. Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |