WO2017101451A1 - 成像方法、成像装置及电子装置 - Google Patents
成像方法、成像装置及电子装置 Download PDFInfo
- Publication number
- WO2017101451A1 WO2017101451A1 PCT/CN2016/091944 CN2016091944W WO2017101451A1 WO 2017101451 A1 WO2017101451 A1 WO 2017101451A1 CN 2016091944 W CN2016091944 W CN 2016091944W WO 2017101451 A1 WO2017101451 A1 WO 2017101451A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- photosensitive
- pixel
- image
- pixels
- merged
- Prior art date
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 55
- 238000012545 processing Methods 0.000 claims description 33
- 238000000034 method Methods 0.000 claims description 21
- 238000010586 diagram Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 8
- 238000003491 array Methods 0.000 description 3
- 238000005286 illumination Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
- H04N25/46—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by combining or binning pixels
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
- H01L27/14—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
- H01L27/144—Devices controlled by radiation
- H01L27/146—Imager structures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/76—Circuitry for compensating brightness variation in the scene by influencing the image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
- H04N5/21—Circuitry for suppressing or minimising disturbance, e.g. moiré or halo
Definitions
- the present invention relates to imaging technology, and in particular to an imaging method, an imaging device, and an electronic device.
- the image generated by the image sensor of the existing imaging device in a low light environment may have insufficient noise, unclearness, and the like.
- the present invention aims to solve at least one of the technical problems existing in the prior art. To this end, the present invention is required to provide an image forming method, an image forming apparatus, and an electronic apparatus.
- the image sensor comprising a photosensitive pixel array and a filter disposed on the photosensitive pixel array, the filter comprising an array of filter units, each of the filter units covering a plurality of the photosensitive Pixels and form a merged pixel;
- An output of the photosensitive pixel array is read, and an output of the photosensitive pixel of the same merged pixel is added to obtain a pixel value of the merged pixel to generate a merged image.
- this imaging method can obtain images with high signal-to-noise ratio, high brightness and sharpness, and less noise in low light.
- the imaging device includes a register, each of the filter units covering 2*2 of the photosensitive pixels;
- the reading step further includes:
- the reading step further comprises:
- the analog signal output generated by the photosensitive pixel is converted into a digital signal output.
- the invention also provides an imaging device comprising:
- An image sensor comprising:
- the filter includes an array of filter units, each of the filter units covering a plurality of the photosensitive pixels and constituting a combined pixel;
- An image processing module connected to the image sensor, the image processing module is configured to read an output of the photosensitive pixel array, and add an output of the photosensitive pixel of the same merged pixel to obtain the merged pixel The pixel value thus produces a merged image.
- the imaging device can obtain images with high signal to noise ratio, brightness and sharpness, and less noise in low light.
- the image sensor comprises a CMOS image sensor.
- the array of filter elements comprises a Bayer array.
- each of the filter units covers 2*2 of the photosensitive pixels.
- the imaging device includes a control module for controlling the photosensitive pixel array to be progressively exposed.
- the image forming apparatus further includes a register, and the control module is configured to sequentially collect and store the output of the photosensitive pixels of the kth row and the k+1th row of the current exposure and store the register.
- k 2n-1
- n is a natural number
- k+1 is less than or equal to the total number of rows of the photosensitive pixel array.
- the image sensor includes an analog to digital converter; each of the photosensitive pixels is coupled to one of the analog to digital converters, and the analog to digital converter is configured to output an analog signal of the photosensitive pixel Convert to digital signal output;
- the digital signal output is used to store the register
- the image processing module is configured to add the digital signal outputs of the photosensitive pixels of the same merged pixel to obtain pixel values of the merged pixels.
- the image sensor includes an array of micromirrors disposed on the filter, each of the micromirrors corresponding to one of the photosensitive pixels.
- the present invention also provides an electronic device including the imaging device.
- the advantageous effects of the imaging method and the imaging device of the embodiment of the present invention can be achieved.
- the electronic device comprises a cell phone.
- the imaging device includes a front camera of the handset.
- the electronic device includes a central processor coupled to the imaging device and an external memory, the central processor for controlling the external memory to store the merged image.
- the electronic device further includes a central processing unit and a display device coupled to the imaging device, the central processor configured to control the display device to display the merged image.
- FIG. 1 is a schematic flow chart of an image forming method according to an embodiment of the present invention.
- FIG. 2 is a schematic flow chart of a reading step of an image forming method according to an embodiment of the present invention.
- FIG. 3 is a schematic flow chart of a reading step of an imaging method according to an embodiment of the present invention.
- FIG. 4 is a schematic structural view of an image forming apparatus according to an embodiment of the present invention.
- FIG. 5 is a schematic diagram of a filter unit array of an image forming apparatus according to an embodiment of the present invention.
- Figure 6 is a schematic diagram of a Bayer array.
- FIG. 7 is a schematic perspective structural view of an image sensor of an image forming apparatus according to an embodiment of the present invention.
- FIG. 8 is a schematic diagram of functional modules of an image forming apparatus according to an embodiment of the present invention.
- FIG. 9 is a schematic diagram of functional blocks of an image forming apparatus according to an embodiment of the present invention.
- FIG. 10 is a schematic diagram of functional blocks of an image forming apparatus according to an embodiment of the present invention.
- FIG. 11 is a schematic diagram of a photosensitive pixel and related circuits of an image forming apparatus according to an embodiment of the present invention.
- FIG. 12 is a schematic diagram of a synthesized pixel and related circuit of an image forming apparatus according to an embodiment of the present invention.
- FIG. 13 is a schematic perspective structural view of an image sensor of an image forming apparatus according to an embodiment of the present invention.
- Fig. 14 is a view showing the configuration of an image sensor of an image forming apparatus according to an embodiment of the present invention.
- 15 is a schematic diagram of functional blocks of an electronic device according to an embodiment of the present invention.
- 16 is a schematic diagram of functional blocks of an electronic device according to an embodiment of the present invention.
- an imaging method includes the following steps:
- S101 providing an image sensor, the image sensor comprises a photosensitive pixel array and a filter disposed on the photosensitive pixel array, the filter comprises an array of filter units, each filter unit covers a plurality of photosensitive pixels and constitutes a combined pixel;
- the output of each photosensitive pixel is S
- the noise is N
- the combined pixel includes n*m photosensitive pixels
- the pixel value of the combined pixel is n*m*S
- each filter unit of the image sensor covers 2*2 photosensitive pixels, and step S102 further includes:
- step S102 further includes:
- the image processing module which is generally a digital signal processing chip, can directly process the output of the image sensor, and secondly, with respect to some schemes that directly process the output of the analog signal format of the image sensor through the circuit,
- the image processing module of the digital signal processing chip of the back end processes the output of the image sensor, and preferably retains the information collected by each photosensitive pixel in the front end image sensor, so that the information collected by each photosensitive pixel can be used to generate high resolution separately.
- the image may also generate an image with low resolution but low noise, high signal to noise ratio and high definition by combining a part of the photosensitive pixels.
- the imaging method of the embodiment of the present invention is A merged image of 4M pixels (combining 2*2 pixels) can be created, and an original image of 16M pixels (ie, not merged) can also be generated.
- the image forming method of the embodiment of the present invention can be realized by the image forming apparatus 100 of the embodiment of the present invention.
- an imaging apparatus 100 includes an image sensor 10 and an image transmission.
- the image processing module 30 is connected to the sensor 10.
- the image sensor 10 includes a photosensitive pixel array 11 and a filter 13 disposed on the photosensitive pixel array 11.
- the filter 13 includes a filter unit array 131, and each of the filter units 1315 covers a plurality of photosensitive pixels 111 and constitutes a merged pixel.
- the image processing module 30 is configured to read the output of the photosensitive pixel array 11 and add the outputs of the photosensitive pixels 111 of the same merged pixel to obtain pixel values of the merged pixels to generate a merged image.
- the imaging apparatus 100 in the embodiment of the present invention combines the outputs of the plurality of photosensitive pixels 111 as the pixel values of the merged pixels, and the image pickup apparatus 100 of the embodiment of the present invention obtains lower image noise in low light than the conventional imaging apparatus.
- the signal-to-noise ratio is high and the definition is high.
- the image sensor 10 of the embodiment of the present invention may be a CMOS sensor.
- CMOS sensors have low power consumption, small camera system size, and low cost.
- the filter unit array 131 includes a Bayer pattern.
- the Bayer array is a common filter cell array structure.
- the filter unit 1315 includes green (G), red (R), and blue (B) filter units, wherein the two green filter units, one red filter unit, and one blue filter unit constitute A filter structure 1313.
- the Bayer structure can use the traditional algorithm for Bayer structure to process image signals, so that no major adjustments in hardware structure are required.
- each filter structure 1313 includes four filter units 1315.
- Each of the filter units 1315 corresponds to one photosensitive pixel and an image pixel.
- the filter unit array 131 may adopt a Bayer structure, and the difference is that each filter unit 1315 corresponds to a plurality of photosensitive pixels 111 .
- each filter unit 1315 corresponds to 2*2 photosensitive pixels 111 to form a merged pixel.
- the four photosensitive pixels 111 corresponding to each of the filter units 1315 may have different outputs depending on the slight difference in illumination. Therefore, the output of the combined pixels integrates the output of the 2*2 photosensitive pixels 111.
- the combined pixel structure of the present embodiment can significantly reduce imaging noise and improve signal-to-noise ratio and sharpness under low light.
- the number of photosensitive pixels 111 that can be arranged on the photosensitive pixel array 11 is limited, and if the number of photosensitive pixels 111 included in each combined pixel is too large, the resolution of the image may be limited, for example, if the photosensitive pixel array 11 is The pixel value is 16M.
- a 2*2 merged pixel structure will result in a combined image with a resolution of 4M, while a 4*4 structure will only result in a combined image with a resolution of 1M. Therefore, the 2*2 combined pixel structure is a better arrangement to enhance image brightness and sharpness while minimizing the resolution.
- the imaging device 100 further includes a control module 40 for controlling the photosensitive pixel array 11 to be exposed row by row.
- the control module 40 is connected with a row selection logic unit 41 and a column selection logic unit. 43.
- the output of the photosensitive pixel 111 is processed line by line. The method of progressive exposure and output makes the circuit easier to implement.
- the imaging apparatus 100 includes a control module 40 connected to the row selection logic unit 41 and the column selection logic unit 43 .
- the row selection logic unit 41 and the column selection logic unit 43 are connected to the switch tube 1115 corresponding to each of the photosensitive pixels, and the control module 40 is configured to control the row selection logic unit 41 and the column selection logic unit 43 to strobe the switch of the photosensitive pixel at a specific position.
- the tube 1115 for example, the switch tube 1115 that controls the first row of photosensitive pixels is closed and controls the switch tube 1115 of the other row of photosensitive pixels to be turned off to output the first photosensitive pixel.
- the imaging device 100 further includes a register 50.
- the control module 40 is configured to sequentially collect the output of the photosensitive pixel 111 of the kth row and the k+1th row of the current exposure and store it in the register 50.
- k 2n-1
- n is a natural number
- k+1 is less than or equal to the total number of rows of the photosensitive pixel array 11.
- control module 40 first collects the outputs of the photosensitive pixels of the first row and the second row and stores them in the register 50.
- the image processing module 30 adds the outputs of the four photosensitive pixels whose position coordinates are 1-1, 1-2, 2-1, 2-2, and obtains the pixel values of the combined pixels, wherein the left digit of the position coordinates represents the row. The number on the right represents the column.
- the pixel values of the merged pixels that is, the outputs of the merged pixels corresponding to the four photosensitive pixels whose coordinates are 1-1, 1-2, 2-1, 2-2.
- the image processing module 30 then adds the outputs of the four photosensitive pixels with coordinates 1-3, 1-4, 2-3, 2-4, and the resulting pixel values of the combined pixels.
- the image processing module processes the outputs of the photosensitive pixels of the third row, the fourth row, the fifth row, and the sixth row until the output of all the photosensitive pixels is processed.
- the image processing module generates a merged image based on the pixel values of all the merged pixels.
- the imaging device 100 includes an analog to digital converter 17, each of the photosensitive pixels 111 being connected to an analog to digital converter 17, respectively, and an analog to digital converter 17 for sensing the pixels.
- the analog signal output of 111 is converted to a digital signal output.
- the photosensitive pixel in the present embodiment includes a photodiode 1113.
- Photodiode 113 is used to convert light into electrical charge, and the resulting charge is proportional to the intensity of the light.
- the switch tube 1115 is configured to control the turn-on and turn-off of the circuit according to the control signals of the row select logic unit 41 and the column select logic unit 43.
- the source follower 1117 source follower
- An analog-to-digital converter 17 is used to convert the voltage signal into a digital signal and transmit it to the image processing module 30 for processing.
- the image processing module 30 includes an image signal processor.
- the photosensitive pixels at positions 1-1, 1-2, 2-1, and 2-2 are combined pixels, and the photodiode 1113 corresponding to each photosensitive pixel is connected to the switch tube 1115.
- the tube 1115 is configured to control the conduction and disconnection of the circuit according to the control signals of the row selection logic unit 41 and the column selection logic unit 43.
- the follower 1117 is used to convert the charge signal generated by the photodiode 1113 by illumination into a voltage signal.
- Analog to digital converter 17 is used to convert the voltage signal to a digital signal and to the register 50.
- the output of the photosensitive pixels of the first row and the corresponding pixels of the second row are connected in parallel, so that the outputs of the photosensitive pixels of the first row and the second row cannot be simultaneously acquired, but by
- the control signals of the row selection logic unit 41 and the column selection logic unit 43 control the switch 1115 of the first row of photosensitive pixels to be closed and the switch tubes 1115 of the other rows of photosensitive pixels are turned off to store the output of the first row of photosensitive pixels in the register. 50.
- the switch 1115 of the second row of photosensitive pixels is closed and the switches 1115 of the other rows are turned off to deposit the output of the second row of photosensitive pixels.
- the register 50 obtains the output of the two rows of photosensitive pixels and then performs calculation processing by the image processing module 30.
- This output processing mode causes the output of the photosensitive pixels to enter the image processing module 30 and then merge them, for example, the output of the photosensitive pixels is combined by software in the image signal processing chip to obtain the pixel values of the combined pixels. Therefore, the output information of each photosensitive pixel is less likely to be lost, and the probability that the resulting image will have a bad point is low. In addition, this output processing method has less noise and higher signal-to-noise ratio.
- image sensor 10 includes micromirror arrays 19 disposed on filter 13, each micromirror 191 corresponding to one photosensitive pixel 111.
- each micro mirror 191 corresponds to one photosensitive pixel 111 , and includes size and position.
- the micromirror 191 can collect light to the photosensitive portion 111 of the photosensitive pixel 111, and enhance the received light intensity of the photosensitive pixel 111, thereby improving the image quality.
- each filter unit 1315 corresponds to 2*2 photosensitive pixels 111 and 2*2 micromirrors 191 to form merged pixels.
- photosensitive pixels 111 on the photosensitive sheet are arranged more and more densely, and a single photosensitive pixel 111 is also smaller and smaller, and its light receiving is affected, and the photosensitive pixel 111 is affected.
- the area of the photosensitive portion 1111 is limited, and the micromirror 191 can collect light to the photosensitive portion 1111, thereby increasing the received light intensity of the photosensitive pixel 111, thereby improving image quality.
- the imaging device in the embodiment of the present invention covers each of the plurality of photosensitive pixels, and the image processing module adds the outputs of the plurality of photosensitive pixels to obtain an output of the combined pixels.
- the imaging device of the present structure obtains lower image noise, lower signal-to-noise ratio, and higher definition in low light.
- the present invention also provides an electronic device to which an image forming apparatus is applied.
- an electronic device includes an imaging device. Therefore, the electronic device has a photographing function and can generate a combined image with high signal to noise ratio and high definition under low light.
- the electronic device can be a mobile phone.
- the imaging device can be a front camera of a cell phone. Since the front camera is mostly used for self-timer, and the self-timer generally requires the definition of the image and the image resolution is not high, the electronic device of the embodiment can meet this requirement.
- the electronic device 200 includes a central processing unit 81 and an external memory 83 connected to the imaging device 100, and the central processing unit 81 is configured to control the external memory 83 to store the merged image.
- the external memory 83 includes an SM (Smart Media) card, a CF (Compact Flash) card, and the like.
- the electronic device 200 further includes a central processing unit 81 and a display device 85 connected to the imaging device 100, and the central processing unit 81 is configured to control the display device 85 to display the merged image.
- the image captured by the electronic device 200 can be displayed on the display device for viewing by the user.
- the display device includes an LED display or the like.
- the electronic device has a photographing function and can generate a combined image with high signal to noise ratio and high definition under low light.
- the electronic device is a front camera of the mobile phone, the brightness and sharpness of the self-timer under low light can be improved.
- a "computer-readable medium” can be any apparatus that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with the instruction execution system, apparatus, or device.
- computer readable media include the following: electrical connections (electronic devices) having one or more wires, portable computer disk cartridges (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable editable read only memory (EPROM or flash memory), fiber optic And portable compact disk read only memory (CDROM).
- the computer readable medium may even be a paper or other suitable medium on which the program can be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if appropriate, other suitable The method is processed to obtain the program electronically and then stored in computer memory.
- portions of the invention may be implemented in hardware, software, firmware or a combination thereof.
- multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system.
- a suitable instruction execution system For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques well known in the art: having logic gates for implementing logic functions on data signals. Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.
- each functional unit in each embodiment of the present invention may be integrated into one processing module, or each unit may exist physically separately, or two or more units may be integrated into one module.
- the above integrated modules can be implemented in the form of hardware or in the form of software functional modules.
- the integrated modules, if implemented in the form of software functional modules and sold or used as stand-alone products, may also be stored in a computer readable storage medium.
- the above mentioned storage medium may be a read only memory, a magnetic disk or an optical disk or the like.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Power Engineering (AREA)
- Condensed Matter Physics & Semiconductors (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Microelectronics & Electronic Packaging (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Electromagnetism (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Solid State Image Pick-Up Elements (AREA)
Abstract
Description
Claims (16)
- 一种成像方法,其特征在于,包括以下步骤:提供图像传感器,所述图像传感器包括感光像素阵列及设置在所述感光像素阵列上的滤光片,所述滤光片包括滤光单元阵列,每个所述滤光单元覆盖多个所述感光像素并构成合并像素;及读取所述感光像素阵列的输出,并将同一所述合并像素的所述感光像素的输出相加以得到所述合并像素的像素值从而生成合并图像。
- 如权利要求1所述的成像方法,其特征在于,所述成像装置包括寄存器,每个所述滤光单元覆盖2*2个所述感光像素;所述读出步骤进一步包括:采集第k行及第k+1行的所述感光像素的输出并存入所述寄存器,其中k=2n-1,n为自然数,k+1小于等于所述感光像素阵列的总行数;及从所述寄存器中提取所述第k行及第k+1行的所述感光像素的输出,将同一所述合并像素的所述感光像素的输出相加以得到所述合并像素的像素值。
- 如权利要求1所述的成像方法,其特征在于,所述读出步骤进一步包括:将所述感光像素产生的模拟信号输出转换为数字信号输出。
- 一种成像装置,其特征在于,包括:图像传感器,所述图像传感器包括:感光像素阵列;设置于所述感光像素阵列上的滤光片;所述滤光片包括滤光单元阵列,每个所述滤光单元覆盖多个所述感光像素并构成合并像素;及与所述图像传感器连接的图像处理模块,所述图像处理模块用于读取所述感光像素阵列的输出,并将同一所述合并像素的所述感光像素的输出相加以得到所述合并像素的像素值从而生成合并图像。
- 如权利要求4所述的成像装置,其特征在于,所述图像传感器包括CMOS图像传感器。
- 如权利要求4所述的成像装置,其特征在于,所述滤光单元阵列包括拜耳阵列。
- 如权利要求4所述的成像装置,其特征在于,每个所述滤光单元覆盖2*2个所述感光像素。
- 如权利要求4所述的成像装置,其特征在于,所述成像装置包括控制模块,所述控制模块用于控制所述感光像素阵列逐行曝光。
- 如权利要求8所述的成像装置,其特征在于,所述成像装置还包括寄存器,所述控制模块用于依次采集当前曝光完成的第k行及第k+1行的所述感光像素的输出并存入所述寄存器,其中k=2n-1,n为自然数,k+1小于等于所述感光像素阵列的总行数。
- 如权利要求9所述的成像装置,其特征在于,所述图像传感器包括模数转换器;每个所述感光像素分别与一个所述模数转换器连接,所述模数转换器用于将所述感光像素的模拟信号输出转换为数字信号输出;所述数字信号输出用于存入所述寄存器;所述图像处理模块用于将同一所述合并像素的所述感光像素的所述数字信号输出相加以得到所述合并像素的像素值。
- 如权利要求4所述的成像装置,其特征在于,所述图像传感器包括设置在所述滤光片上的微镜阵列,每个所述微镜与一个所述感光像素对应。
- 一种电子装置,其特征在于,包括如权利要求4~11任意一项所述的成像装置。
- 如权利要求12所述的电子装置,其特征在于,所述电子装置包括手机。
- 如权利要求13所述的电子装置,其特征在于,所述成像装置包括所述手机的前置相机。
- 如权利要求12所述的电子装置,其特征在于,所述电子装置包括与所述成像装置连接的中央处理器及外存储器,所述中央处理器用于控制所述外存储器存储所述合并图像。
- 如权利要求12所述的电子装置,其特征在于,所述电子装置还包括与所述成像装置连接的中央处理器及显示装置,所述中央处理器用于控制所述显示装置显示所述合并图像。
Priority Applications (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2017528779A JP6377855B2 (ja) | 2015-12-18 | 2016-07-27 | 結像方法、結像装置及び電子装置 |
KR1020177026302A KR20170118197A (ko) | 2015-12-18 | 2016-07-27 | 이미징 방법, 이미징 장치 및 전자 장치 |
AU2016370324A AU2016370324B2 (en) | 2015-12-18 | 2016-07-27 | Imaging method, imaging device, and electronic device |
US15/514,798 US10257447B2 (en) | 2015-12-18 | 2016-07-27 | Imaging method, imaging device, and electronic device |
SG11201706110SA SG11201706110SA (en) | 2015-12-18 | 2016-07-27 | Imaging method, imaging device, and electronic device |
EP16874512.3A EP3229467A4 (en) | 2015-12-18 | 2016-07-27 | Imaging method, imaging device, and electronic device |
ZA2017/06395A ZA201706395B (en) | 2015-12-18 | 2017-09-21 | Imaging method, imaging device, and electronic device |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510964215.XA CN105578072A (zh) | 2015-12-18 | 2015-12-18 | 成像方法、成像装置及电子装置 |
CN201510964215.X | 2015-12-18 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017101451A1 true WO2017101451A1 (zh) | 2017-06-22 |
Family
ID=55887678
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2016/091944 WO2017101451A1 (zh) | 2015-12-18 | 2016-07-27 | 成像方法、成像装置及电子装置 |
Country Status (11)
Country | Link |
---|---|
US (1) | US10257447B2 (zh) |
EP (1) | EP3229467A4 (zh) |
JP (1) | JP6377855B2 (zh) |
KR (1) | KR20170118197A (zh) |
CN (1) | CN105578072A (zh) |
AU (1) | AU2016370324B2 (zh) |
MY (1) | MY180913A (zh) |
SG (1) | SG11201706110SA (zh) |
TW (1) | TW201724015A (zh) |
WO (1) | WO2017101451A1 (zh) |
ZA (1) | ZA201706395B (zh) |
Families Citing this family (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105578072A (zh) | 2015-12-18 | 2016-05-11 | 广东欧珀移动通信有限公司 | 成像方法、成像装置及电子装置 |
CN106341670B (zh) * | 2016-11-29 | 2017-09-22 | 广东欧珀移动通信有限公司 | 控制方法、控制装置及电子装置 |
CN106454288B (zh) * | 2016-11-29 | 2018-01-19 | 广东欧珀移动通信有限公司 | 控制方法、控制装置、成像装置及电子装置 |
CN106507068B (zh) | 2016-11-29 | 2018-05-04 | 广东欧珀移动通信有限公司 | 图像处理方法及装置、控制方法及装置、成像及电子装置 |
CN106454054B (zh) | 2016-11-29 | 2019-03-19 | Oppo广东移动通信有限公司 | 控制方法、控制装置及电子装置 |
CN106504218B (zh) * | 2016-11-29 | 2019-03-12 | Oppo广东移动通信有限公司 | 控制方法、控制装置及电子装置 |
CN106713790B (zh) * | 2016-11-29 | 2019-05-10 | Oppo广东移动通信有限公司 | 控制方法、控制装置及电子装置 |
US10848631B2 (en) * | 2018-09-26 | 2020-11-24 | Ricoh Company, Ltd. | Reading device and image forming apparatus |
KR20200097841A (ko) | 2019-02-08 | 2020-08-20 | 삼성전자주식회사 | 이미지 센서 장치 |
KR102661820B1 (ko) | 2019-02-11 | 2024-05-02 | 삼성전자주식회사 | 이미지 센서 및 그것의 구동 방법 |
KR102695388B1 (ko) | 2019-02-12 | 2024-08-19 | 삼성전자주식회사 | 디지털 픽셀을 포함하는 이미지 센서 |
US10764507B1 (en) * | 2019-04-18 | 2020-09-01 | Kneron (Taiwan) Co., Ltd. | Image processing system capable of generating a snapshot image with high image quality by using a zero-shutter-lag snapshot operation |
CN110161530A (zh) * | 2019-06-10 | 2019-08-23 | 炬佑智能科技(苏州)有限公司 | Tof传感器及其形成方法、机器视觉系统 |
CN110161529A (zh) * | 2019-06-10 | 2019-08-23 | 炬佑智能科技(苏州)有限公司 | Tof传感器及其形成方法、机器视觉系统 |
CN110418044B (zh) * | 2019-07-31 | 2021-04-23 | Oppo广东移动通信有限公司 | 光学系统和电子设备 |
KR102625261B1 (ko) | 2019-10-21 | 2024-01-12 | 삼성전자주식회사 | 이미지 장치 |
Citations (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090167917A1 (en) * | 2007-12-28 | 2009-07-02 | Takanori Miki | Imaging device |
US20090200451A1 (en) * | 2008-02-08 | 2009-08-13 | Micron Technology, Inc. | Color pixel arrays having common color filters for multiple adjacent pixels for use in cmos imagers |
CN105430360A (zh) * | 2015-12-18 | 2016-03-23 | 广东欧珀移动通信有限公司 | 成像方法、图像传感器、成像装置及电子装置 |
CN105430359A (zh) * | 2015-12-18 | 2016-03-23 | 广东欧珀移动通信有限公司 | 成像方法、图像传感器、成像装置及电子装置 |
CN105430363A (zh) * | 2015-12-18 | 2016-03-23 | 广东欧珀移动通信有限公司 | 成像方法、成像装置及电子装置 |
CN105430361A (zh) * | 2015-12-18 | 2016-03-23 | 广东欧珀移动通信有限公司 | 成像方法、图像传感器、成像装置及电子装置 |
CN105430362A (zh) * | 2015-12-18 | 2016-03-23 | 广东欧珀移动通信有限公司 | 成像方法、成像装置及电子装置 |
CN105516697A (zh) * | 2015-12-18 | 2016-04-20 | 广东欧珀移动通信有限公司 | 图像传感器、成像装置、移动终端及成像方法 |
CN105554485A (zh) * | 2015-12-18 | 2016-05-04 | 广东欧珀移动通信有限公司 | 成像方法、成像装置及电子装置 |
CN105578080A (zh) * | 2015-12-18 | 2016-05-11 | 广东欧珀移动通信有限公司 | 成像方法、图像传感器、成像装置及电子装置 |
CN105578076A (zh) * | 2015-12-18 | 2016-05-11 | 广东欧珀移动通信有限公司 | 成像方法、成像装置及电子装置 |
CN105578081A (zh) * | 2015-12-18 | 2016-05-11 | 广东欧珀移动通信有限公司 | 成像方法、图像传感器、成像装置及电子装置 |
CN105578077A (zh) * | 2015-12-18 | 2016-05-11 | 广东欧珀移动通信有限公司 | 成像方法、成像装置及电子装置 |
CN105578006A (zh) * | 2015-12-18 | 2016-05-11 | 广东欧珀移动通信有限公司 | 成像方法、成像装置及电子装置 |
CN105578072A (zh) * | 2015-12-18 | 2016-05-11 | 广东欧珀移动通信有限公司 | 成像方法、成像装置及电子装置 |
CN105592303A (zh) * | 2015-12-18 | 2016-05-18 | 广东欧珀移动通信有限公司 | 成像方法、成像装置及电子装置 |
CN105611125A (zh) * | 2015-12-18 | 2016-05-25 | 广东欧珀移动通信有限公司 | 成像方法、成像装置及电子装置 |
CN105611257A (zh) * | 2015-12-18 | 2016-05-25 | 广东欧珀移动通信有限公司 | 成像方法、图像传感器、成像装置及电子装置 |
CN105611185A (zh) * | 2015-12-18 | 2016-05-25 | 广东欧珀移动通信有限公司 | 图像生成方法、装置及终端设备 |
Family Cites Families (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6999119B1 (en) * | 1998-04-10 | 2006-02-14 | Nikon Corporation | Image-capturing element, image-capturing circuit for processing signal from image-capturing element, image-capturing device, driving method of image-capturing element |
US20060125947A1 (en) * | 2004-12-09 | 2006-06-15 | Packer Jimmy L | Imaging with clustered photosite arrays |
US7924483B2 (en) * | 2006-03-06 | 2011-04-12 | Smith Scott T | Fused multi-array color image sensor |
JP2008109369A (ja) * | 2006-10-25 | 2008-05-08 | Olympus Imaging Corp | 撮像装置及び画像処理方法 |
KR100976284B1 (ko) * | 2007-06-07 | 2010-08-16 | 가부시끼가이샤 도시바 | 촬상 장치 |
TWI504256B (zh) * | 2008-04-07 | 2015-10-11 | Sony Corp | 固態成像裝置,其訊號處理方法,及電子設備 |
US8218068B2 (en) | 2009-04-01 | 2012-07-10 | Omnivision Technologies, Inc. | Exposing pixel groups in producing digital images |
US8134115B2 (en) * | 2009-06-23 | 2012-03-13 | Nokia Corporation | Color filters for sub-diffraction limit-sized light sensors |
JP5471117B2 (ja) * | 2009-07-24 | 2014-04-16 | ソニー株式会社 | 固体撮像装置とその製造方法並びにカメラ |
US8724928B2 (en) | 2009-08-31 | 2014-05-13 | Intellectual Ventures Fund 83 Llc | Using captured high and low resolution images |
JP5044673B2 (ja) * | 2010-03-25 | 2012-10-10 | 株式会社東芝 | 固体撮像装置および画像記録装置 |
JP5644177B2 (ja) * | 2010-05-07 | 2014-12-24 | ソニー株式会社 | 固体撮像装置、および、その製造方法、電子機器 |
JP5664141B2 (ja) * | 2010-11-08 | 2015-02-04 | ソニー株式会社 | 固体撮像素子およびカメラシステム |
US8742309B2 (en) * | 2011-01-28 | 2014-06-03 | Aptina Imaging Corporation | Imagers with depth sensing capabilities |
DE102011100350A1 (de) * | 2011-05-03 | 2012-11-08 | Conti Temic Microelectronic Gmbh | Bildsensor mit einstellbarer Auflösung |
JP2015012303A (ja) * | 2013-06-26 | 2015-01-19 | ソニー株式会社 | 固体撮像装置および電子機器 |
US20150062422A1 (en) * | 2013-08-27 | 2015-03-05 | Semiconductor Components Industries, Llc | Lens alignment in camera modules using phase detection pixels |
KR102136852B1 (ko) * | 2013-12-30 | 2020-07-22 | 삼성전자 주식회사 | Tfa 기반의 시모스 이미지 센서 및 그 동작방법 |
US9438866B2 (en) * | 2014-04-23 | 2016-09-06 | Omnivision Technologies, Inc. | Image sensor with scaled filter array and in-pixel binning |
US9711553B2 (en) * | 2014-04-28 | 2017-07-18 | Samsung Electronics Co., Ltd. | Image sensor including a pixel having photoelectric conversion elements and image processing device having the image sensor |
US9888198B2 (en) * | 2014-06-03 | 2018-02-06 | Semiconductor Components Industries, Llc | Imaging systems having image sensor pixel arrays with sub-pixel resolution capabilities |
TWI552594B (zh) * | 2014-10-27 | 2016-10-01 | 聯詠科技股份有限公司 | 用於影像感測裝置的色彩濾波陣列及其製造方法 |
CN104486602B (zh) | 2014-12-29 | 2018-04-06 | 上海集成电路研发中心有限公司 | 一种实现像素物理合并的结构和方法 |
-
2015
- 2015-12-18 CN CN201510964215.XA patent/CN105578072A/zh active Pending
-
2016
- 2016-07-27 SG SG11201706110SA patent/SG11201706110SA/en unknown
- 2016-07-27 US US15/514,798 patent/US10257447B2/en active Active
- 2016-07-27 JP JP2017528779A patent/JP6377855B2/ja active Active
- 2016-07-27 WO PCT/CN2016/091944 patent/WO2017101451A1/zh active Application Filing
- 2016-07-27 MY MYPI2017702799A patent/MY180913A/en unknown
- 2016-07-27 AU AU2016370324A patent/AU2016370324B2/en active Active
- 2016-07-27 EP EP16874512.3A patent/EP3229467A4/en not_active Ceased
- 2016-07-27 KR KR1020177026302A patent/KR20170118197A/ko not_active Application Discontinuation
- 2016-12-15 TW TW105141528A patent/TW201724015A/zh unknown
-
2017
- 2017-09-21 ZA ZA2017/06395A patent/ZA201706395B/en unknown
Patent Citations (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090167917A1 (en) * | 2007-12-28 | 2009-07-02 | Takanori Miki | Imaging device |
US20090200451A1 (en) * | 2008-02-08 | 2009-08-13 | Micron Technology, Inc. | Color pixel arrays having common color filters for multiple adjacent pixels for use in cmos imagers |
CN105430360A (zh) * | 2015-12-18 | 2016-03-23 | 广东欧珀移动通信有限公司 | 成像方法、图像传感器、成像装置及电子装置 |
CN105430359A (zh) * | 2015-12-18 | 2016-03-23 | 广东欧珀移动通信有限公司 | 成像方法、图像传感器、成像装置及电子装置 |
CN105430363A (zh) * | 2015-12-18 | 2016-03-23 | 广东欧珀移动通信有限公司 | 成像方法、成像装置及电子装置 |
CN105430361A (zh) * | 2015-12-18 | 2016-03-23 | 广东欧珀移动通信有限公司 | 成像方法、图像传感器、成像装置及电子装置 |
CN105430362A (zh) * | 2015-12-18 | 2016-03-23 | 广东欧珀移动通信有限公司 | 成像方法、成像装置及电子装置 |
CN105516697A (zh) * | 2015-12-18 | 2016-04-20 | 广东欧珀移动通信有限公司 | 图像传感器、成像装置、移动终端及成像方法 |
CN105554485A (zh) * | 2015-12-18 | 2016-05-04 | 广东欧珀移动通信有限公司 | 成像方法、成像装置及电子装置 |
CN105578080A (zh) * | 2015-12-18 | 2016-05-11 | 广东欧珀移动通信有限公司 | 成像方法、图像传感器、成像装置及电子装置 |
CN105578076A (zh) * | 2015-12-18 | 2016-05-11 | 广东欧珀移动通信有限公司 | 成像方法、成像装置及电子装置 |
CN105578081A (zh) * | 2015-12-18 | 2016-05-11 | 广东欧珀移动通信有限公司 | 成像方法、图像传感器、成像装置及电子装置 |
CN105578077A (zh) * | 2015-12-18 | 2016-05-11 | 广东欧珀移动通信有限公司 | 成像方法、成像装置及电子装置 |
CN105578006A (zh) * | 2015-12-18 | 2016-05-11 | 广东欧珀移动通信有限公司 | 成像方法、成像装置及电子装置 |
CN105578072A (zh) * | 2015-12-18 | 2016-05-11 | 广东欧珀移动通信有限公司 | 成像方法、成像装置及电子装置 |
CN105592303A (zh) * | 2015-12-18 | 2016-05-18 | 广东欧珀移动通信有限公司 | 成像方法、成像装置及电子装置 |
CN105611125A (zh) * | 2015-12-18 | 2016-05-25 | 广东欧珀移动通信有限公司 | 成像方法、成像装置及电子装置 |
CN105611257A (zh) * | 2015-12-18 | 2016-05-25 | 广东欧珀移动通信有限公司 | 成像方法、图像传感器、成像装置及电子装置 |
CN105611185A (zh) * | 2015-12-18 | 2016-05-25 | 广东欧珀移动通信有限公司 | 图像生成方法、装置及终端设备 |
Non-Patent Citations (1)
Title |
---|
See also references of EP3229467A4 * |
Also Published As
Publication number | Publication date |
---|---|
US10257447B2 (en) | 2019-04-09 |
JP6377855B2 (ja) | 2018-08-22 |
TW201724015A (zh) | 2017-07-01 |
MY180913A (en) | 2020-12-11 |
US20170332022A1 (en) | 2017-11-16 |
SG11201706110SA (en) | 2017-08-30 |
CN105578072A (zh) | 2016-05-11 |
EP3229467A4 (en) | 2018-04-18 |
ZA201706395B (en) | 2019-01-30 |
KR20170118197A (ko) | 2017-10-24 |
AU2016370324A1 (en) | 2017-07-27 |
AU2016370324B2 (en) | 2018-09-06 |
EP3229467A1 (en) | 2017-10-11 |
JP2018502492A (ja) | 2018-01-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2017101451A1 (zh) | 成像方法、成像装置及电子装置 | |
TWI662842B (zh) | 圖像傳感器及輸出方法、相位對焦方法、成像裝置和行動裝置 | |
TWI617196B (zh) | 圖像感測器、成像裝置、行動終端及成像方法 | |
TWI615027B (zh) | 高動態範圍圖像的生成方法、拍照裝置和終端裝置、成像方法 | |
TWI613918B (zh) | 圖像感測器之成像方法、成像裝置、行動終端和非易失性電腦儲存媒體 | |
WO2018098978A1 (zh) | 控制方法、控制装置、电子装置和计算机可读存储介质 | |
WO2018098982A1 (zh) | 图像处理方法、图像处理装置、成像装置及电子装置 | |
WO2018099009A1 (zh) | 控制方法、控制装置、电子装置和计算机可读存储介质 | |
TWI615029B (zh) | 圖像感測器及終端與成像方法 | |
WO2018098981A1 (zh) | 控制方法、控制装置、电子装置和计算机可读存储介质 | |
WO2018098983A1 (zh) | 图像处理方法及装置、控制方法及装置、成像及电子装置 | |
TWI615028B (zh) | 圖像感測器及成像終端與成像方法 | |
CN105993164B (zh) | 固态图像传感器、电子设备和自动聚焦方法 | |
WO2017101864A1 (zh) | 图像传感器、控制方法和电子装置 | |
CN105430360A (zh) | 成像方法、图像传感器、成像装置及电子装置 | |
WO2017101558A1 (zh) | 图像传感器和具有其的终端、成像方法 | |
CN105578077A (zh) | 成像方法、成像装置及电子装置 | |
TWI615030B (zh) | 圖像感測器、具有其的終端裝置、成像方法、行動終端裝置和電腦可讀儲存媒體 | |
JP2007195114A (ja) | 撮像装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 15514798 Country of ref document: US |
|
ENP | Entry into the national phase |
Ref document number: 2017528779 Country of ref document: JP Kind code of ref document: A |
|
REEP | Request for entry into the european phase |
Ref document number: 2016874512 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2016370324 Country of ref document: AU Date of ref document: 20160727 Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 11201706110S Country of ref document: SG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16874512 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 20177026302 Country of ref document: KR Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |