US7301570B2 - Image correction by combining results of multiple linear filters, where extreme linear filter values are eliminated - Google Patents

Image correction by combining results of multiple linear filters, where extreme linear filter values are eliminated Download PDF

Info

Publication number
US7301570B2
US7301570B2 US10/104,911 US10491102A US7301570B2 US 7301570 B2 US7301570 B2 US 7301570B2 US 10491102 A US10491102 A US 10491102A US 7301570 B2 US7301570 B2 US 7301570B2
Authority
US
United States
Prior art keywords
output signals
filters
light
sensor
extreme
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US10/104,911
Other versions
US20020145673A1 (en
Inventor
Frederic Bompard
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dynamic Data Technologies LLC
Original Assignee
NXP BV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=8861583&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=US7301570(B2) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by NXP BV filed Critical NXP BV
Assigned to KONINKLIJKE PHILIPS ELECTRONICS N.V. reassignment KONINKLIJKE PHILIPS ELECTRONICS N.V. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: BOMPARD, FREDERIC
Publication of US20020145673A1 publication Critical patent/US20020145673A1/en
Assigned to NXP B.V. reassignment NXP B.V. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KONINKLIJKE PHILIPS ELECTRONICS N.V.
Application granted granted Critical
Publication of US7301570B2 publication Critical patent/US7301570B2/en
Assigned to TRIDENT MICROSYSTEMS (FAR EAST) LTD. reassignment TRIDENT MICROSYSTEMS (FAR EAST) LTD. ASSIGNMENT OF ASSIGNOR'S INTEREST Assignors: NXP HOLDING 1 B.V., TRIDENT MICROSYSTEMS (EUROPE) B.V.
Assigned to NXP HOLDING 1 B.V. reassignment NXP HOLDING 1 B.V. ASSIGNMENT OF ASSIGNOR'S INTEREST Assignors: NXP
Assigned to ENTROPIC COMMUNICATIONS, INC. reassignment ENTROPIC COMMUNICATIONS, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: TRIDENT MICROSYSTEMS (FAR EAST) LTD., TRIDENT MICROSYSTEMS, INC.
Assigned to ENTROPIC COMMUNICATIONS, INC. reassignment ENTROPIC COMMUNICATIONS, INC. MERGER AND CHANGE OF NAME Assignors: ENTROPIC COMMUNICATIONS, INC., EXCALIBUR ACQUISITION CORPORATION
Assigned to ENTROPIC COMMUNICATIONS, LLC reassignment ENTROPIC COMMUNICATIONS, LLC MERGER AND CHANGE OF NAME Assignors: ENTROPIC COMMUNICATIONS, INC., ENTROPIC COMMUNICATIONS, LLC, EXCALIBUR SUBSIDIARY, LLC
Assigned to JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT reassignment JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT SECURITY AGREEMENT Assignors: ENTROPIC COMMUNICATIONS, LLC (F/K/A ENTROPIC COMMUNICATIONS, INC.), EXAR CORPORATION, MAXLINEAR, INC.
Assigned to DYNAMIC DATA TECHNOLOGIES LLC reassignment DYNAMIC DATA TECHNOLOGIES LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ENTROPIC COMMUNICATIONS LLC, MAXLINEAR INC
Assigned to MUFG UNION BANK, N.A. reassignment MUFG UNION BANK, N.A. SUCCESSION OF AGENCY (REEL 042453 / FRAME 0001) Assignors: JPMORGAN CHASE BANK, N.A.
Assigned to MAXLINEAR, INC., EXAR CORPORATION, MAXLINEAR COMMUNICATIONS LLC reassignment MAXLINEAR, INC. RELEASE OF SECURITY INTEREST Assignors: MUFG UNION BANK, N.A.
Adjusted expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/64—Circuits for processing colour signals
    • H04N9/646—Circuits for processing colour signals for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
    • H04N25/44—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array
    • H04N25/447—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array by preserving the colour pattern with or without loss of information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/68—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to defects

Definitions

  • the invention relates to a camera in the form of a sensor composed of light-sensitive elements arranged in a matrix, and at least a first filtering device for processing the signals issuing from said sensitive elements.
  • the invention also relates to a method of processing the images taken by such an apparatus.
  • a problem which is posed with this type of apparatus is that it is difficult to obtain a sensor free from faults.
  • These sensors are formed by a plurality of elements sensitive to visible radiation, disposed in a matrix.
  • Various layers of color filters deposited on them make them sensitive, selectively, to various components of the physical spectrum, for example to the colors yellow, red and blue. It is during the manufacturing process that the defects occur. These defects can fall in various categories:
  • the present invention proposes an apparatus of the type mentioned in the preamble which deals with the correction of defects according to another approach and which eliminates or greatly attenuates the effects of the defects due to the faulty points on the sensor, notably those described by the aforementioned categories.
  • such an apparatus is characterized in that the filtering device includes a plurality of linear filters corresponding to directions considered on the sensor for supplying a plurality of filtering indications, an elimination device for eliminating the extreme results of the various linear filters and an estimation device for supplying an indication from the non-eliminated filters.
  • the idea of the invention therefore consists of using the luminance and therefore all the information coming from all the points on the sensor.
  • FIG. 1 shows a diagram of the apparatus according to the invention.
  • FIG. 2 shows the organization of the sensor.
  • FIG. 1 a camera according to the invention has been depicted.
  • the reference 3 indicates the sensor including a plurality of elements sensitive to various components, arranged in a matrix.
  • the subject 4 is focused on this sensor, which is obtained by means of a lens 5 .
  • the camera has a first filtering device 10 effecting various filtering operations.
  • this filtering device 10 has a plurality of linear filters Fmd 1 , Fmd 2 , Fdg 1 to Fdg 6 corresponding to directions considered on the sensor for supplying a plurality of filtering indications. These directions are medians and various diagonals. These various linear filters supply various items of information relating to an image point.
  • a branch output device 12 has an elimination device 14 designed to eliminate the extreme results of various linear filters and an estimation device 16 for supplying an indication from the non-eliminated filters.
  • the apparatus is formed by two processing branches: a first branch B 1 which relates to the processing related to the color for which the elements have been sensitized and which includes the aforementioned elements, and a second branch B 2 which relates to processing without consideration of color.
  • the purpose of this second branch is to supply more details on the image, since it processes the upper part of the spectrum of the image without taking account of the color, the eye being more sensitive to transitions in the luminance rather than color transitions.
  • a filtering device 17 including filters Fmd 1 ′, Fmd 2 ′, Fdg 1 ′ to Fdg 6 ′ which operate in a similar manner to the filters of the device 10 , but are adapted to the requirements of the processing of the branch B 2 .
  • filters Fmd 1 , Fmd 2 , Fdg 1 to Fdg 6 with regard to correction, will apply to the filters Fmd 1 ′, Fmd 2 ′, Fdg 1 ′ to Fdg 6 ′.
  • an output device 18 having an elimination device 20 which is also designed to eliminate the extreme results of various linear filters and an estimation device 22 for supplying an indication from the non-eliminated filters.
  • the information supplied by these two branches are simply added to the adder means 25 , 26 and 27 , which add respectively the values relating to the color components processed by the branch B 1 to the luminance information supplied by the branch B 2 .
  • An interfacing device 30 processes these added signals with a view to storing them in an image memory 31 .
  • FIG. 2 explains the directions of the filters. This Figure shows the arrangement of the various elements of the sensor with their sensitivity to the three primary colors:
  • the various filters operate in 8 directions, this being represented by the various hatching patterns.
  • the filters Fmd 1 and Fmd 2 are filters which operate respectively on the horizontal and vertical medians.
  • the filters Fdg 1 and Fdg 2 operate on the main diagonals at 45° with respect to the directions of the filters Fmd 1 and Fmd 2 .
  • the filters Fdg 3 and Fdg 4 operate on the diagonals at 22.5° with respect to the vertical median.
  • the filters Fdg 5 and Fdg 6 operate on the diagonals at 22.5° with respect to the horizontal median.
  • These filters are produced, for example, from a square matrix of 9 ⁇ 9 coefficients centered on the image point to be processed.
  • the various output signals of the aforementioned filters are designed to estimate the value of the central pixel placed on the column CC and the row RC.
  • the magnitudes of these various output signals are classified.
  • the extreme values are eliminated.
  • the value of the pixel is then the result of the mean of the other output signals.
  • the eliminated extreme values can be considered to be due to a defect in the sensor.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Color Television Image Signal Generators (AREA)
  • Image Processing (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)

Abstract

A camera is in the form of a sensor (3) composed of light-sensitive elements arranged in a matrix, and at least a first filtering device (10) for processing the signals issuing from said sensitive elements. The filtering device (10) includes a plurality of linear filters (Fmd1, Fmd2, Fdg1, . . . Fdg6) corresponding to medians and diagonals with respect to the sensor for supplying a plurality of filtering indications. An elimination device (14) eliminates the extreme results of these indications and an estimation device (16) supplyies a valid indication from the non-eliminated indications. Thus, the faulty sensitive elements of the sensor (3) do not degrade the images excessively.

Description

The invention relates to a camera in the form of a sensor composed of light-sensitive elements arranged in a matrix, and at least a first filtering device for processing the signals issuing from said sensitive elements.
The invention also relates to a method of processing the images taken by such an apparatus.
A problem which is posed with this type of apparatus is that it is difficult to obtain a sensor free from faults. These sensors are formed by a plurality of elements sensitive to visible radiation, disposed in a matrix. Various layers of color filters deposited on them make them sensitive, selectively, to various components of the physical spectrum, for example to the colors yellow, red and blue. It is during the manufacturing process that the defects occur. These defects can fall in various categories:
    • A first category of defect is an isolated defect occurring on a single point of the sensor.
    • A second category is a group defect involving several adjacent points of the mosaic. This second category of defect results from the molding process.
    • A third category is a color defect involving several points of the same color. This category occurs during the process of placing the color filters.
    • A fourth category is a column defect involving several points on the sensor situated in the same column.
In Japanese patent document JP 11-262025, an appliance of the type mentioned above in the preamble is described. According to this document the defects are corrected color by color using a previously filled table containing the exact positions of the defective pixels.
The present invention proposes an apparatus of the type mentioned in the preamble which deals with the correction of defects according to another approach and which eliminates or greatly attenuates the effects of the defects due to the faulty points on the sensor, notably those described by the aforementioned categories.
For this purpose, such an apparatus is characterized in that the filtering device includes a plurality of linear filters corresponding to directions considered on the sensor for supplying a plurality of filtering indications, an elimination device for eliminating the extreme results of the various linear filters and an estimation device for supplying an indication from the non-eliminated filters.
A method of processing the images taken by an apparatus of the type mentioned in the preamble is characterized in that it includes the following steps:
    • matrix filtering of the image for each of its points in a plurality of directions,
    • estimation of the filtering value for each of these directions,
    • elimination of the extreme filtering values,
    • estimation of the value to be given to the current point of the image by effecting a combination of means of the non-eliminated filtering values.
The idea of the invention therefore consists of using the luminance and therefore all the information coming from all the points on the sensor.
The invention will be further described with reference to examples of embodiment shown in the drawings to which, however, the invention is not restricted:
FIG. 1 shows a diagram of the apparatus according to the invention.
FIG. 2 shows the organization of the sensor.
In FIG. 1, a camera according to the invention has been depicted. The reference 3 indicates the sensor including a plurality of elements sensitive to various components, arranged in a matrix. The subject 4 is focused on this sensor, which is obtained by means of a lens 5. The camera has a first filtering device 10 effecting various filtering operations.
At the output of the sensor, it is possible to collect various signals corresponding to each of said color components. These various color components undergo a filtering operation performed by the first filtering device 10 (FIG. 1) forming part of a first branch B1. This operation consists of a filtering in two dimensions 2D.
According to the invention this filtering device 10 has a plurality of linear filters Fmd1, Fmd2, Fdg1 to Fdg6 corresponding to directions considered on the sensor for supplying a plurality of filtering indications. These directions are medians and various diagonals. These various linear filters supply various items of information relating to an image point. A branch output device 12 has an elimination device 14 designed to eliminate the extreme results of various linear filters and an estimation device 16 for supplying an indication from the non-eliminated filters.
According to another embodiment, the apparatus is formed by two processing branches: a first branch B1 which relates to the processing related to the color for which the elements have been sensitized and which includes the aforementioned elements, and a second branch B2 which relates to processing without consideration of color. The purpose of this second branch is to supply more details on the image, since it processes the upper part of the spectrum of the image without taking account of the color, the eye being more sensitive to transitions in the luminance rather than color transitions. In this branch B2, there is a filtering device 17 including filters Fmd1′, Fmd2′, Fdg1′ to Fdg6′ which operate in a similar manner to the filters of the device 10, but are adapted to the requirements of the processing of the branch B2. What will be stated for the filters Fmd1, Fmd2, Fdg1 to Fdg6 with regard to correction, will apply to the filters Fmd1′, Fmd2′, Fdg1′ to Fdg6′. There is also an output device 18 having an elimination device 20 which is also designed to eliminate the extreme results of various linear filters and an estimation device 22 for supplying an indication from the non-eliminated filters.
The information supplied by these two branches are simply added to the adder means 25, 26 and 27, which add respectively the values relating to the color components processed by the branch B1 to the luminance information supplied by the branch B2. An interfacing device 30 processes these added signals with a view to storing them in an image memory 31.
FIG. 2 explains the directions of the filters. This Figure shows the arrangement of the various elements of the sensor with their sensitivity to the three primary colors:
    • blue, these elements are indicated by the letter “B” in FIG. 2
    • red, these elements are indicated by the letter “R” in FIG. 2
    • green, these elements are indicated by the letter “G” in this same FIG. 2.
The various filters operate in 8 directions, this being represented by the various hatching patterns.
The filters Fmd1 and Fmd2 are filters which operate respectively on the horizontal and vertical medians.
The filters Fdg1 and Fdg2 operate on the main diagonals at 45° with respect to the directions of the filters Fmd1 and Fmd2.
The filters Fdg3 and Fdg4 operate on the diagonals at 22.5° with respect to the vertical median.
The filters Fdg5 and Fdg6 operate on the diagonals at 22.5° with respect to the horizontal median.
These filters are produced, for example, from a square matrix of 9×9 coefficients centered on the image point to be processed.
The functioning of the invention is as follows.
The various output signals of the aforementioned filters are designed to estimate the value of the central pixel placed on the column CC and the row RC. The magnitudes of these various output signals are classified. The extreme values are eliminated. The value of the pixel is then the result of the mean of the other output signals. The eliminated extreme values can be considered to be due to a defect in the sensor.

Claims (5)

1. A camera comprising:
a sensor composed of light-sensitive elements arranged in a matrix and sensitive to light within an image spectrum;
at least a first filtering device for processing the signals issuing from said sensitive elements, comprising a plurality of linear filters for supplying a respective plurality of output signals, each linear filter acting upon signals from a different plurality of selected light-sensitive elements arranged along a line with respect to the sensor and selected based on the respective positions of the selected light-sensitive elements with respect to a particular light-sensitive element;
an elimination device for classifying output signals of the linear filters relative to each other, for identifying extreme output signals of one or more linear filters that are either greater than or less than output signals of all other linear filters whose output signals have not been identified as extreme output signals, and for eliminating the extreme output signals; and
an estimation device for supplying an estimated image value for the particular light-sensitive element produced by combining a plurality of remaining output signals not previously eliminated as being extreme output signals.
2. A camera as claimed in claim 1, comprising a first branch for filtering color information and a second branch for filtering luminance information within an upper part of the image spectrum, wherein the plurality of filters is placed in the first branch.
3. A camera as claimed in claim 1, comprising a first branch for filtering color information and a second branch for filtering luminance information within an upper part of the image spectrum, wherein the plurality of filters is placed in the second branch.
4. A camera as claimed in claim 1, wherein the estimation device estimates a mean of the output signals of the non-eliminated filters.
5. An image-sensing method comprising:
obtaining sensor signals using a sensor composed of light-sensitive element arranged in a matrix and sensitive to light within an image spectrum;
processing the sensor signals issuing from said light-sensitive elements using a plurality of linear filters for supplying a respective plurality of output signals, each linear filter acting upon signals from a different plurality of selected light-sensitive elements arranged along a line with respect to the sensor and selected based on the respective positions of the selected light-sensitive elements with respect to a particular light-sensitive element;
classifying output signals of the linear filters relative to each other;
identifying extreme output signals of one or more linear filters that are either greater than or less than output signals of all other linear filters whose output signals have not been identified as extreme output signals;
eliminating the extreme output signals; and
supplying an estimated image value for the particular light-sensitive element produced by combining a plurality of remaining output signals not previously eliminated as being extreme output signals.
US10/104,911 2001-03-27 2002-03-22 Image correction by combining results of multiple linear filters, where extreme linear filter values are eliminated Expired - Fee Related US7301570B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR0104108 2001-03-27
FR0104108 2001-03-27

Publications (2)

Publication Number Publication Date
US20020145673A1 US20020145673A1 (en) 2002-10-10
US7301570B2 true US7301570B2 (en) 2007-11-27

Family

ID=8861583

Family Applications (1)

Application Number Title Priority Date Filing Date
US10/104,911 Expired - Fee Related US7301570B2 (en) 2001-03-27 2002-03-22 Image correction by combining results of multiple linear filters, where extreme linear filter values are eliminated

Country Status (4)

Country Link
US (1) US7301570B2 (en)
EP (1) EP1246472A1 (en)
JP (1) JP2002335451A (en)
CN (1) CN1378388A (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4051196B2 (en) * 2001-11-08 2008-02-20 オリンパス株式会社 Noise reduction system, noise reduction method, noise reduction program, and electronic camera
CN100338934C (en) * 2005-01-04 2007-09-19 光宝科技股份有限公司 Dual Function Light Sensing Element
US7710472B2 (en) * 2006-05-01 2010-05-04 Warner Bros. Entertainment Inc. Detection and/or correction of suppressed signal defects in moving images

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11262025A (en) 1998-03-16 1999-09-24 Toshiba Corp Image input device and image correction method
US6404918B1 (en) * 1999-04-30 2002-06-11 Hewlett-Packard Company Image demosaicing method utilizing directional smoothing
US6741754B2 (en) * 2001-02-19 2004-05-25 Eastman Kodak Company Correcting for defects in a digital image taken by an image sensor caused by pre-existing defects in two pixels in adjacent columns of an image sensor
US6809765B1 (en) * 1999-10-05 2004-10-26 Sony Corporation Demosaicing for digital imaging device using perceptually uniform color space

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS61208980A (en) * 1985-03-13 1986-09-17 Mitsubishi Electric Corp Picture defect compensating device
BE1007354A3 (en) * 1993-07-23 1995-05-23 Philips Electronics Nv Signal correction circuit.
US5805217A (en) * 1996-06-14 1998-09-08 Iterated Systems, Inc. Method and system for interpolating missing picture elements in a single color component array obtained from a single color sensor
JP3503372B2 (en) * 1996-11-26 2004-03-02 ミノルタ株式会社 Pixel interpolation device and pixel interpolation method
JPH11191866A (en) * 1997-12-25 1999-07-13 Canon Inc Defective pixel interpolation device, imaging device, and computer-readable storage medium
US5990950A (en) * 1998-02-11 1999-11-23 Iterated Systems, Inc. Method and system for color filter array multifactor interpolation
JP2000217038A (en) * 1999-01-20 2000-08-04 Fujitsu Ltd Defective pixel replacement system and video display device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11262025A (en) 1998-03-16 1999-09-24 Toshiba Corp Image input device and image correction method
US6404918B1 (en) * 1999-04-30 2002-06-11 Hewlett-Packard Company Image demosaicing method utilizing directional smoothing
US6809765B1 (en) * 1999-10-05 2004-10-26 Sony Corporation Demosaicing for digital imaging device using perceptually uniform color space
US6741754B2 (en) * 2001-02-19 2004-05-25 Eastman Kodak Company Correcting for defects in a digital image taken by an image sensor caused by pre-existing defects in two pixels in adjacent columns of an image sensor

Also Published As

Publication number Publication date
JP2002335451A (en) 2002-11-22
EP1246472A1 (en) 2002-10-02
US20020145673A1 (en) 2002-10-10
CN1378388A (en) 2002-11-06

Similar Documents

Publication Publication Date Title
TWI610426B (en) Image sensor with proportional filter array and in-pixel merging
US8253828B2 (en) Image capture device including edge direction determination unit, and image processing method for the same
EP1389771B1 (en) Digital image system and method for combining demosaicing and bad pixel correction
US8817135B2 (en) Correction of cluster defects in imagers
CN1988673B (en) Image processing circuit and image processing method
US6965395B1 (en) Methods and systems for detecting defective imaging pixels and pixel values
US7034873B2 (en) Pixel defect correction in a CMOS active pixel image sensor
USRE43239E1 (en) Color interpolation method of image sensor
US20240040268A1 (en) Rgb-ir pixel pattern conversion via conversion engine
CN106331662A (en) Image acquisition device and image acquisition method
US7027091B1 (en) Detection of color filter array alignment in image sensors
CN108171657A (en) Image interpolation method and device
US7301570B2 (en) Image correction by combining results of multiple linear filters, where extreme linear filter values are eliminated
US20140307130A1 (en) Imaging device
JP2006303491A (en) Method of inspecting wafer
KR101702752B1 (en) Method of inspecting electronic components
JP5466099B2 (en) Appearance inspection device
JP6302272B2 (en) Image processing apparatus, image processing method, and imaging apparatus
TW201735645A (en) Method for processing signals arising from a colour image capture matrix, and corresponding sensor
US7916790B2 (en) Pixel compensation method for an image sensor
US8938120B2 (en) Image sensing device and image data processing method using the same
CN108769635B (en) Shooting device, electronic equipment and image acquisition method
JP2007078663A (en) Defect inspection method and defect inspection apparatus
JP5130257B2 (en) Image processing device
US12267600B2 (en) Method for processing image data of an image sensor based on symmetric or asymmetric positioning of phase detection pixel, image processor unit and computer program

Legal Events

Date Code Title Description
AS Assignment

Owner name: KONINKLIJKE PHILIPS ELECTRONICS N.V., NETHERLANDS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BOMPARD, FREDERIC;REEL/FRAME:012931/0030

Effective date: 20020410

AS Assignment

Owner name: NXP B.V., NETHERLANDS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KONINKLIJKE PHILIPS ELECTRONICS N.V.;REEL/FRAME:019719/0843

Effective date: 20070704

Owner name: NXP B.V.,NETHERLANDS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KONINKLIJKE PHILIPS ELECTRONICS N.V.;REEL/FRAME:019719/0843

Effective date: 20070704

STCF Information on status: patent grant

Free format text: PATENTED CASE

AS Assignment

Owner name: TRIDENT MICROSYSTEMS (FAR EAST) LTD.,CAYMAN ISLAND

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TRIDENT MICROSYSTEMS (EUROPE) B.V.;NXP HOLDING 1 B.V.;REEL/FRAME:023928/0552

Effective date: 20100208

Owner name: NXP HOLDING 1 B.V.,NETHERLANDS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:NXP;REEL/FRAME:023928/0489

Effective date: 20100207

Owner name: NXP HOLDING 1 B.V., NETHERLANDS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:NXP;REEL/FRAME:023928/0489

Effective date: 20100207

Owner name: TRIDENT MICROSYSTEMS (FAR EAST) LTD., CAYMAN ISLAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TRIDENT MICROSYSTEMS (EUROPE) B.V.;NXP HOLDING 1 B.V.;REEL/FRAME:023928/0552

Effective date: 20100208

FPAY Fee payment

Year of fee payment: 4

AS Assignment

Owner name: ENTROPIC COMMUNICATIONS, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TRIDENT MICROSYSTEMS, INC.;TRIDENT MICROSYSTEMS (FAR EAST) LTD.;REEL/FRAME:028153/0440

Effective date: 20120411

AS Assignment

Owner name: ENTROPIC COMMUNICATIONS, INC., CALIFORNIA

Free format text: MERGER AND CHANGE OF NAME;ASSIGNORS:EXCALIBUR ACQUISITION CORPORATION;ENTROPIC COMMUNICATIONS, INC.;ENTROPIC COMMUNICATIONS, INC.;REEL/FRAME:035706/0267

Effective date: 20150430

AS Assignment

Owner name: ENTROPIC COMMUNICATIONS, LLC, CALIFORNIA

Free format text: MERGER AND CHANGE OF NAME;ASSIGNORS:ENTROPIC COMMUNICATIONS, INC.;EXCALIBUR SUBSIDIARY, LLC;ENTROPIC COMMUNICATIONS, LLC;REEL/FRAME:035717/0628

Effective date: 20150430

FPAY Fee payment

Year of fee payment: 8

AS Assignment

Owner name: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT, IL

Free format text: SECURITY AGREEMENT;ASSIGNORS:MAXLINEAR, INC.;ENTROPIC COMMUNICATIONS, LLC (F/K/A ENTROPIC COMMUNICATIONS, INC.);EXAR CORPORATION;REEL/FRAME:042453/0001

Effective date: 20170512

Owner name: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT, ILLINOIS

Free format text: SECURITY AGREEMENT;ASSIGNORS:MAXLINEAR, INC.;ENTROPIC COMMUNICATIONS, LLC (F/K/A ENTROPIC COMMUNICATIONS, INC.);EXAR CORPORATION;REEL/FRAME:042453/0001

Effective date: 20170512

AS Assignment

Owner name: DYNAMIC DATA TECHNOLOGIES LLC, MINNESOTA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MAXLINEAR INC;ENTROPIC COMMUNICATIONS LLC;REEL/FRAME:047128/0295

Effective date: 20180418

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20191127

AS Assignment

Owner name: MUFG UNION BANK, N.A., CALIFORNIA

Free format text: SUCCESSION OF AGENCY (REEL 042453 / FRAME 0001);ASSIGNOR:JPMORGAN CHASE BANK, N.A.;REEL/FRAME:053115/0842

Effective date: 20200701

AS Assignment

Owner name: MAXLINEAR, INC., CALIFORNIA

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:MUFG UNION BANK, N.A.;REEL/FRAME:056656/0204

Effective date: 20210623

Owner name: EXAR CORPORATION, CALIFORNIA

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:MUFG UNION BANK, N.A.;REEL/FRAME:056656/0204

Effective date: 20210623

Owner name: MAXLINEAR COMMUNICATIONS LLC, CALIFORNIA

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:MUFG UNION BANK, N.A.;REEL/FRAME:056656/0204

Effective date: 20210623

Owner name: MAXLINEAR, INC., CALIFORNIA

Free format text: RELEASE OF SECURITY INTEREST;ASSIGNOR:MUFG UNION BANK, N.A.;REEL/FRAME:056656/0204

Effective date: 20210623

Owner name: EXAR CORPORATION, CALIFORNIA

Free format text: RELEASE OF SECURITY INTEREST;ASSIGNOR:MUFG UNION BANK, N.A.;REEL/FRAME:056656/0204

Effective date: 20210623

Owner name: MAXLINEAR COMMUNICATIONS LLC, CALIFORNIA

Free format text: RELEASE OF SECURITY INTEREST;ASSIGNOR:MUFG UNION BANK, N.A.;REEL/FRAME:056656/0204

Effective date: 20210623