WO2020070832A1 - Endoscope et système endoscopique - Google Patents

Endoscope et système endoscopique

Info

Publication number
WO2020070832A1
WO2020070832A1 PCT/JP2018/037068 JP2018037068W WO2020070832A1 WO 2020070832 A1 WO2020070832 A1 WO 2020070832A1 JP 2018037068 W JP2018037068 W JP 2018037068W WO 2020070832 A1 WO2020070832 A1 WO 2020070832A1
Authority
WO
WIPO (PCT)
Prior art keywords
pixel
white
target pixel
white defect
storage unit
Prior art date
Application number
PCT/JP2018/037068
Other languages
English (en)
Japanese (ja)
Inventor
秀範 橋本
Original Assignee
オリンパス株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by オリンパス株式会社 filed Critical オリンパス株式会社
Priority to PCT/JP2018/037068 priority Critical patent/WO2020070832A1/fr
Publication of WO2020070832A1 publication Critical patent/WO2020070832A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/045—Control thereof

Definitions

  • the present invention relates to an endoscope and an endoscope system for effectively detecting a white defect pixel.
  • an endoscope that includes an endoscope that captures an image of a subject inside a subject, a processor that generates an observation image of the subject captured by the endoscope, and a monitor that displays the observation image generated by the processor Mirror systems are widely used in medical fields, industrial fields, and the like.
  • the endoscope has an image pickup device such as a CCD image sensor or a CMOS image sensor at the distal end of the insertion section.
  • an image pickup device such as a CCD image sensor or a CMOS image sensor at the distal end of the insertion section.
  • a defective pixel called a white defect pixel in which an offset is added to an output may occur due to a variation or deterioration during manufacturing.
  • the generated white pixels are detected, learned, and corrected from the image as disclosed in WO2018 / 020686.
  • the technology is known. In this technique, the detection and learning of white spot pixels during imaging of a high-luminance subject are hindered, and thus high-luminance white spot pixels having a large output value are excluded from detection targets.
  • an object of the present invention is to provide an endoscope and an endoscope system that can detect a high-intensity white defect with a small-scale circuit.
  • An endoscope has an imaging element including a plurality of pixels which are arranged in a two-dimensional matrix and receive an external light to generate and output an imaging signal corresponding to a received light amount.
  • a comparison unit that compares whether an output value of the imaging signal output from a pixel of interest and surrounding pixels disposed around the pixel of interest among the plurality of pixels exceeds a predetermined threshold value,
  • a determination unit that determines whether the target pixel is a white defect pixel based on a comparison result of the target unit, wherein the determination unit determines whether the imaging signal is output from the target pixel by the comparison unit. If the output value is determined to exceed the predetermined threshold and the output value of the imaging signal output from the surrounding pixels is determined to be equal to or less than the predetermined threshold, the target pixel is determined to be the white defect pixel I do.
  • the endoscope system includes a plurality of pixels which are arranged in a two-dimensional matrix and receive light from the outside, generate an imaging signal corresponding to the amount of received light, and output the image signal.
  • An image sensor, and a comparison unit that compares whether or not the output value of the imaging signal output from the pixel of interest and surrounding pixels arranged around the pixel of interest among the plurality of pixels exceeds a predetermined threshold.
  • a determination unit that determines whether the target pixel is a white defect pixel based on a comparison result in the comparison unit, wherein the determination unit outputs the target pixel from the target pixel by the comparison unit.
  • An endoscope that determines pixels It is connected to the serial endoscope, having a signal processing apparatus for performing signal processing on the imaging signal output from the imaging element.
  • FIG. 1 is a configuration diagram illustrating a configuration of an endoscope system according to an embodiment of the present invention.
  • FIG. 2 is a block diagram illustrating a detailed configuration of the endoscope.
  • FIG. 3 is a diagram illustrating a positional relationship between a target pixel and surrounding pixels among a plurality of pixels of an image sensor. It is a flowchart for demonstrating an example of the flow of the detection processing of a white defect pixel.
  • FIG. 1 is a configuration diagram showing a configuration of an endoscope system according to an embodiment of the present invention.
  • an endoscope system 1 according to the present embodiment mainly includes an endoscope 2, a processor 3, and a monitor 4.
  • the endoscope 2 of the present embodiment has a configuration that can be introduced into a subject such as a human body and optically images a predetermined observation site in the subject.
  • the subject into which the endoscope 2 is introduced is not limited to a human body, but may be another living body, or may be an artificial object such as a machine or a building.
  • the image signal captured by the endoscope 2 is transmitted to the processor 3.
  • the processor 3 is configured to be connected to the endoscope 2, receives an imaging signal from the endoscope 2, performs predetermined signal processing on the received imaging signal, and observes the endoscope 2 on the monitor 4. Display an image.
  • the endoscope 2 includes an image sensor 10 including a plurality of pixels that are arranged in a two-dimensional matrix, receive light from outside, and generate and output an image signal according to an amount of received light.
  • the processor 3 as a signal processing device receives the imaging signal transmitted from the endoscope 2, performs predetermined signal processing on the imaging signal received by the receiving circuit 13, and outputs the signal to the monitor 4.
  • An output signal processing circuit 14 is provided. Thereby, the processor 3 can display the optical image (endoscope image) captured by the imaging device 10 of the endoscope 2 on the monitor 4 as an image.
  • FIG. 2 is a block diagram illustrating a detailed configuration of the endoscope
  • FIG. 3 is a diagram illustrating a positional relationship between a target pixel and surrounding pixels among a plurality of pixels of the image sensor.
  • the defect correction circuit 11 includes a comparison unit 20, a determination unit 21, a storage control unit 22, a storage unit 23, and a defect correction unit 24.
  • a predetermined pixel among a plurality of pixels of the image sensor 10 is a target pixel 10A, and eight pixels around the target pixel 10A are peripheral pixels 10B.
  • eight pixels around the target pixel 10A are set as the peripheral pixels 10B.
  • the peripheral pixels 10B are not limited to the eight pixels around the target pixel 10A.
  • the surrounding pixels 10B may be optimized according to the type.
  • a pixel arranged in the vicinity of the target pixel 10A and having the same color as the target pixel 10A is defined as a peripheral pixel 10B.
  • the comparing unit 20 determines whether the output value of the imaging signal output from the target pixel 10A and the surrounding pixels 10B disposed around the target pixel 10A among the plurality of pixels of the image sensor 10 exceeds a predetermined threshold. judge.
  • This predetermined threshold is a value for detecting whether or not the target pixel 10A and the surrounding pixels 10B have reached the saturation level.
  • RGB filters in the Bayer array are arranged in front of each pixel of the image sensor 10, different values may be set for the predetermined threshold for each color of the target pixel 10A and each color of the surrounding pixels 10B.
  • the determination unit 21 determines whether the target pixel 10A is a white defect pixel based on the comparison result of the comparison unit 20. More specifically, the determination unit 21 determines that the output value of the imaging signal output from the pixel of interest 10A exceeds the predetermined threshold by the comparison unit 20, and determines whether the imaging signal output from the surrounding pixels 10B When it is determined that the output value is equal to or less than the predetermined threshold, the target pixel 10A is determined to be a white pixel.
  • the determination unit 21 determines that the output value of the imaging signal output from the pixel of interest 10A exceeds the predetermined threshold by the comparison unit 20, and determines the output value of the imaging signal output from at least one of the surrounding pixels 10B. When it is determined that the output value exceeds the predetermined threshold, it is determined that the target pixel 10A is not a white pixel. When the output value of the imaging signal output from the target pixel 10A is equal to or smaller than a predetermined threshold, the determination unit 21 determines that the target pixel 10A is not a white defect pixel.
  • the frequency of occurrence of the white spot pixel at the saturation level is low, so that if the target pixel 10A is a white spot pixel at the saturation level, a white spot pixel at the saturation level may occur adjacent to the surrounding pixel 10B. Poor. Therefore, when the target pixel 10A has reached the saturation level and all the surrounding pixels 10B have not reached the saturation level, the determination unit 21 determines that the target pixel 10A is a white defect pixel.
  • the determination unit 21 determines that the pixel has reached the saturation level due to the high-luminance subject. It is determined that the target pixel 10A is not a white defect pixel.
  • the target pixel 10A even when the target pixel 10A has reached the saturation level, if there is a pixel that has reached the saturation level around the target pixel 10A, the target pixel 10A becomes saturated due to a high luminance pixel depending on the subject.
  • the determination unit 21 determines that the pixel has reached the level, and determines that the target pixel 10A is not a white defect pixel.
  • the storage unit 23 as the white defect storage unit stores information on the target pixel 10A determined as a white defect pixel, for example, coordinate information of the target pixel 10A determined as a white defect pixel.
  • the storage control unit 22 as a white defect storage control unit adds information of the target pixel to the storage unit 23 based on the determination result of the determination unit 21 and the information of the target pixel stored in the storage unit 23, and Control is performed to delete the information of the target pixel from the storage unit 23.
  • the storage control unit 22 determines that the target pixel 10A is a white defect pixel when the determination unit 21 determines that the target pixel 10A is a white defect pixel and the information of the target pixel 10A is not stored in the storage unit 23.
  • the information of the noticed pixel 10A is additionally stored in the storage unit 23.
  • the storage control unit 22 determines that the target pixel 10A is a white defect pixel by the determination unit 21, and the number of target pixels stored in the storage unit 23 is equal to or less than a predetermined number and the storage unit 23 stores the target pixel 10A. If not, the target pixel 10 ⁇ / b> A is additionally stored in the storage unit 23.
  • the storage control unit 22 determines that the determination unit 21 determines that the target pixel 10A is not a white defect pixel, and that the storage unit 23 stores information of the target pixel 10A that is determined not to be a white defect pixel. Then, the information of the target pixel 10 ⁇ / b> A determined to be not a white defect pixel is deleted from the storage unit 23.
  • the defect correction unit 24 corrects a pixel related to a white defect pixel (defective pixel) of the imaging signal based on the information on the white defect pixel stored in the storage unit 23 and outputs the pixel to the transmission circuit 12.
  • FIG. 4 is a flowchart illustrating an example of the flow of the white pixel detection process.
  • the comparison unit 20 compares the output values of the imaging signals of the target pixel 10A and the surrounding pixels 10B with a predetermined threshold (S1).
  • the determination unit 21 determines whether the target pixel 10A is a white defect pixel based on the comparison result by the comparison unit 20 (S2).
  • the determination unit 21 determines that the target pixel 10A is a white defect pixel when the output value of the target pixel 10A exceeds the predetermined threshold value and the output value of the surrounding pixel 10B is equal to or less than the predetermined threshold value. It is determined that the target pixel 10A is not a white defect pixel.
  • the storage control unit 22 stores the information of the target pixel 10A determined as the white defect pixel in the storage unit 23. It is determined whether or not there is (S3).
  • the storage control unit 22 determines whether the pixel of interest is stored in the storage unit 23. It is determined whether the number is equal to or more than a predetermined number (S4).
  • the processing ends. That is, when the information of the white defect pixel corresponding to the storage capacity of the storage unit 23 is stored, the storage control unit 22 ends the process without storing the information in the storage unit 23.
  • the storage control unit 22 stores information of the target pixel 10A determined to be a white pixel.
  • the information is additionally stored in the unit 23 (S5), and the process ends.
  • the storage control unit 22 stores information on the target pixel 10A determined to be not a white defect pixel in the storage unit 23. It is determined whether or not it has been performed (S6).
  • the storage control unit 22 determines that the high-luminance subject has erroneously determined the white defect pixel before. Then, the information of the target pixel 10 ⁇ / b> A determined to be not the white defect pixel is released from the storage unit 23.
  • the white pixel is determined by comparing the target pixel 10A and the surrounding pixels 10B with the predetermined thresholds.
  • the endoscope 2 can detect a high-brightness white flaw only by comparing the target pixel 10A and the surrounding pixels 10B with a predetermined threshold value, so that the high-brightness white flaw can be detected by a small-scale circuit.
  • the comparing unit 20 determines whether or not the output values of the imaging signals output from the target pixel 10A and the surrounding pixels 10B exceed a predetermined threshold, but is not limited thereto. is not. For example, the comparison unit 20 determines whether or not the output value of the imaging signal output from the target pixel 10A exceeds a first threshold, and determines whether the output value of the imaging signal output from the surrounding pixel 10B is the second value. It is determined whether or not the threshold is exceeded.
  • the target pixel 10A that has reached the saturation level due to the high-luminance subject is erroneously determined as a white pixel.
  • the comparison unit 20 determines whether or not the output value of the imaging signal output from the target pixel 10A exceeds the first threshold, and outputs the output of the imaging signal output from the surrounding pixels 10B. It is determined whether the value exceeds the second threshold.
  • the first threshold value is a value for detecting whether or not the target pixel 10A has reached the saturation level.
  • the second threshold is a value smaller than the first threshold, for example, a value for detecting whether the surrounding pixel 10B has reached 80% to 90% of the saturation level.
  • the determination unit 21 determines that the output value of the imaging signal output from the target pixel 10A by the comparison unit 20 exceeds the first threshold, and that the output value of the imaging signal output from the surrounding pixel 10B Is determined to be equal to or less than the second threshold, the target pixel 10A is determined to be a white defect pixel.
  • the determination unit 21 determines that the output value of the imaging signal output from the target pixel 10A by the comparison unit 20 exceeds the first threshold value, and that the imaging unit output from at least one of the surrounding pixels 10B. When it is determined that the output value of the signal exceeds the second threshold, it is determined that the target pixel 10A is not a white defect pixel.
  • Each step in the flowchart in this specification may be executed in a different order, and may be executed at the same time, or may be executed in a different order for each execution, as long as it does not violate its nature.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Biomedical Technology (AREA)
  • Optics & Photonics (AREA)
  • Pathology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Biophysics (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Endoscopes (AREA)

Abstract

Endoscope (2) comprenant : un élément de capture d'image (10) équipé d'une pluralité de pixels qui sont agencés sous la forme d'une matrice bidimensionnelle, qui reçoivent de la lumière depuis l'extérieur et qui génèrent et délivrent un signal de capture d'image en fonction de la quantité de lumière reçue ; une unité de comparaison (20) qui effectue une comparaison de façon à déterminer si les valeurs de sortie des signaux de capture d'image délivrés par un pixel cible (10A) et des pixels périphériques (10B) disposés autour du pixel cible (10A), au sein de la pluralité de pixels, dépassent ou pas une valeur seuil prédéterminée ; et une unité d'évaluation (21) qui, sur la base du résultat de comparaison de l'unité de comparaison (20), détermine si le pixel cible (10A) est ou pas un pixel blanc défectueux. Lorsque l'unité de comparaison (20) détermine que la valeur de sortie du signal de capture d'image délivré par le pixel cible (10A) dépasse la valeur seuil prédéterminée et que les valeurs de sortie des signaux de capture d'image délivrés par les pixels périphériques (10B) ne sont pas supérieures à la valeur seuil prédéterminée, l'unité d'évaluation (21) détermine que le pixel cible (10A) est un pixel blanc défectueux.
PCT/JP2018/037068 2018-10-03 2018-10-03 Endoscope et système endoscopique WO2020070832A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2018/037068 WO2020070832A1 (fr) 2018-10-03 2018-10-03 Endoscope et système endoscopique

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2018/037068 WO2020070832A1 (fr) 2018-10-03 2018-10-03 Endoscope et système endoscopique

Publications (1)

Publication Number Publication Date
WO2020070832A1 true WO2020070832A1 (fr) 2020-04-09

Family

ID=70055186

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/037068 WO2020070832A1 (fr) 2018-10-03 2018-10-03 Endoscope et système endoscopique

Country Status (1)

Country Link
WO (1) WO2020070832A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004241600A (ja) * 2003-02-06 2004-08-26 Sony Corp 欠陥検出回路及び欠陥検出方法
JP2005167885A (ja) * 2003-12-05 2005-06-23 Pentax Corp 欠陥画素検出装置、欠陥画素検出方法、及び欠陥画素検出プログラム
JP2006026234A (ja) * 2004-07-20 2006-02-02 Olympus Corp 生体内撮像装置および生体内撮像システム
WO2006101128A1 (fr) * 2005-03-22 2006-09-28 Olympus Corporation Dispositif de traitement d’image et endoscope

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004241600A (ja) * 2003-02-06 2004-08-26 Sony Corp 欠陥検出回路及び欠陥検出方法
JP2005167885A (ja) * 2003-12-05 2005-06-23 Pentax Corp 欠陥画素検出装置、欠陥画素検出方法、及び欠陥画素検出プログラム
JP2006026234A (ja) * 2004-07-20 2006-02-02 Olympus Corp 生体内撮像装置および生体内撮像システム
WO2006101128A1 (fr) * 2005-03-22 2006-09-28 Olympus Corporation Dispositif de traitement d’image et endoscope

Similar Documents

Publication Publication Date Title
CN102429627B (zh) 内窥镜系统
US8682068B2 (en) Image processing apparatus, image processing method, and program
JP5541718B2 (ja) 撮像装置及びその欠陥画素検出方法
JP5123443B2 (ja) 信号処理装置及び静止画生成方法
US8648941B2 (en) Image processor, method of controlling the same, and storage medium
JP5963990B2 (ja) 医療用システム、その画像処理設定方法、及び画像処理装置
JPH07111978A (ja) 内視鏡用画像処理装置
JP5847017B2 (ja) 電子内視鏡装置及びその作動方法
JP5615155B2 (ja) 画像処理装置及び方法
WO2013154105A1 (fr) Dispositif imageur
US9900533B2 (en) Image processing apparatus and method, and image capturing apparatus
JP2008148835A (ja) 画像信号伝送システム、電子内視鏡、内視鏡プロセッサ
JP5581237B2 (ja) 画像処理装置、電子内視鏡用プロセッサ装置、画像処理装置の作動方法および画像処理用コンピュータプログラム
CN106793929B (zh) 摄像装置以及电子内窥镜系统
WO2020070832A1 (fr) Endoscope et système endoscopique
JP2010130289A (ja) 固体撮像装置、半導体集積回路および欠陥画素補正方法
WO2022126516A1 (fr) Système et procédé de réduction adaptative de bruit d'image
US10694080B2 (en) Endoscope system
US10531026B2 (en) Endoscope system
JP2009105872A (ja) 欠陥画素補正回路及び固体撮像装置
JP2009232200A (ja) 撮像素子の画素欠陥補正方法
JPH04241832A (ja) 電子内視鏡装置
JP4272975B2 (ja) 欠陥画素検出装置、欠陥画素検出方法、及び欠陥画素検出プログラム
JP2008283620A (ja) 固体撮像装置
JP5927371B1 (ja) 内視鏡

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18936129

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18936129

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP