JP7205013B1 - 特徴量出力モデル生成システム、特徴量出力モデル生成方法、特徴量出力モデル生成プログラム及び特徴量出力モデル - Google Patents

特徴量出力モデル生成システム、特徴量出力モデル生成方法、特徴量出力モデル生成プログラム及び特徴量出力モデル Download PDF

Info

Publication number
JP7205013B1
JP7205013B1 JP2022564617A JP2022564617A JP7205013B1 JP 7205013 B1 JP7205013 B1 JP 7205013B1 JP 2022564617 A JP2022564617 A JP 2022564617A JP 2022564617 A JP2022564617 A JP 2022564617A JP 7205013 B1 JP7205013 B1 JP 7205013B1
Authority
JP
Japan
Prior art keywords
learning
feature
image
output model
focus position
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022564617A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2023002678A1 (https=
Inventor
朱里 伊藤
智親 竹嶋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hamamatsu Photonics KK
Original Assignee
Hamamatsu Photonics KK
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hamamatsu Photonics KK filed Critical Hamamatsu Photonics KK
Priority claimed from PCT/JP2022/010685 external-priority patent/WO2023002678A1/ja
Priority to JP2022211786A priority Critical patent/JP7824871B2/ja
Application granted granted Critical
Publication of JP7205013B1 publication Critical patent/JP7205013B1/ja
Publication of JPWO2023002678A1 publication Critical patent/JPWO2023002678A1/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/778—Active pattern-learning, e.g. online learning of image or video features
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B15/00—Special procedures for taking photographs; Apparatus therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/751—Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/774—Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H04N23/675—Focus control based on electronic image sensor signals comprising setting of focusing regions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10056—Microscopic image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30108—Industrial image inspection
    • G06T2207/30148—Semiconductor; IC; Wafer

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • Image Analysis (AREA)
  • Automatic Focus Adjustment (AREA)
  • Studio Devices (AREA)
  • Focusing (AREA)
  • Closed-Circuit Television Systems (AREA)
JP2022564617A 2021-07-19 2022-03-10 特徴量出力モデル生成システム、特徴量出力モデル生成方法、特徴量出力モデル生成プログラム及び特徴量出力モデル Active JP7205013B1 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2022211786A JP7824871B2 (ja) 2021-07-19 2022-12-28 焦点位置推定モデル生成システム、焦点位置推定モデル生成方法、焦点位置推定モデル生成プログラム及び焦点位置推定モデル

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2021118886 2021-07-19
JP2021118886 2021-07-19
PCT/JP2022/010685 WO2023002678A1 (ja) 2021-07-19 2022-03-10 特徴量出力モデル生成システム、特徴量出力モデル生成方法、特徴量出力モデル生成プログラム及び特徴量出力モデル

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2022211786A Division JP7824871B2 (ja) 2021-07-19 2022-12-28 焦点位置推定モデル生成システム、焦点位置推定モデル生成方法、焦点位置推定モデル生成プログラム及び焦点位置推定モデル

Publications (2)

Publication Number Publication Date
JP7205013B1 true JP7205013B1 (ja) 2023-01-16
JPWO2023002678A1 JPWO2023002678A1 (https=) 2023-01-26

Family

ID=84901072

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2022564617A Active JP7205013B1 (ja) 2021-07-19 2022-03-10 特徴量出力モデル生成システム、特徴量出力モデル生成方法、特徴量出力モデル生成プログラム及び特徴量出力モデル
JP2022211786A Active JP7824871B2 (ja) 2021-07-19 2022-12-28 焦点位置推定モデル生成システム、焦点位置推定モデル生成方法、焦点位置推定モデル生成プログラム及び焦点位置推定モデル

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2022211786A Active JP7824871B2 (ja) 2021-07-19 2022-12-28 焦点位置推定モデル生成システム、焦点位置推定モデル生成方法、焦点位置推定モデル生成プログラム及び焦点位置推定モデル

Country Status (5)

Country Link
US (1) US20240290080A1 (https=)
EP (1) EP4336461A4 (https=)
JP (2) JP7205013B1 (https=)
KR (1) KR20240034690A (https=)
CN (1) CN117677988A (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4408007A1 (en) * 2023-01-24 2024-07-31 Hamamatsu Photonics K. K. Focal position estimation method, focal position estimation program, focal position estimation system, model generation method, model generation program, model generation system, and focal position estimation model

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20240147065A1 (en) * 2022-10-31 2024-05-02 Samsung Electronics Co., Ltd. Method and apparatus with autofocus

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019181053A1 (ja) * 2018-03-22 2019-09-26 富士フイルム株式会社 デフォーカス量測定装置、方法およびプログラム、並びに判別器
JP2020160966A (ja) * 2019-03-27 2020-10-01 株式会社日立製作所 画像認識システムおよび画像認識方法
JP2021056678A (ja) * 2019-09-27 2021-04-08 キヤノン株式会社 画像処理方法、プログラム、画像処理装置、学習済みモデルの製造方法、および、画像処理システム

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1986046B1 (en) * 2007-03-08 2014-07-16 Cellavision AB A method for determining an in-focus position and a vision inspection system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019181053A1 (ja) * 2018-03-22 2019-09-26 富士フイルム株式会社 デフォーカス量測定装置、方法およびプログラム、並びに判別器
JP2020160966A (ja) * 2019-03-27 2020-10-01 株式会社日立製作所 画像認識システムおよび画像認識方法
JP2021056678A (ja) * 2019-09-27 2021-04-08 キヤノン株式会社 画像処理方法、プログラム、画像処理装置、学習済みモデルの製造方法、および、画像処理システム

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4408007A1 (en) * 2023-01-24 2024-07-31 Hamamatsu Photonics K. K. Focal position estimation method, focal position estimation program, focal position estimation system, model generation method, model generation program, model generation system, and focal position estimation model

Also Published As

Publication number Publication date
EP4336461A1 (en) 2024-03-13
CN117677988A (zh) 2024-03-08
JP2023055694A (ja) 2023-04-18
JP7824871B2 (ja) 2026-03-05
JPWO2023002678A1 (https=) 2023-01-26
US20240290080A1 (en) 2024-08-29
EP4336461A4 (en) 2025-04-30
KR20240034690A (ko) 2024-03-14

Similar Documents

Publication Publication Date Title
TWI774863B (zh) 用於獲得一對準晶粒對晶粒檢測影像之方法，用於半導體晶粒對晶粒檢測影像中之非暫時性電腦可讀儲存媒體，及半導體晶粒對晶粒檢測系統
JP7205013B1 (ja) 特徴量出力モデル生成システム、特徴量出力モデル生成方法、特徴量出力モデル生成プログラム及び特徴量出力モデル
JP2023111948A (ja) 焦点位置推定システム、焦点位置推定方法、焦点位置推定プログラム、半導体検査システム及び生体観察システム
TWI811758B (zh) 用於自動對焦顯微鏡系統之深度學習模組、自動對焦一顯微鏡系統之方法及非暫時性電腦可讀媒體
JP2023536564A (ja) 深層学習を用いた三次元構造の検査または計測
KR101941581B1 (ko) 광학식 거리 측정 장치
CN110121629B (zh) 借助角度选择的照射确定样本对象的布置
US12553816B2 (en) Method for characterising sperm cells
WO2023002678A1 (ja) 特徴量出力モデル生成システム、特徴量出力モデル生成方法、特徴量出力モデル生成プログラム及び特徴量出力モデル
JP7229439B1 (ja) 傾斜推定システム、傾斜推定方法、傾斜推定プログラム、半導体検査システム及び生体観察システム
KR102898288B1 (ko) 검사 장치 및 검사 방법
CN115953641B (zh) 半导体样本的缺陷检查
KR102129069B1 (ko) 스캐닝 홀로그램 기반 자동광학검사 장치 및 방법
US10475198B2 (en) Microscope system and specimen observation method
US20240257490A1 (en) Focal position estimation method, focal position estimation system, model generation method, model generation system, focal position estimation model, and non-transitory computer-readable storage medium
JP2015222311A (ja) オートフォーカス装置および顕微鏡システム
JP2013088570A (ja) 顕微鏡装置
KR102357212B1 (ko) 랜덤 포레스트 기반의 오토포커싱 장치 및 방법
US20250146949A1 (en) Machine vision system utilizing autofocus and inspection processes
CN118511103A (zh) 显微镜、图像处理装置、图像处理方法以及图像处理程序
JP2015225015A (ja) 欠陥判定装置及び欠陥判定方法
JP2019179097A (ja) 焦点方法及び焦点機構、焦点操作プログラム、並びに光学顕微鏡

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20221024

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20221024

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20221115

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20221124

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20221129

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20221228

R150 Certificate of patent or registration of utility model

Ref document number: 7205013

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250