JPWO2020194111A5 - - Google Patents

Download PDF

Info

Publication number
JPWO2020194111A5
JPWO2020194111A5 JP2021555530A JP2021555530A JPWO2020194111A5 JP WO2020194111 A5 JPWO2020194111 A5 JP WO2020194111A5 JP 2021555530 A JP2021555530 A JP 2021555530A JP 2021555530 A JP2021555530 A JP 2021555530A JP WO2020194111 A5 JPWO2020194111 A5 JP WO2020194111A5
Authority
JP
Japan
Prior art keywords
region
interest
layers
specifying
coordinate
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2021555530A
Other languages
Japanese (ja)
Other versions
JP2022524878A (en
JP7350878B2 (en
Publication date
Priority claimed from US16/367,365 external-priority patent/US11074479B2/en
Application filed filed Critical
Publication of JP2022524878A publication Critical patent/JP2022524878A/en
Publication of JPWO2020194111A5 publication Critical patent/JPWO2020194111A5/ja
Application granted granted Critical
Publication of JP7350878B2 publication Critical patent/JP7350878B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Claims (15)

コンピュータの情報処理により画像を解析する方法であって、前記方法が、
入力画像を取得することと、
前記入力画像内の対象領域を指定する注釈付き画像を取得することと、
前記入力画像を、ターゲット領域を表示する出力画像を前記入力画像から生成する検出モデルに入力することと、
前記対象領域外の誤差よりも重く、前記対象領域内の誤差に重み付けする損失関数を使用して、前記出力画像と前記注釈付き画像の間の誤差を計算することと、
前記誤差を減らすように前記検出モデルを更新することを含む、方法
A method for analyzing an image by computer information processing, the method comprising:
obtaining an input image;
obtaining an annotated image specifying regions of interest in the input image;
inputting the input image into a detection model that generates from the input image an output image displaying a target region;
calculating the error between the output image and the annotated image using a loss function that weights errors within the region of interest more heavily than errors outside the region of interest;
A method comprising updating the detection model to reduce the error.
重み付き交差エントロピーが前記損失関数として使用される、請求項1に記載の方法2. The method of claim 1, wherein weighted cross-entropy is used as the loss function. 前記ターゲット領域内の前記重み付き交差エントロピーの重みが、前記ターゲット領域外の重みよりも大きい値を有するように設定される、請求項2に記載の方法3. The method of claim 2, wherein the weighted cross-entropy weights within the target region are set to have larger values than the weights outside the target region. 前記対象領域内の前記重み付き交差エントロピーの重みが、前記対象領域外の重みよりも大きい値を有するように設定される、請求項23の何れか1項に記載の方法A method according to any one of claims 2 to 3, wherein the weighted cross-entropy weights within the region of interest are set to have a greater value than the weights outside the region of interest. 前記重み付き交差エントロピーが、
式1:
Figure 2020194111000001
によって示され、Xが前記入力画像内のすべてのピクセルiの集合であり、Cがすべてのクラスcの集合であり、Wcが前記クラスcの重みであり、picが前記注釈付き画像内の前記ピクセルiでの前記クラスcの値であり、qicが前記出力画像内の前記ピクセルiでの前記クラスcの前記値である、請求項24の何れか1項に記載の方法
The weighted cross-entropy is
Formula 1:
Figure 2020194111000001
where X is the set of all pixels i in the input image, C is the set of all classes c, Wc is the weight of the class c, and pic is the A method according to any one of claims 2 to 4, wherein q is the value of said class c at pixel i and qic is said value of said class c at said pixel i in said output image.
前記検出モデルが、入力と出力の間に、1つまたは複数の畳み込み層、1つまたは複数のプーリング層、1つまたは複数の逆畳み込み層、および1つまたは複数のバッチ正規化層を含む、請求項15の何れか1項に記載の方法the detection model comprises one or more convolutional layers, one or more pooling layers, one or more deconvolution layers, and one or more batch normalization layers between input and output; The method according to any one of claims 1-5 . 前記複数のバッチ正規化層が、前記複数の畳み込み層および前記複数のプーリング層の一部を含む第1の経路と、その他の前記複数の畳み込み層および前記複数の逆畳み込み層を含む第2の経路とのうちの少なくとも1つに含まれている既定の数の層ごとに、それぞれ配置される、請求項6に記載の方法wherein the plurality of batch normalization layers comprises a first pass including a portion of the plurality of convolution layers and the plurality of pooling layers and a second pass including the other plurality of convolution layers and the plurality of deconvolution layers; 7. The method of claim 6, wherein each is arranged for a predetermined number of layers contained in at least one of the paths. 前記入力画像内の少なくとも1つの座標を取得することと、
前記少なくとも1つの座標に従って前記対象領域を指定することをさらに含む、請求項17の何れか1項に記載の方法
obtaining at least one coordinate within the input image;
A method according to any one of claims 1 to 7, further comprising specifying said region of interest according to said at least one coordinate.
前記少なくとも1つの座標に従って前記対象領域を前記指定することが、前記少なくとも1つの座標を参照として使用して、既定の範囲を前記対象領域として指定することを含む、請求項8に記載の方法9. The method of claim 8, wherein said specifying said region of interest according to said at least one coordinate comprises specifying a predefined extent as said region of interest using said at least one coordinate as a reference. 前記少なくとも1つの座標に従って前記対象領域を前記指定することが、前記少なくとも1つの座標でのテクスチャに類似するテクスチャを有する範囲を前記対象領域として指定することを含む、請求項89の何れかに1項に記載の方法10. Any one of claims 8 to 9, wherein said specifying said target area according to said at least one coordinate comprises specifying, as said target area, a range having a texture similar to the texture at said at least one coordinate. The method according to item 1 . 前記少なくとも1つの座標に従って前記対象領域を前記指定することが、複数の座標のセットによって囲まれた範囲を前記対象領域として指定することを含む、請求項810の何れか1項に記載の方法11. The method according to any one of claims 8 to 10, wherein said specifying said target area according to said at least one coordinate comprises specifying a range enclosed by a set of coordinates as said target area. How . 前記指定された対象領域を表示することと、
前記対象領域が表示されている間に、ユーザ入力を受信し、前記対象領域を変更するとこをさらに含む、請求項811の何れか1項に記載の方法
displaying the specified region of interest;
12. The method of any one of claims 8 to 11, further comprising receiving user input to modify the target area while the target area is displayed.
請求項1~12の何れか1項に記載の方法をコンピュータ・ハードウェアによる手段として構成した装置 Apparatus for implementing the method according to any one of claims 1 to 12 as means by means of computer hardware . 請求項1~12の何れか1項に記載の方法をコンピュータに実行させる、コンピュータ・プログラム A computer program that causes a computer to perform the method according to any one of claims 1 to 12 . 請求項14に記載の前記コンピュータ・プログラムをコンピュータ可読ストレージ媒体に記録した、ストレージ媒体 15. A storage medium having recorded thereon the computer program according to claim 14 .
JP2021555530A 2019-03-28 2020-03-13 Image analysis method, device, program Active JP7350878B2 (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US16/367,365 US11074479B2 (en) 2019-03-28 2019-03-28 Learning of detection model using loss function
US16/367,365 2019-03-28
US16/507,625 2019-07-10
US16/507,625 US11120305B2 (en) 2019-03-28 2019-07-10 Learning of detection model using loss function
PCT/IB2020/052309 WO2020194111A1 (en) 2019-03-28 2020-03-13 Learning of detection model using loss function

Publications (3)

Publication Number Publication Date
JP2022524878A JP2022524878A (en) 2022-05-10
JPWO2020194111A5 true JPWO2020194111A5 (en) 2022-08-12
JP7350878B2 JP7350878B2 (en) 2023-09-26

Family

ID=72603881

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2021555530A Active JP7350878B2 (en) 2019-03-28 2020-03-13 Image analysis method, device, program

Country Status (6)

Country Link
US (2) US11074479B2 (en)
JP (1) JP7350878B2 (en)
CN (1) CN113614780A (en)
DE (1) DE112020000279T5 (en)
GB (1) GB2596751B (en)
WO (1) WO2020194111A1 (en)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11074479B2 (en) 2019-03-28 2021-07-27 International Business Machines Corporation Learning of detection model using loss function
US11592828B2 (en) * 2020-01-16 2023-02-28 Nvidia Corporation Using neural networks to perform fault detection in autonomous driving applications
US11379991B2 (en) * 2020-05-29 2022-07-05 National Technology & Engineering Solutions Of Sandia, Llc Uncertainty-refined image segmentation under domain shift
JP2024501642A (en) * 2020-12-16 2024-01-15 メモリアル スローン-ケタリング キャンサー センター Detecting annotated regions of interest in images
CN113516147B (en) * 2020-12-21 2024-03-05 阿里巴巴集团控股有限公司 Printing error detection method, device, system and storage medium
CN113947598B (en) * 2021-12-20 2022-05-31 宁波昌亚新材料科技股份有限公司 Plastic lunch box defect detection method, device and system based on image processing
CN114187292B (en) * 2022-02-14 2022-05-31 北京阿丘科技有限公司 Abnormality detection method, apparatus, device and storage medium for cotton spinning paper tube
CN115019181B (en) * 2022-07-28 2023-02-07 北京卫星信息工程研究所 Remote sensing image rotating target detection method, electronic equipment and storage medium
CN115063753B (en) * 2022-08-17 2023-05-12 苏州魔视智能科技有限公司 Safety belt wearing detection model training method and safety belt wearing detection method
JP7473765B2 (en) 2022-09-29 2024-04-24 山陽特殊製鋼株式会社 Automatic region identification method for non-metallic inclusions and inclusion discrimination system incorporating the method
CN115861462B (en) * 2022-10-17 2023-11-03 北京百度网讯科技有限公司 Training method and device for image generation model, electronic equipment and storage medium
CN116630812B (en) * 2023-07-21 2023-09-26 四川发展环境科学技术研究院有限公司 Water body feature detection method and system based on visible light image analysis

Family Cites Families (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2978374B2 (en) 1992-08-21 1999-11-15 松下電器産業株式会社 Image processing device, image processing method, and control device for air conditioner
JP3216280B2 (en) 1992-12-11 2001-10-09 松下電器産業株式会社 Control equipment for air conditioners and applied equipment for image processing equipment
JP3264460B2 (en) 1993-04-26 2002-03-11 富士写真フイルム株式会社 Image identification method
JPH07175776A (en) 1993-12-17 1995-07-14 Nec Corp Pattern learning recognition device
DE19544228C1 (en) 1995-11-28 1997-03-06 Man Takraf Foerdertechnik Gmbh Gantry crane running mechanism
JPH1091757A (en) * 1996-09-11 1998-04-10 Ge Yokogawa Medical Syst Ltd Method for correcting concerned area shape, and medical device
JP2006031440A (en) 2004-07-16 2006-02-02 Konica Minolta Photo Imaging Inc Image processing method, image processing apparatus, image processing program and image processing system
JP4719893B2 (en) 2005-05-02 2011-07-06 国立大学法人佐賀大学 Control device, control method, and program thereof
DE102006013476B4 (en) * 2006-03-23 2012-11-15 Siemens Ag Method for positionally accurate representation of tissue regions of interest
JP5130523B2 (en) 2007-03-01 2013-01-30 国立大学法人東京工業大学 Information processing apparatus, information processing method, and program
JP4493679B2 (en) * 2007-03-29 2010-06-30 富士フイルム株式会社 Target region extraction method, apparatus, and program
US8582854B2 (en) * 2008-09-15 2013-11-12 Siemens Aktiengesellschaft Method and system for automatic coronary artery detection
US8885901B1 (en) * 2013-10-22 2014-11-11 Eyenuk, Inc. Systems and methods for automated enhancement of retinal images
US9569736B1 (en) 2015-09-16 2017-02-14 Siemens Healthcare Gmbh Intelligent medical image landmark detection
US9916522B2 (en) * 2016-03-11 2018-03-13 Kabushiki Kaisha Toshiba Training constrained deconvolutional networks for road scene semantic segmentation
US9972092B2 (en) * 2016-03-31 2018-05-15 Adobe Systems Incorporated Utilizing deep learning for boundary-aware image segmentation
US10032067B2 (en) 2016-05-28 2018-07-24 Samsung Electronics Co., Ltd. System and method for a unified architecture multi-task deep learning machine for object recognition
EP3482346A1 (en) 2016-07-08 2019-05-15 Avent, Inc. System and method for automatic detection, localization, and semantic segmentation of anatomical objects
JP6809869B2 (en) 2016-11-02 2021-01-06 Eizo株式会社 Gauze detection system
US11308350B2 (en) 2016-11-07 2022-04-19 Qualcomm Incorporated Deep cross-correlation learning for object tracking
US10417524B2 (en) * 2017-02-16 2019-09-17 Mitsubishi Electric Research Laboratories, Inc. Deep active learning method for civil infrastructure defect detection
US10580131B2 (en) * 2017-02-23 2020-03-03 Zebra Medical Vision Ltd. Convolutional neural network for segmentation of medical anatomical images
JP2020518915A (en) * 2017-04-27 2020-06-25 パスハラキス スタブロスPASCHALAKIS, Stavros System and method for automated fundus image analysis
JP2018206321A (en) 2017-06-09 2018-12-27 コニカミノルタ株式会社 Image processing device, image processing method and image processing program
CN107301640A (en) 2017-06-19 2017-10-27 太原理工大学 A kind of method that target detection based on convolutional neural networks realizes small pulmonary nodules detection
WO2019002474A1 (en) * 2017-06-28 2019-01-03 Deepmind Technologies Limited Generalizable medical image analysis using segmentation and classification neural networks
US9968257B1 (en) * 2017-07-06 2018-05-15 Halsa Labs, LLC Volumetric quantification of cardiovascular structures from medical imaging
US10891778B2 (en) * 2018-01-10 2021-01-12 The Board Of Trustees Of The University Of Illinois Apparatus and method for producing three-dimensional models from magnetic resonance imaging
CN109035197B (en) 2018-05-31 2021-09-28 东南大学 CT radiography image kidney tumor segmentation method and system based on three-dimensional convolution neural network
US11966838B2 (en) * 2018-06-19 2024-04-23 Nvidia Corporation Behavior-guided path planning in autonomous machine applications
CN109145939B (en) 2018-07-02 2021-11-02 南京师范大学 Semantic segmentation method for small-target sensitive dual-channel convolutional neural network
CN108898188A (en) 2018-07-06 2018-11-27 四川奇迹云科技有限公司 A kind of image data set aid mark system and method
CN109035263B (en) * 2018-08-14 2021-10-15 电子科技大学 Automatic brain tumor image segmentation method based on convolutional neural network
CN109351970A (en) * 2018-11-16 2019-02-19 北京遥感设备研究所 A kind of capillary structure 3D printing manufacturing method
US11068694B2 (en) * 2019-01-23 2021-07-20 Molecular Devices, Llc Image analysis system and method of using the image analysis system
US11074479B2 (en) * 2019-03-28 2021-07-27 International Business Machines Corporation Learning of detection model using loss function

Similar Documents

Publication Publication Date Title
GB2596751A (en) Learning of detection model using loss function
JP7433356B2 (en) Accessing data in multidimensional tensors using adders
CN108830826B (en) System and method for detecting pulmonary nodules
WO2020078269A1 (en) Method and device for three-dimensional image semantic segmentation, terminal and storage medium
JPWO2020194111A5 (en)
CN110929637B (en) Image recognition method and device, electronic equipment and storage medium
JP2020537204A (en) Deep Neural Network Normalization Methods and Devices, Instruments, and Storage Media
CN109685199A (en) The method and apparatus of table of the creation comprising the information about pond type and the test method and test device for using it
JP6824845B2 (en) Image processing systems, equipment, methods and programs
US20190236755A1 (en) Image transformation for machine learning
US20180181406A1 (en) Arithmetic processing device and control method of the arithmetic processing device
JP2017130036A (en) Information processing device, calculation method and calculation program
EP3093757A2 (en) Multi-dimensional sliding window operation for a vector processor
WO2020186385A1 (en) Image processing method, electronic device, and computer-readable storage medium
CN113228061A (en) Electronic device and control method thereof
CN110598717A (en) Image feature extraction method and device and electronic equipment
CN109308516A (en) A kind of method and apparatus of image procossing
JP6643821B2 (en) Image processing device
CN113065593A (en) Model training method and device, computer equipment and storage medium
US20200394787A1 (en) Imaging evaluation map, imaging evaluation map generating device, imaging evaluation map generating method, and imaging evaluation map generating program
US20110052059A1 (en) Generating image histogram by parallel processing
JP2021144461A (en) Learning device and inference device
CN113439909A (en) Three-dimensional size measuring method of object and mobile terminal
WO2023003646A1 (en) Focused computer detection of objects in images
US20200218942A1 (en) Computer and image processing method