WO2023053705A1 - 点検支援装置、点検支援方法、及びプログラム - Google Patents

点検支援装置、点検支援方法、及びプログラム Download PDF

Info

Publication number
WO2023053705A1
WO2023053705A1 PCT/JP2022/029312 JP2022029312W WO2023053705A1 WO 2023053705 A1 WO2023053705 A1 WO 2023053705A1 JP 2022029312 W JP2022029312 W JP 2022029312W WO 2023053705 A1 WO2023053705 A1 WO 2023053705A1
Authority
WO
WIPO (PCT)
Prior art keywords
damage
information
diagram
processor
inspection support
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2022/029312
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
修平 堀田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujifilm Corp
Original Assignee
Fujifilm Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujifilm Corp filed Critical Fujifilm Corp
Priority to JP2023550417A priority Critical patent/JPWO2023053705A1/ja
Publication of WO2023053705A1 publication Critical patent/WO2023053705A1/ja
Priority to US18/606,782 priority patent/US20240219312A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84—Systems specially adapted for particular applications
    • G01N21/88—Investigating the presence of flaws or contamination
    • G01N21/8851—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/08—Construction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—Two-dimensional [2D] image generation
    • G06T11/20—Drawing from basic elements
    • G06T11/23—Drawing from basic elements using straight lines or curves
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0004—Industrial image inspection
    • G06T7/001—Industrial image inspection using an image reference approach
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/759—Region-based matching
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/86—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using syntactic or structural representations of the image or video pattern, e.g. symbolic string recognition; using graph matching
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning

Definitions

  • the processor associates the damage graphic with the character string.
  • the processor In the inspection support method for assisting creation of a damage diagram of a structure by a processor according to the twelfth aspect, the processor generates a structural diagram of the target structure on the medium and an image of information including damage information added on the medium by the user. acquiring data; recognizing damage information from the acquired image data; acquiring drawing data corresponding to the structural drawing; aligning the structural drawing of the image data with the drawing data; drawing the damage information as a damage figure at the corresponding position of the drawing data to create a damage figure.
  • the processor stores the structural diagram of the target structure on the medium and the damage information added by the user on the medium.
  • acquiring image data of information including; recognizing damage information from the acquired image data; acquiring drawing data corresponding to the structural drawing; and aligning the structural drawing of the image data with the drawing data. and drawing the damage information as a damage figure at the corresponding position of the drawing data to create a damage figure.
  • a CPU (processor) 20 reads out various programs including a structure inspection support program of the embodiment stored in the storage unit 16 or ROM 24 or the like, develops them in the RAM 22, and performs calculations, thereby performing integrated control of each unit. do. Further, the CPU 20 reads programs stored in the storage unit 16 or the ROM 24 , performs calculations using the RAM 22 , and performs various processes of the structure inspection support apparatus 10 .
  • the display device 30 is, for example, a device such as a liquid crystal display, and can display various information.
  • the inspection support method includes a step of acquiring image data including a structural diagram and damage information (step S1), a step of recognizing damage information from the image data (step S2), and acquiring drawing data. (step S3), aligning the structural diagram and the drawing data (step S4), and drawing the damage figure on the drawing data to create the damage diagram (step S5).
  • damage information 60D, 60E, and 60F indicating the state of regional damage includes patterns (see FIG. 11).
  • Damage information 60D includes a pattern corresponding to "float”
  • damage information 60E includes a pattern corresponding to "free lime”
  • damage information 60F includes a pattern corresponding to "stripping”.
  • 1200A in FIG. 12 is the seventh example, and 1200B is the eighth example.
  • the inspection memo 48 includes the structural drawing 42 and the damage information 60 added by the user U, the photographed image identification information 61, the association information 62, and the additional attribute information 65.
  • the acquired image data 80 of the inspection memo 48 is displayed on the display device 30, for example.
  • the image data acquisition unit 51 acquires the field notebook 40A from the electronic medium 46 as the image data 80.
  • step S2 for the damage information 60 added by the user U, a line drawing and a sketch line representing the position, shape, or attributes (damage type, size, degree of damage, etc.) of the damage in the damage information 60 are obtained by image recognition. Recognize the area.
  • ) is recognized as a character
  • the number “0.15 (0.8)” related to the size is recognized as a character from the additional attribute information 67D
  • the number “0.15 (0.8)” related to the size is recognized from the additional attribute information 67E as a character. )” are recognized as characters.
  • it is predetermined for crack damage that the first number indicates the width (mm) and the number in brackets indicates the length (m).
  • the damage information recognition unit 53 associates the additional attribute information 65 closest to the damage information 60 as the additional attribute information 65 corresponding to the damage information 60.
  • the user can predetermine conditions for associating the damage information 60 and the additional attribute information 65, and can cause the damage information recognition unit 53 to perform processing based on the conditions.
  • the photographed image 103 is obtained from the photographed image identification information 61, and the complementary information for complementing the damage information 60 is obtained from the photographed image 103. preferably.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Analytical Chemistry (AREA)
  • Signal Processing (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Quality & Reliability (AREA)
  • Biochemistry (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Business, Economics & Management (AREA)
  • Economics (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
PCT/JP2022/029312 2021-09-30 2022-07-29 点検支援装置、点検支援方法、及びプログラム Ceased WO2023053705A1 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2023550417A JPWO2023053705A1 (https=) 2021-09-30 2022-07-29
US18/606,782 US20240219312A1 (en) 2021-09-30 2024-03-15 Inspection support device, inspection support method, and program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2021-161060 2021-09-30
JP2021161060 2021-09-30

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/606,782 Continuation US20240219312A1 (en) 2021-09-30 2024-03-15 Inspection support device, inspection support method, and program

Publications (1)

Publication Number Publication Date
WO2023053705A1 true WO2023053705A1 (ja) 2023-04-06

Family

ID=85782263

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/029312 Ceased WO2023053705A1 (ja) 2021-09-30 2022-07-29 点検支援装置、点検支援方法、及びプログラム

Country Status (3)

Country Link
US (1) US20240219312A1 (https=)
JP (1) JPWO2023053705A1 (https=)
WO (1) WO2023053705A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN120008619A (zh) * 2025-04-18 2025-05-16 浙江省机电设计研究院有限公司 一种移动机器人巡检方法、电子设备、存储介质及产品

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7510512B2 (ja) * 2020-09-29 2024-07-03 富士フイルム株式会社 損傷情報処理装置、損傷情報処理方法、及びプログラム

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019175015A (ja) * 2018-03-27 2019-10-10 株式会社竹中工務店 被災情報処理装置、及び被災情報処理モデル学習装置
JP2020160056A (ja) * 2019-03-22 2020-10-01 株式会社安藤・間 移動式ひび割れ検出装置、及びひび割れ検出方法
JP2021101190A (ja) * 2015-12-25 2021-07-08 富士フイルム株式会社 損傷情報処理装置、損傷情報処理方法、及び損傷情報処理プログラム

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115956257A (zh) * 2020-07-29 2023-04-11 富士通株式会社 检查程序、信息处理装置以及检查方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2021101190A (ja) * 2015-12-25 2021-07-08 富士フイルム株式会社 損傷情報処理装置、損傷情報処理方法、及び損傷情報処理プログラム
JP2019175015A (ja) * 2018-03-27 2019-10-10 株式会社竹中工務店 被災情報処理装置、及び被災情報処理モデル学習装置
JP2020160056A (ja) * 2019-03-22 2020-10-01 株式会社安藤・間 移動式ひび割れ検出装置、及びひび割れ検出方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN120008619A (zh) * 2025-04-18 2025-05-16 浙江省机电设计研究院有限公司 一种移动机器人巡检方法、电子设备、存储介质及产品
CN120008619B (zh) * 2025-04-18 2025-07-15 浙江省机电设计研究院有限公司 一种移动机器人巡检方法、电子设备、存储介质及产品

Also Published As

Publication number Publication date
US20240219312A1 (en) 2024-07-04
JPWO2023053705A1 (https=) 2023-04-06

Similar Documents

Publication Publication Date Title
Adhikari et al. Image-based retrieval of concrete crack properties for bridge inspection
CN115315625A (zh) 检修辅助装置、方法及程序
US12449373B2 (en) Inspection support device, inspection support method, and program
JP2006132973A (ja) コンクリート構造物のクラック検査装置及びクラック検査方法
US11959862B2 (en) Damage figure creation supporting apparatus, damage figure creation supporting method, damage figure creation supporting program, and damage figure creation supporting system
US20240219312A1 (en) Inspection support device, inspection support method, and program
EP4148663A1 (en) Damage evaluating device, method, and program
JP7686381B2 (ja) 情報処理装置、情報処理方法及びプログラム
JP7752625B2 (ja) 構造物の点検支援装置、構造物の点検支援方法、及びプログラム
Huang et al. Deep learning without human labeling for on-site rebar instance segmentation using synthetic BIM data and domain adaptation
Puri et al. Toward automated dimensional quality control of precast concrete elements using design BIM
US20260011087A1 (en) Three-dimensional display device, three-dimensional display method, and three-dimensional display program
JP7842833B2 (ja) 画像処理装置、画像処理装置の制御方法、及びプログラム
JP7479528B2 (ja) 画像処理装置、画像処理方法及びプログラム
JP2025068449A (ja) 情報処理装置、情報処理方法及びプログラム
JP6389120B2 (ja) データ処理装置、データ処理方法、及び、プログラム
CN116250019A (zh) 损伤信息处理装置、损伤信息处理方法及程序
WO2020116279A1 (ja) 構造物の点検支援装置及び方法
Loverdos et al. Developing Three Dimensional Geometrical Digital-Twins for Masonry Arch Bridges Using Deep Learning
Shu et al. Automated layered personification methodology of structural drawings with embedded design information
JP2024156382A (ja) 情報処理装置、情報処理方法およびプログラム
WO2023203965A1 (ja) 情報処理装置、情報処理方法及びプログラム
JP2025005234A (ja) 画像解析装置、画像解析装置の制御方法及びプログラム
KR20230085372A (ko) 스캐너를 이용한 건축구조물 외관조사망도의 입력 자동화 시스템 및 그 방법
JP2025091582A (ja) 情報処理装置、情報処理方法、及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22875582

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023550417

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22875582

Country of ref document: EP

Kind code of ref document: A1