EP3979031A4 - Inspection assistance system - Google Patents

Inspection assistance system Download PDF

Info

Publication number
EP3979031A4
EP3979031A4 EP20819473.8A EP20819473A EP3979031A4 EP 3979031 A4 EP3979031 A4 EP 3979031A4 EP 20819473 A EP20819473 A EP 20819473A EP 3979031 A4 EP3979031 A4 EP 3979031A4
Authority
EP
European Patent Office
Prior art keywords
assistance system
inspection assistance
inspection
assistance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP20819473.8A
Other languages
German (de)
French (fr)
Other versions
EP3979031B1 (en
EP3979031A1 (en
Inventor
Fuminori Yamasaki
Takashi Karino
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
IXS Co Ltd
Original Assignee
IXS Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by IXS Co Ltd filed Critical IXS Co Ltd
Publication of EP3979031A1 publication Critical patent/EP3979031A1/en
Publication of EP3979031A4 publication Critical patent/EP3979031A4/en
Application granted granted Critical
Publication of EP3979031B1 publication Critical patent/EP3979031B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/0094—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
    • E—FIXED CONSTRUCTIONS
    • E01—CONSTRUCTION OF ROADS, RAILWAYS, OR BRIDGES
    • E01D—CONSTRUCTION OF BRIDGES, ELEVATED ROADWAYS OR VIADUCTS; ASSEMBLY OF BRIDGES
    • E01D22/00—Methods or apparatus for repairing or strengthening existing bridges ; Methods or apparatus for dismantling bridges
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01M—TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
    • G01M5/00—Investigating the elasticity of structures, e.g. deflection of bridges or air-craft wings
    • G01M5/0033—Investigating the elasticity of structures, e.g. deflection of bridges or air-craft wings by determining damage, crack or wear
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01M—TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
    • G01M5/00—Investigating the elasticity of structures, e.g. deflection of bridges or air-craft wings
    • G01M5/0091—Investigating the elasticity of structures, e.g. deflection of bridges or air-craft wings by using electromagnetic excitation or detection
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84—Systems specially adapted for particular applications
    • G01N21/88—Investigating the presence of flaws or contamination
    • G01N21/8851—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/60—Intended control result
    • G05D1/644—Optimisation of travel parameters, e.g. of energy consumption, journey time or distance
    • G05D1/6445—Optimisation of travel parameters, e.g. of energy consumption, journey time or distance for optimising payload operation, e.g. camera or spray coverage
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53—Querying
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/751—Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84—Systems specially adapted for particular applications
    • G01N21/88—Investigating the presence of flaws or contamination
    • G01N21/8851—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • G01N2021/8887—Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges based on image processing techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Automation & Control Theory (AREA)
  • Databases & Information Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Artificial Intelligence (AREA)
  • Quality & Reliability (AREA)
  • Computing Systems (AREA)
  • Evolutionary Computation (AREA)
  • Structural Engineering (AREA)
  • Civil Engineering (AREA)
  • Architecture (AREA)
  • Electromagnetism (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
  • Image Processing (AREA)
EP20819473.8A 2019-06-03 2020-02-28 Inspection assistance system Active EP3979031B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2019103834A JP6788291B1 (en) 2019-06-03 2019-06-03 Inspection support system
PCT/JP2020/008486 WO2020246085A1 (en) 2019-06-03 2020-02-28 Inspection assistance system

Publications (3)

Publication Number Publication Date
EP3979031A1 EP3979031A1 (en) 2022-04-06
EP3979031A4 true EP3979031A4 (en) 2022-06-29
EP3979031B1 EP3979031B1 (en) 2024-05-29

Family

ID=73452874

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20819473.8A Active EP3979031B1 (en) 2019-06-03 2020-02-28 Inspection assistance system

Country Status (7)

Country Link
US (1) US11869177B2 (en)
EP (1) EP3979031B1 (en)
JP (1) JP6788291B1 (en)
CN (1) CN113994290A (en)
AU (1) AU2020287769B2 (en)
CA (1) CA3142464C (en)
WO (1) WO2020246085A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015004739A1 (en) * 2013-07-10 2015-01-15 株式会社日立製作所 Monitor system, automated patrol robot, and monitor method
JP2015111111A (en) * 2013-10-29 2015-06-18 株式会社イクシスリサーチ Deterioration diagnosis support system, database, database creation device, and deterioration diagnosis support method
JP6365799B2 (en) * 2016-06-17 2018-08-01 三菱電機株式会社 Deformation progress determination device and deformation progress determination method
WO2019073704A1 (en) * 2017-10-11 2019-04-18 株式会社日立システムズ Deterioration diagnosis system using aircraft

Family Cites Families (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE4338850A1 (en) * 1993-11-13 1995-05-18 Dornier Gmbh Device for monitoring the durability of structures
TWI390096B (en) * 2009-08-24 2013-03-21 Nat Applied Res Laboratories Safety Monitoring System and Method of Bridge Structure
JP5626011B2 (en) * 2011-02-25 2014-11-19 富士通株式会社 Program and image processing apparatus
CA2855645C (en) 2011-11-15 2020-06-23 Trispera Dental Inc. Method and system for acquiring data from an individual for preparing a 3d model
JP5862344B2 (en) * 2012-02-10 2016-02-16 富士通株式会社 Image processing apparatus, prior information update method, and program
US8718353B2 (en) * 2012-03-08 2014-05-06 Kla-Tencor Corporation Reticle defect inspection with systematic defect filter
US8983172B2 (en) * 2012-12-28 2015-03-17 Modern Technology Solutions, Inc. Visual inspection apparatus, secure one-way data transfer device and methods therefor
JP6043662B2 (en) * 2013-03-18 2016-12-14 株式会社ニューフレアテクノロジー Inspection method and inspection apparatus
DE102013108485B4 (en) * 2013-08-06 2015-06-25 Khs Gmbh Device and method for error tracking in strip materials
SG2013090378A (en) 2013-11-29 2015-06-29 K One Ind Pte Ltd Flexible vision inspector
US10746900B2 (en) * 2014-11-25 2020-08-18 Cylo Technologies Incorporated System and method for pipeline management
KR101796258B1 (en) * 2015-04-21 2017-11-13 순천대학교 산학협력단 A construction safety inspection method based on vision using small unmanned aerial vehicles
JP6572618B2 (en) 2015-05-08 2019-09-11 富士通株式会社 Information processing device, information processing program, information processing method, terminal device, setting method, setting program
FR3037429B1 (en) * 2015-06-15 2018-09-07 Donecle SYSTEM AND METHOD FOR AUTOMATIC SURFACE INSPECTION
JP2017009379A (en) * 2015-06-19 2017-01-12 株式会社ニューフレアテクノロジー Inspection device and method for inspection
JP6569114B2 (en) * 2015-10-19 2019-09-04 エナジー・ソリューションズ株式会社 Inspection system and inspection method
JP6609463B2 (en) * 2015-11-19 2019-11-20 シャープ株式会社 Self-propelled electronic device
JP6846897B2 (en) 2016-03-24 2021-03-24 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Position indication method, position indicator, self-propelled device and program
CN107229274B (en) 2016-03-24 2022-06-28 松下电器（美国）知识产权公司 Position indication method, terminal device, self-propelled device, and program
JP2017045480A (en) 2016-11-25 2017-03-02 シャープ株式会社 Object search system and object search device
CN206321575U (en) * 2016-11-28 2017-07-11 武汉理工大学 A kind of device of unmanned machine check high building exterior wall crackle
US11416979B2 (en) * 2017-01-18 2022-08-16 Asml Netherlands B.V. Defect displaying method
JP7030431B2 (en) * 2017-06-26 2022-03-07 株式会社東芝 Inspection support system and inspection support control program
CN109254077B (en) * 2017-07-14 2021-04-06 财团法人工业技术研究院 Degradation detection method of structural member
CN109387518B (en) * 2017-08-02 2022-06-17 上海微电子装备（集团）股份有限公司 Automatic optical detection method
US20190114725A1 (en) * 2017-10-13 2019-04-18 Honeywell International Inc. Utility network monitoring with a device and an unmanned aircraft
US10692203B2 (en) * 2018-02-19 2020-06-23 International Business Machines Corporation Measuring defectivity by equipping model-less scatterometry with cognitive machine learning
WO2020041899A1 (en) * 2018-08-30 2020-03-05 Camso Inc. Systems and methods for monitoring vehicles with tires
CN109671119A (en) * 2018-11-07 2019-04-23 中国科学院光电研究院 A kind of indoor orientation method and device based on SLAM
GB2605319B (en) * 2020-01-17 2024-01-31 Landmark Graphics Corp Continuous assessment of well elements using fiber optics

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015004739A1 (en) * 2013-07-10 2015-01-15 株式会社日立製作所 Monitor system, automated patrol robot, and monitor method
JP2015111111A (en) * 2013-10-29 2015-06-18 株式会社イクシスリサーチ Deterioration diagnosis support system, database, database creation device, and deterioration diagnosis support method
JP6365799B2 (en) * 2016-06-17 2018-08-01 三菱電機株式会社 Deformation progress determination device and deformation progress determination method
WO2019073704A1 (en) * 2017-10-11 2019-04-18 株式会社日立システムズ Deterioration diagnosis system using aircraft

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2020246085A1 *

Also Published As

Publication number Publication date
US11869177B2 (en) 2024-01-09
AU2020287769B2 (en) 2023-04-20
EP3979031B1 (en) 2024-05-29
AU2020287769A1 (en) 2021-12-23
JP6788291B1 (en) 2020-11-25
WO2020246085A1 (en) 2020-12-10
CN113994290A (en) 2022-01-28
CA3142464A1 (en) 2020-12-10
TW202045914A (en) 2020-12-16
EP3979031A1 (en) 2022-04-06
US20220318978A1 (en) 2022-10-06
JP2020197454A (en) 2020-12-10
CA3142464C (en) 2024-02-20

Similar Documents

Publication Publication Date Title
EP3867787A4 (en) Blockchain-based hours-of-service system
EP3928275A4 (en) Micro-loan system
EP3764184A4 (en) Abnormality determination assistance device
EP3860453A4 (en) Measurement system
EP3989819A4 (en) Caregiver assistance system
EP3604108B8 (en) System
EP3992572A4 (en) Inspection master
EP3865447A4 (en) Intra-hoistway measurement system
EP3827791A4 (en) Mandbular advancement system
EP3951103A4 (en) Calibration operation assisting system
EP3805927A4 (en) Maintenance operation assistance system
EP3868350A4 (en) Assistance device
EP3999254A4 (en) Stacked-package detection system
EP3751436A4 (en) Design assistance system
EP3876052A4 (en) Production assistance system
EP4141421A4 (en) Inspection system
EP3926291A4 (en) Threat-coping system
EP3913351A4 (en) Detection system
EP3899141A4 (en) Aerification system
EP4075349A4 (en) Maintenance assistance system
EP3936789A4 (en) Assisting system
EP4067601A4 (en) Flooring-material system
EP4028545A4 (en) System
EP3938758A4 (en) Measuring system
EP3879481A4 (en) Challenge assistance system

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20211202

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

A4 Supplementary search report drawn up and despatched

Effective date: 20220527

RIC1 Information provided on ipc code assigned before grant

Ipc: G01N 21/88 20060101ALI20220520BHEP

Ipc: G01N 21/84 20060101ALI20220520BHEP

Ipc: G05D 1/02 20200101AFI20220520BHEP

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20231221

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602020031760

Country of ref document: DE