EP3635680A1 - Computer-implemented method and device for automatically generating characterized image data and analysis device for inspecting a component - Google Patents
Computer-implemented method and device for automatically generating characterized image data and analysis device for inspecting a componentInfo
- Publication number
- EP3635680A1 EP3635680A1 EP18753089.4A EP18753089A EP3635680A1 EP 3635680 A1 EP3635680 A1 EP 3635680A1 EP 18753089 A EP18753089 A EP 18753089A EP 3635680 A1 EP3635680 A1 EP 3635680A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- component
- image data
- visual representation
- database
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/10—Geometric CAD
- G06F30/12—Geometric CAD characterised by design entry means specially adapted for CAD, e.g. graphical user interfaces [GUI] specially adapted for CAD
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01M—TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
- G01M5/00—Investigating the elasticity of structures, e.g. deflection of bridges or air-craft wings
- G01M5/0033—Investigating the elasticity of structures, e.g. deflection of bridges or air-craft wings by determining damage, crack or wear
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01M—TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
- G01M13/00—Testing of machine parts
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01M—TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
- G01M15/00—Testing of engines
- G01M15/14—Testing gas-turbine engines or jet-propulsion engines
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01M—TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
- G01M5/00—Investigating the elasticity of structures, e.g. deflection of bridges or air-craft wings
- G01M5/0091—Investigating the elasticity of structures, e.g. deflection of bridges or air-craft wings by using electromagnetic excitation or detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/51—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
- G06T7/001—Industrial image inspection using an image reference approach
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C3/00—Registering or indicating the condition or the working of machines or other apparatus, other than vehicles
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/32—Operator till task planning
- G05B2219/32186—Teaching inspection data, pictures and criteria and apply them for inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30164—Workpiece; Machine component
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Definitions
- a computer implemented method and apparatus for automatic ⁇ tables generate marked image data and analysis of a component for checking sevorraum
- the present invention relates to a computer-implemented method and to a device for automatically generating tagged image data of components, and to an analysis device for checking a component.
- the data processing in this case requires just at applicatio ⁇ gen artificial intelligence a comprehensive database.
- large amounts of manually acquired image data have hitherto been required for this purpose.
- these real image data In order to train an artificial intelligence system with these image data, however, these real image data must be marked accordingly.
- relevant areas must be identified in the image data and each area must then be assigned one or more properties.
- a component such as a mechanical shaft or a turbine blade
- several photographs are created.
- a component can be photographed, for example, of several un ⁇ ter Kunststoff perspectives.
- a component or possibly also several identical or similar components in different operating states, aging stages or with various types of damage can be recorded photographically. Then each of these photographs must be manually evaluated to identify the component in the corresponding image and, if necessary the component and characteristics like aging state possible damage, etc. zuzuwei ⁇ sen.
- Basis for data processing in complex technical systems can be used.
- the present invention discloses a computer-implemented method for generating tagged image data with the features of patent claim 1, an apparatus for automatically generating tagged image data with the features of patent claim 9 and an analysis device for inspecting a component with the features of patent claim 10 ,
- a computer-implemented method for generating tagged image data of components includes the steps of providing design data for a component and providing specifications for possible surface properties of the component. Furthermore, the method comprises a step for calculating a visual representation of the component. The visual representation is calculated using the provided design data and the provided specifications for the surface properties of the component. Finally, the method includes a step of automatically assigning predetermined labels to the computed visual representation of the component.
- a device for automatically generating tagged image data of components.
- the device comprises a first database, a second database and a Schmda ⁇ tengenerator.
- the first database is designed to To provide design data for a component.
- the second database is designed to provide specifications for possible surface properties of the component.
- the image data generator is designed to calculate a visual representation of the component. Specifically, the visual representation is calculated using the design data provided by the first database and the surface potential specifications provided by the second database. Furthermore, the image data generator is designed to automatically assign predetermined markings to the calculated visual representation of the component.
- An analysis device for checking a component with a device according to the invention for generating marked image data a reference image data memory and an evaluation device.
- the reference image data memory is configured to store the tagged image data generated by the apparatus for automatically generating tagged image data.
- the evaluation device is designed to receive a camera image of a component to be checked and to compare the received camera image with the marked visual representations stored in the reference image data memory.
- the present invention is based on the finding that the diagnosis of complex industrial plants of a database with a large number of identified image data is of great importance. Further, the present invention is based on the recognition that the Clearel- len such a data base for complex industrial An lay ⁇ and particularly identifying individual elements in the image data represents a major challenge to the con- can not be realized in a conventional manner, and in particular even with the use of human labor.
- the present invention is therefore based on the idea to provide a solution with which it is completely automatically possible to generate labeled image data for components of industrial plants and to prepare them for further use in a digital environment.
- the present invention initially provides, not to obtain the image data of components in industrial plants in a conventional manner by photographing real components, but to calculate this image data digitally. Since components of modern systems are usually already constructed in a digital environment anyway, digital design data is also available for such components. Based on this digital design data, a three-dimensional model of the component can be easily calculated. Ins ⁇ particular it is possible to calculate a model of the component based on the existing design data. For example, convention ionel ⁇ le CAD data or any other design data can this be used as design data.
- the design data also provide information about the materials used in the component for which a visual representation is to be calculated.
- an arbitrary modification Impress ⁇ tr foundedung, aging, damage, etc. may already be simulated and included in the calculation of visual representation in the calculation of the visual representation of the component.
- different different states of the component can also be simulated. For example, can be defi ned ⁇ which characterize the visual representation of the component in a predetermined state respectively different properties of a surface for various Alterungsstu- fen.
- a corrosion example ⁇ rusting or the like an increasing roughening or abrading a portion of the component, the Bil ⁇ extension of cracks, especially of micro-cracks or the like, stretching, compressing or bending as a portion of the Component, a change due to heat or any other change in the surface properties of the component simulated and included in the generated visual representation.
- This allows for loading Sonder efficient, multi-layered and detailed Ge ⁇ ner ist visual representations of the part.
- each ⁇ the underlying conditions, particularly the respective specifications of the surface properties are known for each calculated visual display part, these known properties may also be assigned directly to the respective calculated visual representation.
- image area in the visual representation corresponds to which part of the component and which surface properties of the respective calculation are based.
- a corresponding identification with the underlying parameters can be very precisely assigned to each individual part of a component in the visual representation.
- image data of components can be produced while identifiers are assigned in these image data and individual areas meeting the underlying specifications for generating the image data very quickly, herebygüns ⁇ tig and efficiently in this way.
- image data of components which correspond to a component with a particularly high and optionally critical stress it is also possible to calculate image data which correspond to a component after a stress in a dangerous operating state, without the building part in such a dangerous operating condition to Operator Op ⁇ ben. Furthermore, image data can be obtained from perspectives in this way, which are not possible under real conditions or only with great effort.
- second database storage unit can be, for example, in a knowledge base (ger .: Knowledge Base), which can be ge ⁇ uses for other applications, such as an automatic diagnosis of a component.
- a knowledge base (ger .: Knowledge Base)
- ge ⁇ uses for other applications, such as an automatic diagnosis of a component.
- the provided surface properties specifications include characteristic textures, particularly for predetermined areas of a surface of the component.
- characteristic textures may correspond to various stages of corrosion, such as rusting or other oxidation.
- different textures may also include different gradations of scratching a particular area of the component, different stages of abrading or grinding on a component, different stages of formation of cracks, in particular, for example, microcracks or the like, various stages of thermal action of heat or cold on the component, a deformation of a sectionberei ⁇ Ches on the component, in particular bending, stretching, upsetting or the like, a wave formation at a portion of the surface and any other physical or chemical action an area of the component.
- the characteristic textures particular properties such as wear, aging, a predetermined load, a pollution or a potential failure probability of the component speci fied ⁇ can. This information can be taken into account in the automatic assignment of the given identifier to serve as a reference for the diagnosis of image data of real components.
- the visual representation of the component is calculated from a given perspective and / or along a predetermined observation path.
- a movement path for example, a flight of a virtual drone along a flight path for the observation of a component can be specified. This enables a particularly flexible, universal generation of image data from almost any angle and perspective.
- the design data underlying the computed visual representation includes CAD data or manufacturing data for manufacturing the component.
- The- Such design data are already available for almost all components due to the modern production technology. Therefore, the visual representations of the component can be particularly easily calculated without further, possibly complex intermediate steps.
- the computation of the visual representations of the component can be generated, for example, on the basis of algorithms and / or graphics units such as those already used, for example, for calculating images in computer games or other optical simulations.
- a three-dimensional model can be calculated from the design data at first, on the basis of the visual representation of the component is generated ⁇ riert.
- the visual representation may correspond to a saudi ⁇ dimensional image.
- the automatic assignment of the predetermined markings to the calculated visual representations of the component comprises a multi-level hierarchical characterization, in particular of at least a part of the component.
- the automatic assignment of the predetermined identifications to the computed visual representations of the component comprises at least one diagnosis for a predetermined error, an indication of a possible damage, a prognosis for a probability of failure and / or a repair recommendation.
- the predetermined indicia may also include any other parameters, properties, or values suitable for characterizing features of a portion of the component in the visual representation.
- the computer-implemented method for generating the image data comprises a step of storing the visual representation of the component together with the assigned identifiers in a database, and a step of comparing an image of a camera to diagnosti ⁇ ornamental component with the stored visual display.
- the comparison of the calculated and marked image data with real image data can not only comprise a direct pairwise comparison of image data. Rather, a more complex analysis of the image data may be performed based on the calculated tagged image data. For this purpose, methods based on artificial intelligence and neural networks or the like can be used.
- the evaluation device of the analysis device for checking a component is designed to identify a match between at least a part of the camera image and a part of a calculated visual representation of a component.
- the evaluation device can be designed to output markings that correspond in the visual representation of the identified part of the component in the marked image data. Such markings can be used to diagnose a component to be tested in order to establish a rapid, reliable and efficient diagnosis of the component. Based on such a diagnosis a ra ⁇ specific, timely and cost-effective maintenance and repair of the component can be executed.
- the analysis device comprises a control device.
- the control device can be designed to generate one or more control commands depending on the result of the comparison between the camera image and the marked image data.
- the generated control commands can then be output.
- These control commands may be, for example, a Shutdown command act to shut down a system with the corresponding component in a dangerous situation.
- the control command can also include a command to transfer a system into a predetermined operating state, which, based on the analysis of the component, enables a safe continued operation, at least for a predetermined period of time.
- the control command may also include a repair recommendation for the maintenance of the component to be diagnosed.
- the control command can also be used to cause an automatic order of required spare parts for maintenance or repair of the component.
- any additional control commands are possible on the basis of previous Ana ⁇ analysis.
- the analysis device comprises an interface.
- This interface can be designed to receive at least one camera image of the component to be checked.
- This interface can play as acting accession to a wired interface which is coupled directly or via a data bus or the like with ei ⁇ ner or more cameras.
- it can also be a radio interface which receives image data from one or more cameras via a wireless transmission. For example, there is also a reception from
- the evaluation device of the analysis device is designed to carry out the comparison between the camera image and the stored marked visual representations based on artificial intelligence.
- a so-called Convolutional Neural Network can be implemented in the analysis device.
- CNN for example about "folding neural network", it is a
- feedforward artificial neural network This is a concept inspired by biological processes in the field of machine learning.
- FIG. 1 shows a schematic representation of an analysis device for checking a component with a device for the automatic generation of image data according to an embodiment
- Fig. 2 a schematic representation of marked
- FIG. 3 is a flowchart underlying a computer-implemented method for generating tagged image data according to one embodiment.
- the analysis device may, for example, a Apparatus 10 for automatically generating tagged image data.
- This apparatus 10 for automatically generating tagged image data comprises a first database 11 in which design data for one or more components is provided.
- Design data may be, for example, CAD data or any other design data for a part. Since the construction of components in recent years increasingly digital systems are used, the design data of these components are usually already in digital form. This design data of the component can be used as a basis for the generation of ge ⁇ marked image data. For this purpose, the corresponding design data in the first database 11 can be stored and provided. Furthermore, specifications for possible surface properties of components can be provided in a second database 12. These specifications of surface properties can characterize different material properties of a component. For example, in the second database 12
- Textures for different material states or surface states of a component can be specified. For example, textures for different gradations ei ⁇ ner corrosion specified on a material surface advertising to. For example, different degrees of gradation of the
- Rostens an iron surface and the corresponding textures of the respective surface are specified. Further, wear by abrading a material surface and the textures corresponding thereto in the second database 12 may also be specified. Also, other characteristics such as forming grooves or grooves due to rubbing of two material surfaces on each other can be specified. Further, thermal or thermal exposure to a material may also result in a characteristic optical change which may also be specified in the second database 12. For example, contact by strong heat ⁇ exposure to a metal called tarnish on, from which shows the maximum temperature effect. Corresponding colors or textures can be specified in the second database 12 for the corresponding surfaces of a component.
- Further characteristic features specified in the second database 12 are, for example, soiling, in particular also soiling, which may be the result of improper use of the component, the formation of cracks, in particular microcracks, during normal operation or overstressing of the component, characteristic deformations,
- 13 positions can be specified in a third database, from the perspective of which a visual representation of a component is to be calculated.
- individual positions can for example be specified, a visual representation be from their perspective ⁇ expects to be, or is it more complex motion ⁇ paths, such as lines, curves, polygons or similarity ⁇ royal possible along which a virtual camera be ⁇ moves.
- ⁇ paths such as lines, curves, polygons or similarity ⁇ royal possible along which a virtual camera be ⁇ moves.
- virtual flights of a drone or the like can be simulated, which moves along a component or around a component.
- ⁇ sondere can be defined in this way also prospects which are not or only with great effort possible to a component when installed under real conditions.
- the first database 11, the second database 12 and the third database 13 are described herein as a single, separate databanks ⁇ ken, it is also possible to store and provide the data of two or all three databases in a gene Exammen storage means.
- a component is considered in each case.
- the term "a component" is not to be understood as a single individual component. Much more can be understood as a component and complex machine arrangements of any number of individual parts.
- the visual representation of the component to be generated can also include the representation of a complete machine or a subassembly of a machine.
- a drive shaft including bearings or any other composite of several machine parts or components can be understood.
- an image data generator 20 can calculate a visual representation of the component.
- a dreidimensiona ⁇ les model of the component can be calculated, for example, from the design data first.
- the surface of this three-dimensional model can be determined according to the specifications for the surface properties. In this way it is possible, for example, to include certain stresses, damage, wear or the like in the calculation of the visual representation of the component.
- the component can be simulated in almost any state and a visual representation based on it can be generated. In particular, visual representations of the component are possible, which are due to over ⁇ claims, possibly in dangerous Radio- states.
- a corresponding parameterization can also be assigned to the individual regions in the image data. For example, on a predetermined area of the component calculates an optical representation, which is on a high heattechnischzure ⁇ ren, the corresponding area in the calculated visual representation can be characterized accordingly, ie
- this portion of the component the designation of the part, the name of the corresponding portion in the component, the use ⁇ te material in this portion of the component, and the further underlying the effect of heat are assigned in this partial area of the corresponding partial area of the image.
- the assignment of markings to subareas of the calculated visual representation can be based on a multi-level hierarchical structure. In principle, any other types of assignment of labels to subregions in the image data are also possible. In principle, a common characteristic or marking can also be assigned to a plurality of subregions of the component in the visual representation.
- the generated image data with the identifiers in a reference image data memory 30 can be stored.
- the storage of the image data, in particular the assignment of the marking to subregions in the image data, can take place in any structure.
- any databases with a 1: n structure or even an m: n structure can be used to assign labels to the image data.
- the tagged image data stored in the reference image data memory 30 may be used, for example, to train an analysis system 40. In this
- Analysis system 40 may be any system which, based on provided marked image data, an evaluation, in particular an evaluation from image data of real components.
- a system may be, for example, an artificial intelligence system.
- neural networks may also be trained based on the provided computed image data to enable analysis of real device image data.
- the evaluation device 40 can be provided with a real image of a component.
- This real image of the component can be recorded, for example, by means of a camera 50.
- the camera 50 can be coupled with ⁇ means of a wired connection to the evaluation device 40th
- cable-free communication paths between the camera 50 and the evaluation device 40 are also possible.
- one or optionally also more cameras 50 may be installed that detects a component or a system with egg ⁇ NEM or more components visually. The image data acquired thereby can be provided to the evaluation device 40, which then makes a comparison or a comparison
- image data can also be acquired from a component at predetermined intervals, for example during maintenance or the like, in particular when a system is at a standstill, and these data are provided to the evaluation device 40. Also in this case, the evaluation device 40 based on the marked image data stored in the reference image data memory 30.
- Image data in the reference image data memory 30 perform a diagnosis in order to make the most accurate possible statement about the aktuel ⁇ len state of the component, which has been optically detected by the camera 50.
- the analysis can be, for example, a comparison of the acquired image data of the real component with the image data stored in the reference image data memory 30 act.
- any further gegebe ⁇ appropriate, more complex analyzes on basis of data stored in the Refe ⁇ ence image data memory 30 image data are possible.
- the current state of the component to be checked can then be determined.
- a forecast of the further development of the component and in assess ⁇ Zung over the still expected remaining life of the component is optionally also possible.
- the component is damaged, such as cracks or the like, which detek- based on the data stored in the Re ference ⁇ image data memory 30 image data may be advantage, such a damage can be diagnosed. If necessary, then an order process for a required spare parts initi ⁇ ated can be automatic. Furthermore, further repair measures can be triggered in order to achieve a rapid repair of the component to be diagnosed. In this way, the availability of the component and the associated entire technical system can be increased.
- FIG. 2 shows a schematic representation of automatically generated image data with corresponding identifications, as they are based on an embodiment.
- the representation of the building ⁇ part comprises a component A, which consists of two sub-elements Aa and Ab.
- the specification of the component can ⁇ on the design data it ⁇ follow when, for example, based here.
- On the basis of this design data a three-dimensional model can first be calculated.
- the subelement Ab can furthermore be subdivided, for example, into two subparts Abi and Ab2.
- a special stress can be assumed.
- This particular stress can, for example, lead to a change in the surface and a correspondingly modified result in the texture of the visual presentation.
- this is represented by marking Abl-x. Since the respective framework conditions are known in the gene ⁇ ration of the visual representation of the component A by the design data and the characteristic properties of the surface properties of the component, in each case a corresponding marking can be assigned in corresponding sub-areas of the visual representation.
- image data can then be stored, for example, in the previously described reference image data memory 30 and used as training or reference data for a subsequent analysis of similar components.
- FIG. 3 shows a schematic representation of a sequence diagram on which a computer-implemented method for generating tagged image data of components is based.
- Step S1 design data for a part is provided. Furthermore, speci ⁇ fications for possible surface properties of a component are provided in step S2.
- Darue about ⁇ may optionally contain one or more items for possible perspectives for the image data to be calculated are specified addition.
- step S3 then a calculation of awill ⁇ len representation of the component takes place. The component is calculated using the provided design data and the provided surface properties specifications. Furthermore, the calculation of the visual representation for the specified perspectives can be carried out.
- the specified perspectives may be one or more predefined points in the space or optionally also a trajectory of a virtual camera.
- step S4 an automatic assignment of pre-determined agreed markings of the calculated visual representation of the component.
- the automatic assignment of Distinguishing ⁇ voltage are measured on the basis of parameters that defines taken as a basis of loading ⁇ statement of visual representation in step S3.
- the embodiments that have already been described above in connection with the device also apply to the method for generating the marked image data.
- the present invention relates to an auto matic ⁇ generating marked image data.
- the marked image data can be used in modern industrial plants for the monitoring and diagnosis of components, plant components up to entire industrial plants.
- the marked image data serve as reference or training basis for the evaluation of image data of real plant components.
- the present invention relates to automatic generation of tagged image data.
- a visual representation of the component is calculated on the basis of already existing design data for a component, wherein the surface properties of the visual representation of the component can be varied based on predetermined characteristic properties. Since the calculation of such visual representations both the component itself, and the underlying characteristic surface properties are known, this information can be used to identify the corresponding parts in the visual representation to allow automatic identification of the calculated visual representation. In this way, image data can be automatically generated and in the same without the need for a ma ⁇ Nuelles intervention is required. This makes it possible to produce marked image data on a large scale with a high quality.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Geometry (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Software Systems (AREA)
- Evolutionary Computation (AREA)
- Aviation & Aerospace Engineering (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Molecular Biology (AREA)
- Artificial Intelligence (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Mathematical Optimization (AREA)
- Computing Systems (AREA)
- Quality & Reliability (AREA)
- Mathematical Physics (AREA)
- Computer Hardware Design (AREA)
- Databases & Information Systems (AREA)
- Architecture (AREA)
- Pure & Applied Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computational Mathematics (AREA)
- Mathematical Analysis (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Electromagnetism (AREA)
- Image Analysis (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102017213060.1A DE102017213060A1 (en) | 2017-07-28 | 2017-07-28 | A computer-implemented method and apparatus for automatically generating tagged image data and analyzer for inspecting a component |
PCT/EP2018/070416 WO2019020791A1 (en) | 2017-07-28 | 2018-07-27 | Computer-implemented method and device for automatically generating characterized image data and analysis device for inspecting a component |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3635680A1 true EP3635680A1 (en) | 2020-04-15 |
Family
ID=63168376
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP18753089.4A Pending EP3635680A1 (en) | 2017-07-28 | 2018-07-27 | Computer-implemented method and device for automatically generating characterized image data and analysis device for inspecting a component |
Country Status (4)
Country | Link |
---|---|
US (1) | US11501030B2 (en) |
EP (1) | EP3635680A1 (en) |
DE (1) | DE102017213060A1 (en) |
WO (1) | WO2019020791A1 (en) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
ES2926792T3 (en) * | 2018-06-19 | 2022-10-28 | Bae Systems Plc | workbench system |
EP3916636A1 (en) | 2020-05-27 | 2021-12-01 | Siemens Aktiengesellschaft | Method and systems for providing synthetic labelled training data sets and use of same |
CA3180630A1 (en) | 2020-05-29 | 2021-12-02 | Alexander Harvey | Methods and systems for construct identification and analysis |
DE102020131607A1 (en) | 2020-11-30 | 2022-06-02 | Schaeffler Technologies AG & Co. KG | Method for providing a training data set, method for operating a self-learning component defect detection device and self-learning component defect detection device |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5969973A (en) * | 1994-11-09 | 1999-10-19 | Amada Company, Ltd. | Intelligent system for generating and executing a sheet metal bending plan |
US9858658B2 (en) * | 2012-04-19 | 2018-01-02 | Applied Materials Israel Ltd | Defect classification using CAD-based context attributes |
US9031317B2 (en) * | 2012-09-18 | 2015-05-12 | Seiko Epson Corporation | Method and apparatus for improved training of object detecting system |
US10234846B2 (en) * | 2014-07-07 | 2019-03-19 | Siemens Aktiengesellschaft | Method and apparatus for determining an optimum manufacturing alternative for manufacturing a product |
CN105989210B (en) * | 2015-02-27 | 2019-04-09 | 中芯国际集成电路制造(上海)有限公司 | Customize dummy pattern fill method |
US20180173824A1 (en) * | 2015-06-12 | 2018-06-21 | Siemens Aktiengesellschaft | A method and apparatus for performing a model-based failure analysis of a complex industrial system |
US10459430B2 (en) * | 2015-09-11 | 2019-10-29 | Xerox Corporation | Method and system for variable data printing in a 3D print system |
-
2017
- 2017-07-28 DE DE102017213060.1A patent/DE102017213060A1/en active Pending
-
2018
- 2018-07-27 US US16/633,652 patent/US11501030B2/en active Active
- 2018-07-27 WO PCT/EP2018/070416 patent/WO2019020791A1/en unknown
- 2018-07-27 EP EP18753089.4A patent/EP3635680A1/en active Pending
Also Published As
Publication number | Publication date |
---|---|
DE102017213060A1 (en) | 2019-01-31 |
US11501030B2 (en) | 2022-11-15 |
WO2019020791A1 (en) | 2019-01-31 |
US20200167510A1 (en) | 2020-05-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3635680A1 (en) | Computer-implemented method and device for automatically generating characterized image data and analysis device for inspecting a component | |
DE102017108169B4 (en) | Production system that defines a determination value of a variable in relation to a product deviation | |
DE102012219187B4 (en) | System for binary classification of elements of interest in a reproducible process | |
DE102018129425B4 (en) | System for recognizing a machining error for a laser machining system for machining a workpiece, laser machining system for machining a workpiece by means of a laser beam comprising the same, and method for detecting a machining error in a laser machining system for machining a workpiece | |
EP3671632B1 (en) | Image-based maintenance prediction and erroneous operation detection | |
DE102018128158A1 (en) | DEVICE FOR INSPECTION OF THE APPEARANCE PICTURE | |
DE102021114967A1 (en) | WORKPIECE INSPECTION AND ERROR DETECTION SYSTEM THAT INDICATES THE NUMBER OF ERROR IMAGES FOR THE TRAINING | |
DE102019113830A1 (en) | Information processing method, information processing apparatus and program | |
EP4072808B1 (en) | Computer-assisted method and device for testing the quality of exposed concrete | |
EP3767403A1 (en) | Machine learning based shape and surface measurement for monitoring production | |
DE102019120696A1 (en) | Apparatus and method for tire testing | |
EP3396477B1 (en) | Method for determining rules for characterizing the normal operating state of a work process | |
WO2022167022A1 (en) | Method for checking a component of a turbomachine | |
DE102007031654A1 (en) | Method for manufacturing die-cast components, particularly of components made of aluminum or magnesium materials, involves performing quality test of cast component after casting | |
DE102021105695A1 (en) | SYSTEM AND PROCEDURE FOR EVALUATION OF THE INTEGRITY OF SPOT WELDING | |
EP3904827A1 (en) | Dynamic route planning of a drone-based inspection of route equipment of a route | |
DE102018112910B4 (en) | Manufacturing process for a drive device and test device | |
Pechenin et al. | Neural network model of machine parts classification by optical scanning results | |
DE102020213694A1 (en) | Automated evaluation of screws used | |
DE102020204983A1 (en) | System for providing trained AI models for various applications | |
WO2020058219A1 (en) | Method for processing images of semiconductor structures, and for process characterization and process optimization by means of semantic data compression | |
EP3899863A1 (en) | Computer-implemented method for analysing measurement data from a measurement of an object | |
DE102018128640A1 (en) | Device for estimating a noise generation cause | |
DE102021118877A1 (en) | Procedure for evaluating the reliability of an optical measuring system | |
DE102022103997B3 (en) | Computer-implemented method for detecting damage in a body, trained neural network for detecting damage, and test system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20200107 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20211125 |