EP4399065A1 - Bewerten und/oder steuern eines roboterarbeitsprozesses - Google Patents
Bewerten und/oder steuern eines roboterarbeitsprozessesInfo
- Publication number
- EP4399065A1 EP4399065A1 EP22769154.0A EP22769154A EP4399065A1 EP 4399065 A1 EP4399065 A1 EP 4399065A1 EP 22769154 A EP22769154 A EP 22769154A EP 4399065 A1 EP4399065 A1 EP 4399065A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- vibration data
- robot
- work process
- measurement data
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Program-controlled manipulators
- B25J9/16—Program controls
- B25J9/1628—Program controls characterised by the control loop
- B25J9/163—Program controls characterised by the control loop learning, adaptive, model based, rule based expert control
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Program-controlled manipulators
- B25J9/16—Program controls
- B25J9/1674—Program controls characterised by safety, monitoring, diagnostic
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Program-controlled manipulators
- B25J9/16—Program controls
- B25J9/1628—Program controls characterised by the control loop
- B25J9/1641—Program controls characterised by the control loop compensation for backlash, friction, compliance, elasticity in the joints
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/39—Robotics, robotics to robotics hand
- G05B2219/39241—Force and vibration control
Definitions
- the present invention relates to a method for evaluating, in particular for monitoring, and/or for controlling a working process of at least one robot on the basis of a machine-learned process model, a method for monitored machine learning of a, in particular this, process model of a working process of at least one robot, and a System, computer program or computer program product for carrying out at least one of these methods.
- Process models of robot work processes which are learned by supervised machine learning (machine), can advantageously be used, in particular to improve the robot work processes, preferably to evaluate them, in particular to monitor them, and/or to control them.
- machine supervised machine learning
- measurement data for example drive currents, drive torques and/or control errors of the robot.
- An object of an embodiment of the present invention is to improve the supervised machine learning of a process model of a work process of at least one robot.
- An object of an embodiment of the present invention is to improve the evaluation, in particular the monitoring, and/or the control of a work process of at least one robot.
- Claims 8, 9 represent a system or computer program or
- a method for supervised machine learning of a process model of a work process of one or more robot(s) comprises the steps:
- Supervised machine learning (“Supervised (Machine) Learning”) of a process model, in particular a mathematical and/or numerical or computer-implemented process model, in particular a Kl process model, of the work process on the basis of the measurement data, which are labeled on the basis of the recorded vibration data.
- the process model can in particular include at least one artificial neural network, the monitored machine learning correspondingly training the process model, in particular this artificial neural network, using the labeled measurement data, but without being limited to this.
- the method also includes the step:
- measurement data is often labeled manually based on visual observations of the work process or camera images of the work process.
- the recorded vibration data include airborne and/or structure-borne noise (wave) signals or airborne and/or structural vibration signals.
- wave structure-borne noise
- a snapping noise can be used to assess whether a joining process has been carried out successfully or not, and measurement data recorded during this joining process can be labeled accordingly as “joining process successful” or “joining process unsuccessful”.
- the senor or one or more of the sensors can be an acceleration sensor, in one embodiment a single-axis or multi-axis acceleration sensor.
- the vibration data can be advantageously recorded, in particular more precisely and/or more undisturbed, for example in comparison to external (arranged) microphones, which can also be used, but often with more interference or ambient noise capture.
- the measurement data is or will be labeled manually or by one or more people, in one embodiment jointly, on the basis of the recorded vibration data, with joint manual labeling in one embodiment comprising an evaluation of several individual labels by one or more people each , in particular a labeling according to the majority of the individual labels, an average of the individual labels or the like.
- the labeling of the measurement data can thereby be improved in one embodiment.
- the measurement data are or will be labeled out of sight of the work process or remotely, in a further development in a cloud (“cloud labeling”).
- the labeling of the measurement data can be advantageously distributed and/or carried out without impairing the work process and/or without being adversely affected by the work process, thereby improving the labeling and/or the work process in one embodiment.
- the measurement data are or will be labeled on the basis of acoustic signals which, in one embodiment, are generated from the vibration data or are dependent on the vibration data in whole or in part.
- the vibration data can already have (the) acoustic signal(s), in particular can be, as a result of which the precision can be improved in one embodiment.
- the vibration data can be converted or processed into acoustic signals or the acoustic signals can be generated on the basis of the detected vibration data.
- the measurement data are then labeled on the basis of these acoustic signals and thus also on the basis of the recorded vibration data (on which they are based).
- the recorded vibration data is processed, in one embodiment into (the) acoustic signals, and the measurement data are or are then labeled on the basis of this processed vibration data, in particular acoustic signals.
- this can improve detection and/or precision.
- structure-borne noise can be detected and processed into audible acoustic signals that a human being can perceive particularly well, in particular quickly(er), more precisely(er), intuitively(er) and/or less(er). ) error-prone, can handle.
- the recorded vibration data is transformed into another frequency range, which in one embodiment is audible and which is between 20 Hz and 20 kHz in one embodiment. Since, as mentioned, people can process acoustic signals particularly well, in particular quickly(er), more precisely,(more) intuitively and/or less error-prone, the labeling of the measurement data can thereby be improved in one embodiment.
- all or part of the recorded vibration data lies in the audible frequency range or a frequency range between 20 Hz and 20 kHz.
- the labeling can be carried out particularly precisely and/or reliably by means of such vibration data.
- the at least one sensor in particular an acceleration sensor, at least partially detects in a frequency range between 20 Hz and 20 kHz, or is set up for this purpose or is used for this purpose.
- the recorded vibration data is filtered during processing in one embodiment by at least one bandpass filter and/or by cutting out a frequency range specified in a further development.
- particularly significant frequency ranges can be used or made available for labeling and the labeling, in particular the precision and/or reliability, can thereby be improved.
- the filtering in particular a predetermined frequency range that is cut out and/or one or more frequencies of the bandpass filter, are carried out in one embodiment using artificial intelligence, in particular explainable AI, anomaly detection, autoencoder, reconstruction error, in particular minimization thereof, or the like. or determined empirically. In this way, in one embodiment, particularly advantageous, in particular significant and/or suitable for human labellers, processed vibration data can be generated.
- exercise vibration data is recorded in advance for labeling the measurement data and the entity, in one embodiment the person or people who then label the measurement data, which, in one embodiment, processed in the manner explained above with reference to the vibration data, exercise vibration data together with a classification of this exercise vibration data for the (initial) practice of Labein made available.
- the classification can be based on a visual inspection, image recognition or the like, for example.
- the exercise vibration data are processed into acoustic signals and/or transformed into another, in particular audible, frequency range and/or filtered, in particular by at least one bandpass filter and/or cutting out a predetermined frequency range, before they are sent to the entity for practicing the exercise to provide.
- This instance can then practice the (correct) labeling using this exercise vibration data or acoustic (exercise) signals.
- the recorded measurement data which is or will be labeled on the basis of the recorded vibration data and on the basis of which the process model (supervised) is learned by machine or the recorded measurement data on the basis of which the work process is evaluated and/or controlled, includes movement data , in particular time series, and/or load data, in particular time series, in one embodiment (time series of) positions, forces(ies), torque(s), control deviations and/or (time series of) first(s) and/or higher(s) temporal derivations of positions, forces, torques and/or control deviations of the robot in one version of its drives.
- the method for evaluating, in particular for monitoring, and/or for controlling a work process of at least one robot comprises the steps:
- evaluating and/or controlling the work process based on the learned process model includes the steps:
- a process model that is learned through monitored machine learning can advantageously be used to evaluate, in particular to monitor and/or control, and thereby improve a robot work process.
- the robot work process can be controlled, for example a correction or sorting action or the like can be initiated if the process model based on the recorded measurement data detects a faulty process, in particular a process step, or a work product of the robot work process are sorted into one of several (quality) classes or the like.
- a system is set up, in particular in terms of hardware and/or software, in particular in terms of programming, for carrying out a method described here.
- a system comprises:
- means for labeling the measurement data on the basis of the recorded vibration data in particular for outputting the recorded vibration data, possibly processed, in particular to form acoustic signals, to one or more people and manual labeling of the measurement data by the person or people, in particular receiving or Entering appropriate labels from or by the human being.
- system or its means(s) has:
- Means for processing the recorded vibration data in particular to acoustic signals and/or for transforming into another, in particular audible, frequency range and/or for filtering, in particular by at least one bandpass filter and/or cutting out a predetermined frequency range; and or
- a system comprises:
- system or its means(s) comprises:
- system or its means(s) comprises:
- a system and/or a means within the meaning of the present invention can be designed in terms of hardware and/or software, in particular at least one, in particular digital, processing unit, in particular microprocessor unit ( CPU), graphics card (GPU) or the like, and / or have one or more programs or program modules.
- the processing unit can be designed to process commands that are implemented as a program stored in a memory system, to detect input signals from a data bus and/or to output output signals to a data bus.
- a storage system can have one or more, in particular different, storage media, in particular optical, magnetic, solid-state and/or other non-volatile media.
- the program may be designed to embody or embody the methods described herein.
- a computer program product can have, in particular, be a, in particular, computer-readable and/or non-volatile storage medium for storing a program or instructions or with a program or with instructions stored thereon.
- execution of this program or these instructions by a system or controller, in particular a computer or an arrangement of multiple computers causes the system or controller, in particular the computer or computers, to perform a method described here or one or more of its steps, or the program or the instructions are set up to do so.
- one or more, in particular all, steps of the method are carried out fully or partially automatically, in particular by the system or its means.
- the system has the at least one robot.
- Fig. 1 a system according to an embodiment of the present invention.
- Figure 2 a method according to an embodiment of the present invention.
- FIG. 1 shows a system and FIG. 2 shows a method according to an embodiment of the present invention.
- exercise vibration data are recorded during a multiple repetition of a work process using an acceleration sensor 1 on an end flange 6 of a robot 2 . If necessary, this exercise vibration data is also processed, for example filtered and/or transformed into another frequency range, and sent as audible acoustic signals to one or more lablers 4 together with a classification of this exercise vibration data into "work process OK"7 "work process not OK” or the like provided.
- the classification can be based on a visual inspection, image recognition or the like, for example.
- the labeller(s) 4 practice labeling on the basis of exercise vibration data that may have been processed. I.e. they practice, for example, labeling certain noises as "work process OK"7, "work process not OK” or “joining fully achieved/”joining partially achieved”/"joining failed” or the like.
- vibration data and additional measurement data are again recorded during a multiple repetition of a work process using the acceleration sensor 1 3 of the robot.
- This recorded vibration data is optionally processed, preferably in the same way as the exercise vibration data before (FIG. 2: step S30).
- the detected vibration data is transformed into another frequency range and/or filtered by at least one bandpass filter and/or cutting out a predetermined frequency range, and thus processed into acoustic signals.
- a process model for example in the form of an artificial neural network 5 , is trained or machine-learned (monitored) in a step S50 by supervised (machine) learning.
- step S60 Similar work processes of the robot 2 can be evaluated on the basis of this process model 5 learned by machine on the basis of the labeled measurement data (FIG. 2, step S60), in particular the work process can be monitored. Additionally or alternatively, the work process can be controlled in step S60, for example a correction or sorting action can be carried out in the event of a failed joining.
- the acceleration sensor can detect sound signals in an audible frequency range between 20 Hz and 20 kHz, which are played to a person 4, who then reads the associated measurement data, for example position and/or load data from the drives 3, as "Joining OK “ labels if he hears a corresponding click or snap sound, or labels as “Join not OK” if he does not hear a (correct or practiced) click or snap sound.
Landscapes
- Engineering & Computer Science (AREA)
- Robotics (AREA)
- Mechanical Engineering (AREA)
- Manipulator (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE102021209867.3A DE102021209867A1 (de) | 2021-09-07 | 2021-09-07 | Bewerten und/oder Steuern eines Roboterarbeitsprozesses |
| PCT/EP2022/073547 WO2023036610A1 (de) | 2021-09-07 | 2022-08-24 | Bewerten und/oder steuern eines roboterarbeitsprozesses |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4399065A1 true EP4399065A1 (de) | 2024-07-17 |
Family
ID=83283397
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP22769154.0A Pending EP4399065A1 (de) | 2021-09-07 | 2022-08-24 | Bewerten und/oder steuern eines roboterarbeitsprozesses |
Country Status (3)
| Country | Link |
|---|---|
| EP (1) | EP4399065A1 (de) |
| DE (1) | DE102021209867A1 (de) |
| WO (1) | WO2023036610A1 (de) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102023213287A1 (de) * | 2023-12-22 | 2025-06-26 | Robert Bosch Gesellschaft mit beschränkter Haftung | Computerimplementiertes Verfahren zur Erkennung von Anomalien bei der Verwendung einer Maschine |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102017000063B4 (de) | 2016-01-14 | 2019-10-31 | Fanuc Corporation | Robotereinrichtung mit Lernfunktion |
| JP6514171B2 (ja) * | 2016-09-27 | 2019-05-15 | ファナック株式会社 | 最適な物品把持経路を学習する機械学習装置、及び機械学習方法 |
| JP6484265B2 (ja) | 2017-02-15 | 2019-03-13 | ファナック株式会社 | 学習制御機能を備えたロボットシステム及び学習制御方法 |
| JP6577527B2 (ja) | 2017-06-15 | 2019-09-18 | ファナック株式会社 | 学習装置、制御装置及び制御システム |
| JP6781183B2 (ja) | 2018-03-26 | 2020-11-04 | ファナック株式会社 | 制御装置及び機械学習装置 |
| KR20200031463A (ko) * | 2018-09-14 | 2020-03-24 | 한국산업기술대학교산학협력단 | 로봇 고장원인 진단 시스템 및 방법 |
| JP7048539B2 (ja) * | 2019-04-26 | 2022-04-05 | ファナック株式会社 | 振動表示装置、動作プログラム作成装置、およびシステム |
| IT201900007332A1 (it) * | 2019-05-27 | 2020-11-27 | Linari Eng S R L | Metodo e sistema per rilevare malfunzionamenti di un’apparecchiatura |
| JP7401207B2 (ja) | 2019-06-21 | 2023-12-19 | ファナック株式会社 | ツールの状態を学習する機械学習装置、ロボットシステム、及び機械学習方法 |
| JP7525777B2 (ja) | 2020-06-16 | 2024-07-31 | 株式会社デンソーウェーブ | 薄板状小型ワークの把持装置、薄板状小型ワークの把時方法 |
-
2021
- 2021-09-07 DE DE102021209867.3A patent/DE102021209867A1/de active Pending
-
2022
- 2022-08-24 WO PCT/EP2022/073547 patent/WO2023036610A1/de not_active Ceased
- 2022-08-24 EP EP22769154.0A patent/EP4399065A1/de active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| DE102021209867A1 (de) | 2023-03-09 |
| WO2023036610A1 (de) | 2023-03-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| DE102019007721B4 (de) | Vorrichtung zur Erfassung einer Anomalie bei der Anfügung eines Werkzeugs | |
| DE102017105174B4 (de) | Verfahren zum Erzeugen von Trainingsdaten für die Überwachung einer Gefahrenquelle | |
| EP3725472A1 (de) | Verfahren zum ermitteln einer trajektorie eines roboters | |
| WO2020127512A1 (de) | Überprüfungssystem und verfahren zum überprüfen von arbeitsabläufen | |
| DE10215885A1 (de) | Automatische Prozesskontrolle | |
| DE102021132755A1 (de) | Verfahren und system zum überwachen von herstellungsvorgängen unter verwendung von maschinellem sehen für von menschen durchgeführte aufgaben | |
| WO2024115613A1 (de) | Selbstlernendes verfahren für einen fertigungs- und/oder montageprozess | |
| EP4399065A1 (de) | Bewerten und/oder steuern eines roboterarbeitsprozesses | |
| EP4206843A1 (de) | Verfahren zur automatischen erstellung von anlagenspezifischen messprofilen für ein isolationsüberwachungssystem | |
| EP4202585A1 (de) | Prüfaufbau und verfahren zum testen eines steuergerätes | |
| EP3518059B1 (de) | Verfahren zur rechnergestützten benutzerassistenz bei der in-betriebnahme eines bewegungsplaners für eine maschine | |
| DE112022006723T5 (de) | Lehrunterstützungsvorrichtung, arbeitssystem, lehrunterstützungsverfahren und speichermedium | |
| EP4200107A1 (de) | Überwachung bei einem robotergestützten prozess | |
| DE102019209228A1 (de) | Verfahren und Vorrichtung zum Überprüfen der Robustheit eines künstlichen neuronalen Netzes | |
| DE102018125712A1 (de) | Fahrunterstützungsverfahrens für ein Fahrzeug | |
| DE102018207220A1 (de) | Verfahren, Vorrichtung und Computerprogramm zum Detektieren eines Berechnungsfehlers oder einer Fehlfunktion | |
| EP3710207B1 (de) | Qualitätssicherung eines prozesses | |
| EP4133341A1 (de) | Roboterprozess | |
| EP3901838A1 (de) | System zum bereitstellen von trainierten ki-modellen für verschiedene anwendungen | |
| EP4075220B1 (de) | Vorrichtung und verfahren zur identifizierung von veränderungen an einer maschinenanordnung | |
| EP3710900A1 (de) | Verfahren und system zum vorgeben bzw. lernen eines roboterbefehls | |
| DE10038094B4 (de) | Vorrichtung und Verfahren zum Generieren und Erweitern der Wissensbasis eines Expertensystems | |
| EP3429805A1 (de) | Steuern einer automatisierungsanordnung | |
| EP4485348B1 (de) | Computer-implementiertes verfahren und werkzeug zur optischen qualitätskontrolle von zwischen- oder endprodukten von produktionsanlagen sowie produktionsanlagensteuerung | |
| DE102023200017B3 (de) | Verfahren zur Fehlererkennung in Montage- und Instandhaltungsprozessen |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20240207 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| P01 | Opt-out of the competence of the unified patent court (upc) registered |
Free format text: CASE NUMBER: APP_49710/2024 Effective date: 20240902 |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) |