EP4118493A1 - Method and device for optimised production of sheet metal parts - Google Patents

Method and device for optimised production of sheet metal parts

Info

Publication number
EP4118493A1
EP4118493A1 EP21711844.7A EP21711844A EP4118493A1 EP 4118493 A1 EP4118493 A1 EP 4118493A1 EP 21711844 A EP21711844 A EP 21711844A EP 4118493 A1 EP4118493 A1 EP 4118493A1
Authority
EP
European Patent Office
Prior art keywords
production
sheet metal
metal parts
event
algorithm
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP21711844.7A
Other languages
German (de)
French (fr)
Inventor
Carina Mieth
Jens Ottnad
Alexandru RINCIOG
Frederick STRUCKMEIER
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Trumpf Werkzeugmaschinen SE and Co KG
Original Assignee
Trumpf Werkzeugmaschinen SE and Co KG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Trumpf Werkzeugmaschinen SE and Co KG filed Critical Trumpf Werkzeugmaschinen SE and Co KG
Publication of EP4118493A1 publication Critical patent/EP4118493A1/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B21MECHANICAL METAL-WORKING WITHOUT ESSENTIALLY REMOVING MATERIAL; PUNCHING METAL
    • B21DWORKING OR PROCESSING OF SHEET METAL OR METAL TUBES, RODS OR PROFILES WITHOUT ESSENTIALLY REMOVING MATERIAL; PUNCHING METAL
    • B21D28/00Shaping by press-cutting; Perforating
    • B21D28/24Perforating, i.e. punching holes
    • B21D28/26Perforating, i.e. punching holes in sheets or flat parts
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B13/00Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion
    • G05B13/02Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric
    • G05B13/0265Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric the criterion being a learning criterion
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B13/00Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion
    • G05B13/02Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric
    • G05B13/0265Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric the criterion being a learning criterion
    • G05B13/027Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric the criterion being a learning criterion using neural networks only
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/084Backpropagation, e.g. using gradient descent
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00Computing arrangements using knowledge-based models
    • G06N5/01Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/04Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem"
    • G06Q10/043Optimisation of two dimensional placement, e.g. cutting of clothes or wood
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0631Resource planning, allocation, distributing or scheduling for enterprises or organisations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/04Manufacturing
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30Computing systems specially adapted for manufacturing

Definitions

  • the invention relates to a method for optimizing the production of Blechtei sources.
  • the invention also relates to a device for performing such a method.
  • Sheet metal parts appear in a wide variety of products in a wide variety of geometries. To manufacture products with sheet metal parts, the sheet metal parts are cut out of a large sheet metal, separated, deburred, bent, joined, coated and / or assembled.
  • the sheet metal parts are manufactured in so-called orders.
  • An order includes i) the production of a cut, separated, bent and / or assembled sheet metal part or ii) the production of several cut, separated, bent and / or assembled sheet metal parts within a given production period.
  • the individual sheet metal parts should be cut out of the sheet metal in such a way that as little residual material (waste) as possible remains as waste from the sheet metal. Since the sheet metal parts of different orders can have different geometries, it can be advantageous to optimize waste to provide sheet metal parts of different orders to save space together on a metal sheet.
  • the sheet metal parts can be produced on several identical or similar production machines.
  • several identical or similar bending machines can be provided for bending the separated sheet metal parts.
  • the production machines should be operated with the highest possible utilization.
  • Production planning i.e. planning when which sheet metal part is processed on which production machine, becomes very complex due to the variables described, especially in the case of events such as production machine failures, rush orders and / or production machine capacities that are freed up.
  • JSSP job shop scheduling problem
  • the solution according to the invention thus comprises a method for optimizing the production of sheet metal parts.
  • the method comprises at least the following process steps (before, after and / or between the subsequent process steps, a further process step or several further process steps can be provided): a) cutting out and separating the sheet metal parts (in particular by means of punching or laser cutting); b) bending the sheet metal parts.
  • the method has at least the following method steps (before, after and / or between the following method steps, a further method step or several further method steps can be provided):
  • Neural networks are known to the person skilled in the art, for example, from: [13] Günter Daniel Rey, Karl F. Wender, "Neural Networks", 2nd edition, 2010,
  • the neural network has decision nodes connected via edges.
  • these are part of a Monte Carlo tree search (MCTS) framework, ie an algorithm with a decision tree.
  • MCTS Monte Carlo tree search
  • a promising path is selected in the decision tree (selection), the path is expanded, a simulation is carried out on the basis of the extended path (simulation) and, on the basis of the simulation result, feedback, in particular in the form of a strengthening or weakening, is sent to the Decision tree given (back propagation).
  • MCTS is carried out by the neural network, with the neural network Network is pre-trained through supervised learning. Decision-making and further training take place using self-play and reinforcement learning.
  • Reinforcement learning is understood to be a feedback-based learning process that includes, in particular, the strengthening or weakening of the decision tree of the MCTS framework. Reinforcement learning generally stands for a number of methods of machine learning in which an agent himself constantly learns a strategy to maximize rewards received.
  • the agent is not shown which action is best in which situation but at certain times he receives a reward, which can also be negative. Using these rewards, he approximates a utility function that describes the value of a certain state or action. Details on the implementation can be found in the following publications:
  • supervised learning Under supervised learning a training with given solutions is understood. This supervised learning is generally a branch of machine learning. Learning here means the ability of an artificial intelligence to reproduce laws. The results are known through the laws of nature or expert knowledge and are used to learn the system. A learning algorithm tries to find a hypothesis that makes predictions that are as accurate as possible. A hypothesis is to be understood as a mapping that assigns the presumed output value to each input value. The method is therefore based on a predetermined output to be learned, the results of which are known. The results of the learning process can be compared, ie "monitored", with the known, correct results. Details on the implementation can be found in the following publications:
  • the algorithm is preferably executed in the form of a single player game.
  • the output in method step D) can be made to a manufacturing execution system (MES). This allows the production plan to be implemented directly on the production machines.
  • MES manufacturing execution system
  • the method according to the invention can have one or more of the following process steps in addition to those already mentioned: c) deburring the sheet metal parts; d) joining, in particular welding and / or soldering, the sheet metal parts; e) Coating the sheet metal parts, in particular by painting and / or
  • the method according to the invention is carried out with the AlphaGo algorithm, in a particularly preferred embodiment with the AlphaGo Zero algorithm.
  • the algorithm comprises the previously described Monte Carlo tree search framework with the neural network trained by means of supervised learning and self-play with reinforcement learning.
  • AlphaGo or AlphaGo Zero has proven to be a very powerful algorithm for optimizing the production of sheet metal parts within the scope of the implementation of the invention.
  • the AlphaGo Zero algorithm can be viewed on the following websites:
  • AlphaGo or AlphaGo Zero is preferably implemented in Python and / or Tensorflow. Further details on the implementation of AlphaGo or AlphaGo Zero can be found in the following publications:
  • the training in method step A) is more preferably carried out with heuristically determined solutions of optimized production plans. This gives the neural network a good starting point for further optimization.
  • optimized production plans in the form of earliest due date (EDD) solutions can be used. These solutions have proven to be particularly advantageous, since in practice there are often rush orders that make previous production planning obsolete.
  • a particularly preferred embodiment of the method relates to the case that the optimization includes both the minimization of waste and the optimization of production times. This enables both fast and inexpensive and resource-saving production.
  • the goals of production time optimization are, in particular, the minimum total delay and / or the minimum total production time.
  • the boundary conditions in process step B) can include the production deadlines for the sheet metal parts.
  • the production time optimization can then take into account compliance with the production deadlines. Compliance with production deadlines can be given a higher priority than other goals.
  • the boundary conditions in method step B) can include the values, that is to say the monetary values or prices, of the sheet metal parts.
  • This allows production to be optimized depending on the values of the respective sheet metal parts. In general, this allows the value of a sheet metal part, for example the price of its late manufacture, to be qualified within the scope of the optimization according to the invention.
  • a waste score is allocated to the waste and, when the production deadline is reached, a production deadline score is assigned that is based on the value of the sheet metal parts, with the optimization minimizing both the waste score and the production deadline score. By assigning the scores, the production time minimization can be treated or optimized on the same scale as the waste minimization.
  • the estimated maximum achievable total score value is preferably stored in the decision node;
  • the waste score and the production deadline score can be used, for example, in the form of a price. Then the price for waste material can be weighed against the price of a sheet metal part produced too late. As part of the procedure, the following function can be used to optimize:
  • c (W) represents the value for the total material used (including waste, i.e. waste)
  • T, and v respectively represent the delay and the value of the order part i l is a parameter that penalizes delay.
  • r abs reflects the sum of the sheet metal parts, each reduced proportionally to the production deadlines, minus the total material costs.
  • the formula can be used to generate a reward for the neural network, in particular scaled to [0, 1], the maximum possible score being r max (without delay and without waste).
  • Process steps B) to D) can be triggered as required by the presence of an event, the event being read in via an event interface.
  • the event is preferably in the form of a request for further processing of a sheet metal part, in the form of production machine capacity being freed up, in the form of a production machine failure and / or in the form of a rush order.
  • the event can be triggered automatically and read in via the event interface.
  • the event is particularly preferably triggered by a production machine, an indoor localization system and / or a manufacturing execution system and read in via the event interface.
  • the planning can be further optimized in an automated manner using events transmitted by the tags of the indoor localization system.
  • a user evaluation of the production plan output in process step D) can be read in in a method step E).
  • the invention further relates to a method for the production of sheet metal parts, in which a previously mentioned method is carried out and then the process steps a) and b) are carried out on the basis of the optimized production plan.
  • process steps c), d), e) and / or f) can be carried out on the basis of the optimized production plan.
  • the object of the invention is also achieved by a device for performing a method described here, the device having a computer for storing and executing the neural network, a boundary conditions interface for reading in the boundary conditions and a production plan interface for outputting the production plan.
  • a user evaluation interface can be provided for reading in the user evaluations.
  • the neural network can be cloud-based in order to facilitate training with, in particular anonymized, user reviews.
  • the device according to the invention can have the event interface and furthermore have a production machine, an indoor localization system (with several tags that transmit events) and / or a manufacturing execution system, one of the production machine, the indoor localization system and / or The event triggered by the manufacturing execution system can be read in via the event interface.
  • the device can be optimized in an automated or partially automated manner.
  • Fig. 1 shows schematically the production sequence in the manufacture of sheet metal parts.
  • Fig. 2 shows schematically the optimization of the production process.
  • Fig. 1 shows schematically the production of various orders.
  • the orders Aoi to Aio are shown by way of example.
  • the orders Aoi-Aio include the manufacture of products Poi to Pio, which are made from several, in particular different, sheet metal parts with their respective geometric data.
  • the sheet metal parts Bi and B 2 are provided with a reference symbol in FIG. 1.
  • the individual sheet metal parts Bi, B 2 have different production times. Furthermore, orders A 0i to A i0 have different production deadlines F 01 to F 10 . Piggy banks indicate that the sheet metal parts Bi, B 2 have different (money) values. The specifications described ben represent boundary conditions 10 of the sheet metal parts Bi, B 2 .
  • the sheet metal parts Bi, B 2 are arranged on a sheet metal 12 in such a way that the waste is minimal. As can be seen from FIG. 1, this can lead to the mixing of sheet metal parts Bi, B 2 of different orders A01-A10.
  • the sheet metal parts Bi, B 2 are processed on production machines 14, of which in Fig. 1 production machines Ci, C 2 (cut) for cutting and singling, production machines bi, b 2 (bend) for bending and production machines ai, a 2 (assemble ) for mounting the sheet metal parts Bi, B 2 are shown.
  • further production machines 14, not shown in FIG. 1 can be provided for processing the sheet metal parts Bi, B 2 , for example for deburring, joining and / or coating the sheet metal parts Bi, B 2 .
  • the finished products comprising the sheet metal parts Bi, B 2 are shown in FIG. 1 at reference number 16.
  • the distribution of the sheet metal parts Bi, B2 to the production machines 14 represents a highly complex problem with the various boundary conditions 10 of the sheet metal parts Bi, B2. This is particularly true because the individual process steps take different lengths of time, production machines 14 fail and / or urgent orders can be received .
  • FIG. 2 shows a device 18 for the optimized production or optimized production planning of the sheet metal parts Bi, B 2 from FIG. 1.
  • An algorithm 20 is provided for this purpose.
  • the algorithm 20 is preferably in the form of AlphaGo or AlphaGo Zero.
  • the algorithm 20 comprises a Monte Carlo tree search framework 22.
  • the Monte Carlo tree search framework 22 is modified by a neural network 24.
  • supervised learning is carried out, i.e. training based on heuristically determined problem solutions.
  • step 26 selection
  • step 28 the decision tree with the decision nodes is expanded according to the random principle
  • the result of this is simulated in step 30 and the decision nodes are reweighted on the basis of this simulation result in step 32 (strengthened or weakened).
  • steps 26 to 32 are repeated several times. The determination of the optimal division of the production steps carried out in this way preferably takes place both with regard to minimizing waste (nesting) and with regard to production time optimization (scheduling).
  • This process can be described as optimization by a nesting agent and a scheduling agent, in which the agents make decisions in a simulation environment and receive a reward depending on the quality of the decision.
  • the simulation is an image of the sheet metal production.
  • the optimized production plan is output via a production plan interface 34, in particular to a manufacturing execution system 36.
  • the manufacturing execution system 36 controls the production machines 14, that is to say the real sheet metal production, with the optimized production plan.
  • the algorithm 20 is supplied with the boundary conditions 10 via a boundary condition interface 38.
  • User evaluations 40 can be fed to the algorithm 20 via a user evaluation interface 42.
  • an event interface 44 can be provided, via which an event 46 can be read.
  • the event 46 can be triggered by the manufacturing-execution-system 36, one or more production machines 14 and / or an indoor localization system 48.
  • the event 46 can include, for example, a failure of a production machine 14, capacity of a production machine 14 that is freed up, errors in production, new orders and / or order changes.
  • the event 46 includes the further production planning for a sheet metal part Bi, B 2 (see FIG. 1) that has just completed a production step in a production machine 14.
  • the algorithm 20 is executed on a computer 50.
  • the computer 50 can be cloud-based in order to facilitate the use of user reviews 40 from different users.
  • the manufacturing execution system 36 can be executed (as indicated) on the same computer or on a different computer.
  • the invention relates in summary to a method for optimizing the production of sheet metal parts Bi, B 2 .
  • the method optimizes the allocation of sheet metal parts Bi, B 2 for processing on different production machines 14 and outputs an optimized production plan.
  • an algorithm 20 is provided which has a decision tree in the form of a Monte Carlo tree search framework 22 and a neural network 24.
  • the algorithm 20 is used with each new query trained through self-play and reinforcement learning.
  • a pre-training of the algorithm 20 is achieved through supervised learning.
  • the algorithm 20 preferably optimizes the production plan primarily with regard to minimally delayed production periods Foi to Fio of the sheet metal parts Bi, B2 and secondarily with regard to a minimal waste. By assigning scores, both goals can be assessed together.
  • the method can include the receipt of query-triggering events 46 and / or the operation of production machines 14 in accordance with the production plan.
  • the invention also relates to a device 18 for carrying out the method.
  • Ci c 2 cutting production machines bi, b 2 bending production machines ai, a 2 assembly production machines 10 boundary conditions

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Physics & Mathematics (AREA)
  • Economics (AREA)
  • Strategic Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Marketing (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Evolutionary Computation (AREA)
  • Health & Medical Sciences (AREA)
  • Development Economics (AREA)
  • Quality & Reliability (AREA)
  • Operations Research (AREA)
  • Game Theory and Decision Science (AREA)
  • Software Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Primary Health Care (AREA)
  • Manufacturing & Machinery (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Automation & Control Theory (AREA)
  • Educational Administration (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Computing Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Mechanical Engineering (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Bending Of Plates, Rods, And Pipes (AREA)

Abstract

The invention relates to a method for optimising production of sheet metal parts. The method optimises the allocation of sheet metal parts for processing on various production machines (14) and outputs an optimised production plan. An algorithm (20) is provided for this, which has a decision tree in the form of a Monte Carlo tree search framework (22) and a neural network (24). With each new query, the algorithm (20) is trained by means of self-play and reinforcement learning. Pre-training of the algorithm (20) is achieved by means of supervised learning. The algorithm (20) preferably optimises the production plan primarily with regard to minimally behind-schedule production deadlines for the sheet metal parts and secondarily with regard to minimal waste. Both goals can be evaluated jointly through the awarding of scores. The method can comprise receiving query-triggering events 46 and/or operating production machines (14) in accordance with the production plan. The invention further relates to a device (18) for carrying out the method.

Description

Verfahren und Vorrichtung zur optimierten Produktion von Blechteilen Process and device for the optimized production of sheet metal parts
Hintergrund der Erfindung Background of the invention
Die Erfindung betrifft ein Verfahren zur Optimierung der Produktion von Blechtei len. Die Erfindung betrifft weiterhin eine Vorrichtung zur Durchführung eines sol chen Verfahrens. The invention relates to a method for optimizing the production of Blechtei sources. The invention also relates to a device for performing such a method.
Blechteile kommen in verschiedensten Produkten in verschiedensten Geometrien vor. Zur Herstellung von Produkten mit Blechteilen werden die Blechteile aus einer großen Blechtafel ausgeschnitten, vereinzelt, entgratet, gebogen, gefügt, be schichtet und/oder montiert. Sheet metal parts appear in a wide variety of products in a wide variety of geometries. To manufacture products with sheet metal parts, the sheet metal parts are cut out of a large sheet metal, separated, deburred, bent, joined, coated and / or assembled.
Die Herstellung der Blechteile erfolgt dabei in sogenannten Aufträgen. Ein Auftrag beinhaltet i) die Herstellung eines ausgeschnittenen, vereinzelten, gebogenen und/oder montierten Blechteils oder ii) die Herstellung mehrerer ausgeschnittener, vereinzelter, gebogener und/oder montierter Blechteile innerhalb einer vorgegebenen Produktionsfrist. Die einzelnen Blechteile sollten so aus der Blechtafel ausgeschnitten werden, dass möglichst wenig Restmaterial (Verschnitt) der Blechtafel als Abfall verbleibt. Da die Blechteile verschiedener Aufträge verschiedene Geometrien aufweisen können, kann es zur Verschnittoptimierung vorteilhaft sein, Blechteile verschiedener Auf träge platzsparend gemeinsam auf einer Blechtafel vorzusehen. The sheet metal parts are manufactured in so-called orders. An order includes i) the production of a cut, separated, bent and / or assembled sheet metal part or ii) the production of several cut, separated, bent and / or assembled sheet metal parts within a given production period. The individual sheet metal parts should be cut out of the sheet metal in such a way that as little residual material (waste) as possible remains as waste from the sheet metal. Since the sheet metal parts of different orders can have different geometries, it can be advantageous to optimize waste to provide sheet metal parts of different orders to save space together on a metal sheet.
Die hierdurch entstehende zeitliche Vermischung der Aufträge erhöht jedoch die Komplexität bei der Produktionsplanung. Hinzu kommt, dass die Produktion der Blechteile auf mehreren gleichen oder ähnlichen Produktionsmaschinen erfolgen kann. Beispielsweise können zum Biegen der vereinzelten Blechteile mehrere glei- che oder ähnliche Biegemaschinen vorgesehen sein. Die Produktionsmaschinen sollten dabei mit möglichst hoher Auslastung betrieben werden. The resulting mixing of orders in time increases the complexity of production planning. In addition, the sheet metal parts can be produced on several identical or similar production machines. For example, several identical or similar bending machines can be provided for bending the separated sheet metal parts. The production machines should be operated with the highest possible utilization.
Die Produktionsplanung, also die Planung, wann welches Blechteil auf welcher Pro duktionsmaschine bearbeitet wird, wird durch die beschriebenen Variablen sehr komplex, insbesondere im Fall von Ereignissen wie Produktionsmaschinenausfäl len, Eilaufträgen und/oder freiwerdenden Produktionsmaschinenkapazitäten. Production planning, i.e. planning when which sheet metal part is processed on which production machine, becomes very complex due to the variables described, especially in the case of events such as production machine failures, rush orders and / or production machine capacities that are freed up.
Die optimale Produktionsplanung wird als Lösung eines job-shop-scheduling-prob- lems (JSSP) bezeichnet. Lösungen und Lösungsansätze hierzu finden sich in fol- genden Veröffentlichungen: Optimal production planning is known as the solution to a job shop scheduling problem (JSSP). Solutions and approaches to this can be found in the following publications:
[1] F. Pfitzer, J. Provost, C. Mieth, and W. Liertz, "Event-driven production re- scheduling in job shop environments", in 2018 IEEE 14th International Con ference on Automation Science and Engineering (CASE), IEEE, 2018, pp. 939-944; [2] M. Putz and A. Schlegel, "Simulationsbasierte Untersuchung von Prioritäts und Kommissionierregeln zur Steuerung des Materialflusses in der Blechin dustrie"; [3] L. L. Li, C. B. Li, L. Li, Y. Tang, and Q. S. Yang, "An integrated approach for remanufacturing job shop scheduling with routing alternatives.", Mathemat- ical biosciences and engineering: MBE, vol. 16, no. 4, pp. 2063-2085, 2019; [1] F. Pfitzer, J. Provost, C. Mieth, and W. Liertz, "Event-driven production scheduling in job shop environments", in 2018 IEEE 14th International Conference on Automation Science and Engineering (CASE), IEEE, 2018, pp. 939-944; [2] M. Putz and A. Schlegel, "Simulation-based investigation of priority and picking rules for controlling the material flow in the sheet metal industry"; [3] LL Li, CB Li, L. Li, Y. Tang, and QS Yang, "An integrated approach for remanufacturing job shop scheduling with routing alternatives.", Mathematical biosciences and engineering: MBE, vol. 16, no. 4, pp. 2063-2085, 2019;
[4] M. Gondran, M.-J. Huguet, P. Lacomme, and N. Tchernev, "Comparison be- tween two approaches to solve the job-shop scheduling problem with rout ing", 2019; [4] M. Gondran, M.-J. Huguet, P. Lacomme, and N. Tchernev, "Comparison between two approaches to solve the job-shop scheduling problem with routing", 2019;
[5] J. J. van Hoorn, "The current state of bounds on benchmark instances of the job-shop scheduling problem", Journal of Scheduling, vol. 21, no. 1, pp. 127-128, 2018; [5] J. J. van Hoorn, "The current state of bounds on benchmark instances of the job-shop scheduling problem," Journal of Scheduling, vol. 21, no. 1, pp. 127-128, 2018;
[6] S.-C. Lin, E. D. Goodman, and W. F. Punch III, "A genetic algorithm approach to dynamic job shop scheduling problem", in ICGA, 1997, pp. 481-488; [6] S.-C. Lin, E. D. Goodman, and W. F. Punch III, "A genetic algorithm approach to dynamic job shop scheduling problem," in ICGA, 1997, pp. 481-488;
[7] T. Yamada and R. Nakano, "Scheduling by genetic local search with multi- step crossover", in International Conference on Parallel Problem Solving from Nature, Springer, 1996, pp. 960- 969; [7] T. Yamada and R. Nakano, "Scheduling by genetic local search with multistep crossover", in International Conference on Parallel Problem Solving from Nature, Springer, 1996, pp. 960-969;
[8] B. M. Ombuki and M. Ventresca, "Local search genetic algorithms for the job shop scheduling problem", Applied Intelligence, vol. 21, no. 1, pp. 99-109, 2004; [8] B. M. Ombuki and M. Ventresca, "Local search genetic algorithms for the job shop scheduling problem," Applied Intelligence, vol. 21, no. 1, pp. 99-109, 2004;
[9] E. S. Nicoara, F. G. Filip, and N. Paraschiv, "Simulation-based optimization using genetic algorithms for multi-objective flexible jssp", Studies in Infor- matics and Control, vol. 20, no. 4, pp. 333-344, 2011; [9] E. S. Nicoara, F. G. Filip, and N. Paraschiv, "Simulation-based optimization using genetic algorithms for multi-objective flexible jssp", Studies in Informatics and Control, vol. 20, no. 4, pp. 333-344, 2011;
[10] L. Asadzadeh, "A local search genetic algorithm for the job shop scheduling problem with intelligent agents", Computers & Industrial Engineering, vol. 85, pp. 376-383, 2015; [10] L. Asadzadeh, "A local search genetic algorithm for the job shop scheduling problem with intelligent agents," Computers & Industrial Engineering, vol. 85, pp. 376-383, 2015;
[11] B. Waschneck, A. Reichstaller, L. Belzner, T. Altenmüller, T. Bauernhansl, A. Knapp, and Kyek, "Optimization of global production scheduling with deep reinforcement learning", Procedia CIRP, vol. 72, pp. 1264-1269, 2018; [11] B. Waschneck, A. Reichstaller, L. Belzner, T. Altenmüller, T. Bauernhansl, A. Knapp, and Kyek, "Optimization of global production scheduling with deep reinforcement learning", Procedia CIRP, vol. 72, pp. 1264-1269, 2018;
[12] M. Botvinick, S. Ritter, J. X. Wang, Z. Kurth-Nelson, C. Blundell, and D. Has- sabis, "Reinforcement learning, fast and slow", Trends in cognitive Sciences, 2019. [12] M. Botvinick, S. Ritter, J. X. Wang, Z. Kurth-Nelson, C. Blundell, and D. Hasabis, "Reinforcement learning, fast and slow", Trends in cognitive Sciences, 2019.
Weiterhin ist es aus der WO 2017/157809 Al bekannt geworden, eine Produkti onsplanung mit einer Optimiereinheit und einer davon getrennten Verteileinheit vorzusehen. Trotz umfangreicher Bemühungen konnte aufgrund der Komplexität der Aufgabe eine zufriedenstellende Produktionsplanung jedoch bislang nicht erzielt werden. Furthermore, it has become known from WO 2017/157809 A1 to provide a production planning with an optimization unit and a distribution unit separate therefrom. Despite extensive efforts, due to the complexity of the task, a satisfactory production planning has not yet been achieved.
Aufgabe der Erfindung Object of the invention
Es ist daher Aufgabe der Erfindung, ein Verfahren und eine Vorrichtung zur opti mierten Produktion von Blechteilen bereit zu stellen. It is therefore the object of the invention to provide a method and a device for the optimized production of sheet metal parts.
Beschreibung der Erfindung Description of the invention
Diese Aufgabe wird erfindungsgemäß gelöst durch ein Verfahren gemäß An spruch 1 und eine Vorrichtung gemäß Anspruch 13. Die Unteransprüche geben bevorzugte Weiterbildungen wieder. This object is achieved according to the invention by a method according to claim 1 and a device according to claim 13. The subclaims reproduce preferred developments.
Die erfindungsgemäße Lösung umfasst somit ein Verfahren zur Optimierung der Produktion von Blechteilen. Das Verfahren umfasst zumindest folgende Prozess schritten (vor, nach und/oder zwischen den nachfolgenden Prozessschritten kann ein weiterer Prozessschritt oder können mehrere weitere Prozessschritte vorgese- hen sein): a) Ausschneiden und Vereinzeln der Blechteile (insbesondere mittels Stanzen oder Laserschneiden); b) Biegen der Blechteile. The solution according to the invention thus comprises a method for optimizing the production of sheet metal parts. The method comprises at least the following process steps (before, after and / or between the subsequent process steps, a further process step or several further process steps can be provided): a) cutting out and separating the sheet metal parts (in particular by means of punching or laser cutting); b) bending the sheet metal parts.
Das Verfahren weist zumindest folgende Verfahrensschritte auf (vor, nach und/0- der zwischen den nachfolgenden Verfahrensschritten kann ein weiterer Verfah rensschritt oder können mehrere weitere Verfahrensschritte vorgesehen sein):The method has at least the following method steps (before, after and / or between the following method steps, a further method step or several further method steps can be provided):
A) Training eines auf einem Monte-Carlo-tree-search-framework durchgeführ ten neuronalen Netzes mittels supervised-learning und self-play mit rein- forcement-learning; B) Erfassen von Randbedingungen der Blechteile, wobei die Randbedingungen zumindest geometrische Daten der Blechteile umfassen; A) Training of a neural network carried out on a Monte Carlo tree search framework by means of supervised learning and self-play with reinforcement learning; B) detecting boundary conditions of the sheet metal parts, the boundary conditions including at least geometric data of the sheet metal parts;
C) Erstellen eines optimierten Produktionsplans durch das neuronale Netz;C) Creation of an optimized production plan by the neural network;
D) Ausgabe des Produktionsplans. Erfindungsgemäß ist es somit vorgesehen, eine Optimierung mit einem neuronalen Netz (NN) vorzusehen. Neuronale Netze sind dem Fachmann beispielsweise be kannt aus: [13] Günter Daniel Rey, Karl F. Wender, „Neuronale Netze", 2. Auflage, 2010,D) Output of the production plan. According to the invention it is therefore provided to provide an optimization with a neural network (NN). Neural networks are known to the person skilled in the art, for example, from: [13] Günter Daniel Rey, Karl F. Wender, "Neural Networks", 2nd edition, 2010,
Huber. Huber.
Das neuronale Netz weist über Kanten verbundene Entscheidungsknoten auf. Diese sind im vorliegenden Fall Teil eines Monte-Carlo-tree-search-(MCTS)-frame- works, also einem Algorithmus mit einem Entscheidungsbaum. Dabei wird in dem Entscheidungsbaum ein aussichtsreicher Pfad gewählt (selection), der Pfad erwei tert (expansion), eine Simulation auf Grundlage des erweiterten Pfads (Simulation) durchgeführt und auf Grundlage des Simulationsergebnisses eine Rückmeldung, insbesondere in Form einer Stärkung oder Schwächung, an den Entscheidungs- bäum gegeben (backpropagation). Details zur Implementierung eines MCTS- framework kann folgender Veröffentlichung entnommen werden: The neural network has decision nodes connected via edges. In the present case, these are part of a Monte Carlo tree search (MCTS) framework, ie an algorithm with a decision tree. A promising path is selected in the decision tree (selection), the path is expanded, a simulation is carried out on the basis of the extended path (simulation) and, on the basis of the simulation result, feedback, in particular in the form of a strengthening or weakening, is sent to the Decision tree given (back propagation). Details on the implementation of an MCTS framework can be found in the following publication:
[14]G. Chaslot, S. Bakkes, I. Szita, and P. Spronck, "Monte-carlo tree search: A new framework for game ai", in AIIDE, 2008. Im vorliegenden Fall wird die MCTS durch das neuronale Netz durchgeführt, wobei das neuronale Netz durch supervised-learning vortrainiert wird. Die Entschei dungsfindung und weiteres Training erfolgt mittels self-play und reinforcement learning. Unter reinforcement-learning (RL) wird ein Rückmeldungs-basierter Lernprozess verstanden, der insbesondere die Stärkung bzw. Schwächung des Entscheidungs baums des MCTS-frameworks umfasst. Reinforcement-learning steht allgemein für eine Reihe von Methoden des maschinellen Lernens, bei denen ein Agent selbst ständig eine Strategie erlernt, um erhaltene Belohnungen (rewards) zu maximie- ren. Dabei wird dem Agenten nicht vorgezeigt, welche Aktion in welcher Situation die beste ist, sondern er erhält zu bestimmten Zeitpunkten eine Belohnung, die auch negativ sein kann. Anhand dieser Belohnungen approximiert er eine Nutzen funktion, die beschreibt, welchen Wert ein bestimmter Zustand oder Aktion hat. Details zur Implementierung können folgenden Veröffentlichungen entnommen werden: [14] G. Chaslot, S. Bakkes, I. Szita, and P. Spronck, "Monte Carlo tree search: A new framework for game ai", in AIIDE, 2008. In the present case, the MCTS is carried out by the neural network, with the neural network Network is pre-trained through supervised learning. Decision-making and further training take place using self-play and reinforcement learning. Reinforcement learning (RL) is understood to be a feedback-based learning process that includes, in particular, the strengthening or weakening of the decision tree of the MCTS framework. Reinforcement learning generally stands for a number of methods of machine learning in which an agent himself constantly learns a strategy to maximize rewards received. The agent is not shown which action is best in which situation but at certain times he receives a reward, which can also be negative. Using these rewards, he approximates a utility function that describes the value of a certain state or action. Details on the implementation can be found in the following publications:
[15] W. Zhang and T. G. Dietterich, "A reinforcement learning approach to job- shop scheduling", in IJCAI, Citeseer, vol. 95, 1995, pp. 1114-1120; [15] W. Zhang and T. G. Dietterich, "A reinforcement learning approach to job-shop scheduling", in IJCAI, Citeseer, vol. 95, 1995, pp. 1114-1120;
[16] R. S. Sutton, A. G. Barto, et al., Introduction to reinforcement learning, 4. MIT press Cam- bridge, 1998, vol. 2; [16] R. S. Sutton, A. G. Barto, et al., Introduction to reinforcement learning, 4. MIT press Cambridge, 1998, vol. 2;
[17] S. Mahadevan and G. Theocharous, "Optimizing production manufacturing using reinforcement learning.", in FI_AIRS Conference, 1998, pp. 372-377; [17] S. Mahadevan and G. Theocharous, "Optimizing production manufacturing using reinforcement learning.", In FI_AIRS Conference, 1998, pp. 372-377;
[18] S. J. Bradtke and M. 0. Duff, "Reinforcement learning methods for continu- ous-time markov decision Problems", in Advances in neural Information Pro cessing Systems, 1995, pp. 393-400; [18] S. J. Bradtke and M. 0. Duff, "Reinforcement learning methods for continuation-time markov decision problems", in Advances in neural information processing systems, 1995, pp. 393-400;
[19] S. Riedmiller and M. Riedmiller, "A neural reinforcement learning approach to learn local dispatching policies in production scheduling", in IJCAI, vol. 2, 1999, pp. 764-771; [19] S. Riedmiller and M. Riedmiller, "A neural reinforcement learning approach to learn local dispatching policies in production scheduling", in IJCAI, vol. 2, 1999, pp. 764-771;
[20] C. D. Paternina-Arboleda and T. K. Das, "A multi-agent reinforcement learn ing approach to obtaining dynamic control policies for stochastic lot sched uling problem", Simulation Modelling Practice and Theory, vol. 13, no. 5, pp. 389-406, 2005; [20] C. D. Paternina-Arboleda and T. K. Das, "A multi-agent reinforcement learning approach to obtaining dynamic control policies for stochastic lot scheduling problem," Simulation Modeling Practice and Theory, vol. 13, no. 5, pp. 389-406, 2005;
[21]T. Gabel and M. Riedmiller, "Scaling adaptive agent-based reactive job-shop scheduling to large-scale Problems", in 2007 IEEE Symposium on Computa- tional Intelligence in Scheduling, IEEE, 2007, pp. 259-266; [21] T. Gabel and M. Riedmiller, "Scaling adaptive agent-based reactive job-shop scheduling to large-scale problems", in 2007 IEEE Symposium on Computational Intelligence in Scheduling, IEEE, 2007, pp. 259-266;
[22]Y. C. F. Reyna, Y. M. Jim 'enez, J. M. B. Cabrera, and B. M. M. Hernändez, "A reinforcement learning approach for scheduling Problems", Investigaciön Operacional, vol. 36, no. 3, pp. 225-231, 2015; [22] YCF Reyna, YM Jim ' enez, JMB Cabrera, and BMM Hernandez, "A reinforcement learning approach for scheduling problems," Investigacion Operacional, vol. 36, no. 3, pp. 225-231, 2015;
[23] S. Qu, J. Wang, S. Govil, and J. O. Leckie, "Optimized adaptive scheduling of a manufacturing process System with multi-skill workforce and multiple machine types: An ontology-based, multi-agent reinforcement learning ap proach", Procedia CIRP, vol. 57, pp. 55-60, 2016; [23] S. Qu, J. Wang, S. Govil, and JO Leckie, "Optimized adaptive scheduling of a manufacturing process system with multi-skill workforce and multiple machine types: An ontology-based, multi-agent reinforcement learning ap proach ", Procedia CIRP, vol. 57, pp. 55-60, 2016;
[24]V. Mnih, K. Kavukcuoglu, D. Silver, A. Graves, I. Antonoglou, D. Wierstra, and M. Ried- miller, "Playing atari with deep reinforcement learning", arXiv preprint arXiv: 1312.5602, 2013; [24] V. Mnih, K. Kavukcuoglu, D. Silver, A. Graves, I. Antonoglou, D. Wierstra, and M. Ried-miller, "Playing atari with deep reinforcement learning", arXiv preprint arXiv: 1312.5602, 2013;
[25]A. Kuhnle, L. Schäfer, N. Stricker, and G. Lanza, "Design, Implementation and evaluation of reinforcement learning for an adaptive Order dispatching in job shop manufacturing Systems", Procedia CIRP, vol. 81, pp. 234-239, 2019; [25] A. Kuhnle, L. Schäfer, N. Stricker, and G. Lanza, "Design, Implementation and evaluation of reinforcement learning for an adaptive order dispatching in job shop manufacturing systems ", Procedia CIRP, vol. 81, pp. 234-239, 2019;
[26] N. Stricker, A. Kuhnle, R. Sturm, and S. Friess, "Reinforcement learning for adaptive Order dispatching in the semiconductor industry", CIRP Annals, vol. 67, no. 1, pp. 511-514, 2018; [26] N. Stricker, A. Kuhnle, R. Sturm, and S. Friess, "Reinforcement learning for adaptive order dispatching in the semiconductor industry," CIRP Annals, vol. 67, no. 1, pp. 511-514, 2018;
[27] J . Schulman, S. Levine, P. Abbeel, M. Jordan, and P. Moritz, "Trust region policy optimization", in International Conference on machine learning, 2015, pp. 1889-1897. [27] J. Schulman, S. Levine, P. Abbeel, M. Jordan, and P. Moritz, "Trust region policy optimization", in International Conference on machine learning, 2015, pp. 1889-1897.
Unter supervised-learning wird ein Training mit vorgegebenen Lösungen verstan den. Dieses überwachte Lernen ist allgemein ein Teilgebiet des maschinellen Ler nens. Mit Lernen ist dabei die Fähigkeit einer künstlichen Intelligenz gemeint, Ge setzmäßigkeiten nachzubilden. Die Ergebnisse sind durch Naturgesetze oder Ex pertenwissen bekannt und werden benutzt, um das System anzulernen. Ein Ler nalgorithmus versucht, eine Hypothese zu finden, die möglichst zielsichere Voraus sagen trifft. Unter Hypothese ist dabei eine Abbildung zu verstehen, die jedem Eingabewert den vermuteten Ausgabewert zuordnet. Die Methode richtet sich also nach einer im Vorhinein festgelegten zu lernenden Ausgabe, deren Ergebnisse be kannt sind. Die Ergebnisse des Lernprozesses können mit den bekannten, richtigen Ergebnissen verglichen, also „überwacht", werden. Details zur Implementierung kann den folgenden Veröffentlichungen entnommen werden: Under supervised learning a training with given solutions is understood. This supervised learning is generally a branch of machine learning. Learning here means the ability of an artificial intelligence to reproduce laws. The results are known through the laws of nature or expert knowledge and are used to learn the system. A learning algorithm tries to find a hypothesis that makes predictions that are as accurate as possible. A hypothesis is to be understood as a mapping that assigns the presumed output value to each input value. The method is therefore based on a predetermined output to be learned, the results of which are known. The results of the learning process can be compared, ie "monitored", with the known, correct results. Details on the implementation can be found in the following publications:
[28] M. Gombolay, R. Jensen, J. Stigile, S.-H. Son, and J. Shah, "Apprenticeship scheduling: Learning to schedule from human experts", AAAI Press/Interna- tional Joint Conferences on Artificial Intelligence, 2016; [28] M. Gombolay, R. Jensen, J. Stigile, S.-H. Son, and J. Shah, "Apprenticeship scheduling: Learning to schedule from human experts", AAAI Press / International Joint Conferences on Artificial Intelligence, 2016;
[29] H. Ingimundardottir and T. P. Runarsson, "Supervised learning linear priority dispatch rules for job-shop scheduling", in International Conference on learn ing and intelligent optimization, Springer, 2011, pp. 263-277. [29] H. Ingimundardottir and T. P. Runarsson, "Supervised learning linear priority dispatch rules for job-shop scheduling", in International Conference on learning and intelligent optimization, Springer, 2011, pp. 263-277.
Die Ausführung des Algorithmus erfolgt vorzugsweise in Form eines single-player- games. The algorithm is preferably executed in the form of a single player game.
Die Kombination aus Monte-Carlo-tree-search-framework basiertem neuronalen Netz und Training dieses neuronalen Netzes mittels supervised-learning und self- play mit reinforcement-learning führt zu einer Optimierung, die die bekannten Op timierungen in der Blechbearbeitung signifikant übertreffen. The combination of a Monte Carlo tree search framework based neural network and training of this neural network by means of supervised learning and self- play with reinforcement learning leads to an optimization that significantly surpasses the known optimizations in sheet metal processing.
Bevorzugte Ausführunqsformen Preferred embodiments
Die Ausgabe im Verfahrensschritt D) kann an ein manufacturing-execution-system (MES) erfolgen. Hierdurch kann der Produktionsplan direkt an den Produktionsma schinen umgesetzt werden. The output in method step D) can be made to a manufacturing execution system (MES). This allows the production plan to be implemented directly on the production machines.
Das erfindungsgemäße Verfahren kann zusätzlich zu den bereits genannten einen oder mehrere der folgenden Prozessschritte aufweist: c) Entgraten der Blechteile; d) Fügen, insbesondere Schweißen und/oder Löten, der Blechteile; e) Beschichten der Blechteile, insbesondere durch Lackieren und/oderThe method according to the invention can have one or more of the following process steps in addition to those already mentioned: c) deburring the sheet metal parts; d) joining, in particular welding and / or soldering, the sheet metal parts; e) Coating the sheet metal parts, in particular by painting and / or
Pulverbeschichten; f) Montieren der Blechteile. Powder coating; f) Assemble the sheet metal parts.
Jeder dieser Prozessschritte kann durch Produktionsmaschinen erfolgen und durch das erfindungsgemäße Verfahren optimiert werden. Each of these process steps can be carried out by production machines and optimized by the method according to the invention.
In bevorzugter Ausgestaltung der Erfindung wird das erfindungsgemäße Verfahren mit dem Algorithmus AlphaGo, in besonders bevorzugter Ausgestaltung mit dem Algorithmus AlphaGo Zero, durchgeführt. In diesem Fall umfasst der Algorithmus das zuvor beschriebene Monte-Carlo-tree-search-framework mit dem mittels su- pervised-learning und self-play mit reinforcement-learning trainierte neuronale Netz. AlphaGo bzw. AlphaGo Zero hat sich im Rahmen der Erfindungsumsetzung als ein sehr leistungsstarker Algorithmus bei der Optimierung der Fertigung von Blechteilen erwiesen. In a preferred embodiment of the invention, the method according to the invention is carried out with the AlphaGo algorithm, in a particularly preferred embodiment with the AlphaGo Zero algorithm. In this case, the algorithm comprises the previously described Monte Carlo tree search framework with the neural network trained by means of supervised learning and self-play with reinforcement learning. AlphaGo or AlphaGo Zero has proven to be a very powerful algorithm for optimizing the production of sheet metal parts within the scope of the implementation of the invention.
Der Algorithmus AlphaGo Zero ist auf folgenden Webseiten einsehbar: The AlphaGo Zero algorithm can be viewed on the following websites:
• https://tmoer.github.io/AlphaZero/ • https://tmoer.github.io/AlphaZero/
• https://towardsdatascience.com/alphazero-implementation-and-tutorial- f4324d65fdfc • https://medium.com/applied-data-science/how-to-build-your-own-alpha- zero-ai-using-python-and-keras-7f664945cl88 • https://towardsdatascience.com/alphazero-implementation-and-tutorial- f4324d65fdfc • https://medium.com/applied-data-science/how-to-build-your-own-alpha- zero-ai-using-python-and-keras-7f664945cl88
AlphaGo bzw. AlphaGo Zero ist vorzugsweise in Python und/oder Tensorflow im plementiert. Weitere Details zur Implementierung von AlphaGo bzw. AlphaGo Zero sind folgenden Veröffentlichungen entnehmbar: AlphaGo or AlphaGo Zero is preferably implemented in Python and / or Tensorflow. Further details on the implementation of AlphaGo or AlphaGo Zero can be found in the following publications:
[30] D. Silver, A. Huang, C. J. Maddison, A. Guez, L. Sifre, G. Van Den Driessche, J. Schrittwieser, I. Antonoglou, V. Panneershelvam, M. Lanctot, et al., "Mas- tering the game of go with deep neural networks and tree search", nature, vol. 529, no. 7587, p. 484, 2016. [30] D. Silver, A. Huang, CJ Maddison, A. Guez, L. Sifre, G. Van Den Driessche, J. Stepwieser, I. Antonoglou, V. Panneershelvam, M. Lanctot, et al., "Mas - tering the game of go with deep neural networks and tree search ", nature, vol. 529, no.7587, p. 484, 2016.
[31]G. Chaslot, S. Bakkes, I. Szita, and P. Spronck, "Monte-carlo tree search: A new framework for game ai.", in AIIDE, 2008. [31] G. Chaslot, S. Bakkes, I. Szita, and P. Spronck, "Monte-Carlo tree search: A new framework for game ai.", In AIIDE, 2008.
[32] D. Silver, J. Schrittwieser, K. Simonyan, I. Antonoglou, A. Huang, A. Guez, T. Hubert, L. Baker, M. Lai, A. Bolton, et al., "Mastering the game of go without human knowledge", Nature, vol. 550, no. 7676, p. 354, 2017. [32] D. Silver, J. Stepwieser, K. Simonyan, I. Antonoglou, A. Huang, A. Guez, T. Hubert, L. Baker, M. Lai, A. Bolton, et al., "Mastering the game of go without human knowledge, "Nature, vol. 550, no.7676, p. 354, 2017.
[33] D. Silver, T. Hubert, J. Schrittwieser, I. Antonoglou, M. Lai, A. Guez, M. Lanctot, L. Sifre, D. Kumaran, T. Graepel, et al., "Mastering chess and shogi by self-play with a general reinforcement learning algorithm", arXiv preprint arXiv:1712.01815, 2017. [33] D. Silver, T. Hubert, J. Stepwieser, I. Antonoglou, M. Lai, A. Guez, M. Lanctot, L. Sifre, D. Kumaran, T. Graepel, et al., "Mastering chess and shogi by self-play with a general reinforcement learning algorithm ", arXiv preprint arXiv: 1712.01815, 2017.
Die Offenbarung aller hier zitierten Veröffentlichungen und Websites wird vollum fänglich in die vorliegende Beschreibung aufgenommen (incorporated by refe- rence). The disclosure of all publications and websites cited here is fully incorporated into the present description (incorporated by reference).
Weiter bevorzugt wird das Training im Verfahrensschritt A) mit heuristisch ermit telten Lösungen optimierter Produktionspläne durchgeführt. Hierdurch erhält das neuronale Netz einen guten Ausgangspunkt für seine weitere Optimierung. The training in method step A) is more preferably carried out with heuristically determined solutions of optimized production plans. This gives the neural network a good starting point for further optimization.
Insbesondere können dabei optimierte Produktionspläne in Form von earliest-due- date-(EDD)-Lösungen eingesetzt werden. Diese Lösungen haben sich als beson ders vorteilhaft erwiesen, da in der Praxis oftmals Eilaufträge anfallen, die die vor herige Produktionsplanung obsolet machen. Eine besonders bevorzugte Ausgestaltung des Verfahrens betrifft den Fall, dass die Optimierung sowohl die Verschnittminimierung als auch die Produktionszeitopti mierung umfasst. Dies ermöglicht sowohl eine schnelle als auch kostengünstige und ressourcenschonende Fertigung. Ziele der Produktionszeitoptimierung sind insbesondere die minimale gesamte Verspätung und/oder die minimale gesamte Produktionszeit. In particular, optimized production plans in the form of earliest due date (EDD) solutions can be used. These solutions have proven to be particularly advantageous, since in practice there are often rush orders that make previous production planning obsolete. A particularly preferred embodiment of the method relates to the case that the optimization includes both the minimization of waste and the optimization of production times. This enables both fast and inexpensive and resource-saving production. The goals of production time optimization are, in particular, the minimum total delay and / or the minimum total production time.
Die Randbedingungen im Verfahrensschritt B) können die Produktionsfristen der Blechteile umfassen. Die Produktionszeitoptimierung kann dann die Einhaltung der Produktionsfristen berücksichtigen. Der Einhaltung der Produktionsfristen kann da bei eine höhere Priorität zukommen als anderen Zielen. The boundary conditions in process step B) can include the production deadlines for the sheet metal parts. The production time optimization can then take into account compliance with the production deadlines. Compliance with production deadlines can be given a higher priority than other goals.
Alternativ oder zusätzlich dazu können die Randbedingungen im Verfahrensschritt B) die Werte, also die Geldwerte bzw. Preise, der Blechteile umfassen. Hierdurch kann die Produktion in Abhängigkeit der Werte der jeweiligen Blechteile optimiert werden. Allgemein kann hierdurch der Wert eines Blechteils, beispielsweise der Preis seiner verspäteten Fertigung, im Rahmen der erfindungsgemäßen Optimie rung qualifiziert werden. Weiter bevorzugt wird dem Verschnitt ein Verschnittscore zugeteilt und dem Er reichen der Produktionsfrist eine Produktionsfristscore zugeteilt, der auf dem Wert der Blechteile basiert, wobei die Optimierung sowohl den Verschnittscore als auch den Produktionsfristscore minimiert. Durch die Zuteilung der Scores kann die Pro duktionszeitminimierung auf derselben Skala wie die Verschnittminimierung be- handelt bzw. optimiert werden. As an alternative or in addition to this, the boundary conditions in method step B) can include the values, that is to say the monetary values or prices, of the sheet metal parts. This allows production to be optimized depending on the values of the respective sheet metal parts. In general, this allows the value of a sheet metal part, for example the price of its late manufacture, to be qualified within the scope of the optimization according to the invention. It is further preferred that a waste score is allocated to the waste and, when the production deadline is reached, a production deadline score is assigned that is based on the value of the sheet metal parts, with the optimization minimizing both the waste score and the production deadline score. By assigning the scores, the production time minimization can be treated or optimized on the same scale as the waste minimization.
Im Entscheidungsknoten wird in diesem Fall vorzugsweise der geschätzte maximal erreichbare Gesamtscore-Wert hinterlegt; auf den die Entscheidungsknoten ver bindenden Kanten wird vorzugsweise die Wahrscheinlichkeit (= Gewichtung) hin- terlegt, dass die jeweilige Entscheidung des Entscheidungsknotens die beste ist. Der Verschnittscore und der Produktionsfristscore können beispielsweise in Form eines Preises eingesetzt werden. Dann kann der Preis für Verschnittmaterial gegen den Preis eines zu spät produzierten Blechteils abgewogen werden. Im Rahmen des Verfahrens kann gemäß folgender Funktion optimiert werden: In this case, the estimated maximum achievable total score value is preferably stored in the decision node; The probability (= weighting) that the respective decision of the decision node is the best is preferably stored on the edges connecting the decision nodes. The waste score and the production deadline score can be used, for example, in the form of a price. Then the price for waste material can be weighed against the price of a sheet metal part produced too late. As part of the procedure, the following function can be used to optimize:
Wobei c(W) den Wert für das insgesamt eingesetzte Material darstellt (inclusive Verschnitt, also Abfall), T, und v, jeweils die Verspätung und den Wert des Auf tragsteils i darstellen l ist ein Parameter, der Verspätung bestraft. rabs spiegelt die Summe der Blechteile wider, jeweils proportional zu Produktionsfristen reduziert, minus die gesamten Materialkosten. Mit der Formel kann eine Belohnung des neu ronalen Netzes generiert werden, insbesondere skaliert auf [0, 1], wobei der ma ximal mögliche Score rmax (ohne Verspätung und ohne Verschnitt) ist. Die Verfahrensschritte B) bis D) können bedarfsgerecht durch Vorliegen eines Er eignisses getriggert werden, wobei das Einlesen des Ereignisses über eine Ereig nisschnittstelle erfolgt. Where c (W) represents the value for the total material used (including waste, i.e. waste), T, and v, respectively represent the delay and the value of the order part i l is a parameter that penalizes delay. r abs reflects the sum of the sheet metal parts, each reduced proportionally to the production deadlines, minus the total material costs. The formula can be used to generate a reward for the neural network, in particular scaled to [0, 1], the maximum possible score being r max (without delay and without waste). Process steps B) to D) can be triggered as required by the presence of an event, the event being read in via an event interface.
Vorzugsweise liegt das Ereignis dabei in Form einer Anfrage zur weiteren Bearbei- tung eines Blechteils, in Form freiwerdender Produktionsmaschinenkapazität, in Form eines Produktionsmaschinenausfalls und/oder in Form eines Eilauftrags vor. The event is preferably in the form of a request for further processing of a sheet metal part, in the form of production machine capacity being freed up, in the form of a production machine failure and / or in the form of a rush order.
Dabei kann das Ereignis automatisiert ausgelöst und über die Ereignisschnittstelle eingelesen werden. Besonders bevorzugt wird das Ereignis von einer Produktions- maschine, einem Indoor-Lokalisierungssystem und/oder einem manufacturing execution System ausgelöst und über die Ereignisschnittstelle eingelesen. Im Fall eines Indoor-Lokalisierungssystems kann die Planung durch von den Tags des In- door-Lokalisierungssystems übermittelte Ereignisse automatisiert weiter optimiert werden. Zur weiteren Verbesserung des neuronalen Netzes kann in einem Verfahrensschritt E) eine Nutzerbewertung des im Verfahrensschritt D) ausgegebenen Produktions plans eingelesen werden. Die Erfindung betrifft weiterhin ein Verfahren zur Herstellung von Blechteilen, bei dem ein zuvor angeführtes Verfahren durchgeführt wird und anschließend die Pro zessschritte a) und b) auf Grundlage des optimierten Produktionsplans durchge führt werden. Bei dem Verfahren zur Herstellung von Blechteilen kann/können nach den Prozess schritten a) und b) die Prozessschritte c), d), e) und/oder f) auf Grundlage des optimierten Produktionsplans durchgeführt werden. The event can be triggered automatically and read in via the event interface. The event is particularly preferably triggered by a production machine, an indoor localization system and / or a manufacturing execution system and read in via the event interface. In the case of an indoor localization system, the planning can be further optimized in an automated manner using events transmitted by the tags of the indoor localization system. To further improve the neural network, a user evaluation of the production plan output in process step D) can be read in in a method step E). The invention further relates to a method for the production of sheet metal parts, in which a previously mentioned method is carried out and then the process steps a) and b) are carried out on the basis of the optimized production plan. In the method for producing sheet metal parts, after process steps a) and b), process steps c), d), e) and / or f) can be carried out on the basis of the optimized production plan.
Die erfindungsgemäße Aufgabe wird weiterhin gelöst durch eine Vorrichtung zur Durchführung eines hier beschriebenen Verfahrens, wobei die Vorrichtung einen Computer zum Speichern und Ausführen des neuronalen Netzes, eine Randbedin gungsschnittstelle zum Einlesen der Randbedingungen und eine Produktionsplan schnittstelle zur Ausgabe des Produktionsplans aufweist. Zum Einlesen der Nutzerbewertungen kann eine Nutzerbewertungsschnittstelle vorgesehen sein. Das neuronale Netz kann cloudbasiert ausgebildet sein, um das Training mit, insbesondere anonymisierten, Nutzerbewertungen zu erleichtern. The object of the invention is also achieved by a device for performing a method described here, the device having a computer for storing and executing the neural network, a boundary conditions interface for reading in the boundary conditions and a production plan interface for outputting the production plan. A user evaluation interface can be provided for reading in the user evaluations. The neural network can be cloud-based in order to facilitate training with, in particular anonymized, user reviews.
Die erfindungsgemäße Vorrichtung kann die Ereignisschnittstelle aufweisen und weiterhin eine Produktionsmaschine, ein Indoor-Lokalisierungssystem (mit meh reren Tags, die Ereignisse übermitteln) und/oder ein manufacturing execution Sys tem aufweisen, wobei ein von der Produktionsmaschine, dem Indoor-Lokalisie rungssystem und/oder dem manufacturing execution System ausgelöstes Ereignis über die Ereignisschnittstelle einlesbar ist. Die Vorrichtung ist in diesem Fall auto- matisiert bzw. teilautomatisiert optimierbar. The device according to the invention can have the event interface and furthermore have a production machine, an indoor localization system (with several tags that transmit events) and / or a manufacturing execution system, one of the production machine, the indoor localization system and / or The event triggered by the manufacturing execution system can be read in via the event interface. In this case, the device can be optimized in an automated or partially automated manner.
Weitere Vorteile der Erfindung ergeben sich aus der Beschreibung und der Zeich nung. Ebenso können die vorstehend genannten und die noch weiter ausgeführten Merkmale erfindungsgemäß jeweils einzeln für sich oder zu mehreren in beliebigen Kombinationen Verwendung finden. Die gezeigten und beschriebenen Ausfüh rungsformen sind nicht als abschließende Aufzählung zu verstehen, sondern haben vielmehr beispielhaften Charakter für die Schilderung der Erfindung. Further advantages of the invention emerge from the description and the drawing voltage. The aforementioned and those detailed below can also be used Features according to the invention can be used individually or collectively in any combination. The embodiments shown and described are not to be understood as an exhaustive list, but rather have an exemplary character for describing the invention.
Detaillierte Beschreibung der Erfindung und Zeichnung Detailed description of the invention and drawing
Fig. 1 zeigt schematisch den Produktionsablauf bei der Fertigung von Blechteilen. Fig. 2 zeigt schematisch die Optimierung des Produktionsablaufs. Fig. 1 zeigt schematisch die Fertigung verschiedener Aufträge. In Fig. 1 sind exemplarisch die Aufträge Aoi bis Aio gezeigt. Die Aufträge Aoi-Aio umfassen die Herstellung von Produkten Poi bis Pio, die aus mehreren, insbesondere verschie denen, Blechteilen mit ihren jeweiligen geometrischen Daten gefertigt sind. Aus Gründen der Übersichtlichkeit sind in Fig. 1 nur die Blechteile Bi und B2 mit einem Bezugszeichen versehen. Fig. 1 shows schematically the production sequence in the manufacture of sheet metal parts. Fig. 2 shows schematically the optimization of the production process. Fig. 1 shows schematically the production of various orders. In Fig. 1, the orders Aoi to Aio are shown by way of example. The orders Aoi-Aio include the manufacture of products Poi to Pio, which are made from several, in particular different, sheet metal parts with their respective geometric data. For the sake of clarity, only the sheet metal parts Bi and B 2 are provided with a reference symbol in FIG. 1.
Wie durch Uhrensymbole in Fig. 1 angedeutet ist, weisen die einzelnen Blechteile Bi, B2 verschiedene Fertigungszeiten auf. Weiterhin weisen die Aufträge A0i bis Ai0 verschiedene Produktionsfristen F01 bis F10 auf. Sparschweine deuten an, dass die Blechteile Bi, B2 verschiedene (Geld-)Werte aufweisen. Die beschriebenen Vorga ben stellen Randbedingungen 10 der Blechteile Bi, B2 dar. As indicated by clock symbols in FIG. 1, the individual sheet metal parts Bi, B 2 have different production times. Furthermore, orders A 0i to A i0 have different production deadlines F 01 to F 10 . Piggy banks indicate that the sheet metal parts Bi, B 2 have different (money) values. The specifications described ben represent boundary conditions 10 of the sheet metal parts Bi, B 2 .
Die Blechteile Bi, B2 werden auf einer Blechtafel 12 möglichst so angeordnet, dass der Verschnitt minimal ist. Wie aus Fig. 1 ersichtlich ist, kann dies zur Vermischung von Blechteilen Bi, B2 verschiedener Aufträge A01-A10 führen. Die Blechteile Bi, B2 werden auf Produktionsmaschinen 14 bearbeitet, von denen in Fig. 1 Produktions maschinen Ci, C2 (cut) zum Schneiden und Vereinzeln, Produktionsmaschinen bi, b2 (bend) zum Biegen und Produktionsmaschinen ai, a2 (assemble) zur Montage der Blechteile Bi, B2 dargestellt sind. Darüber hinaus können weitere, in Fig. 1 nicht gezeigte, Produktionsmaschinen 14 zur Bearbeitung der Blechteile Bi, B2, beispielsweise zum Entgraten, Fügen und/oder Beschichten der Blechteile Bi, B2 vorgesehen sein. Die fertigen, die Blechteile Bi, B2 aufweisenden Produkte sind in Fig. 1 beim Bezugszeichen 16 dargestellt. Die Aufteilung der Blechteile Bi, B2 auf die Produktionsmaschinen 14 stellt bei den verschiedenen Randbedingungen 10 der Blechteile Bi, B2 ein hochkomplexes Prob lem dar. Dies insbesondere, da die einzelnen Prozessschritte verschieden lang dau- ern, Produktionsmaschinen 14 ausfallen und/oder Eilaufträge eingehen können. The sheet metal parts Bi, B 2 are arranged on a sheet metal 12 in such a way that the waste is minimal. As can be seen from FIG. 1, this can lead to the mixing of sheet metal parts Bi, B 2 of different orders A01-A10. The sheet metal parts Bi, B 2 are processed on production machines 14, of which in Fig. 1 production machines Ci, C 2 (cut) for cutting and singling, production machines bi, b 2 (bend) for bending and production machines ai, a 2 (assemble ) for mounting the sheet metal parts Bi, B 2 are shown. In addition, further production machines 14, not shown in FIG. 1, can be provided for processing the sheet metal parts Bi, B 2 , for example for deburring, joining and / or coating the sheet metal parts Bi, B 2 . The finished products comprising the sheet metal parts Bi, B 2 are shown in FIG. 1 at reference number 16. The distribution of the sheet metal parts Bi, B2 to the production machines 14 represents a highly complex problem with the various boundary conditions 10 of the sheet metal parts Bi, B2. This is particularly true because the individual process steps take different lengths of time, production machines 14 fail and / or urgent orders can be received .
Die erfindungsgemäße Optimierung des Produktionsablaufs ist in Fig. 2 darge stellt. Fig. 2 zeigt eine Vorrichtung 18 zur optimierten Fertigung bzw. optimierten Fertigungsplanung der Blechteile Bi, B2 aus Fig. 1. Hierzu ist ein Algorithmus 20 vorgesehen. Der Algorithmus 20 liegt vorzugsweise als AlphaGo oder AlphaGo Zero vor. Der Algorithmus 20 umfasst ein Monte-Carlo-tree-search-framework 22. Das Monte-Carlo-tree-search-framework 22 wird von einem neuronalen Netz 24 modi fiziert. Hierbei wird zunächst ein supervised learning durchgeführt, also ein Trai ning anhand heuristisch ermittelter Problemlösungen. The optimization of the production process according to the invention is shown in FIG. 2 Darge. FIG. 2 shows a device 18 for the optimized production or optimized production planning of the sheet metal parts Bi, B 2 from FIG. 1. An algorithm 20 is provided for this purpose. The algorithm 20 is preferably in the form of AlphaGo or AlphaGo Zero. The algorithm 20 comprises a Monte Carlo tree search framework 22. The Monte Carlo tree search framework 22 is modified by a neural network 24. First of all, supervised learning is carried out, i.e. training based on heuristically determined problem solutions.
Anschließend erfolgt self-play mit reinforcement-learning als single-player-game. Dies ist in Fig. 2 in den Schritten 26 (selection), 28 (expansion), 30 (Simulation) und 32 (backpropagation) dargestellt. Dabei wird im Schritt 26 ein Entscheidungs pfad über bestimmte Entscheidungsknoten gewählt, im Schritt 28 der Entschei- dungsbaum mit den Entscheidungsknoten nach dem Zufallsprinzip erweitert, das Ergebnis hieraus im Schritt 30 simuliert und die Entscheidungsknoten auf Grund lage dieses Simulationsergebnisses im Schritt 32 neu gewichtet (gestärkt oder ge schwächt). Die Schritte 26 bis 32 werden mehrfach wiederholt. Das so durchgeführte Ermitteln einer möglichst optimalen Aufteilung der Ferti gungsschritte erfolgt vorzugsweise sowohl im Hinblick auf Verschnittminimierung (nesting) als auch im Hinblick auf Produktionszeitoptimierung (scheduling). Dieser Vorgang kann als Optimierung durch einen nesting-Agenten und einen scheduling- Agenten beschrieben werden, bei dem die Agenten in einer Simulationsumgebung Entscheidungen treffen und dafür je nach Güte der Entscheidung eine Belohnung (reward) erhalten. Die Simulation ist dabei Abbild der Blechfertigung. Der optimierte Produktionsplan wird über eine Produktionsplanschnittstelle 34, insbesondere an ein manufacturing-execution-system 36, ausgeben. Das manu- facturing-execution-system 36 steuert die Produktionsmaschinen 14, also die reale Blechfertigung, mit dem optimierten Produktionsplan. This is followed by self-play with reinforcement learning as a single-player game. This is shown in FIG. 2 in steps 26 (selection), 28 (expansion), 30 (simulation) and 32 (backpropagation). In step 26, a decision path is selected via certain decision nodes, in step 28 the decision tree with the decision nodes is expanded according to the random principle, the result of this is simulated in step 30 and the decision nodes are reweighted on the basis of this simulation result in step 32 (strengthened or weakened). Steps 26 to 32 are repeated several times. The determination of the optimal division of the production steps carried out in this way preferably takes place both with regard to minimizing waste (nesting) and with regard to production time optimization (scheduling). This process can be described as optimization by a nesting agent and a scheduling agent, in which the agents make decisions in a simulation environment and receive a reward depending on the quality of the decision. The simulation is an image of the sheet metal production. The optimized production plan is output via a production plan interface 34, in particular to a manufacturing execution system 36. The manufacturing execution system 36 controls the production machines 14, that is to say the real sheet metal production, with the optimized production plan.
Dem Algorithmus 20 werden über eine Randbedingungsschnittstelle 38 die Rand bedingungen 10 zugeführt. Nutzerbewertungen 40 können über eine Nutzerbe wertungsschnittstelle 42 dem Algorithmus 20 zugeführt werden. Alternativ oder zusätzlich dazu kann eine Ereignisschnittstelle 44 vorgesehen sein, über die ein Ereignis 46 einlesbar ist. Das Ereignis 46 kann von dem manufac turing-execution-system 36, einer oder mehreren Produktionsmaschinen 14 und/oder einem Indoor-Lokalisierungssystem 48 ausgelöst werden. Das Ereignis 46 kann dabei beispielsweise einen Ausfall einer Produktionsmaschine 14, freiwer- dende Kapazität einer Produktionsmaschine 14, Fehler in der Produktion, Neuauf träge und/oder Auftragsänderungen umfassen. Insbesondere umfasst das Ereignis 46 die weitere Produktionsplanung für ein Blechteil Bi, B2 (siehe Fig. 1), das einen Produktionsschritt in einer Produktionsmaschine 14 gerade abgeschlossen hat. Der Algorithmus 20 wird auf einem Computer 50 ausgeführt. Der Computer 50 kann cloudbasiert ausgebildet sein, um den Einsatz von Nutzerbewertungen 40 verschiedener Nutzer zu erleichtern. Das manufacturing-execution-system 36 kann (wie angedeutet) auf demselben Computer oder einem anderen Computer ausgeführt werden. The algorithm 20 is supplied with the boundary conditions 10 via a boundary condition interface 38. User evaluations 40 can be fed to the algorithm 20 via a user evaluation interface 42. As an alternative or in addition to this, an event interface 44 can be provided, via which an event 46 can be read. The event 46 can be triggered by the manufacturing-execution-system 36, one or more production machines 14 and / or an indoor localization system 48. The event 46 can include, for example, a failure of a production machine 14, capacity of a production machine 14 that is freed up, errors in production, new orders and / or order changes. In particular, the event 46 includes the further production planning for a sheet metal part Bi, B 2 (see FIG. 1) that has just completed a production step in a production machine 14. The algorithm 20 is executed on a computer 50. The computer 50 can be cloud-based in order to facilitate the use of user reviews 40 from different users. The manufacturing execution system 36 can be executed (as indicated) on the same computer or on a different computer.
Unter Vornahme einer Zusammenschau aller Figuren der Zeichnung betrifft die Erfindung zusammenfassend ein Verfahren zur Optimierung einer Fertigung von Blechteilen Bi, B2. Das Verfahren optimiert die Zuteilung von Blechteilen Bi, B2 zur Bearbeitung an verschiedenen Produktionsmaschinen 14 und gibt einen optimier ten Produktionsplan aus. Hierzu ist ein Algorithmus 20 vorgesehen, der einen Ent scheidungsbaum in Form eines Monte-Carlo-tree-search-frameworks 22 und ein neuronales Netz 24 aufweist. Der Algorithmus 20 wird mit jeder neuen Abfrage durch self-play und reinforcement learning trainiert. Ein Vortraining des Algorith mus 20 wird durch supervised learning erzielt. Der Algorithmus 20 optimiert vor zugsweise den Produktionsplan primär hinsichtlich minimal verspäteter Produkti onsfristen Foi bis Fio der Blechteile Bi, B2 und sekundär hinsichtlich eines minima- len Verschnitts. Durch die Vergabe von Scores können beide Ziele gemeinsam be wertet werden. Das Verfahren kann den Empfang von Abfrage-auslösenden Ereig nissen 46 und/oder den Betrieb von Produktionsmaschinen 14 gemäß dem Pro duktionsplan umfassen. Die Erfindung betrifft weiterhin eine Vorrichtung 18 zur Durchführung des Verfahrens. Taking all the figures of the drawing together, the invention relates in summary to a method for optimizing the production of sheet metal parts Bi, B 2 . The method optimizes the allocation of sheet metal parts Bi, B 2 for processing on different production machines 14 and outputs an optimized production plan. For this purpose, an algorithm 20 is provided which has a decision tree in the form of a Monte Carlo tree search framework 22 and a neural network 24. The algorithm 20 is used with each new query trained through self-play and reinforcement learning. A pre-training of the algorithm 20 is achieved through supervised learning. The algorithm 20 preferably optimizes the production plan primarily with regard to minimally delayed production periods Foi to Fio of the sheet metal parts Bi, B2 and secondarily with regard to a minimal waste. By assigning scores, both goals can be assessed together. The method can include the receipt of query-triggering events 46 and / or the operation of production machines 14 in accordance with the production plan. The invention also relates to a device 18 for carrying out the method.
Bezuaszeichenliste Aoi bis Aio Aufträge Reference list Aoi to Aio orders
Poi bis Pio Produkte Bi, B2 Blechteile Poi to Pio products Bi, B 2 sheet metal parts
Foi bis Fio Produktionsfristen Foi to Fio production deadlines
Ci, c2 Schneide-Produktionsmaschinen bi, b2 Biege-Produktionsmaschinen ai, a2 Montage-Produktionsmaschinen 10 Randbedingungen Ci, c 2 cutting production machines bi, b 2 bending production machines ai, a 2 assembly production machines 10 boundary conditions
12 Blechtafel 12 sheet metal
14 Produktionsmaschinen 14 production machines
16 Produkte 16 products
18 Vorrichtung 20 Algorithmus 18 device 20 algorithm
22 Monte-Carlo-tree-search-framework22 Monte Carlo tree search framework
24 neuronales Netz 24 neural network
26 Schritt - selection 26 step - selection
28 Schritt - expansion 30 Schritt - Simulation 28 step expansion 30 step simulation
32 Schritt - backpropagation 32 step - backpropagation
34 Produktionsplanschnittstelle 34 Production plan interface
36 manufacturing-execution-system36 manufacturing execution system
38 Randbedingungsschnittstelle 40 Nutzerbewertungen 38 Constraint Interface 40 User Reviews
42 Nutzerbewertungsschnittstelle 42 User Rating Interface
44 Ereignisschnittstelle 44 Event Interface
46 Ereignis 46 event
48 Indoor-Lokalisierungssystem 50 Computer 48 indoor localization system 50 computers

Claims

Patentansprüche Claims
1. Verfahren zur Optimierung der Produktion von Blechteilen (Bi, B2) mit den1. Method for optimizing the production of sheet metal parts (Bi, B 2 ) with the
Prozessschritten: a) Ausschneiden und Vereinzeln der Blechteile (Bi, B2); b) Biegen der Blechteile (Bi, B2); wobei das Verfahren folgende Verfahrensschritte aufweist: Process steps: a) Cutting out and separating the sheet metal parts (Bi, B 2 ); b) bending the sheet metal parts (Bi, B 2 ); wherein the method has the following method steps:
A) Training eines auf einem Monte-Carlo-tree-search-framework (22) ausgeführten neuronalen Netzes (24) mittels supervised-learning und self-play mit reinforcement-learning; A) training of a neural network (24) executed on a Monte Carlo tree search framework (22) by means of supervised learning and self-play with reinforcement learning;
B) Erfassen von Randbedingungen (10) der Blechteile (Bi, B2), wobei die Randbedingungen (10) geometrische Daten der Blechteile (Bi, B2) umfassen; B) detecting boundary conditions (10) of the sheet metal parts (Bi, B 2 ), the boundary conditions (10) including geometric data of the sheet metal parts (Bi, B 2 );
C) Erstellen eines optimierten Produktionsplans durch das neuronale Netz (24); C) creating an optimized production plan by the neural network (24);
D) Ausgabe des Produktionsplans. D) Output of the production plan.
2. Verfahren nach Anspruch 1, bei dem das Verfahren einen oder mehrere der folgenden Prozessschritte aufweist: c) Entgraten der Blechteile (Bi, B2); d) Fügen der Blechteile (Bi, B2); e) Beschichten der Blechteile (Bi, B2); f) Montieren der Blechteile (Bi, B2). 2. The method according to claim 1, wherein the method has one or more of the following process steps: c) deburring the sheet metal parts (Bi, B 2 ); d) joining the sheet metal parts (Bi, B 2 ); e) coating the sheet metal parts (Bi, B 2 ); f) Assemble the sheet metal parts (Bi, B 2 ).
3. Verfahren nach Anspruch 1 oder 2, bei dem die Verfahrensschritte A) bis D) mit einem Algorithmus (20) durchgeführt wird, wobei der Algorithmus (20) auf AlphaGo oder AlphaGo Zero basiert und wobei der Algorithmus (20) das neuronale Netz aufweist. 3. The method according to claim 1 or 2, wherein the method steps A) to D) is carried out with an algorithm (20), the algorithm (20) based on AlphaGo or AlphaGo Zero and wherein the algorithm (20) comprises the neural network .
4. Verfahren nach einem der vorhergehenden Ansprüche, bei dem das Trai ning im Verfahrensschritt A) mit heuristisch ermittelten Lösungen opti mierter Produktionspläne durchgeführt wird. 4. The method according to any one of the preceding claims, in which the training in method step A) is carried out with heuristically determined solutions of optimized production plans.
5. Verfahren nach Anspruch 4, bei dem optimierte Produktionspläne in Form von earliest-due-date-Lösungen eingesetzt werden. 5. The method according to claim 4, in which optimized production plans in the form of earliest due date solutions are used.
6. Verfahren nach einem der vorhergehenden Ansprüche, bei dem die Opti mierung sowohl die Verschnittminimierung als auch die Produktionszeitop timierung umfasst. 6. The method according to any one of the preceding claims, in which the optimization comprises both the minimization of waste and the optimization of production time.
7. Verfahren nach Anspruch 6, bei dem die Randbedingungen (10) im Verfah rensschritt B) zusätzlich die Produktionsfristen der Blechteile (Bi, B2) um fassen. 7. The method according to claim 6, in which the boundary conditions (10) in procedural step B) additionally include the production periods of the sheet metal parts (Bi, B 2 ).
8. Verfahren nach Anspruch 7, bei dem die Randbedingungen (10) im Verfah rensschritt B) zusätzlich die Werte der Blechteile (Bi, B2) umfassen. 8. The method according to claim 7, wherein the boundary conditions (10) in procedural step B) additionally include the values of the sheet metal parts (Bi, B 2 ).
9. Verfahren nach Anspruch 8, bei dem dem Verschnitt ein Verschnittscore zugeteilt wird und dem Erreichen der Produktionsfrist eine Produktions fristscore zugeteilt wird, der auf dem Wert der Blechteile (Bi, B2) basiert, wobei die Optimierung sowohl den Verschnittscore als auch den Produkti onsfristscore minimiert. 9. The method according to claim 8, in which a waste score is allocated to the waste and a production deadline score is allocated to the achievement of the production deadline, which is based on the value of the sheet metal parts (Bi, B 2 ), the optimization of both the waste score and the product onsfristscore minimized.
10. Verfahren nach einem der vorhergehenden Ansprüche, bei dem die Verfah rensschritte B) bis D) Ereignis-getriggert durchgeführt werden, wobei das Einlesen des Ereignisses (46) über eine Ereignisschnittstelle (44) erfolgt. 10. The method according to any one of the preceding claims, in which the procedural steps B) to D) are carried out event-triggered, the event (46) being read in via an event interface (44).
11. Verfahren nach Anspruch 10, bei dem das Ereignis (46) in Form einer An frage zur weiteren Bearbeitung eines Blechteils (Bi, B2), in Form freiwer dender Produktionsmaschinenkapazität, in Form eines Produktionsmaschi nenausfalls und/oder in Form eines Eilauftrags vorliegt. 11. The method according to claim 10, wherein the event (46) is in the form of a request for further processing of a sheet metal part (Bi, B 2 ), in the form of freed up production machine capacity, in the form of a production machine failure and / or in the form of a rush order .
12. Verfahren nach Anspruch 10 oder 11, bei dem das Ereignis (46) von einer Produktionsmaschine (14), einem Indoor-Lokalisierungssystem (48) und/oder einem manufacturing execution System (36) ausgelöst und über die Ereignisschnittstelle (44) eingelesen wird. 12. The method as claimed in claim 10 or 11, in which the event (46) is triggered by a production machine (14), an indoor localization system (48) and / or a manufacturing execution system (36) and is read in via the event interface (44) .
13. Verfahren nach einem der vorhergehenden Ansprüche, bei dem in einem Verfahrensschritt E) eine Nutzerbewertung (40) des im Verfahrensschritt D) ausgegebenen Produktionsplans eingelesen wird und das neuronale Netz (24) mit der Nutzerbewertung (40) weiter trainiert wird. 13. The method according to any one of the preceding claims, in which in a method step E) a user evaluation (40) of the production plan output in method step D) is read and the neural network (24) is further trained with the user evaluation (40).
14. Vorrichtung (18) zur Durchführung eines Verfahrens nach einem der vor hergehenden Ansprüche, wobei die Vorrichtung (18) einen Computer (50) zum Speichern und Ausführen des neuronalen Netzes (24), eine Randbe- dingungsschnittsteile (38) zum Einlesen der Randbedingungen (10) und eine Produktionsplanschnittstelle (34) zur Ausgabe des Produktionsplans aufweist. 14. Device (18) for performing a method according to one of the preceding claims, wherein the device (18) has a computer (50) for storing and executing the neural network (24), a boundary condition section (38) for reading in the boundary conditions (10) and a production plan interface (34) for outputting the production plan.
15. Vorrichtung nach Anspruch 14 in Verbindung mit Anspruch 12, bei dem die Vorrichtung (18) die Ereignisschnittstelle (44) aufweist und die die Vorrich tung (18) weiterhin eine Produktionsmaschine (14), ein Indoor-Lokalisie- rungssystem (48) und/oder ein manufacturing execution System (36) auf weist, wobei ein von der Produktionsmaschine (14), dem Indoor-Lokalisie- rungssystem (48) und/oder dem manufacturing execution System (36) ausgelöstes Ereignis (46) über die Ereignisschnittstelle (44) einlesbar ist. 15. The device according to claim 14 in conjunction with claim 12, wherein the device (18) has the event interface (44) and the device (18) further comprises a production machine (14), an indoor localization system (48) and / or a manufacturing execution system (36), an event (46) triggered by the production machine (14), the indoor localization system (48) and / or the manufacturing execution system (36) via the event interface (44 ) can be read.
EP21711844.7A 2020-03-13 2021-03-10 Method and device for optimised production of sheet metal parts Pending EP4118493A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102020203296.3A DE102020203296A1 (en) 2020-03-13 2020-03-13 Process and device for the optimized production of sheet metal parts
PCT/EP2021/056107 WO2021180816A1 (en) 2020-03-13 2021-03-10 Method and device for optimised production of sheet metal parts

Publications (1)

Publication Number Publication Date
EP4118493A1 true EP4118493A1 (en) 2023-01-18

Family

ID=74873753

Family Applications (1)

Application Number Title Priority Date Filing Date
EP21711844.7A Pending EP4118493A1 (en) 2020-03-13 2021-03-10 Method and device for optimised production of sheet metal parts

Country Status (5)

Country Link
US (1) US11586996B2 (en)
EP (1) EP4118493A1 (en)
CN (1) CN115335780A (en)
DE (1) DE102020203296A1 (en)
WO (1) WO2021180816A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102021124706A1 (en) * 2021-09-23 2023-03-23 Trumpf Werkzeugmaschinen Gmbh + Co. Kg Device and method for determining a probable number of removal attempts for a successful automated removal of a component cut from a metal sheet
DE102022125984A1 (en) * 2022-10-07 2024-04-18 TRUMPF Werkzeugmaschinen SE + Co. KG Computer-aided manufacturing process and manufacturing system
CN116882596B (en) * 2023-09-07 2023-12-15 中国地质大学(武汉) Calculation efficiency improvement method for future random optimization problem of combined heat and power system

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102016204392A1 (en) 2016-03-16 2017-09-21 Trumpf Werkzeugmaschinen Gmbh + Co. Kg System and process for production planning
EP3485337B1 (en) * 2016-09-23 2020-10-21 Apple Inc. Decision making for autonomous vehicle motion control
US10387161B2 (en) * 2017-09-01 2019-08-20 Facebook, Inc. Techniques for capturing state information and performing actions for threads in a multi-threaded computing environment
EP3608743A1 (en) * 2018-08-07 2020-02-12 KH Automotive S.r.l. Arrangement and method for controlling the pressing of metal sheets
US20210278825A1 (en) 2018-08-23 2021-09-09 Siemens Aktiengesellschaft Real-Time Production Scheduling with Deep Reinforcement Learning and Monte Carlo Tree Research

Also Published As

Publication number Publication date
CN115335780A (en) 2022-11-11
WO2021180816A1 (en) 2021-09-16
DE102020203296A1 (en) 2021-09-16
US20230004880A1 (en) 2023-01-05
US11586996B2 (en) 2023-02-21

Similar Documents

Publication Publication Date Title
EP4118493A1 (en) Method and device for optimised production of sheet metal parts
US11036191B2 (en) Machine learning device, industrial machine cell, manufacturing system, and machine learning method for learning task sharing among plurality of industrial machines
Abdullah et al. Generating university course timetable using genetic algorithms and local search
EP2112568B1 (en) Method for computer-supported control and/or regulation of a technical system
DE102016014264B4 (en) Machine learning device, sheet metal package maker, sheet metal package making system and machine learning method for learning to stack package sheets
EP2106576B1 (en) Method for the computer-assisted control and/or regulation of a technical system
DE102017010799A1 (en) A machine learning apparatus and robot system for learning a machining order of a laser machining robot and machine learning method therefor
DE102016008910A1 (en) A cell control system, manufacturing system, and control method, wherein the control manufacturing cell comprises a plurality of manufacturing machines.
DE102020204351A1 (en) DEVICE AND METHOD FOR PLANNING A MULTIPLE ORDERS FOR A VARIETY OF MACHINERY
DE102019112211A1 (en) simulation device
DE102018001028B4 (en) Numerical control
Bagchi Pareto-optimal solutions for multi-objective production scheduling problems
DE102021203400A1 (en) Computer-implemented method and computer program for assembly quantity planning of assembly parts for production optimization of a production system, assembly quantity planning system and production planning and control system
CN115640898A (en) Large-scale flexible job shop scheduling method based on DDQN algorithm
Heydari et al. Minimizing the maximum tardiness and makespan criteria in a job shop scheduling problem with sequence dependent setup times
Yang et al. Real-time and concurrent optimization of scheduling and reconfiguration for dynamic reconfigurable flow shop using deep reinforcement learning
Rokni et al. A multi-criteria optimization framework for industrial shop scheduling using fuzzy set theory
WO2021190919A1 (en) Computer-implemented method for planning and/or controlling a production by a production system, and production planning and/or control system
CN117369378A (en) Mixed flow manufacturing shop scheduling method and system based on Monte Carlo tree search algorithm
Jain et al. Decision making in FMS by COPRAS approach
Li Assembly line balancing under uncertain task time and demand volatility
EP3992733A1 (en) Machine loading planning for a complex production plant
Asadi-Zonouz et al. A hybrid unconscious search algorithm for mixed-model assembly line balancing problem with SDST, parallel workstation and learning effect
Jafari et al. Integrating Developed Evolutionary Algorithm and Taguchi Method for Solving Fuzzy Facility’s Layout Problem
Malakooti A gradient-based approach for solving hierarchical multi-criteria production planning problems

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20220831

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

RAP3 Party data changed (applicant data changed or rights of an application transferred)

Owner name: TRUMPF WERKZEUGMASCHINEN SE + CO. KG

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20230630