EP3785090A1 - Industrielle fertigungsstätte und verfahren zur automatisierten verbuchung von manuellen tätigkeiten - Google Patents
Industrielle fertigungsstätte und verfahren zur automatisierten verbuchung von manuellen tätigkeitenInfo
- Publication number
- EP3785090A1 EP3785090A1 EP19719460.8A EP19719460A EP3785090A1 EP 3785090 A1 EP3785090 A1 EP 3785090A1 EP 19719460 A EP19719460 A EP 19719460A EP 3785090 A1 EP3785090 A1 EP 3785090A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- movement
- data
- worker
- manual
- activity
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims abstract description 95
- 238000009776 industrial production Methods 0.000 title claims abstract description 6
- 230000033001 locomotion Effects 0.000 claims abstract description 167
- 238000004519 manufacturing process Methods 0.000 claims abstract description 100
- 238000003754 machining Methods 0.000 claims abstract description 21
- 230000000694 effects Effects 0.000 claims description 128
- 238000012545 processing Methods 0.000 claims description 95
- 238000004422 calculation algorithm Methods 0.000 claims description 24
- 238000011157 data evaluation Methods 0.000 claims description 24
- 238000013528 artificial neural network Methods 0.000 claims description 22
- 239000002184 metal Substances 0.000 claims description 18
- 238000011156 evaluation Methods 0.000 claims description 14
- 238000001514 detection method Methods 0.000 claims description 12
- 230000001133 acceleration Effects 0.000 claims description 6
- 238000005555 metalworking Methods 0.000 claims description 4
- 238000013527 convolutional neural network Methods 0.000 claims description 3
- 238000004458 analytical method Methods 0.000 description 9
- 241000196324 Embryophyta Species 0.000 description 7
- 238000012360 testing method Methods 0.000 description 7
- 238000005553 drilling Methods 0.000 description 6
- 239000000463 material Substances 0.000 description 6
- 238000003698 laser cutting Methods 0.000 description 5
- 238000003909 pattern recognition Methods 0.000 description 5
- 238000004080 punching Methods 0.000 description 5
- 238000005304 joining Methods 0.000 description 4
- 238000003801 milling Methods 0.000 description 4
- 238000013459 approach Methods 0.000 description 3
- 230000006978 adaptation Effects 0.000 description 2
- 238000005452 bending Methods 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000005520 cutting process Methods 0.000 description 2
- 238000000151 deposition Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000012467 final product Substances 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 238000004381 surface treatment Methods 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 229910018138 Al-Y Inorganic materials 0.000 description 1
- 241001465754 Metazoa Species 0.000 description 1
- 229910000831 Steel Inorganic materials 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000007795 chemical reaction product Substances 0.000 description 1
- 244000221110 common millet Species 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000009740 moulding (composite fabrication) Methods 0.000 description 1
- 230000001537 neural effect Effects 0.000 description 1
- 230000007935 neutral effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 239000010959 steel Substances 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 238000001931 thermography Methods 0.000 description 1
- 238000002604 ultrasonography Methods 0.000 description 1
- 239000013598 vector Substances 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
- 238000003466 welding Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
- G05B19/4183—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM] characterised by data acquisition, e.g. workpiece identification
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
- G05B19/41865—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM] characterised by job scheduling, process planning, material flow
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0631—Resource planning, allocation, distributing or scheduling for enterprises or organisations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0631—Resource planning, allocation, distributing or scheduling for enterprises or organisations
- G06Q10/06311—Scheduling, planning or task assignment for a person or group
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
- G05B19/41885—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM] characterised by modeling, simulation of the manufacturing system
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/32—Operator till task planning
- G05B2219/32334—Use of reinforcement learning, agent acts, receives reward
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/32—Operator till task planning
- G05B2219/32423—Task planning
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Definitions
- the present invention relates to a method for accounting for manual activities in a digital control system of an industrial manufacturing plant, in particular in the metal and / or sheet metal processing. Furthermore, the invention relates to an industrial manufacturing plant, in particular in the metal and / or sheet metal processing.
- Processing steps of workpieces include automated machining steps, such as laser cutting or punching, and manual processing steps. The latter are at least partially based on manual activities.
- Manual operations include machining of workpieces by drilling, milling, riveting, sawing, hammering, joining together (inserting, screwing, etc.), clamping, and deburring. Such a manual activity of a worker when machining a workpiece is z.
- B. Part of a manual processing step which is carried out at a manual workstation in the industrial manufacturing plant for metal and / or sheet metal processing.
- Manual activities also generally include the handling of workpieces such as transporting, sorting, stacking, sorting off, loading and unloading of machines on or between manual and automated work stations and the picking of workpieces.
- the concepts disclosed herein relate to a manufacturing process of a workpiece that includes multiple manual processing steps, wherein the manual processing steps may form a sequence that is interrupted by automated processing steps. This is referred to herein as a processing process chain.
- processing steps are carried out, they must be recorded in a digital control system on the workpiece or the associated processing plan.
- the process chain digitally reflects the progress of production and allows it to be compared with the processing plan.
- An example of an update process is a posting of a completed / completed processing step (changing the current status) in a production control program of the digital control system (also known as production control system).
- the status generally refers to the current position in a processing plan of an order.
- the processing plan generally includes not only processing steps, but also necessary intermediate events such as transport from one workstation to the next.
- the production control program or the production control system provides access to the digital data of a job, in particular the current digitally stored status of the processing of the workpieces or the already performed and the pending processing steps.
- the production control program may also output each individual order, the respective status of a machining plan, the location of a work piece in a manufacturing facility, etc. to a display device such as a screen, tablet or smartphone.
- the production control program may be configured to control the operation of e.g. B. automated processing steps to control, for example, machines.
- One aspect of this disclosure is based on the object of making manual processing steps in a digital control system accessible as part of a digital process chain of the production and, in particular, automatically supporting or making the creation of such a digital process chain.
- a method for automated accounting of manual activities is disclosed. These are performed by a worker in an industrial manufacturing facility during the manufacture of a workpiece.
- the manufacturing includes the processing (e.g. Processing steps) and handling (eg transport and positioning) of a work piece.
- the booking is carried out in a digital control system for the creation of a digital production process chain, whereby the digital process chain comprises activity profiles which are each assigned to a manual activity.
- the method comprises the steps:
- the movement data and the position data being input data of a classification process, in which the input data are classified with respect to the activity profiles and a specific activity profile for the movement data is output, and
- an industrial manufacturing facility for workpieces comprising manual operations by a worker and optionally automated processing steps on the workpieces.
- a production of the work piece is mapped in a digital process chain.
- the manufacturing facility includes at least one manual workstation where one or more manual activities can be performed by the operator.
- the manufacturing facility includes a system for detecting a movement of the worker or an item being moved by the worker. The movement occurs when performing a manual activity.
- the manufacturing facility comprises a system for detecting a position in the industrial manufacturing facility at which the detected movement of the worker or the moving member takes place. Accordingly, manual activity movement data and manual activity position data may be provided to a digital control system of the manufacturing facility.
- the digital control system is designed to create the digital process chain, which includes several, depending Weil assigned to a manual activity, activity profiles and the production of the workpiece digitally maps.
- the control system comprises an algorithmic data evaluation unit which is adapted to classify input data formed by the movement data and the position data of the manual activity with respect to the activity profiles and to output a specific activity profile for a detected movement of the worker or the moving element.
- the control system is designed to record issued specific activity profiles in the digital process chain. The assignment of a manual activity to a digital job profile, the related structure of the digital process chain and the corresponding booking of manual activities digitally depict manual and mechanical processing steps.
- Activity profiles can be defined by a plurality of features, in particular movement characteristics, which are individually characteristic of manual activities such as drilling, milling, riveting, sawing, hammering, joining (inserting, screwing, etc.), clamping, deburring, transporting, Sorting, stacking, sorting, loading and unloading machines and picking of workpieces are.
- Such features include u.a. specific movement trajectories of z. As a movement of a worker or an element, in particular the spatial course of the movement trajectory, spatial characteristics of the movement trajectory and / or a repetition number of BeWe movement trajectory.
- an activity profile may include a duration of the movement along the movement trajectory, a start time and / or an end time of the movement along the movement trajectory and a point in time at which the movement trajectory takes place within the scope of a workpiece-specific machining process.
- an activity profile can be characterized by the specific worker (master, apprentice, laborer, etc.) performing the movement along the movement trajectory.
- the method may further comprise the following steps:
- the movement of the worker or the moving element can be detected by a sensor system which outputs movement-specific coordinate data records.
- the Sen sorsystem may for example have an acceleration sensor, a position sensor and / or egg NEN barometric sensor. These can be designed in particular as MEMS-based sensors. For detecting a sensor from the worker on a body part, in particular dere worn on one arm as a bracelet or glove, on a leg or on the head of the who. This allows a specific tracking of a movement of the corresponding body part.
- the sensor system may further include a sensor that detects movement of the moving element.
- the method may further comprise the following steps:
- 2D or 3D coordinates can be defined across the area of the manufacturing facility.
- sensors can be specified for specific workplaces or deposits in 2D or 3D.
- the determination of the position data can be carried out with an interior positioning system which is designed to determine the position of the worker, of the moving element or of the workpiece in the production site.
- the interior location system can, for. B. on several transceiver units and at least one piece of work, on the moving element or work piece provided mobile unit based.
- the associated position data can already be given by the workplace in the industrial plant to which the moving element is installed as part of the workplace.
- the detection of the movement of the worker or of the moved element and / or the determination of the position data can take place with a camera system and image recognition.
- a data evaluation based on an algorithm for classification, in particular on a self-improving algorithm may have one or more of the following evaluation steps: - processing the input data with a first processing data record and a first processing algorithm for generating intermediate data;
- Test records may include input data and associated job profiles
- determining the processing records and processing algorithms may be based on the following steps:
- Processing records may include records with associated factors (weights), the factors individually weighting the data to be processed.
- Processing algorithms can be arithmetic, combinatorial and / or logically processing algorithms that further process the data to be processed according to the prescribed combinatorics, arithmetic and / or logic.
- the data evaluation can furthermore be designed to use a plurality of improvement algorithms and to use improvement algorithms which arrive at given scales faster or more reliably to a predetermined match target.
- the data evaluation can also be designed to use a plurality of repetition algorithms, and to use repeating algorithms which arrive at given scales faster or more reliably to a predetermined match target.
- the algorithmic evaluation of the motion data may be performed with at least one neural network.
- the neural network is configured for specific manual activities in the industrial manufacturing plant. Furthermore, it may alternatively or additionally continuously improve itself.
- the motion data and the position data are digital input values of the neural network and the activity profiles are mapped as digital output classes in the neural network.
- a neural network can be a Convolutional Neural Network.
- folding planes the convolutional layers
- a first neural network may be provided for detected movements of the worker in the manual activity and a second neural network for detected movements of an element being moved by the worker.
- the concepts disclosed herein allow manual activities to be securely posted without additional effort.
- the concepts can be adapted to individual processing modes of the executing person, especially when self-learning and / or self-improving algorithms are used.
- the update may replace a handwritten signature or the classic user login for verification.
- FIG. 2 is a perspective view of an industrial plant with manual and au tomatis elected jobs
- Fig. 3 is a sketch to illustrate the classification process and 4 shows a flow chart to illustrate the method for the automated accounting of a manual activity.
- mapping is done using pattern recognition of z.
- the knowledge of the production site is an essential basis for the assignment and is available as a digital shadow of the production site in whole or in part digitally.
- the additional knowledge of the environment which is present at the time and place of the manual activity, can be included in the evaluation.
- z. B. be recognized based on the location information of the worker.
- the approach proposed herein may allow to gain the correct knowledge of the performed manual operation with an increased accuracy and to record it in the production control, in the production control program or in the production control system.
- the manufacturing control system may include an MES (Manufacturing Execution System) and an indoor location system (herein referred to as location system).
- the MES may be configured with one or more manual workstations or automated workstations positioned in a factory floor, e.g. B. Machine tools to be connected via wireless or wired communication links.
- the MES can serve the control of process sequences / manufacturing steps in the industrial production of work pieces with the workstations.
- the MES can receive information about the process sequences / production steps as well as status information of the workstations.
- the MES may be implemented in a data processing device.
- This can be a single electronic data processing device (server) or a bundle of several data processing devices (server network / cloud).
- the data processing device or the composite can be provided locally in the production site or can be set up outside of a decentralized location.
- Machining steps in the metal and sheet metal processing include, for example, cutting, cutting, punching, deforming, bending, joining, surface treatment, etc. of the workpieces. Such processing steps can be stored together in an editing plan.
- a machining plan can be provided jointly for several workpieces in a workpiece assembly.
- the MES can be designed so that the machining plans of the workpieces to be produced can be created and processed in it.
- the MES can represent the status of the workpieces. This means that the MES can output the sequence of processing steps as well as the processing steps already carried out.
- the MES can additionally be designed to allocate individual machining plans to the workstations.
- the MES can be additionally designed to intervene at any time manually or automatically in the processing steps of a machining plan. This has the advantage that it can be reacted very flexibly to different, in particular unexpected alstre tend events during the manufacturing process of several under defenceli chen processing plans. These events can, for.
- the location system is designed for indoor positioning of mobile locating units (see FIG. 2). It may have multiple stationary and / or mobile transceiver units and cooperate with the MES in the digital assignment.
- the mobile positioning units can be located via the transceiver units by means of runtime analysis.
- the transceiver units can be fixedly installed on the hall ceiling, on hall walls, machine tools, bearing structures, etc.
- the positions of the transceiver units are stored, for example, in a digital layout of the production hall.
- a mobile location unit may also be operated as a mobile transceiver unit.
- raw data of the movement can be analyzed for the activity profiles with a data evaluation (eg based on a neural network).
- absolute coordinates of a movement trajectory of the worker in the production site are present, they can be unambiguously assigned a known job profile in space and time with their characteristics.
- the movement can be detected in one or more of the following ways:
- Optical motion detection One detects with one or more cameras orts resolved movements taking place.
- Locating movements are detected by means of indoor positioning, such as the "Ultra Wide Band (UWB)" technology for indoor location.
- UWB Ultra Wide Band
- Sensor-based motion detection Information about the ongoing motion is obtained with sensors such as accelerometers and gyrosensor. Sensors may be provided at the worksman (eg, by the worker's hand) or on an element moved by the worker (eg, a footswitch).
- sensors and indoor location can be at least partially due to the use of surveillance cameras and image processing however, stationary cameras at the location of the manual activity to be recorded often encounter limits of acceptance and privacy considerations.
- Fig. 1 illustrates the method for the automated posting of a manual activity based on a schematic overview of an industrial manufacturing plant 1, which is connected via data links with a digital control system 3.
- a final product 23 ' is generated at the manual and automati cal workstations. That is, there are manual operations M performed by a worker 21 and automated processing steps A of machines at the work piece 23 according to a processing plan.
- the manual activities M include z.
- manual operations such as drilling, milling, or bending of the workpiece 23 as well as the manual handling such as sorting, transporting or loading of Ma chines.
- the manufacturing process in the manufacturing plant 1 is illustrated in Fig. 1 with an arrow 4 ver, which passes through the various processing steps.
- the manufacturing process is controlled and monitored by the digital control system 3.
- the digital control system 3 comprises an algorithmic data evaluation unit 7.
- the data evaluation unit 7 is set up to map the manufacturing process in a digital process chain 5, in which the manual and maschi nelle processes performed on the workpiece are stored. Information about the automated processing steps A are available digitally to the machines of the workstations A1, A2, A3 and can accordingly be simply included in the digital process chain. This does not apply to manual processing. Nevertheless, to map manual processes in the digital process chain 5 can, the data evaluation unit 7 is further adapted to a method for Automati s convinced accounting of manual activities M, which are performed by the worker 21 in an industrial plant 1 in the manufacture of the final product 23 'run.
- the data evaluation unit 7 receives via data inputs 7A data which are evaluated with the algorithms NN1, NN2, the data belonging to manual activities to be recorded at the manual workstations Ml, M2, M3. Various data are provided.
- the data to be evaluated comprise position data 9A z. B. a mobile unit 15 'of an indoor location system, with which a position of the worker 21 is detected, where this performs the manual activity M of the workplace Ml in the manufacturing plant 1.
- position data 9B of the position of the manual activity in the production site 1 can be made available for example by means of image analysis from image data of a camera 11.
- the data to be evaluated comprise movement data 12A of movement sensors 17, which are provided, for example, on the hands of the worker 21 and thus detect movement trajectories as an example of movement data, which are e.g. B. picking up, to lift and deposit the workpiece 23 characterize.
- the movement data 12A belong to a movement of the worker 21 in the manual activity M. They are detected in the manual activity to be recorded by the motion sensor 17 and include, in addition to the movement trajectory z. B. spatial characteristics (direction of movement, motion speed), a repetition number of the same movement trajectories, a duration of movement along the movement trajectory, a start time and / or an end time of the movement and a time at which the movement trajectory in a workpiece-specific machining process takes place.
- movement data of a movement of an element moved by the worker 21 in the manual activity M can be detected.
- This can be se with a motion sensor on the moving element (primary / direct motion information).
- An example of this is the movement of a footswitch at a manual workstation, as indicated schematically in FIG.
- Other motion sensors may be based on secondary motion information, such as the power consumption of a hand tool.
- Respective motion data 12B of the moving element is supplied to the data inputs 7A.
- the movement data 12A, 12B and the position data 9A, 9B are input data relating to movement and location of the manual activity for the algorithmic data evaluation unit 7.
- the data evaluation with the algorithms NN 1, NN 2 comprises a classification process, which leads to a classification of the input data with regard to possible activity profiles.
- the classification process or the underlying algorithmic evaluation, outputs a specific activity profile for the detected movement of the worker 21 or the element moved by the worker 21.
- the output specific activity profile is recorded in the digital process chain 5 of the workpiece 23 with respect to the corresponding manual workstation Ml, M2, M3.
- the digital control system 3 the digital process chain for a controller of the pro duction site on a display 19, z. As a monitor, spend, so that it can track the status of the manufacturing process of the workpiece 23 and monitor.
- Fig. 2 shows a schematic partial view of the industrial plant 1.
- the fully automated workplace Al of the manufacturing plant 1 is z.
- B. a flatbed machine tool that allows to automatically perform processing steps performed digitally in the digital process chain 5. Correspondingly cut workpieces can be assigned directly to machining plans.
- the manufacturing plant 1 also has the manual workstation Ml and a partially automated workstation M2. It also recognizes trolleys 31, with which Maschinenstü bridge 23 are transported from one workstation to the next. Further, in the manufacturing facility 1 cameras 11 and an indoor locating system for detecting a movement of the worker 21 in a manual operation, a movement of an element moved by the worker 21 in manual operation or a trolley 31 are installed. The Cameras 11 provide image data to an image recognition system for deriving motion in captured images. The indoor location system uses stationary transceiver 13 and / or mobile transceiver 15 (also called mobile units) to z. B. carried by the workers 21 mobile units 15 ', and thus the positions of the workers 21, in the manufacturing plant 1 to determine. With appropriate resolution and movements of the workers 21 can be determined.
- a Absortiervorgang is clarified, in which the worker 21 stores workpieces 23 from a sorting table on the trolley 31.
- the depositing process takes place along a movement trajectory 25A. This is detected with movement sensors on the hands of the worker 21 and the corresponding movement data of this manual activity are transferred to the digital control system, in particular to the data inputs 7A of the data evaluation unit 7.
- the manual workstation is additionally equipped with cameras 11 for image acquisition, which can be used independently or in addition to the determination of the movement trajectories 25 A.
- a manual processing step of drilling with a footswitch 33 is indicated.
- a corresponding signal is output. This corresponds to a movement trajectory 25B of the foot plate of the foot switch 33 and is likewise transmitted to the digital control system, in particular to the data inputs 7B of the data evaluation unit 7.
- the indoor location system of the manufacturing facility enables the generation of position data of the mobile units 15 'carried by, for example, the workers 21, while fully engaging in manual work in the factory 1 manual operations. These position data are transferred to the data inputs 7A of the data evaluation unit 7.
- Figures 1 and 2 show an industrial manufacturing plant 1 for the production of workpieces 23.
- the production includes manual activities of the workers 21 and automated production steps on the workpieces 23.
- the manufacturing plant 1 comprises and systems for detecting movement of a worker 21 (eg, the indoor location system, the camera image based motion analysis system, motion sensors).
- the manufacturing facility 1 comprises a system for detecting an element moved by the worker 21 (foot switch 33).
- These systems allow a location in the industrial manufacturing facility where the detected movement of the worker 21 or the moving member by the worker 21 is located to be known or at least determined.
- the systems can thus provide movement data of the manual activity and position data of the manual activity for further evaluation.
- the industrial manufacturing site 1 comprises a digital production control system, which is designed for the creation of the digital process chain.
- the process chain comprises a plurality of activity profiles, each associated with a manual activity, and reflects the manufacturing process of the workpiece 23.
- the production control system comprises an algorithmic, in particular self-improving, data evaluation which is designed to classify input data, here the manual activity movement data together with the manual activity position data, with respect to the activity profiles and a specific activity profile for a detected movement of the worker 21 or of the moving element 33 output.
- Fig. 3 shows schematically aspects of an exemplary classification process, which is schematically referred to as a neural network NN.
- Position data 9 and motion data 12 are supplied as input values to input nodes 41 of the network NN.
- direct data for the movement of the worker 21 (arm up / down) or the foot switch 33 (pressed, released) can be transferred to the network NN.
- Such data essentially determine the movement trajectory.
- Other data of the movement include a tag D, a start time T in a manual action, and a duration delta t of a manual action.
- Table 42 indicates data for four holes that were taken in the morning in succession on the same day. Such data may also be assigned to input nodes 41 of the network NN.
- the values are weighted together. Allocation takes place by means of algorithms which are suitable for a corresponding classifi- ornamentation formed and z. B. were trained in the context of "intelligent" algorithms. The weights are determined, for example, with test activities. In the context of z. B. self-learning algorithms, the data evaluation classified different processing operations and can z. B. recognize the executing workers after repeated implementation again.
- the output nodes 44 of the network NN are populated with output values 47 determined for the possible activity profiles as a result of the classification. They represent a probability statement on the activity profile to be booked.
- exemplary output values 47 for action profile "Drill” 46A, "Transport along known motion trajectory 25A” 46B, "Bend” 46C, "Grind” 46D and "Deburr” 46E are listed at manual workstation M2.
- the position data and movement data of the manual activity at the manual workstation M2 are classified as “drilling” with 95%. Accordingly, an update 49 of the manual activity in the digital process chain 5 takes place.
- Processing steps Al-X, Al-Y and Al-Z of the automated workstations Al, A2 and A3 are also stored in the digital process chain 5.
- Fig. 3 also schematically shows a database 51 of possible activity profiles associated with the various manual workstations Ml, M2, M3.
- the activity profiles may be specific to workers A, B, C.
- the work station M1 includes the activity profiles 45A-A, 45B-A, 45C-A ... for workers A, 45A-B, 45B-B, 45C-B ... for worker B, etc.
- the work station M2 includes the Activity profiles 46A-A, 46B-A for Wer ker A, and 46A-B, 46B-B ... for Werker B.
- Fig. 4 shows a flowchart illustrating the method for automated verbu tion of manual activities.
- the starting point of the method is the steps 61 and 63 of providing movement data of a manual activity to be recorded and providing position data of the manual activity to be recorded.
- the step 61 of providing movement data may include, for example, step 61A, in which movement of a worker at the manual activity or an element which is moved by the worker in the manual activity.
- the step 61 of providing movement data may include the step 61B of generating motion data describing movement of the worker or the moving member for the detected movement.
- the step 63 of providing position data of the manual activity to be recorded may be e.g. B.
- step 63 A determination (step 63 A) of the position data for the position in the industrial plant, where the detected movement of the worker or the moving element takes place to seize, in particular camera-assisted or by means of indoor location. Further, the position data may be set by the work station in the industrial manufacturing facility (step 63B). In steps 61C and 63C, the movement data and the position data are supplied as input data to at least one input of the classification process.
- step 65 an algorithmic evaluation of the movement data and the position data takes place and a specific activity profile for the movement data is output. Based on this, in step 67, the output specific activity profile in the digital process chain of the workpiece is posted.
- the control system can recognize by sample analysis that the worker has grabbed a workpiece and that he is depositing it. This can be detected in parallel with cameras to z. For example, it also identifies where a workpiece was gripped and where the hand was when it was deposited. Furthermore, for example, when sorting the masses of the deposited parts can be detected with sensors. Since source, target and roughly the mass are known, the pattern analysis can be used to be derived from animals. An appropriate booking of the sorting process can automatically follow.
- Measurement of the start and result state can be detected by additional sensors. These parameters can also be incorporated into the pattern recognition.
- the following sensors are provided to the worker: acceleration sensor, magnetic field sensor, rotation rate or active RFID for spatial resolution. Movement patterns of hand, foot or arm can thus relate to space trajectories, position vectors, and time windows.
- cameras for image processing can be installed, in particular IR cameras / thermal imaging cameras. Furthermore, detection can take place via ultrasound.
- machine data such as power consumption can be indirectly linked to an activity profile.
- This relates in particular to the detection of moving elements by manual manipulation by the worker. Accordingly, movement patterns for a pressing beam, a rocker arm, a foot switch can be supplemented, again together with position data and time information.
- sensors are integrated in a glove of the welder or external sensors are attached directly to the machine.
- the classification is based on the fact that there are binary states during production, because a worker can only carry out one manual activity at a time. The probability to be determined for this manual activity is maximum, whereas the probabilities for the remaining manual activities are low.
- classification tasks can be processed with deep leaming strategies, for example with neuronal networks and, in particular, with convolutional neutral networks.
- a probability matrix of the present activity profiles is generally to be created and verified.
- a neural network is understood here to mean a system of interconnected data points whose values are offset against each other. The connections of the Points have a numerical weighting that is adjusted during a training process, so that a correctly trained network responds correctly to a motion pattern to be detected.
- the network usually consists of several layers of data points. Each layer has many data points that result in a likelihood score on output data points based on the specific weights on different combinations of input values given at input data points. Folding neural networks with special folding layers and weights in this layer are used in particular in pattern recognition.
- Classification processes can be designed specifically for a manual workstation.
- trained networks For algorithmic evaluation, trained networks (fully trained systems) can be used.
- the algorithmic evaluation can be exposed to a constant adaptation of the underlying net (trainable system, which is constantly being trained). The latter allows adaptation to changing conditions and is particularly advantageous if job profiles of a job are not permanently consistent.
- Such an indoor location system has a plurality of mobile, and / or permanently installed in the production hall, transceiver units and an analysis unit for detecting a position of a mobile positioning unit.
- the transceiver units and the mobile locating unit are designed to generate, transmit, receive and process electromagnetic signals.
- the analysis unit is designed to determine transit times of the electromagnetic signals between the transceiver units and the mobile location unit and to determine the position of the mobile location unit in the production hall from the transit times of the electromagnetic signals.
- the indoor positioning system is provided for providing data on the position of the mobile locating unit to the control unit.
- the analysis unit mentioned herein may be an electronic circuit which processes signals, individually by itself, combining with each other, or both.
- the analysis unit can carry out analyzes in particular according to predetermined or adjustable analog or digital thresholds.
- the analysis unit may in particular comprise a memory, an arithmetic logic calculation device, and input and output connections and / or devices.
- electromagnetic signals By generating electromagnetic signals here is the conversion of electrical power, eg. B. from a DC power supply, in particular battery or rechargeable battery, in electromagnetic signals in the radio frequency range or higher frequencies meant that are suitable for broadcasting to other mobile transceiver units (generally for communi) are suitable.
- processing electromagnetic signals is meant here the analog and / or digital conversion of the electromagnetic signals into information which can be stored and / or processed further and which can lead to further actions of the mobile transceiver units.
- the mobile transceiver units and the stationary transceiver units thus comprise electronic circuits and an electrical power supply and may be configured to process data transmitted with the electromagnetic signals.
- the manufacturing control and algorithmic data evaluation unit disclosed herein may be designed for the metalworking industry.
- machine tools especially flatbed machine tools, can be designed to create workpieces as output elements for subsequent machining operations (also referred to herein purely as machining or processing steps).
- the workpieces can z. B. from a punching or laser cutting machine according to a processing plan in various forms and quantities of a, in particular present in a sheet form, flat material, such as a metal sheet or a metal object, for. As tube, sheet or steel plate, are generated.
- the processing plan may be stored in a processing control system monitoring and controlling the processing operations or a production control of a production facility, in particular digitally, and be aligned with digital process chains.
- the processing plan may, for example, in a punching or laser cutting machine, contain instructions for driving, where, for. B. with a punching tool or laser cutting beam, the material should be cut. Information in this regard can be stored in the digital process chain after execution.
- the processing plan can also provide further information for manual processing steps, such as: As forming, joining, welding, surface treatment, etc. have.
- the concepts disclosed herein may automate a manual activity posting based on classifying the activities into activity profiles.
- the corresponding infor mation can be stored connected according to the order information for industrial machining of workpiece, which is finally the processing steps taken in the digital process chain correspond.
- the end products mentioned herein have gone through all the processing steps according to the associated processing plan.
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Economics (AREA)
- Entrepreneurship & Innovation (AREA)
- Strategic Management (AREA)
- Manufacturing & Machinery (AREA)
- General Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Game Theory and Decision Science (AREA)
- Educational Administration (AREA)
- Development Economics (AREA)
- Marketing (AREA)
- Operations Research (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- General Factory Administration (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102018110063.9A DE102018110063A1 (de) | 2018-04-26 | 2018-04-26 | Industrielle fertigungsstätte und verfahren zur automatisierten verbuchung von manuellen tätigkeiten |
PCT/EP2019/059869 WO2019206750A1 (de) | 2018-04-26 | 2019-04-17 | Industrielle fertigungsstätte und verfahren zur automatisierten verbuchung von manuellen tätigkeiten |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3785090A1 true EP3785090A1 (de) | 2021-03-03 |
Family
ID=66286321
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP19719460.8A Withdrawn EP3785090A1 (de) | 2018-04-26 | 2019-04-17 | Industrielle fertigungsstätte und verfahren zur automatisierten verbuchung von manuellen tätigkeiten |
Country Status (4)
Country | Link |
---|---|
US (1) | US20210034043A1 (de) |
EP (1) | EP3785090A1 (de) |
DE (1) | DE102018110063A1 (de) |
WO (1) | WO2019206750A1 (de) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3828790A1 (de) * | 2019-11-28 | 2021-06-02 | Siemens Aktiengesellschaft | Verfahren zur herstellung eines, aus einer produktmenge aufgrund eines auswahlkriteriums ausgewählten produkts, sowie produktionssystem hierfür |
EP3961326B1 (de) * | 2020-08-27 | 2023-12-27 | Siemens AG Österreich | Verfahren und system zur optimalen herstellung eines produkts |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE19843162C2 (de) * | 1998-09-21 | 2001-02-22 | Alfing Montagetechnik Gmbh | Bearbeitungsvorrichtung mit einem Bearbeitungswerkzeug zur Bearbeitung eines Werkstücks |
EP2916189B1 (de) * | 2014-03-06 | 2019-05-08 | Hexagon Technology Center GmbH | Qualitätsgesicherte Herstellung |
DE102016110462A1 (de) * | 2016-06-07 | 2017-12-07 | Sartorius Stedim Biotech Gmbh | Serviceeinheit und Verfahren zur Überwachnung und Dokumentation von Wartungsarbeiten |
DE102016120132A1 (de) | 2016-10-21 | 2018-04-26 | Trumpf Werkzeugmaschinen Gmbh + Co. Kg | Werkstücksammelstelleneinheit und Verfahren zur Unterstützung der Bearbeitung von Werkstücken |
DE102016120131B4 (de) | 2016-10-21 | 2020-08-06 | Trumpf Werkzeugmaschinen Gmbh + Co. Kg | Absortierunterstützungsverfahren und Flachbettwerkzeugmaschine |
-
2018
- 2018-04-26 DE DE102018110063.9A patent/DE102018110063A1/de not_active Withdrawn
-
2019
- 2019-04-17 EP EP19719460.8A patent/EP3785090A1/de not_active Withdrawn
- 2019-04-17 WO PCT/EP2019/059869 patent/WO2019206750A1/de active Application Filing
-
2020
- 2020-10-13 US US17/069,021 patent/US20210034043A1/en not_active Abandoned
Also Published As
Publication number | Publication date |
---|---|
WO2019206750A1 (de) | 2019-10-31 |
US20210034043A1 (en) | 2021-02-04 |
DE102018110063A1 (de) | 2019-10-31 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
DE112019000170B4 (de) | Steuerungssystem, Transportvorrichtung, Programm und Steuerungsverfahren | |
EP3529012B1 (de) | Verfahren zur durchführung einer sequenz von bearbeitungsschritten zur bearbeitung von werkstücken und flachbettwerkzeugmaschine | |
EP3529001B1 (de) | Absortierunterstützungsverfahren und flachbettwerkzeugmaschine | |
AT519452B1 (de) | Verfahren und Vorrichtung zum Kommissionieren von Waren | |
DE112012002677T9 (de) | Zuführvorrichtung für Bauelemente | |
AT507339B1 (de) | Verfahren und anlage zum aufnehmen und/oder bearbeiten von objekten | |
EP3797337B1 (de) | Verfahren zum hantieren eines werkstücks mit hilfe eines entnahmewerkzeugs und maschine zur durchführung des verfahrens | |
DE102019208187B4 (de) | Robotersystem und Steuerungsverfahren für ein Robotersystem | |
DE112017007397B4 (de) | Steuervorrichtung, Greifsystem, Verteilersystem, Programm, Steuerverfahren und Herstellungsverfahren | |
EP2216144B1 (de) | Verfahren und System zur Kontrolle von Bauteilen und/oder Funktionseinheiten mit einer Prüfvorrichtung | |
DE112019000097B4 (de) | Steuervorrichtung, Arbeitsroboter, Programm und Steuerverfahren | |
DE112017007392B4 (de) | Steuervorrichtung, Greifsystem, Verteilersystem, Programm, Steuerverfahren und Herstellungsverfahren | |
WO2019206753A1 (de) | Innenraum-ortungssystem für die industrielle fertigung | |
DE112018007727B4 (de) | Robotersystem | |
DE112017007399B4 (de) | Steuervorrichtung, Greifsystem, Verteilersystem, Programm, Steuerverfahren und Herstellungsverfahren | |
EP3682303A1 (de) | Verfahren zur fertigungssteuerung von fertigungsprozessen in der metallverarbeitenden industrie mittels bildaufnahmevorrichtungen | |
DE112017007398T5 (de) | Steuervorrichtung, Greifsystem, Verteilersystem, Programm und Steuerverfahren | |
EP3785090A1 (de) | Industrielle fertigungsstätte und verfahren zur automatisierten verbuchung von manuellen tätigkeiten | |
DE102020107385B4 (de) | Betriebseinstellvorrichtung zum einstellen des betriebs einer robotervorrichtung | |
DE102019211770B3 (de) | Verfahren zur rechnergestützten Erfassung und Auswertung eines Arbeitsablaufs, bei dem ein menschlicher Werker und ein robotisches System wechselwirken | |
DE102017216863B3 (de) | Verfahren und Robotersystem zum Anpassen eines Robotereinsatzes an einen Arbeitsprozess | |
DE102019128707A1 (de) | Robotersystem | |
EP3966644A1 (de) | Produktionssystem und produktionssteuerungsverfahren mit ortungssystem-basierter simulation von produktionsabläufen | |
AT524802B1 (de) | Verfahren zum Ablegen von Halbzeugen | |
DE102021117455B4 (de) | Verfahren zum Anlernen und zum Betrieb eines Palettierroboters sowie zugehöriges Palettiersystem |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20201016 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20220622 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN |
|
18W | Application withdrawn |
Effective date: 20220922 |