DE102022122955A1 - Method and device for simulated handling in real time with a container treatment machine - Google Patents

Abstract

The invention relates to a method for simulated handling in real time of a container treatment machine (11), the method comprising: creating simulation data (4) of a 3D model of the container treatment machine using simulation software (3) in real time; Rendering the simulation data (4) to rendered data; Streaming the rendered data to data glasses (10) to create an interactive 360° representation of the container treatment machine in 3D space; detecting a virtual interaction with at least one virtual element of the 360° representation of the container processing machine; transmitting data regarding the virtual interaction to the simulation software and creating updated simulation data of the 3D model of the container processing machine using the simulation software in real time based on the data; Rendering the updated simulation data to updated rendered data and streaming the updated rendered data to the smart glasses to create an updated 360° interactive representation of the container handling machine in 3D space. The invention also relates to a device for simulated handling of the container processing machine in real time.

Description

The invention relates to a method and a device for simulated handling in real time with a container treatment machine according to the independent claims.

State of the art

US 2021/0158716 A1 discloses a device for training welding work, comprising a mobile electronic device designed to perform a welding simulation. An operational orientation of the mobile electronic device may be determined for performing the welding simulation based on a user characteristic, and a current orientation of the mobile electronic device may be determined. A notification may be issued indicating whether the stake alignment is different from the current alignment.

Task

The object of the invention is to provide a method and a device for simulated handling in real time with a container treatment machine, which requires the presence of a physical container treatment machine for learning how to handle the container treatment machine and / or the associated software and / or for a Eliminates the need to test the container handling machine and/or associated software.

Solution

The task is solved by the method and the device for simulated handling in real time with a container treatment machine according to the independent claims. Further embodiments are disclosed in the subclaims.

• - Erstellen von Simulationsdaten eines 3D-Modells der Behälterbehandlungsmaschine mittels einer Simulationssoftware in Echtzeit,
• - Rendern der Simulationsdaten zu gerenderten Daten,
• - Streamen der gerenderten Daten an eine Datenbrille zur Erstellung einer interaktiven 360°-Darstellung der Behälterbehandlungsmaschine im 3D-Raum,
• - Detektieren einer virtuellen Interaktion mit zumindest einem virtuellen Element der 360°-Darstellung der Behälterbehandlungsmaschine,
• - Übermitteln von Daten betreffend die virtuelle Interaktion an die Simulationssoftware und Erstellen von aktualisierten Simulationsdaten des 3D-Modells der Behälterbehandlungsmaschine mittels der Simulationssoftware in Echtzeit basierend auf den Daten,
• - Rendern der aktualisierten Simulationsdaten zu aktualisierten gerenderten Daten und
• - Streamen der aktualisierten gerenderten Daten an die Datenbrille zur Erstellung einer aktualisierten interaktiven 360°-Darstellung der Behälterbehandlungsmaschine im 3D-Raum.

The procedure for simulated real-time handling of a container handling machine includes:

• - Creating simulation data of a 3D model of the container treatment machine using simulation software in real time,
• - Rendering the simulation data to rendered data,
• - Streaming the rendered data to data glasses to create an interactive 360° representation of the container treatment machine in 3D space,
• - detecting a virtual interaction with at least one virtual element of the 360° representation of the container treatment machine,
• - transmitting data regarding the virtual interaction to the simulation software and creating updated simulation data of the 3D model of the container treatment machine using the simulation software in real time based on the data,
• - Render the updated simulation data to updated rendered data and
• - Stream the updated rendered data to the smart glasses to create an updated interactive 360° representation of the container processing machine in 3D space.

Using the simulation software, a simulated 3D model that is as close as possible to the physical container processing machine can be created, with which a human operator can carry out simulated handling in real time.

A container treatment machine can, for example, be a manufacturing machine for containers, such as a can manufacturing machine, a plastic container manufacturing machine, a container coating machine, a composite packaging manufacturing machine, a filling machine, a labeling machine, a closing machine, a packaging machine, a palletizer, an inspection machine, an inspection unit, a pasteurizer, a rinser, a container washing machine, a short-term heating unit, an ultra-high heating unit, a mixer, a carbonizer, a means of transport between container treatment machines, such as transport stars, conveyor belts, means of transport using long stator linear motors and / or planar motors or air transporters.

Rendering the simulation data into rendered data can include determining the elements of the container processing machine that are visible from a virtual viewer and a simulation of surfaces of elements of the container processing machine, influenced by their material properties.

The data glasses can be VR glasses (virtual reality) or AR glasses (augmented reality). Alternatively, this can be a virtual cave, an extended reality or another playback medium that is suitable for playing back an extended reality. For the last two, the data glasses can also be designed very simply. For example, the data glasses can only be used to generate or display a 3D effect, with the projection of the 3D model being carried out another device, such as a projector, can be created. In these cases, the data glasses are not the data recipient of the rendered data. The data receiver can be another device, such as the projector. The last two variants have the advantage that the data glasses can be constructed simply and therefore the wearing comfort can be significantly better than with the previously commercially available VR or AR glasses.

Due to the possibility of detecting a virtual interaction with at least one virtual element of the 360° representation of the container treatment machine, virtual handling of the container treatment machine can be trained and tested without concerns about safety. The container treatment machine can be handled virtually, for example with regard to sales, construction, maintenance service, production process, etc.

By streaming the updated rendered data to the data glasses to create an updated interactive 360° representation of the container processing machine in 3D space, a reaction of the container processing machine to a virtual interaction can be simulated and displayed in real time.

The virtual interaction can include interaction with a light barrier, other sensors, products or other components of the container treatment machine. In this case, the light barrier represents one virtual element of the 360° representation of the container processing machine. For example, the light barrier can be interrupted by a virtual intervention by an operator.

The virtual interaction may include interaction with a machine guard of the container processing machine. In this case, the machine protection represents the one virtual element of the 360° representation of the container treatment machine. For example, during the virtual interaction, an operator can completely or partially remove the machine protection or remove it from its operating position.

• - Erstellen von simulierten Sensordaten der Behälterbehandlungsmaschine,
• - Übermitteln der Sensordaten an eine Steuerung der Behälterbehandlungsmaschine, die basierend auf den Sensordaten Daten an eine Mensch-Maschinen-Schnittstelle übermittelt und
• - Ausgeben einer Meldung an der Mensch-Maschinen-Schnittstelle basierend auf den von der Steuerung übermittelten Daten.

Creating updated simulation data of the 3D model of the container processing machine using the simulation software in real time based on the data may include:

• - Creating simulated sensor data from the container processing machine,
• - Transmitting the sensor data to a controller of the container treatment machine, which transmits data to a human-machine interface based on the sensor data and
• - Issue a message at the human-machine interface based on the data transmitted by the controller.

A reaction to the virtual interaction can therefore not only be seen in the interactive 360° representation of the container treatment machine in 3D space, but also in the human-machine interface (also known as HMI (human machine interface)).

The message may include a fault message in response to the virtual response.

• - Empfangen von Bedienangaben für die Behälterbehandlungsmaschine mittels der Mensch-Maschinen-Schnittstelle,
• - Erstellen von Bediendaten durch die Mensch-Maschinen-Schnittstelle, die basierend auf den Bediendaten Daten an die Steuerung übermittelt und
• - Übermitteln der an die Steuerung übermittelten Daten an die Simulationssoftware und Erstellen von aktualisierten Simulationsdaten des 3D-Modells der Behälterbehandlungsmaschine mittels der Simulationssoftware in Echtzeit basierend auf den Bediendaten.

The procedure may further include:

• - Receiving operating information for the container treatment machine using the human-machine interface,
• - Creation of operating data through the human-machine interface, which transmits data to the controller based on the operating data and
• - Transmitting the data transmitted to the controller to the simulation software and creating updated simulation data of the 3D model of the container treatment machine using the simulation software in real time based on the operating data.

The operating information can include changes to operating parameters.

• - Erstellen von Simulationsdaten eines 3D-Modells einer/der Mensch-Maschinen-Schnittstelle mittels einer Simulationssoftware in Echtzeit,
• - Rendern der Simulationsdaten zu gerenderten Daten,
• - Streamen der gerenderten Daten an die Datenbrille zur Erstellung einer interaktiven 360°-Darstellung der Mensch-Maschinen-Schnittstelle im 3D-Raum.

The procedure may further include:

• - Creating simulation data of a 3D model of a human-machine interface using simulation software in real time,
• - Rendering the simulation data to rendered data,
• - Stream the rendered data to the data glasses to create an interactive 360° representation of the human-machine interface in 3D space.

The human-machine interface, like the container treatment machine, can thus be made available virtually. Alternatively, it is possible that a physical human-machine interface can be provided as part of the method.

• - mindestens eine Computervorrichtung mit darauf gespeicherten Instruktionen, die beim Ausführen durch einen Prozessor, die Computervorrichtung dazu veranlassen, die Simulationssoftware auszuführen.

The device for simulated handling in real time with a container processing machine according to the method as described above or further below comprises:

• - at least one computing device with instructions stored thereon which, when executed by a processor, cause the computing device to execute the simulation software.

The device can further comprise a human-machine interface that is designed to receive operating information for the container processing machine.

The device can further comprise a control for the container treatment machine.

The human-machine interface and the control can be included in a test stand.

The human-machine interface can be further designed to output a message based on data transmitted by the controller. The message can be issued in response to a virtual interaction with at least one virtual element of the 360° representation of the container processing machine. The message may include a fault report.

The human-machine interface may include hardware.

The human-machine interface may include a physical touchscreen.

Alternatively, the human-machine interface may include a representation of rendered and streamed simulation data of a 3D model of the human-machine interface.

The streamed simulation data can represent an interactive 360° representation of the human-machine interface in 3D space.

Short character description

• 1 eine schematische Darstellung einer Vorrichtung zum simulierten Umgang in Echtzeit mit einer Behälterbehandlungsmaschine.

The attached figure represents aspects and/or exemplary embodiments of the invention for better understanding and illustration. It shows:

• 1 a schematic representation of a device for simulated handling in real time with a container treatment machine.

Detailed character description

The 1 shows a schematic representation of a device 1 for simulated handling in real time with a container treatment machine 11. A first computer device 2 can include simulation software 3 with which simulation data 4 of a 3D model of the container treatment machine 11 can be created in real time. The simulation data 4 can be transmitted via a first data connection 5 to a second computer device 6, where the simulation data 4 is converted into rendered data using rendering software 7. The rendered data can be streamed to data glasses 10 via a second data connection 8 to create an interactive 360° representation of the container treatment machine 11 in 3D space. A human operator 9 who wants to carry out the simulated handling in real time with the container treatment machine 11 can wear the data glasses 10.

To handle the container treatment machine 11, an operation 12 of a human-machine interface 14 (also known as an HMI (human machine interface)) can take place. The human-machine interface 14 can be provided virtually or physically. The human-machine interface 14 can transmit data, for example input data, to a controller 16 of the container processing machine 11 via a third data connection 15. The human-machine interface 14 and the controller 16 can be included in a test stand 13.

The controller 16 can transmit data, for example position data, to the simulation software 3 via a fourth data connection 17. Based on the transmitted data, the simulation software 3 can create updated simulation data 4 of the 3D model of the container treatment machine 11 in real time. The updated simulation data 4 can be transmitted via the first data connection 5 to the second computing device 6, where the updated simulation data 4 can be converted into updated rendered data using the rendering software 7. The updated rendered data can be streamed to the data glasses 10 via the second data connection 8 to create an updated interactive 360° representation of the container treatment machine 11 in 3D space.

A virtual interaction with at least one virtual element of the 360° representation of the container treatment machine 11 can also occur, for example if a virtual interaction with a light barrier of the container treatment machine 11 and/or a virtual interaction with a machine guard of the container treatment machine 11 by an operator 9 is triggered.

The virtual interaction with the at least one virtual element of the 360° representation of the container treatment machine 11 can be detected and data relating to the virtual interaction can be collected be transmitted to the rendering software 7 via a fifth data connection 19. From the rendering software 7, data relating to the virtual interaction can be fed to the simulation data 4 via a sixth data connection 20. Updated simulation data 4 can be created and can be transmitted via the first data connection 5 to the second computing device 6, where the updated simulation data 4 is converted into updated rendered data using the rendering software 7. The updated rendered data can be streamed to the data glasses 10 via the second data connection 8 to create an updated interactive 360° representation of the container treatment machine 11 in 3D space.

Creating the updated simulation data 4 of the 3D model of the container treatment machine 11 using the simulation software 3 in real time based on the data relating to the virtual interaction may include creating simulated sensor data of the container treatment machine 11. The sensor data can be transmitted to the controller 16 of the container treatment machine 11 via a seventh data connection 21. The controller 16 can transmit data to the human-machine interface 14 based on the sensor data via the third data connection 15 and a message can be output at the human-machine interface 14 based on the data transmitted by the controller 16. The virtual interaction can thus lead to a message 22 on the human-machine interface 14.

Data can also be transmitted from the data glasses 10 to the rendering software 7 via an eighth data connection 23.

QUOTES INCLUDED IN THE DESCRIPTION

This list of documents listed by the applicant was generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Cited patent literature

• US 2021/0158716 A1 [0002]

Claims (14)

Method for simulated handling in real time with a container treatment machine (11), the method comprising: - Creating simulation data (4) of a 3D model of the container treatment machine (11) using simulation software (3) in real time, - Rendering the simulation data (4) to rendered data, - streaming the rendered data to data glasses (10) to create an interactive 360° representation of the container treatment machine (11) in 3D space, - detecting a virtual interaction with at least one virtual element of the 360° representation of the container treatment machine (11), - transmitting data relating to the virtual interaction to the simulation software (3) and creating updated simulation data (4) of the 3D model of the container treatment machine (11) using the simulation software (3) in real time based on the data, - Rendering the updated simulation data (4) to updated rendered data and - Streaming the updated rendered data to the data glasses (10) to create an updated interactive 360° representation of the container treatment machine (11) in 3D space. The procedure according to Claim 1 , wherein the virtual interaction includes an interaction with a light barrier of the container treatment machine (11). The procedure according to Claim 1 or 2 , wherein the virtual interaction includes an interaction with a machine guard of the container treatment machine (11). The procedure according to one of the Claims 1 until 3 , wherein the creation of updated simulation data (4) of the 3D model of the container treatment machine (11) using the simulation software (3) in real time based on the data includes: - creation of simulated sensor data of the container treatment machine (11), - transmitting the sensor data to a Control (16) of the container treatment machine (11), which transmits data to a human-machine interface (14) based on the sensor data and - outputs a message to the human-machine interface (14) based on the data sent by the controller (16 ) transmitted data. The procedure according to Claim 4 , further comprising: - receiving operating information for the container treatment machine (11) by means of the human-machine interface (14), - creating operating data through the human-machine interface (14), which sends data to the controller ( 16) transmits and - transmitting the data transmitted to the controller (16) to the simulation software (3) and creating updated simulation data (4) of the 3D model of the container treatment machine (11) using the simulation software (3) in real time based on the operating data . The procedure according to one of the Claims 1 until 5 , further comprising: - creating simulation data (4) of a 3D model of a human-machine interface (14) using simulation software (3) in real time, - rendering the simulation data (4) into rendered data, - streaming the rendered Data to the data glasses (10) to create an interactive 360° representation of the human-machine interface (14) in 3D space. Device for simulated handling in real time with a container treatment machine (11) according to the method according to one of Claims 1 until 6 , wherein the device comprises: - at least one computer device (2) with instructions stored thereon which, when executed by a processor, cause the computer device (2) to execute the simulation software (3). The device according to Claim 7 , further comprising: - a human-machine interface (14), which is designed to receive operating information for the container treatment machine (11). The device according to Claim 7 or 8th , further comprising: - a control (16) for the container treatment machine (11). The device according to Claim 8 , wherein the human-machine interface (14) is further designed to output a message based on data transmitted by the controller (16). The device according to one of the Claims 8 until 10 , wherein the human-machine interface (14) comprises hardware. The device according to Claim 11 , wherein the human-machine interface (14) comprises a physical touchscreen. The device according to one of the Claims 8 until 10 , wherein the human-machine interface (14) comprises a representation of rendered and streamed simulation data (4) of a 3D model of the human-machine interface (14). The device according to Claim 13 , wherein the streamed simulation data (4) represents an interactive 360° representation of the human-machine interface (14) in 3D space.

Images