WO2019178783A1

WO2019178783A1 - Method and device for industrial simulation

Info

Publication number: WO2019178783A1
Application number: PCT/CN2018/079895
Authority: WO
Inventors: Liyu WANG; Shaojie Cheng; Haifei HE
Original assignee: Abb Schweiz Ag
Priority date: 2018-03-21
Filing date: 2018-03-21
Publication date: 2019-09-26

Abstract

Embodiments of the present disclosure provide a method and a device for industrial simulation, a computer readable medium, and a computer program product. The method comprises obtaining an image of an industrial environment in which an industrial device is to be deployed. The method also comprises creating a simulation environment based on the obtained image and a simulation model for the industrial device. The method further comprises simulating a deployment of the industrial device into the industrial environment based on the created simulation environment. With the solution in accordance with the embodiments of the present disclosure, the industrial simulation can be automatically setup and thus the user can know an impact on the industrial environment from the industrial simulation.

Description

METHOD AND DEVICE FOR INDUSTRIAL SIMULATION

TECHNICAL FIELD

Embodiments of the present disclosure generally relate to industrial simulation, and more particularly, to a method and a device for industrial simulation, a computer readable medium, and a computer program product.

BACKGROUND

Traditionally, in order to simulate an existing industrial system, engineers must know equipment of the industrial system and then manually setup the simulated industrial system. However, in simulation, the engineers usually have no knowledge of the industrial environment of the industrial system. Thus, when the engineers change or replace the equipment in the simulated industrial system, they do not know the impact of such change and the replacement on other parts in the industrial environment, such as a factory.

Additionally, construction of simulation environment is always a heavy duty when trying to simulate an industry environment. Further, as mentioned, when performing simulation, it is difficult to take into account the impact of the change and the replacement of a part on the other parts, such as other apparatuses, in the industrial environment.

SUMMARY

Embodiments of the present disclosure present a method and a device for industrial simulation, a computer readable medium, and a computer program product.

In a first aspect, the embodiments of the present disclosure provide a method for industrial simulation. The method comprises obtaining an image of an industrial environment in which an industrial device is to be deployed. The method also comprises creating a simulation environment based on the obtained image and a simulation model for the industrial device. The method further comprises simulating a deployment of the industrial device into the industrial environment based on the created simulation environment.

In some embodiments, creating the simulation environment comprises identifying an image portion corresponding to the industrial device in the obtained image, and modifying the image by replacing the image portion with a visual representation of the simulation model for the industrial device.

In some embodiments, replacing the image portion comprises determining a position of the image portion in the image, removing the image portion from the image, and placing the visual representation of the simulation model for the industrial device in the determined position in the image.

In some embodiments, simulating the deployment of the industrial device into the industrial environment comprises simulating a position, a volume, an operation and/or a movement of the industrial device in the industrial environment using the simulation environment, and determining an impact of the simulated deployment of the industrial device on the industrial environment based on the simulated position, the simulated volume, the simulated operation and/or the simulated movement.

In some embodiments, the method further comprises in response to determining that the simulated deployment of the industrial device has an adverse impact on the industrial environment, adjusting the simulated deployment of the industrial device into the industrial environment.

In some embodiments, adjusting the simulated deployment of the industrial device into the industrial environment comprises modifying the simulated position, the simulated volume, the simulated operation and/or the simulated movement of the industrial device in the industrial environment.

In some embodiments, determining the impact comprises determining a collision between the industrial device and an apparatus in the industrial environment.

In some embodiments, the industrial device comprises a robot.

In a second aspect, the embodiments of the present disclosure provide a device for industrial simulation. The device comprises at least one processor and at least one memory including computer program instructions. The at least one memory and the computer program instructions are configured, with the processor, to cause the device to obtain an image of an industrial environment in which an industrial device is to be deployed. The at least one memory and the computer program instructions are also configured, with the processor, to cause the device to create a simulation environment based on the obtained image and a simulation model for the industrial device. The at least one memory and the computer program instructions are further configured, with the processor, to simulate a deployment of the industrial device into the industrial environment based on the created simulation environment.

In some embodiments, the at least one memory and the computer program instructions are further configured, with the processor, to identify an image portion corresponding to the industrial device in the obtained image, and modify the image by replacing the image portion with a visual representation of the simulation model for the industrial device.

In some embodiments, the at least one memory and the computer program instructions are further configured, with the processor, to cause the device to determine a position of the image portion in the image, remove the image portion from the image, and place the visual representation of the simulation model for the industrial device in the determined position in the image.

In some embodiments, the at least one memory and the computer program instructions are further configured, with the processor, to cause the device to simulate a position, a volume, an operation and/or a movement of the industrial device in the industrial environment using the simulation environment, and determine an impact of the simulated deployment of the industrial device on the industrial environment based on the simulated position, the simulated volume, the simulated operation and/or the simulated movement.

In some embodiments, the at least one memory and the computer program instructions are further configured, with the processor, to cause the device to, in response to determining that the simulated deployment of the industrial device has an adverse impact on the industrial environment, adjust the simulated deployment of the industrial device into the industrial environment.

In some embodiments, the at least one memory and the computer program instructions are further configured, with the processor, to cause the device to modify the simulated position, the simulated volume, the simulated operation and/or the simulated movement of the industrial device in the industrial environment.

In some embodiments, the at least one memory and the computer program instructions are further configured, with the processor, to cause the device to determine a collision between the industrial device and an apparatus in the industrial environment.

In some embodiments, the industrial device comprises a robot.

In a third aspect, the embodiments of the present disclosure provide a computer readable medium having instructions stored thereon, the instructions, when executed on at least one processor, cause the at least one processor to perform the method of the first aspect.

In a fourth aspect, the embodiments of the present disclosure provide a computer program product being tangibly stored on a computer readable storage medium and comprising instructions which, when executed on at least one processor, cause the at least one processor to perform the method of the first aspect.

BRIEF DESCRIPTION OF THE DRAWINGS

Through the following detailed descriptions with reference to the accompanying drawings, the above and other objectives, features and advantages of the embodiments disclosed herein will become more comprehensible. In the drawings, several embodiments disclosed herein will be illustrated in an example and in a non-limiting manner, wherein:

Fig. 1 illustrates a schematic diagram of an industrial simulation system in which the embodiments of the present disclosure may be implemented.

Fig. 2 illustrates a flowchart of a method for industrial simulation in accordance with the embodiments of the present disclosure.

Fig. 3 illustrates schematic diagram of an example image of an example industrial environment in which an industrial device is to be deployed in accordance with the embodiments of the present disclosure.

Fig. 4 illustrates an example simulation environment in accordance with the embodiments of the present disclosure.

Fig. 5 illustrates an example simulation based on the example simulation environment in accordance with the embodiments of the present disclosure.

Fig. 6 illustrates a block diagram of a device that can be used to implement the embodiments of the present disclosure.

Throughout the drawings, the same or corresponding reference symbols refer to the same or corresponding parts.

DETAILED DESCRIPTION

The subject matter described herein will now be discussed with reference to several embodiments. These embodiments are discussed only for the purpose of enabling those skilled persons in the art to better understand and thus implement the subject matter described herein, rather than suggesting any limitations on the scope of the subject matter.

The term “comprises” or “includes” and its variants are to be read as open terms that mean “includes, but is not limited to. ” The term “or” is to be read as “and/or” unless the context clearly indicates otherwise. The term “based on” is to be read as “based at least in part on. ” The term “being operable to” is to mean a function, an action, a motion or a state can be achieved by an operation induced by a user or an external mechanism. The term “one embodiment” and “an embodiment” are to be read as “at least one embodiment. ” The term “another embodiment” is to be read as “at least one other embodiment. ”

Unless specified or limited otherwise, the terms “mounted, ” “connected, ” “supported, ” and “coupled” and variations thereof are used broadly and encompass direct and indirect mountings, connections, supports, and couplings. Furthermore, “connected” and “coupled” are not restricted to physical or mechanical connections or couplings. In the description below, like reference numerals and labels are used to describe the same, similar or corresponding parts in the Figures. Other definitions, explicit and implicit, may be included below.

As mentioned above, in known industrial simulation solutions, construction of simulation environment is always a heavy duty when trying to simulate an industry environment. Further, when performing an industrial simulation, it is difficult to simulate impacts on other parts, such as other apparatuses, in the industrial environment. In order to at least in part solve the above or other potential problems, embodiments of the present disclosure provide an improved industrial simulation. Now some embodiments of the present disclosure will be discussed with reference to the figures.

Fig. 1 illustrates a schematic diagram of an industrial simulation system 100 in which the embodiments of the present disclosure may be implemented. As shown in Fig. 1, the industrial simulation system 100 comprises a computer 110, an image capture device 120, and an industrial database 130. The image capture device 120 and the industrial database 130 are communicatively coupled or connected to the computer 110.

The image capture device 120 may be used to capture an image of an industrial environment and then send the captured image to the computer 110. Examples of the image capture device 120 include, but are not limited to, a camera, a digital camera, a video camera, a mobile phone with image capture capability, a tablet with image capture capability, and so on. As will be discussed later, the computer 110 may perform an industrial simulation based on the received image of the industrial environment.

In the image of the industrial environment, there may be various industrial devices, such as robots, conveyers, objects, or the like. The computer 110 may perform the industrial simulation based on the image according to one or more simulation models for these industrial devices. Such simulation models for a variety of industrial devices may be stored in the industrial database 130. In operation, these models can be retrieved from the industrial database 130 by the computer 110.

It is to be appreciated that Fig. 1 only shows components related to the present disclosure, and that the embodiments of the present disclosure are not limited thereto. Further, although Fig. 1 shows that the image capture device 120 and the industrial database 130 are external to the computer 110, this is merely for illustration without suggesting any limitations as to the scope of the present disclosure. In other embodiments, for example, the camera 120 and the industrial database 130 may be located within the computer 110.

Fig. 2 illustrates a flowchart of a method 200 for industrial simulation in accordance with the embodiments of the present disclosure. In some embodiments, the method 200 can be implemented in the computer 110 in the industrial simulation system 100 as shown in Fig. 1. In some other embodiments, the method 200 can also be implemented in other components or in more than one component in the industrial simulation system 100.

At block 210, the computer 110 obtains an image of an industrial environment in which an industrial device is to be deployed. As mentioned, the computer 110 may receive the image from the image capture device 120. The captured image can be of any suitable form and transmitted with any suitable communication channels.

In practice, it is common that various industrial devices are to be deployed in a particular industrial environment to build a production line. As a result, the image may include image portions corresponding to industrial devices (for example, robots, objects and conveyers) and other apparatuses existing in the industrial environment. Fig. 3 illustrates schematic diagram of an example image 310 of an example industrial environment 300 in which an industrial device is to be deployed in accordance with the embodiments of the present disclosure.

As shown in Fig. 3, in this example, the industrial environment 300 comprises a conveyer 320, on which there are objects 330-1 to 330-5 collectively referred to as object (s) 330. In some embodiments, the objects 330 may move with the conveyer 320 at a constant speed. The industrial environment 300 also comprises robots 340-1 to 340-6, collectively referred to as robot (s) 340. The robots 340 may perform an operation on the objects 330. For example, the operation may include but not limited to machining, picking, placing or the like.

In the following, the robot 340-4 will be taken as an example of the industrial device for simplicity. Thus, in the description below, the term “robot 340-4” may be used interchangeably with the term “industrial device. ” However, it is to be understood that the industrial device may be other robots and other devices, such as the conveyer 320 and the objects 330. The embodiments of the present disclosure are not limited thereto.

As shown in Fig. 3, the industrial environment 300 further comprises an apparatus 350, which may be any apparatus that may exist in the industrial environment 300. For example, the apparatus 350 may be equipment other than a robot or a conveyer in the production line. However, in some other embodiments, the apparatus 350 may be a further robot or a further conveyer in addition to the robots 340 and the conveyer 320.

Referring back to Fig. 2, at block 220, the computer 110 creates a simulation environment based on the obtained image 310 and a simulation model for the industrial device. In some embodiments, in order to perform simulation on the industrial device (such as the robot 340-4) , the computer 110 may first identify an image portion corresponding to the industrial device in the obtained image 310. For example, the computer 110 may employ various image recognition technologies, either known or to be developed in the future, to identify the image portion corresponding to the industrial device.

After the recognition of the image portion corresponding to the industrial device, the computer 110 may modify the image 310 by replacing the image portion corresponding to the industrial device with a visual representation of the simulation model for the industrial device. As discussed above, the simulation model for the industrial device may be obtained from the industrial database 130, for example.

In order to replace the image portion corresponding to the industrial device, the computer 110 may determine a position of the image portion in the image 310, which represents the position of the industrial device in the industrial environment 300. In some embodiments, for example, the computer 110 may employ simultaneous localization and mapping (SLAM) technology to determine the position. As known, SLAM is a computational problem of constructing or updating a map of an unknown environment while simultaneously keeping track of a location of an object within the environment. With the SLAM algorithms, the position of the image portion corresponding to the industrial device in the image 310 as well as positions of other devices in the industrial environment 300 may be determined more efficiently, robustly and accurately.

Based on the determined position of the image portion corresponding to the industrial device in the image 310, the computer 110 may remove the image portion corresponding to the industrial device from the image 310 and then place the visual representation of the simulation model for the industrial device in the determined position in the image 310. In this way, the computer 110 can perform simulation with the simulation model for the industrial device in the created simulation environment.

Alternatively, other than replacing the image portion corresponding to the industrial device with the visual representation of the simulation model for the industrial device, in some embodiments, the computer 110 may modify the image 310 by merely covering the image portion corresponding to the industrial device by the visual representation of the simulation model for the industrial device. This covering approach might be simpler than the replacement, since the removing operation may be omitted.

In the covering or replacing process, the computer 110 may employ the augmented reality (AR) technologies. AR is a direct or indirect live view of a physical, real-world environment whose elements are “augmented” by computer-generated perceptual information, ideally across multiple sensory modalities, including visual, auditory, haptic, somatosensory, and olfactory.

With the AR technologies, the overlaid sensory information can be constructive (i.e. additive to the natural environment) or destructive (i.e. masking of the natural environment) and is spatial registered with the physical world such that it is perceived as an immersive aspect of the real environment. In this way, augmented reality alters perception of a real world environment, whereas virtual reality replaces the real world environment with a simulated one.

By means of the augmented reality, components of the digital world can be involved into a perception of the real world. Moreover, this is not done through a simple display of data, but through the integration of immersive sensations that are perceived as natural parts of an environment. Therefore, augmented reality may be used to enhance the natural environments or situations and offer perceptually enriched experiences. As a result, the information about the industrial environment becomes interactive and digitally operable.

Fig. 4 illustrates an example simulation environment 410 in accordance with the embodiments of the present disclosure. As shown in Fig. 4, the simulation environment 410 comprises the simulated conveyer 420 which replaces the image portion corresponding to the conveyer 320 in the image 310. The simulation environment 410 also comprises the simulated objects 430 which replace the image portions corresponding to the objects 330 in the image 310. The simulation environment 410 further comprises the simulated robots 440-1 to 440-4 which replace the image portions corresponding to the robots 340-1 to 340-4 in the image 310.

It is noted that the image portions corresponding to robots 340-5 and 340-6 are not replaced and remain unchanged, according to the practical simulation requirement, for example. In other embodiments, all the image portions corresponding to the robots 340 may be replaced by the visual representations of their simulation models. Additionally, it is noted that the image portion corresponding to the apparatus 350 in the image 310 remains unchanged in the simulation environment 410. As discussed above, this unchanged image portion corresponding to apparatus 350 allows the computer 110 to determine an impact on the apparatus 350 in the simulation.

Referring back to Fig. 2, at block 230, the computer 110 simulates a deployment of the industrial device into the industrial environment 300 based on the created simulation environment 410. In particular, since the image portions corresponding to the real industrial devices are replaced by the visual representations of their simulation models, the computer 110 may simulate a position, a volume, an operation and/or a movement of the industrial device (such as the robot 340-4) in the industrial environment 300 using the simulation environment 410.

Fig. 5 illustrates an example simulation 500 based on the example simulation environment 410 in accordance with the embodiments of the present disclosure. As shown in Fig. 5, a movement of the industrial device, such as the robot 340-4, in the industrial environment 300 may be simulated by moving 510 the simulated robot 440-4 in the simulation environment 410. In addition, the simulated conveyer 420 is changed to another simulated conveyer 420’ which has a longer length.

It should be understood that although the movement 510 of the simulated robot 440-4 and the change of the simulated conveyer 420 are taken as an example of the simulation of a deployment of an industrial device into the industrial environment 300, the embodiments of the present disclosure are not limited thereto. Instead, the simulation includes but not limited to position simulation, volume simulation, shape simulation, operation simulation, movement simulation, or the like.

In the simulation, the computer 110 may determine an impact of the simulated deployment of the industrial device, such as the robot 340-4, on the industrial environment 300 based on the simulated position, the simulated volume, the simulated operation and/or the simulated movement. For example, as shown in Fig. 5, the computer 110 may determine the impact of the simulated deployment of the robot 340-4 on the industrial environment 300 based on the simulated movement 510.

In some embodiments, the computer 110 may determine that the simulated deployment of the industrial device, such as the robot 340-4, has an adverse impact on the industrial environment 300. For example, as shown in Fig. 5, through the simulated movement 510 of the simulated robot 440-4, the computer 110 may determine a collision 520 between the robot 340-4 and an apparatus 350 in the industrial environment 300. In this way, the computer 110 can know what effect the modification (in this example, the movement 510) would make to the real industrial environment 300.

As another example, when the computer 110 adds a new simulated robot (not shown in Fig. 5) to the industrial environment 300, it may also has a collision with other existing apparatus or devices in the industrial environment 300. In such a case, the computer 110 can immediately notice that, and thus a risk of making a simulation system which cannot be applied to a field industrial environment can be reduced.

In case the computer 110 determines that the simulated deployment of the industrial device, such as the robot 340-4, has an adverse impact on the industrial environment 300, the computer 110 may adjust the simulated deployment of the industrial device into the industrial environment 300, so as to eliminate the adverse impact. In the adjustment, the computer 110 may modify the simulated position, the simulated volume, the simulated operation and/or the simulated movement of the industrial device in the industrial environment 300. For example, in the embodiment shown in Fig. 5, the simulated movement 510 may be modified by the computer 110 to avoid the collision 520. Alternatively or additionally, other simulated parameters, such as the simulated volume, of the simulated robot 440-4 may be modified.

With the method and apparatus for industrial simulation in accordance with the embodiments of the present disclosure, the industrial simulation can be automatically setup by simply exploring the industrial environment, which can reduce the effort to build a simulation system. In some embodiments, by using AR technology in the industrial simulation, a user can observe the industrial environment when performing the industrial simulation, and thus the user can know an impact on the industrial environment from the industrial simulation. Thus, the user can do some modifications before the industrial simulation is applied to a real industrial production line.

In addition, the embodiments of the present disclosure may build up an automatic simulation environment system based on image recognition and SLAM technology, and may provide a field simulation system which can simulate industrial devices (such as, robots) in the live video of field environment based on augmented reality technology.

Fig. 6 illustrates a block diagram of a device 600 that can be used to implement the embodiments of the present disclosure. As shown in Fig. 6, the device 600 comprises a Central Processing Unit (CPU) 601 which can perform various appropriate actions and processing based on computer program instructions stored in a Read Only Memory (ROM) 602 or computer program instructions uploaded from storage unit 608 to a Random Access Memory (RAM) 603. In the RAM 603, there further stores various programs and data needed by operation of the device 600. The CPU 601, ROM 602 and RAM 603 are connected one another via a bus 604. An input/output (I/O) interface 605 can also be connected to the bus 604.

A plurality of components in the device 600 are connected to the I/O interface 605, including an input unit 606, such as a keyboard, a mouse, and the like; an output unit 607, such as display of various types and loudspeakers; a storage unit 608, such as a magnetic disk and an optical disk; a communication unit 609, such as a network card, a modem, a wireless communication transceiver and so on. The communication unit 609 allows the device 600 to exchange information/data with other devices via computer networks, such as Internet, and/or various telecommunication networks.

The processes and processing described above, the method 200 for instance, can be performed by the CPU 601. For example, in some embodiments, the method 200 can be implemented as a computer software program which is corporeally contained in a machine readable medium, such as a storage unit 608. In some embodiments, the computer program can be partly or wholly loaded and/or mounted on the device 600 by the ROM 602 and/or the communication unit 609. When the computer program is uploaded to the RAM 603 and executed by the CPU 601, one or more steps of method 200 described above can be executed.

The present disclosure also provides at least one computer program product tangibly stored on a non-transitory computer readable storage medium. The computer program product comprises computer-executable instructions, such as those included in program modules, being executed in a device on a target real or virtual processor, to carry out the process or method 200 as described above with reference to Fig. 2.

Generally, program modules include routines, programs, libraries, objects, classes, components, data structures, or the like that perform particular tasks or implement particular abstract data types. The functionality of the program modules may be combined or split between program modules as desired in various embodiments. Machine-executable instructions for program modules may be executed within a local or distributed device. In a distributed device, program modules may be located in both local and remote storage media.

Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowcharts and/or block diagrams to be implemented. The program code may execute entirely on a machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.

The above program code may be embodied on a machine readable medium, which may be any tangible medium that may contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine readable medium may be a machine readable signal medium or a machine readable storage medium. A machine readable medium may include but not limited to an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing.

More specific examples of the machine readable storage medium would include an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM) , a read-only memory (ROM) , an erasable programmable read-only memory (EPROM or Flash memory) , an optical fiber, a portable compact disc read-only memory (CD-ROM) , an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In certain circumstances, multitasking and parallel processing may be advantageous.

Likewise, while several specific implementation details are contained in the above discussions, these should not be construed as limitations on the scope of the present disclosure, but rather as descriptions of features that may be specific to particular embodiments. Certain features that are described in the context of separate embodiments may also be implemented in combination in a single embodiment. On the other hand, various features that are described in the context of a single embodiment may also be implemented in multiple embodiments separately or in any suitable sub-combination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

Claims

A method for industrial simulation, comprising:

obtaining an image of an industrial environment in which an industrial device is to be deployed;

creating a simulation environment based on the obtained image and a simulation model for the industrial device; and

simulating a deployment of the industrial device into the industrial environment based on the created simulation environment.
The method of claim 1, wherein creating the simulation environment comprises:

identifying an image portion corresponding to the industrial device in the obtained image; and

modifying the image by replacing the image portion with a visual representation of the simulation model for the industrial device.
The method of claim 2, wherein replacing the image portion comprises:

determining a position of the image portion in the image;

removing the image portion from the image; and

placing the visual representation of the simulation model for the industrial device in the determined position in the image.
The method of claim 1, wherein simulating the deployment of the industrial device into the industrial environment comprises:

simulating a position, a volume, an operation and/or a movement of the industrial device in the industrial environment using the simulation environment; and

determining an impact of the simulated deployment of the industrial device on the industrial environment based on the simulated position, the simulated volume, the simulated operation and/or the simulated movement.
The method of claim 4, further comprising:

in response to determining that the simulated deployment of the industrial device has an adverse impact on the industrial environment, adjusting the simulated deployment of the industrial device into the industrial environment.
The method of claim 5, wherein adjusting the simulated deployment of the industrial device into the industrial environment comprises:

modifying the simulated position, the simulated volume, the simulated operation and/or the simulated movement of the industrial device in the industrial environment.
The method of claim 4, wherein determining the impact comprises:

determining a collision between the industrial device and an apparatus in the industrial environment.
The method of claim 1, wherein the industrial device comprises a robot.
A device for industrial simulation, comprising:

at least one processor, and

at least one memory including computer program instructions, the at least one memory and the computer program instructions configured, with the processor, to cause the device to:

obtain an image of an industrial environment in which an industrial device is to be deployed;

create a simulation environment based on the obtained image and a simulation model for the industrial device; and

simulate a deployment of the industrial device into the industrial environment based on the created simulation environment.
The device of claim 9, wherein the at least one memory and the computer program instructions are further configured, with the processor, to cause the device to:

identify an image portion corresponding to the industrial device in the obtained image; and

modify the image by replacing the image portion with a visual representation of the simulation model for the industrial device.
The device of claim 10, wherein the at least one memory and the computer program instructions are further configured, with the processor, to cause the device to:

determine a position of the image portion in the image;

remove the image portion from the image; and

place the visual representation of the simulation model for the industrial device in the determined position in the image.
The device of claim 9, wherein the at least one memory and the computer program instructions are further configured, with the processor, to cause the device to:

simulate a position, a volume, an operation and/or a movement of the industrial device in the industrial environment using the simulation environment; and

determine an impact of the simulated deployment of the industrial device on the industrial environment based on the simulated position, the simulated volume, the simulated operation and/or the simulated movement.
The device of claim 12, wherein the at least one memory and the computer program instructions are further configured, with the processor, to cause the device to:

in response to determining that the simulated deployment of the industrial device has an adverse impact on the industrial environment, adjust the simulated deployment of the industrial device into the industrial environment.
The device of claim 13, wherein the at least one memory and the computer program instructions are further configured, with the processor, to cause the device to:

modify the simulated position, the simulated volume, the simulated operation and/or the simulated movement of the industrial device in the industrial environment.
The device of claim 12, wherein the at least one memory and the computer program instructions are further configured, with the processor, to cause the device to:

determine a collision between the industrial device and an apparatus in the industrial environment.
The device of claim 9, wherein the industrial device comprises a robot.
A computer readable medium having instructions stored thereon, the instructions, when executed on at least one processor, cause the at least one processor to perform the method according to any of claims 1 to 8.
A computer program product being tangibly stored on a computer readable storage medium and comprising instructions which, when executed on at least one processor, cause the at least one processor to perform the method according to any of claims 1 to 8.